2024-09-13T23:14:31.459 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T23:14:31.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:14:31.603 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904423' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 rgw: ec-data-pool: false frontend: beast selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 3476 sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi043.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGCt7grJeRb7R3UlruDExlDi5SDMGrL85waKSPLsV8hBZN0dWKDtmunSNRtAuexbNPVHdtkqpLbbzc75rX4WIkE= smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTpkfMkT1oO+4QSjcx5RevMEcXNQGk+WOp5yiZApqAQKk/PuLfajqkJaVWlcmRQCXYX58gpqI5N53ZARUYuu80= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T23:14:31.603 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T23:14:31.604 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T23:14:31.604 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T23:14:31.606 INFO:teuthology.task.internal:Checking packages... 2024-09-13T23:14:31.626 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ecab7be58963a5bd03910cd73eef66405d7fdd50' 2024-09-13T23:14:31.627 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T23:14:31.627 INFO:teuthology.packaging:ref: None 2024-09-13T23:14:31.627 INFO:teuthology.packaging:tag: None 2024-09-13T23:14:31.627 INFO:teuthology.packaging:branch: squid 2024-09-13T23:14:31.627 INFO:teuthology.packaging:sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:14:31.627 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T23:14:31.834 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-324.gecab7be5 2024-09-13T23:14:31.835 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T23:14:31.842 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T23:14:31.842 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T23:14:31.882 INFO:teuthology.task.internal:Saving configuration 2024-09-13T23:14:31.897 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T23:14:31.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T23:14:31.950 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 23:09:42.221501', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGCt7grJeRb7R3UlruDExlDi5SDMGrL85waKSPLsV8hBZN0dWKDtmunSNRtAuexbNPVHdtkqpLbbzc75rX4WIkE='} 2024-09-13T23:14:31.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 23:09:42.222816', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTpkfMkT1oO+4QSjcx5RevMEcXNQGk+WOp5yiZApqAQKk/PuLfajqkJaVWlcmRQCXYX58gpqI5N53ZARUYuu80='} 2024-09-13T23:14:31.981 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T23:14:31.987 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T23:14:31.987 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T23:14:31.988 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T23:14:32.098 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2175243ac0>, signals=[15]) 2024-09-13T23:14:32.098 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T23:14:32.103 INFO:teuthology.task.internal:Opening connections... 2024-09-13T23:14:32.104 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi043.front.sepia.ceph.com 2024-09-13T23:14:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:14:32.192 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:14:32.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:14:32.278 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T23:14:32.284 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2024-09-13T23:14:32.302 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2024-09-13T23:14:32.303 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2024-09-13T23:14:32.361 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2024-09-13T23:14:32.361 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2024-09-13T23:14:32.361 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2024-09-13T23:14:32.361 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T23:14:32.362 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T23:14:32.363 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2024-09-13T23:14:32.402 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-13T23:14:32.420 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-13T23:14:32.421 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-13T23:14:32.478 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-13T23:14:32.478 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-13T23:14:32.478 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-13T23:14:32.478 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T23:14:32.479 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T23:14:32.480 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-13T23:14:32.510 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T23:14:32.519 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T23:14:32.540 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T23:14:32.541 DEBUG:teuthology.orchestra.run.smithi043:> test '!' -e /home/ubuntu/cephtest 2024-09-13T23:14:32.543 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-13T23:14:32.559 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T23:14:32.564 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T23:14:32.564 DEBUG:teuthology.orchestra.run.smithi043:> test -z $(ls -A /var/lib/ceph) 2024-09-13T23:14:32.600 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-13T23:14:32.626 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T23:14:32.692 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T23:14:32.707 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T23:14:32.707 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T23:14:32.708 DEBUG:teuthology.orchestra.run.smithi043:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T23:14:32.708 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T23:14:32.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:14:32.724 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-13T23:14:32.725 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:14:32.726 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-13T23:14:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-503.el9.x86_64 2024-09-13T23:14:32.781 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-503.el9.x86_64 2024-09-13T23:14:32.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-09-13T23:14:32.784 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-503.el9.x86_64 2024-09-13T23:14:32.784 INFO:teuthology.task.kernel:Running kernel on smithi043: 5.14.0-503.el9.x86_64 2024-09-13T23:14:32.784 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum install -y kernel 2024-09-13T23:14:35.120 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T23:14:36.228 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-13T23:14:38.129 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-13T23:14:45.454 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-13T23:14:46.819 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 20 MB 00:10 2024-09-13T23:14:46.888 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-13T23:14:47.701 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-13T23:14:51.011 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-13T23:14:52.944 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 19 kB 00:00 2024-09-13T23:14:53.339 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T23:14:53.708 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-13T23:14:55.379 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T23:14:55.380 INFO:teuthology.orchestra.run.smithi043.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T23:14:55.478 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:14:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:14:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-13T23:14:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:14:55.482 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:14:55.482 INFO:teuthology.orchestra.run.smithi043.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-09-13T23:14:55.483 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:14:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 79 M 2024-09-13T23:14:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 126 M 2024-09-13T23:14:55.484 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:14:55.647 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 163 kB/s | 23 kB 00:00 2024-09-13T23:14:56.641 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-09-13T23:14:56.983 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 23 MB/s | 35 MB 00:01 2024-09-13T23:14:57.650 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-13T23:14:57.650 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:14:57.651 INFO:teuthology.orchestra.run.smithi043.stdout:Total 36 MB/s | 79 MB 00:02 2024-09-13T23:14:58.364 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:14:58.731 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:14:58.731 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:14:59.204 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-09-13T23:14:59.729 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:14:59.730 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:15:01.253 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T23:15:01.253 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T23:15:01.346 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T23:15:01.352 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:15:01.353 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 79 M 2024-09-13T23:15:01.354 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 126 M 2024-09-13T23:15:01.354 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:15:01.561 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 226 kB/s | 23 kB 00:00 2024-09-13T23:15:02.197 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-13T23:15:02.309 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:15:02.722 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-13T23:15:02.973 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-13T23:15:02.973 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:15:02.973 INFO:teuthology.orchestra.run.smithi099.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-13T23:15:02.978 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T23:15:03.061 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:03.653 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:15:04.009 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:15:04.009 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:15:04.938 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:15:04.938 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:15:05.867 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:05.988 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:15:08.032 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T23:15:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:10.928 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:11.055 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:11.116 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:11.155 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:15.894 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:16.021 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:16.289 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:20.862 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:55.604 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:55.644 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:56.146 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:56.146 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T23:15:56.146 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:56.146 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:56.989 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:15:56.990 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:15:57.346 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T23:15:57.441 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T23:15:57.443 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T23:15:57.443 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T23:15:57.443 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T23:15:57.443 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T23:15:57.443 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T23:15:57.443 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi043.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T23:15:57.443 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T23:15:57.504 INFO:teuthology.orchestra.run.smithi043.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T23:15:57.504 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T23:15:57.504 DEBUG:teuthology.orchestra.run.smithi043:> sudo rpm -qi grub2-tools 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Name : grub2-tools 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Epoch : 1 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Version : 2.06 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Release : 82.el9 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Architecture: x86_64 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Group : Unspecified 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:Size : 8274670 2024-09-13T23:15:57.536 INFO:teuthology.orchestra.run.smithi043.stdout:License : GPLv3+ 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Packager : builder@centos.org 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Vendor : CentOS 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Summary : Support tools for GRUB. 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:Description : 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:15:57.537 INFO:teuthology.orchestra.run.smithi043.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T23:15:57.538 INFO:teuthology.orchestra.run.smithi043.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T23:15:57.538 INFO:teuthology.orchestra.run.smithi043.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T23:15:57.538 INFO:teuthology.orchestra.run.smithi043.stdout:hardware devices. 2024-09-13T23:15:57.538 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:15:57.538 INFO:teuthology.orchestra.run.smithi043.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T23:15:57.539 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T23:15:57.539 INFO:teuthology.task.kernel:Updating grub on smithi043 to boot 5.14.0-505.el9.x86_64 2024-09-13T23:15:57.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T23:15:58.239 INFO:teuthology.orchestra.run.smithi043.stderr:Generating grub configuration file ... 2024-09-13T23:15:59.095 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:59.135 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:59.461 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:15:59.461 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T23:15:59.461 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T23:15:59.461 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T23:15:59.550 INFO:teuthology.orchestra.run.smithi043.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T23:15:59.577 INFO:teuthology.orchestra.run.smithi043.stderr:done 2024-09-13T23:15:59.580 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-13T23:15:59.595 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.NMOrFuNXAI 2024-09-13T23:15:59.596 DEBUG:teuthology.orchestra.run.smithi043:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NMOrFuNXAI 2024-09-13T23:15:59.662 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.NMOrFuNXAI 2024-09-13T23:15:59.806 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.NMOrFuNXAI is 6KB 2024-09-13T23:15:59.855 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.NMOrFuNXAI 2024-09-13T23:15:59.869 DEBUG:teuthology.orchestra.run.smithi043:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T23:15:59.932 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T23:15:59.932 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T23:15:59.932 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T23:15:59.932 INFO:teuthology.orchestra.run.smithi043.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T23:15:59.934 DEBUG:teuthology.orchestra.run.smithi043:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.096 DEBUG:teuthology.orchestra.run.smithi043:> sudo shutdown -r now 2024-09-13T23:16:00.292 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T23:16:00.292 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:16:00.293 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:16:00.643 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T23:16:00.788 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.789 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T23:16:00.789 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T23:16:00.789 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T23:16:00.789 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T23:16:00.789 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T23:16:00.789 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T23:16:00.789 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T23:16:00.848 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T23:16:00.848 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T23:16:00.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-09-13T23:16:00.880 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 82.el9 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8274670 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T23:16:00.881 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-09-13T23:16:00.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:16:00.883 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T23:16:00.883 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T23:16:00.884 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-505.el9.x86_64 2024-09-13T23:16:00.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T23:16:01.538 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-13T23:16:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T23:16:02.911 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-13T23:16:02.913 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-13T23:16:02.929 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.p5YLtC7Meo 2024-09-13T23:16:02.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.p5YLtC7Meo 2024-09-13T23:16:02.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.p5YLtC7Meo 2024-09-13T23:16:03.138 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.p5YLtC7Meo is 6KB 2024-09-13T23:16:03.186 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.p5YLtC7Meo 2024-09-13T23:16:03.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T23:16:03.268 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T23:16:03.269 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T23:16:03.269 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T23:16:03.269 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T23:16:03.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T23:16:03.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-13T23:16:30.125 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T23:16:30.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:16:30.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:16:33.450 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T23:16:33.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:16:33.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:16:48.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.43 2024-09-13T23:16:51.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-13T23:16:57.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:16:57.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:17:00.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:17:00.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:17:03.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-13T23:17:15.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:17:15.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:17:48.234 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-13T23:17:48.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:17:48.602 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-13T23:17:48.602 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-13T23:17:48.617 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-505.el9.x86_64 2024-09-13T23:17:48.617 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T23:17:48.617 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T23:17:48.618 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T23:17:49.618 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T23:17:49.619 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T23:17:49.692 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-13T23:17:49.711 DEBUG:teuthology.parallel:result is None 2024-09-13T23:17:57.590 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T23:18:09.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:18:09.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:18:10.030 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-13T23:18:10.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:18:10.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T23:18:10.417 DEBUG:teuthology.orchestra.run.smithi043:> uname -r 2024-09-13T23:18:10.434 INFO:teuthology.orchestra.run.smithi043.stdout:5.14.0-505.el9.x86_64 2024-09-13T23:18:10.434 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T23:18:10.434 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T23:18:10.434 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T23:18:11.436 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T23:18:11.436 DEBUG:teuthology.orchestra.run.smithi043:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T23:18:11.508 INFO:teuthology.orchestra.run.smithi043.stdout:ttyS1 2024-09-13T23:18:11.531 DEBUG:teuthology.parallel:result is None 2024-09-13T23:18:11.532 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T23:18:11.539 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T23:18:11.539 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T23:18:11.542 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T23:18:11.561 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T23:18:11.572 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T23:18:11.614 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T23:18:11.614 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T23:18:11.617 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T23:18:11.735 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T23:18:11.741 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T23:18:11.741 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T23:18:11.744 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T23:18:11.778 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:18:11.779 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:18:11.789 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:18:11.791 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T23:18:11.793 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T23:18:11.799 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T23:18:11.799 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T23:18:11.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T23:18:11.867 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T23:18:11.876 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T23:18:11.877 DEBUG:teuthology.orchestra.run.smithi043:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T23:18:11.909 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T23:18:11.927 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:18:12.019 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:18:12.059 DEBUG:teuthology.orchestra.run.smithi043:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:18:12.152 DEBUG:teuthology.orchestra.run.smithi043:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:18:12.189 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:18:12.189 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T23:18:12.258 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:18:12.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T23:18:12.358 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:18:12.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T23:18:12.486 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:18:12.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T23:18:12.552 DEBUG:teuthology.orchestra.run.smithi043:> sudo service rsyslog restart 2024-09-13T23:18:12.555 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-13T23:18:12.602 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:18:12.637 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:18:13.131 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T23:18:13.138 INFO:teuthology.task.internal:Starting timer... 2024-09-13T23:18:13.138 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T23:18:13.178 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T23:18:13.217 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T23:18:13.217 DEBUG:teuthology.orchestra.run.smithi043:> sudo service auditd rotate 2024-09-13T23:18:13.259 INFO:teuthology.orchestra.run.smithi043.stdout:Rotating logs: 2024-09-13T23:18:13.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-13T23:18:13.325 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-13T23:18:13.327 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T23:18:13.327 DEBUG:teuthology.orchestra.run.smithi043:> /usr/sbin/getenforce 2024-09-13T23:18:13.352 INFO:teuthology.orchestra.run.smithi043.stdout:Permissive 2024-09-13T23:18:13.352 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-13T23:18:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-13T23:18:13.379 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi043.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi099.front.sepia.ceph.com': 'permissive'} 2024-09-13T23:18:13.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:18:13.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:18:13.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:18:13.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:18:13.453 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T23:18:13.453 DEBUG:teuthology.orchestra.run.smithi043:> sudo /usr/sbin/setenforce permissive 2024-09-13T23:18:13.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-13T23:18:13.533 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T23:18:13.543 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T23:18:13.555 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T23:18:13.557 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi043.front.sepia.ceph.com,smithi099.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T23:22:00.426 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi043.front.sepia.ceph.com'), Remote(name='ubuntu@smithi099.front.sepia.ceph.com')] 2024-09-13T23:22:00.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:22:00.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:22:00.515 DEBUG:teuthology.orchestra.run.smithi043:> true 2024-09-13T23:22:00.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2024-09-13T23:22:00.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:22:00.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T23:22:00.692 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-13T23:22:00.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-13T23:22:00.772 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T23:22:00.782 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T23:22:00.783 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:22:00.783 DEBUG:teuthology.orchestra.run.smithi043:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:22:00.786 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T23:22:00.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:22:00.814 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T23:22:00.829 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T23:22:00.840 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T23:22:00.854 INFO:teuthology.orchestra.run.smithi043.stderr:sudo: ntpd: command not found 2024-09-13T23:22:00.855 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T23:22:00.866 INFO:teuthology.orchestra.run.smithi043.stdout:506 Cannot talk to daemon 2024-09-13T23:22:00.880 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-13T23:22:00.880 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T23:22:00.891 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-13T23:22:00.895 INFO:teuthology.orchestra.run.smithi043.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T23:22:00.905 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T23:22:00.919 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T23:22:00.956 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:22:00.959 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:22:00.959 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-13T23:22:00.959 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.959 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.960 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.960 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.976 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.980 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:22:00.981 INFO:teuthology.run_tasks:Running task install... 2024-09-13T23:22:00.989 DEBUG:teuthology.task.install:project ceph 2024-09-13T23:22:00.989 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}} 2024-09-13T23:22:00.989 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'} 2024-09-13T23:22:00.989 INFO:teuthology.task.install:Using flavor: default 2024-09-13T23:22:00.994 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T23:22:00.995 INFO:teuthology.task.install:extra packages: [] 2024-09-13T23:22:00.995 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T23:22:00.996 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:22:00.998 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'tag': None, 'wait_for_package': False} 2024-09-13T23:22:00.998 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:22:01.149 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/ 2024-09-13T23:22:01.149 INFO:teuthology.task.install.rpm:Package version is 19.1.1-324.gecab7be5 2024-09-13T23:22:01.161 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/ 2024-09-13T23:22:01.161 INFO:teuthology.task.install.rpm:Package version is 19.1.1-324.gecab7be5 2024-09-13T23:22:01.273 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T23:22:01.274 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:22:01.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T23:22:01.280 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/ecab7be58963a5bd03910cd73eef66405d7fdd50/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T23:22:01.280 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:22:01.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T23:22:01.302 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T23:22:01.302 DEBUG:teuthology.orchestra.run.smithi043:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ecab7be58963a5bd03910cd73eef66405d7fdd50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T23:22:01.307 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T23:22:01.308 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ecab7be58963a5bd03910cd73eef66405d7fdd50/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T23:22:01.369 DEBUG:teuthology.orchestra.run.smithi043:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T23:22:01.374 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T23:22:01.445 DEBUG:teuthology.orchestra.run.smithi043:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T23:22:01.449 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T23:22:01.511 INFO:teuthology.orchestra.run.smithi043.stdout:check_obsoletes = 1 2024-09-13T23:22:01.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum clean all 2024-09-13T23:22:01.513 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-13T23:22:01.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-13T23:22:01.752 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-13T23:22:01.755 INFO:teuthology.orchestra.run.smithi043.stdout:45 files removed 2024-09-13T23:22:01.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw 2024-09-13T23:22:01.782 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-radosgw 2024-09-13T23:22:02.333 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-13T23:22:02.347 INFO:teuthology.orchestra.run.smithi043.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-13T23:22:02.601 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-13T23:22:02.631 INFO:teuthology.orchestra.run.smithi043.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-13T23:22:02.859 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-13T23:22:02.907 INFO:teuthology.orchestra.run.smithi043.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-13T23:22:03.890 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.2 MB 00:00 2024-09-13T23:22:05.716 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-13T23:22:06.050 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-13T23:22:11.451 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-13T23:22:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-13T23:22:13.726 INFO:teuthology.orchestra.run.smithi043.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-13T23:22:14.705 INFO:teuthology.orchestra.run.smithi043.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-13T23:22:16.476 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 6.5 MB 00:00 2024-09-13T23:22:18.119 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-13T23:22:19.323 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-13T23:22:20.345 INFO:teuthology.orchestra.run.smithi043.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-13T23:22:22.789 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 11 M 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrading: 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout: librados2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.4 M 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.2 M 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:22:22.804 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.4 M 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 21 M 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux x86_64 2:19.1.1-324.gecab7be5.el9 ceph 25 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 752 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 507 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T23:22:22.805 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.3 M 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 45 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 136 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs x86_64 2:19.1.1-324.gecab7be5.el9 ceph 162 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados x86_64 2:19.1.1-324.gecab7be5.el9 ceph 321 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 301 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 99 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T23:22:22.806 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:Installing weak dependencies: 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:Install 30 Packages 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout:Upgrade 2 Packages 2024-09-13T23:22:22.807 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:22.808 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 60 M 2024-09-13T23:22:22.808 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:22:24.454 INFO:teuthology.orchestra.run.smithi043.stdout:(1/32): ceph-base-19.1.1-324.gecab7be5.el9.x86_ 4.0 MB/s | 5.4 MB 00:01 2024-09-13T23:22:24.521 INFO:teuthology.orchestra.run.smithi043.stdout:(2/32): ceph-selinux-19.1.1-324.gecab7be5.el9.x 378 kB/s | 25 kB 00:00 2024-09-13T23:22:24.637 INFO:teuthology.orchestra.run.smithi043.stdout:(3/32): libcephfs2-19.1.1-324.gecab7be5.el9.x86 6.3 MB/s | 752 kB 00:00 2024-09-13T23:22:24.670 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-13T23:22:24.738 INFO:teuthology.orchestra.run.smithi043.stdout:(4/32): libradosstriper1-19.1.1-324.gecab7be5.e 5.0 MB/s | 507 kB 00:00 2024-09-13T23:22:24.988 INFO:teuthology.orchestra.run.smithi043.stdout:(5/32): ceph-radosgw-19.1.1-324.gecab7be5.el9.x 5.6 MB/s | 11 MB 00:01 2024-09-13T23:22:25.030 INFO:teuthology.orchestra.run.smithi043.stdout:(6/32): python3-ceph-argparse-19.1.1-324.gecab7 1.1 MB/s | 45 kB 00:00 2024-09-13T23:22:25.122 INFO:teuthology.orchestra.run.smithi043.stdout:(7/32): librgw2-19.1.1-324.gecab7be5.el9.x86_64 14 MB/s | 5.3 MB 00:00 2024-09-13T23:22:25.147 INFO:teuthology.orchestra.run.smithi043.stdout:(8/32): python3-ceph-common-19.1.1-324.gecab7be 1.1 MB/s | 136 kB 00:00 2024-09-13T23:22:25.173 INFO:teuthology.orchestra.run.smithi043.stdout:(9/32): python3-cephfs-19.1.1-324.gecab7be5.el9 3.2 MB/s | 162 kB 00:00 2024-09-13T23:22:25.206 INFO:teuthology.orchestra.run.smithi043.stdout:(10/32): python3-rados-19.1.1-324.gecab7be5.el9 5.4 MB/s | 321 kB 00:00 2024-09-13T23:22:25.231 INFO:teuthology.orchestra.run.smithi043.stdout:(11/32): python3-rbd-19.1.1-324.gecab7be5.el9.x 5.0 MB/s | 301 kB 00:00 2024-09-13T23:22:25.256 INFO:teuthology.orchestra.run.smithi043.stdout:(12/32): python3-rgw-19.1.1-324.gecab7be5.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-13T23:22:25.499 INFO:teuthology.orchestra.run.smithi043.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-13T23:22:25.524 INFO:teuthology.orchestra.run.smithi043.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 600 kB/s | 160 kB 00:00 2024-09-13T23:22:25.549 INFO:teuthology.orchestra.run.smithi043.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-13T23:22:25.633 INFO:teuthology.orchestra.run.smithi043.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-13T23:22:25.691 INFO:teuthology.orchestra.run.smithi043.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-13T23:22:25.717 INFO:teuthology.orchestra.run.smithi043.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 505 kB/s | 42 kB 00:00 2024-09-13T23:22:25.750 INFO:teuthology.orchestra.run.smithi043.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-13T23:22:25.784 INFO:teuthology.orchestra.run.smithi043.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 534 kB/s | 36 kB 00:00 2024-09-13T23:22:25.809 INFO:teuthology.orchestra.run.smithi043.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 806 kB/s | 47 kB 00:00 2024-09-13T23:22:25.860 INFO:teuthology.orchestra.run.smithi043.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-13T23:22:25.885 INFO:teuthology.orchestra.run.smithi043.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T23:22:25.910 INFO:teuthology.orchestra.run.smithi043.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T23:22:25.936 INFO:teuthology.orchestra.run.smithi043.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-13T23:22:25.994 INFO:teuthology.orchestra.run.smithi043.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-13T23:22:26.028 INFO:teuthology.orchestra.run.smithi043.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T23:22:26.270 INFO:teuthology.orchestra.run.smithi043.stdout:(28/32): ceph-common-19.1.1-324.gecab7be5.el9.x 6.7 MB/s | 21 MB 00:03 2024-09-13T23:22:26.320 INFO:teuthology.orchestra.run.smithi043.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-13T23:22:26.421 INFO:teuthology.orchestra.run.smithi043.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-09-13T23:22:26.779 INFO:teuthology.orchestra.run.smithi043.stdout:(31/32): librados2-19.1.1-324.gecab7be5.el9.x86 6.7 MB/s | 3.4 MB 00:00 2024-09-13T23:22:26.879 INFO:teuthology.orchestra.run.smithi043.stdout:(32/32): librbd1-19.1.1-324.gecab7be5.el9.x86_6 5.7 MB/s | 3.2 MB 00:00 2024-09-13T23:22:26.885 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:22:26.886 INFO:teuthology.orchestra.run.smithi043.stdout:Total 15 MB/s | 60 MB 00:04 2024-09-13T23:22:26.988 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:22:27.029 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:22:27.029 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:22:27.037 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 11 M 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.4 M 2024-09-13T23:22:27.046 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.2 M 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.4 M 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 21 M 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.1.1-324.gecab7be5.el9 ceph 25 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 752 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T23:22:27.047 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 507 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.1.1-324.gecab7be5.el9 ceph 5.3 M 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 45 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.1.1-324.gecab7be5.el9 ceph 136 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.1.1-324.gecab7be5.el9 ceph 162 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.1.1-324.gecab7be5.el9 ceph 321 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 301 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.1.1-324.gecab7be5.el9 ceph 99 k 2024-09-13T23:22:27.048 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout:Install 30 Packages 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2024-09-13T23:22:27.049 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:27.050 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 60 M 2024-09-13T23:22:27.050 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:22:27.716 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:22:27.716 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:22:27.829 INFO:teuthology.orchestra.run.smithi099.stdout:(1/32): ceph-base-19.1.1-324.gecab7be5.el9.x86_ 9.4 MB/s | 5.4 MB 00:00 2024-09-13T23:22:27.887 INFO:teuthology.orchestra.run.smithi099.stdout:(2/32): ceph-selinux-19.1.1-324.gecab7be5.el9.x 432 kB/s | 25 kB 00:00 2024-09-13T23:22:28.021 INFO:teuthology.orchestra.run.smithi099.stdout:(3/32): libcephfs2-19.1.1-324.gecab7be5.el9.x86 5.5 MB/s | 752 kB 00:00 2024-09-13T23:22:28.088 INFO:teuthology.orchestra.run.smithi099.stdout:(4/32): libradosstriper1-19.1.1-324.gecab7be5.e 7.5 MB/s | 507 kB 00:00 2024-09-13T23:22:28.280 INFO:teuthology.orchestra.run.smithi099.stdout:(5/32): ceph-radosgw-19.1.1-324.gecab7be5.el9.x 10 MB/s | 11 MB 00:01 2024-09-13T23:22:28.330 INFO:teuthology.orchestra.run.smithi099.stdout:(6/32): python3-ceph-argparse-19.1.1-324.gecab7 906 kB/s | 45 kB 00:00 2024-09-13T23:22:28.389 INFO:teuthology.orchestra.run.smithi099.stdout:(7/32): python3-ceph-common-19.1.1-324.gecab7be 2.3 MB/s | 136 kB 00:00 2024-09-13T23:22:28.456 INFO:teuthology.orchestra.run.smithi099.stdout:(8/32): python3-cephfs-19.1.1-324.gecab7be5.el9 2.4 MB/s | 162 kB 00:00 2024-09-13T23:22:28.548 INFO:teuthology.orchestra.run.smithi099.stdout:(9/32): librgw2-19.1.1-324.gecab7be5.el9.x86_64 12 MB/s | 5.3 MB 00:00 2024-09-13T23:22:28.573 INFO:teuthology.orchestra.run.smithi099.stdout:(10/32): python3-rados-19.1.1-324.gecab7be5.el9 2.7 MB/s | 321 kB 00:00 2024-09-13T23:22:28.599 INFO:teuthology.orchestra.run.smithi099.stdout:(11/32): python3-rbd-19.1.1-324.gecab7be5.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-13T23:22:28.624 INFO:teuthology.orchestra.run.smithi099.stdout:(12/32): python3-rgw-19.1.1-324.gecab7be5.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-13T23:22:28.841 INFO:teuthology.orchestra.run.smithi099.stdout:(13/32): ceph-common-19.1.1-324.gecab7be5.el9.x 13 MB/s | 21 MB 00:01 2024-09-13T23:22:28.924 INFO:teuthology.orchestra.run.smithi099.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-13T23:22:28.975 INFO:teuthology.orchestra.run.smithi099.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-09-13T23:22:29.000 INFO:teuthology.orchestra.run.smithi099.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 426 kB/s | 160 kB 00:00 2024-09-13T23:22:29.058 INFO:teuthology.orchestra.run.smithi099.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-13T23:22:29.092 INFO:teuthology.orchestra.run.smithi099.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-13T23:22:29.117 INFO:teuthology.orchestra.run.smithi099.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 360 kB/s | 42 kB 00:00 2024-09-13T23:22:29.143 INFO:teuthology.orchestra.run.smithi099.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-13T23:22:29.168 INFO:teuthology.orchestra.run.smithi099.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-09-13T23:22:29.193 INFO:teuthology.orchestra.run.smithi099.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-13T23:22:29.216 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:22:29.252 INFO:teuthology.orchestra.run.smithi099.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-13T23:22:29.277 INFO:teuthology.orchestra.run.smithi099.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-13T23:22:29.300 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T23:22:29.302 INFO:teuthology.orchestra.run.smithi099.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 273 kB/s | 26 kB 00:00 2024-09-13T23:22:29.327 INFO:teuthology.orchestra.run.smithi099.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T23:22:29.334 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T23:22:29.359 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T23:22:29.361 INFO:teuthology.orchestra.run.smithi099.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T23:22:29.382 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:22:29.403 INFO:teuthology.orchestra.run.smithi099.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-13T23:22:29.407 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:22:29.453 INFO:teuthology.orchestra.run.smithi099.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-13T23:22:29.545 INFO:teuthology.orchestra.run.smithi099.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-13T23:22:29.618 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:22:29.670 INFO:teuthology.orchestra.run.smithi099.stdout:(31/32): librbd1-19.1.1-324.gecab7be5.el9.x86_6 15 MB/s | 3.2 MB 00:00 2024-09-13T23:22:29.680 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:22:29.737 INFO:teuthology.orchestra.run.smithi099.stdout:(32/32): librados2-19.1.1-324.gecab7be5.el9.x86 10 MB/s | 3.4 MB 00:00 2024-09-13T23:22:29.742 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:22:29.742 INFO:teuthology.orchestra.run.smithi099.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-13T23:22:29.842 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:22:29.877 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:22:29.877 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:22:30.040 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T23:22:30.153 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:30.248 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:30.344 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 8/34 2024-09-13T23:22:30.371 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:22:30.425 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:22:30.454 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T23:22:30.498 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 11/34 2024-09-13T23:22:30.560 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:22:30.560 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:22:30.568 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:22:30.598 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:30.662 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:30.696 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T23:22:30.817 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T23:22:30.847 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T23:22:30.893 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T23:22:30.921 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T23:22:30.950 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T23:22:30.983 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T23:22:31.329 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T23:22:31.379 INFO:teuthology.orchestra.run.smithi043.stdout: Upgrading : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:22:31.470 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:22:31.501 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 23/34 2024-09-13T23:22:31.545 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T23:22:32.054 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T23:22:32.081 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:22:32.153 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:22:32.157 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:22:32.233 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 27/34 2024-09-13T23:22:32.242 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-13T23:22:32.258 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 28/34 2024-09-13T23:22:32.275 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-13T23:22:32.301 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-13T23:22:32.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:22:32.356 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-13T23:22:32.550 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:22:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-13T23:22:32.946 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-13T23:22:33.060 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:33.153 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:33.243 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 8/34 2024-09-13T23:22:33.270 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:22:33.342 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 9/34 2024-09-13T23:22:33.378 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-13T23:22:33.424 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 11/34 2024-09-13T23:22:33.500 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:22:33.522 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:33.586 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:33.629 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-13T23:22:33.737 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-13T23:22:33.777 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-13T23:22:33.812 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-13T23:22:33.862 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-13T23:22:33.891 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-13T23:22:33.928 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-13T23:22:34.236 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-13T23:22:34.278 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:22:34.367 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 22/34 2024-09-13T23:22:34.399 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 23/34 2024-09-13T23:22:34.435 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-13T23:22:34.664 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:34.705 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:34.917 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-13T23:22:34.938 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:22:35.009 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 26/34 2024-09-13T23:22:35.086 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 27/34 2024-09-13T23:22:35.125 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 28/34 2024-09-13T23:22:35.330 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:35.370 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:22:35.459 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:22:35.459 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T23:22:35.459 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T23:22:35.460 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:35.502 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:37.397 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:37.470 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:38.055 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 29/34 2024-09-13T23:22:38.091 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:22:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 30/34 2024-09-13T23:22:38.182 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T23:22:38.182 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T23:22:38.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:38.217 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /sys 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /proc 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /mnt 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /var/tmp 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /home 2024-09-13T23:22:46.006 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /root 2024-09-13T23:22:46.007 INFO:teuthology.orchestra.run.smithi043.stdout:skipping the directory /tmp 2024-09-13T23:22:46.007 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:47.019 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:22:47.045 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:47.047 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:22:47.138 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:22:47.138 INFO:teuthology.orchestra.run.smithi043.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:48.315 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:48.315 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 1/34 2024-09-13T23:22:48.315 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2/34 2024-09-13T23:22:48.315 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 3/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 4/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 5/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 6/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 8/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 9/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 10/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 11/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T23:22:48.316 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T23:22:48.317 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T23:22:48.318 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T23:22:48.318 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T23:22:48.318 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T23:22:48.318 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T23:22:48.319 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:48.319 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T23:22:48.319 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 33/34 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-13T23:22:48.587 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:49.312 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:49.312 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:49.312 INFO:teuthology.orchestra.run.smithi043.stdout:Upgraded: 2024-09-13T23:22:49.312 INFO:teuthology.orchestra.run.smithi043.stdout: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T23:22:49.313 INFO:teuthology.orchestra.run.smithi043.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T23:22:49.314 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:49.315 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:22:49.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 32/34 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T23:22:49.590 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:49.592 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:22:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-13T23:22:49.684 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:49.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-test 2024-09-13T23:22:50.320 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:30 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:22:50.458 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test x86_64 2:19.1.1-324.gecab7be5.el9 ceph 49 M 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite x86_64 2:19.1.1-324.gecab7be5.el9 ceph 163 k 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T23:22:50.459 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:50.460 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:22:50.460 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:22:50.460 INFO:teuthology.orchestra.run.smithi043.stdout:Install 4 Packages 2024-09-13T23:22:50.460 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:22:50.460 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 49 M 2024-09-13T23:22:50.461 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 209 M 2024-09-13T23:22:50.461 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:22:50.686 INFO:teuthology.orchestra.run.smithi043.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-13T23:22:50.736 INFO:teuthology.orchestra.run.smithi043.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T23:22:50.942 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:50.942 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 1/34 2024-09-13T23:22:50.942 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 3/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 4/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 5/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 6/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 7/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x 8/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86 9/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 10/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 11/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 12/34 2024-09-13T23:22:50.943 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 13/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-13T23:22:50.944 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.1.1-324.gecab7be5.el9.x86_64 31/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-13T23:22:50.946 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 33/34 2024-09-13T23:22:51.044 INFO:teuthology.orchestra.run.smithi043.stdout:(3/4): libcephsqlite-19.1.1-324.gecab7be5.el9.x 292 kB/s | 163 kB 00:00 2024-09-13T23:22:52.117 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.118 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T23:22:52.119 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:52.120 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:22:52.442 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-test 2024-09-13T23:22:53.007 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:22:53.140 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:22:53.140 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.1.1-324.gecab7be5.el9 ceph 49 M 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.1.1-324.gecab7be5.el9 ceph 163 k 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:22:53.141 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-13T23:22:53.142 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:22:53.142 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 49 M 2024-09-13T23:22:53.142 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 209 M 2024-09-13T23:22:53.142 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:22:53.514 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-13T23:22:53.539 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): libcephsqlite-19.1.1-324.gecab7be5.el9.x 612 kB/s | 163 kB 00:00 2024-09-13T23:22:53.564 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T23:22:56.722 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): ceph-test-19.1.1-324.gecab7be5.el9.x86_6 14 MB/s | 49 MB 00:03 2024-09-13T23:22:56.724 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:22:56.725 INFO:teuthology.orchestra.run.smithi099.stdout:Total 14 MB/s | 49 MB 00:03 2024-09-13T23:22:56.752 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:22:56.772 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:22:56.772 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:22:57.165 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:22:57.165 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:22:57.687 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:22:57.771 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T23:22:57.829 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T23:22:57.857 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:23:00.110 INFO:teuthology.orchestra.run.smithi043.stdout:(4/4): ceph-test-19.1.1-324.gecab7be5.el9.x86_6 5.1 MB/s | 49 MB 00:09 2024-09-13T23:23:00.112 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:00.113 INFO:teuthology.orchestra.run.smithi043.stdout:Total 5.1 MB/s | 49 MB 00:09 2024-09-13T23:23:00.142 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:00.165 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:00.165 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:00.583 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:00.584 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:01.127 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:01.215 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T23:23:01.263 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T23:23:01.287 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:23:02.553 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:23:02.630 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:23:05.191 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:23:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 1/4 2024-09-13T23:23:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2/4 2024-09-13T23:23:05.192 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:05.517 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T23:23:05.518 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T23:23:05.518 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:05.518 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:05.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph 2024-09-13T23:23:06.174 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 3/4 2024-09-13T23:23:06.255 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:23:06.370 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:42 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:06.505 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:06.507 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.1.1-324.gecab7be5.el9 ceph 6.5 k 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.1.1-324.gecab7be5.el9 ceph 2.4 M 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.1.1-324.gecab7be5.el9 ceph 1.5 M 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 249 k 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.1.1-324.gecab7be5.el9 ceph 4.7 M 2024-09-13T23:23:06.508 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 17 M 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T23:23:06.509 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T23:23:06.510 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:06.511 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:06.512 INFO:teuthology.orchestra.run.smithi099.stdout:Install 37 Packages 2024-09-13T23:23:06.512 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:06.512 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 30 M 2024-09-13T23:23:06.512 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 108 M 2024-09-13T23:23:06.512 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:07.139 INFO:teuthology.orchestra.run.smithi099.stdout:(1/37): ceph-19.1.1-324.gecab7be5.el9.x86_64.rp 45 kB/s | 6.5 kB 00:00 2024-09-13T23:23:07.306 INFO:teuthology.orchestra.run.smithi099.stdout:(2/37): ceph-mgr-19.1.1-324.gecab7be5.el9.x86_6 4.9 MB/s | 1.5 MB 00:00 2024-09-13T23:23:07.365 INFO:teuthology.orchestra.run.smithi099.stdout:(3/37): ceph-mds-19.1.1-324.gecab7be5.el9.x86_6 6.4 MB/s | 2.4 MB 00:00 2024-09-13T23:23:07.432 INFO:teuthology.orchestra.run.smithi099.stdout:(4/37): ceph-mgr-modules-core-19.1.1-324.gecab7 3.7 MB/s | 249 kB 00:00 2024-09-13T23:23:07.574 INFO:teuthology.orchestra.run.smithi099.stdout:(5/37): ceph-mon-19.1.1-324.gecab7be5.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-09-13T23:23:07.602 INFO:teuthology.orchestra.run.smithi099.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-13T23:23:07.644 INFO:teuthology.orchestra.run.smithi099.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T23:23:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-13T23:23:07.728 INFO:teuthology.orchestra.run.smithi099.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T23:23:07.770 INFO:teuthology.orchestra.run.smithi099.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 6.3 MB/s | 1.2 MB 00:00 2024-09-13T23:23:07.795 INFO:teuthology.orchestra.run.smithi099.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-13T23:23:07.929 INFO:teuthology.orchestra.run.smithi099.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-13T23:23:07.954 INFO:teuthology.orchestra.run.smithi099.stdout:(13/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-13T23:23:08.121 INFO:teuthology.orchestra.run.smithi099.stdout:(14/37): ceph-osd-19.1.1-324.gecab7be5.el9.x86_ 21 MB/s | 17 MB 00:00 2024-09-13T23:23:08.147 INFO:teuthology.orchestra.run.smithi099.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 160 kB/s | 35 kB 00:00 2024-09-13T23:23:08.172 INFO:teuthology.orchestra.run.smithi099.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 355 kB/s | 77 kB 00:00 2024-09-13T23:23:08.197 INFO:teuthology.orchestra.run.smithi099.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-13T23:23:08.222 INFO:teuthology.orchestra.run.smithi099.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-13T23:23:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:(19/37): python3-pytz-2021.1-5.el9.noarch.rpm 358 kB/s | 51 kB 00:00 2024-09-13T23:23:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:(20/37): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-13T23:23:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 432 kB/s | 43 kB 00:00 2024-09-13T23:23:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-13T23:23:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 714 kB/s | 18 kB 00:00 2024-09-13T23:23:08.399 INFO:teuthology.orchestra.run.smithi099.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T23:23:08.424 INFO:teuthology.orchestra.run.smithi099.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T23:23:08.449 INFO:teuthology.orchestra.run.smithi099.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-13T23:23:08.475 INFO:teuthology.orchestra.run.smithi099.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T23:23:08.500 INFO:teuthology.orchestra.run.smithi099.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-13T23:23:08.533 INFO:teuthology.orchestra.run.smithi099.stdout:(29/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-09-13T23:23:08.559 INFO:teuthology.orchestra.run.smithi099.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 942 kB/s | 79 kB 00:00 2024-09-13T23:23:08.584 INFO:teuthology.orchestra.run.smithi099.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-13T23:23:08.609 INFO:teuthology.orchestra.run.smithi099.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-13T23:23:08.623 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 4/4 2024-09-13T23:23:08.623 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 1/4 2024-09-13T23:23:08.623 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2/4 2024-09-13T23:23:08.623 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T23:23:08.745 INFO:teuthology.orchestra.run.smithi099.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 223 kB/s | 36 kB 00:00 2024-09-13T23:23:08.776 INFO:teuthology.orchestra.run.smithi099.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 986 kB/s | 272 kB 00:00 2024-09-13T23:23:08.802 INFO:teuthology.orchestra.run.smithi099.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-13T23:23:08.827 INFO:teuthology.orchestra.run.smithi099.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.8 MB/s | 230 kB 00:00 2024-09-13T23:23:08.852 INFO:teuthology.orchestra.run.smithi099.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.9 MB/s | 427 kB 00:00 2024-09-13T23:23:08.856 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:08.856 INFO:teuthology.orchestra.run.smithi099.stdout:Total 13 MB/s | 30 MB 00:02 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-test-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: libcephsqlite-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T23:23:08.927 INFO:teuthology.orchestra.run.smithi043.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T23:23:08.928 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:08.928 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:09.001 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:09.042 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:09.042 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:09.214 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph 2024-09-13T23:23:09.504 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:09.504 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:09.799 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:09.943 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:09.945 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:09.945 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:09.945 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph x86_64 2:19.1.1-324.gecab7be5.el9 ceph 6.5 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds x86_64 2:19.1.1-324.gecab7be5.el9 ceph 2.4 M 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr x86_64 2:19.1.1-324.gecab7be5.el9 ceph 1.5 M 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 249 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon x86_64 2:19.1.1-324.gecab7be5.el9 ceph 4.7 M 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 17 M 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T23:23:09.946 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T23:23:09.947 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T23:23:09.948 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout:Install 37 Packages 2024-09-13T23:23:09.949 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:09.950 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 30 M 2024-09-13T23:23:09.950 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 108 M 2024-09-13T23:23:09.950 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:10.365 INFO:teuthology.orchestra.run.smithi043.stdout:(1/37): ceph-19.1.1-324.gecab7be5.el9.x86_64.rp 22 kB/s | 6.5 kB 00:00 2024-09-13T23:23:10.878 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:10.938 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T23:23:10.990 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T23:23:11.024 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T23:23:11.095 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T23:23:11.156 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T23:23:11.198 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T23:23:11.289 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T23:23:11.368 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T23:23:11.374 INFO:teuthology.orchestra.run.smithi043.stdout:(2/37): ceph-mgr-19.1.1-324.gecab7be5.el9.x86_6 1.2 MB/s | 1.5 MB 00:01 2024-09-13T23:23:11.409 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T23:23:11.452 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T23:23:11.490 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T23:23:11.525 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T23:23:11.558 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T23:23:11.599 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T23:23:11.600 INFO:teuthology.orchestra.run.smithi043.stdout:(3/37): ceph-mds-19.1.1-324.gecab7be5.el9.x86_6 1.6 MB/s | 2.4 MB 00:01 2024-09-13T23:23:11.659 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T23:23:11.693 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T23:23:11.741 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T23:23:11.773 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T23:23:11.774 INFO:teuthology.orchestra.run.smithi043.stdout:(4/37): ceph-mgr-modules-core-19.1.1-324.gecab7 1.4 MB/s | 249 kB 00:00 2024-09-13T23:23:11.847 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T23:23:11.916 INFO:teuthology.orchestra.run.smithi043.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-13T23:23:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T23:23:12.008 INFO:teuthology.orchestra.run.smithi043.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-09-13T23:23:12.051 INFO:teuthology.orchestra.run.smithi043.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-13T23:23:12.072 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T23:23:12.092 INFO:teuthology.orchestra.run.smithi043.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-13T23:23:12.126 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T23:23:12.134 INFO:teuthology.orchestra.run.smithi043.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-09-13T23:23:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T23:23:12.176 INFO:teuthology.orchestra.run.smithi043.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-09-13T23:23:12.214 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T23:23:12.260 INFO:teuthology.orchestra.run.smithi043.stdout:(11/37): ceph-mon-19.1.1-324.gecab7be5.el9.x86_ 2.5 MB/s | 4.7 MB 00:01 2024-09-13T23:23:12.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T23:23:12.360 INFO:teuthology.orchestra.run.smithi043.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-13T23:23:12.410 INFO:teuthology.orchestra.run.smithi043.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 697 kB/s | 35 kB 00:00 2024-09-13T23:23:12.435 INFO:teuthology.orchestra.run.smithi043.stdout:(14/37): python3-mako-1.1.4-6.el9.noarch.rpm 982 kB/s | 172 kB 00:00 2024-09-13T23:23:12.481 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T23:23:12.485 INFO:teuthology.orchestra.run.smithi043.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-13T23:23:12.519 INFO:teuthology.orchestra.run.smithi043.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-13T23:23:12.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T23:23:12.544 INFO:teuthology.orchestra.run.smithi043.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-13T23:23:12.561 INFO:teuthology.orchestra.run.smithi043.stdout:(18/37): lua-devel-5.4.4-4.el9.x86_64.rpm 531 kB/s | 22 kB 00:00 2024-09-13T23:23:12.603 INFO:teuthology.orchestra.run.smithi043.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-13T23:23:12.605 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T23:23:12.629 INFO:teuthology.orchestra.run.smithi043.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 651 kB/s | 43 kB 00:00 2024-09-13T23:23:12.662 INFO:teuthology.orchestra.run.smithi043.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.0 MB/s | 172 kB 00:00 2024-09-13T23:23:12.687 INFO:teuthology.orchestra.run.smithi043.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 432 kB/s | 11 kB 00:00 2024-09-13T23:23:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T23:23:12.713 INFO:teuthology.orchestra.run.smithi043.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 714 kB/s | 18 kB 00:00 2024-09-13T23:23:12.738 INFO:teuthology.orchestra.run.smithi043.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 929 kB/s | 23 kB 00:00 2024-09-13T23:23:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T23:23:12.763 INFO:teuthology.orchestra.run.smithi043.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 789 kB/s | 19 kB 00:00 2024-09-13T23:23:12.788 INFO:teuthology.orchestra.run.smithi043.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.8 MB/s | 358 kB 00:00 2024-09-13T23:23:12.814 INFO:teuthology.orchestra.run.smithi043.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-13T23:23:12.839 INFO:teuthology.orchestra.run.smithi043.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-13T23:23:12.860 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T23:23:12.864 INFO:teuthology.orchestra.run.smithi043.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T23:23:12.890 INFO:teuthology.orchestra.run.smithi043.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-13T23:23:12.915 INFO:teuthology.orchestra.run.smithi043.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-13T23:23:12.941 INFO:teuthology.orchestra.run.smithi043.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-13T23:23:12.966 INFO:teuthology.orchestra.run.smithi043.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-13T23:23:12.999 INFO:teuthology.orchestra.run.smithi043.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-13T23:23:13.013 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 32/37 2024-09-13T23:23:13.025 INFO:teuthology.orchestra.run.smithi043.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-13T23:23:13.044 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:23:13.050 INFO:teuthology.orchestra.run.smithi043.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:23:13.070 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:14.033 INFO:teuthology.orchestra.run.smithi043.stdout:(37/37): ceph-osd-19.1.1-324.gecab7be5.el9.x86_ 6.3 MB/s | 17 MB 00:02 2024-09-13T23:23:14.038 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:14.039 INFO:teuthology.orchestra.run.smithi043.stdout:Total 7.4 MB/s | 30 MB 00:04 2024-09-13T23:23:14.197 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:14.241 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:14.520 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:23:14.547 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:23:14.547 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:14.547 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T23:23:14.547 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:23:14.547 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:23:14.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:14.753 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:14.753 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:15.005 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:23:15.028 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:15.255 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:23:15.278 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:23:15.278 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:15.278 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T23:23:15.279 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:23:15.279 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:23:15.279 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:15.343 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:23:16.138 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:16.203 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-13T23:23:16.241 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-13T23:23:16.272 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-13T23:23:16.347 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-13T23:23:16.405 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-13T23:23:16.446 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-13T23:23:16.541 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-13T23:23:16.627 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-13T23:23:16.675 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-13T23:23:16.709 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-13T23:23:16.738 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-13T23:23:16.773 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-13T23:23:16.806 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-13T23:23:16.856 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-13T23:23:16.899 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-13T23:23:16.933 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-13T23:23:16.982 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-13T23:23:17.022 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 1/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 3/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 4/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 5/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 6/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T23:23:17.047 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T23:23:17.048 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T23:23:17.049 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T23:23:17.050 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T23:23:17.098 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-13T23:23:17.249 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-13T23:23:17.341 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-13T23:23:17.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-13T23:23:17.446 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-13T23:23:17.505 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-13T23:23:17.569 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-13T23:23:17.765 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-13T23:23:17.826 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-13T23:23:17.906 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-13T23:23:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T23:23:18.073 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T23:23:18.074 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T23:23:18.075 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T23:23:18.076 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:18.077 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:18.121 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-13T23:23:18.157 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-13T23:23:18.281 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-13T23:23:18.445 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 32/37 2024-09-13T23:23:18.476 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-base 2024-09-13T23:23:18.526 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:23:18.553 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 33/37 2024-09-13T23:23:18.553 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:18.554 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T23:23:18.554 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:23:18.554 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T23:23:18.554 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:19.040 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:19.128 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:23:19.169 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:19.170 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:23:19.170 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:19.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install cephadm 2024-09-13T23:23:19.807 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:55 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 765 k 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:23:19.942 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 765 k 2024-09-13T23:23:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 771 k 2024-09-13T23:23:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:20.068 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:23:20.097 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 34/37 2024-09-13T23:23:20.098 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:20.098 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T23:23:20.098 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:23:20.098 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T23:23:20.098 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:20.197 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm-19.1.1-324.gecab7be5.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-13T23:23:20.198 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:20.198 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-13T23:23:20.198 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:20.203 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:20.203 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:20.209 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:20.210 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:20.287 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:20.560 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 35/37 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T23:23:20.586 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:20.691 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:20.776 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:20.828 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:23:20.853 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 36/37 2024-09-13T23:23:20.853 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:20.853 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T23:23:20.854 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:23:20.854 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T23:23:20.854 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:20.919 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:23:21.160 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:21.425 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:21.426 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:21.426 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:21.426 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:21.427 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:21.427 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:21.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T23:23:22.226 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:58 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:22.360 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-324.gecab7be5.el9 ceph 145 k 2024-09-13T23:23:22.361 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 145 k 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 435 k 2024-09-13T23:23:22.362 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:22.772 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 37/37 2024-09-13T23:23:22.772 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-2:19.1.1-324.gecab7be5.el9.x86_64 1/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 3/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 4/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 5/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.n 6/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-13T23:23:22.773 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-13T23:23:22.774 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-13T23:23:22.775 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-13T23:23:22.776 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mds-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-modules-core-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mon-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-osd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:23.817 INFO:teuthology.orchestra.run.smithi043.stdout: lua-5.4.4-4.el9.x86_64 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T23:23:23.818 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T23:23:23.819 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:23.820 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:24.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-base 2024-09-13T23:23:24.744 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-immutable-object-cache-19.1.1-324.gecab7be 61 kB/s | 145 kB 00:02 2024-09-13T23:23:24.745 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:24.745 INFO:teuthology.orchestra.run.smithi099.stdout:Total 61 kB/s | 145 kB 00:02 2024-09-13T23:23:24.745 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:24.754 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:24.754 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:24.770 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:04 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:24.816 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:24.816 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:24.864 INFO:teuthology.orchestra.run.smithi043.stdout:Package ceph-base-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:23:24.908 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:24.909 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:23:24.909 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:24.964 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:24.991 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install cephadm 2024-09-13T23:23:25.045 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:25.070 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:25.070 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:25.070 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T23:23:25.070 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:25.577 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:05 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:25.717 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:25.718 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:25.718 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:25.718 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:25.718 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 765 k 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 765 k 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 771 k 2024-09-13T23:23:25.719 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:25.961 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:25.995 INFO:teuthology.orchestra.run.smithi043.stdout:cephadm-19.1.1-324.gecab7be5.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-13T23:23:25.995 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:25.996 INFO:teuthology.orchestra.run.smithi043.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-13T23:23:25.996 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:26.002 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:26.002 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:26.008 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:26.008 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:26.087 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:26.192 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr 2024-09-13T23:23:26.548 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:26.643 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:26.765 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:02 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:23:26.897 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:26.898 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:23:26.898 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:26.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T23:23:27.025 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout: cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:27.285 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:27.494 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T23:23:27.527 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:03 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:27.659 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:27.660 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 3.6 M 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 32 k 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 16 k 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T23:23:27.661 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout:Install 12 Packages 2024-09-13T23:23:27.662 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:27.663 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 8.7 M 2024-09-13T23:23:27.663 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 104 M 2024-09-13T23:23:27.663 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:28.090 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:08 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:28.232 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:28.233 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:28.233 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2024-09-13T23:23:28.233 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:28.233 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-324.gecab7be5.el9 ceph 145 k 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 145 k 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 435 k 2024-09-13T23:23:28.234 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:28.356 INFO:teuthology.orchestra.run.smithi099.stdout:(1/12): ceph-grafana-dashboards-19.1.1-324.geca 221 kB/s | 32 kB 00:00 2024-09-13T23:23:28.381 INFO:teuthology.orchestra.run.smithi099.stdout:(2/12): ceph-prometheus-alerts-19.1.1-324.gecab 97 kB/s | 16 kB 00:00 2024-09-13T23:23:28.418 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-immutable-object-cache-19.1.1-324.gecab7be 789 kB/s | 145 kB 00:00 2024-09-13T23:23:28.419 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:28.419 INFO:teuthology.orchestra.run.smithi043.stdout:Total 781 kB/s | 145 kB 00:00 2024-09-13T23:23:28.419 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:28.428 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:28.428 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:28.488 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:28.598 INFO:teuthology.orchestra.run.smithi099.stdout:(3/12): ceph-mgr-dashboard-19.1.1-324.gecab7be5 9.2 MB/s | 3.6 MB 00:00 2024-09-13T23:23:28.634 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:28.694 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:28.720 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:28.720 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:28.720 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T23:23:28.720 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:28.806 INFO:teuthology.orchestra.run.smithi099.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.0 MB/s | 863 kB 00:00 2024-09-13T23:23:28.857 INFO:teuthology.orchestra.run.smithi099.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-13T23:23:28.890 INFO:teuthology.orchestra.run.smithi099.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 584 kB/s | 19 kB 00:00 2024-09-13T23:23:28.924 INFO:teuthology.orchestra.run.smithi099.stdout:(7/12): python3-protobuf-3.14.0-13.el9.noarch.r 496 kB/s | 269 kB 00:00 2024-09-13T23:23:28.991 INFO:teuthology.orchestra.run.smithi099.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 20 MB/s | 2.0 MB 00:00 2024-09-13T23:23:29.016 INFO:teuthology.orchestra.run.smithi099.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-13T23:23:29.041 INFO:teuthology.orchestra.run.smithi099.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-13T23:23:29.067 INFO:teuthology.orchestra.run.smithi099.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.0 MB/s | 144 kB 00:00 2024-09-13T23:23:29.225 INFO:teuthology.orchestra.run.smithi099.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-13T23:23:29.229 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:29.229 INFO:teuthology.orchestra.run.smithi099.stdout:Total 5.5 MB/s | 8.7 MB 00:01 2024-09-13T23:23:29.280 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:29.298 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:29.298 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:29.522 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:29.522 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:29.668 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.e 1/1 2024-09-13T23:23:29.669 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:29.669 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:29.669 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-immutable-object-cache-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:23:29.669 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:29.669 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:29.929 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr 2024-09-13T23:23:30.050 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:30.125 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T23:23:30.161 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T23:23:30.207 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T23:23:30.246 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T23:23:30.351 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T23:23:30.488 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T23:23:30.520 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:30.581 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T23:23:30.613 INFO:teuthology.orchestra.run.smithi043.stdout:Package ceph-mgr-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:23:30.625 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T23:23:30.654 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:23:30.657 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:30.659 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:23:30.659 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:30.694 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 10/12 2024-09-13T23:23:30.729 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T23:23:31.317 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:11 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:31.458 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:31.459 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:31.459 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:31.459 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 3.6 M 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 32 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 16 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-13T23:23:31.460 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout:Install 12 Packages 2024-09-13T23:23:31.461 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:31.462 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 8.7 M 2024-09-13T23:23:31.462 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 104 M 2024-09-13T23:23:31.462 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:31.740 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 11/12 2024-09-13T23:23:31.778 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:23:32.039 INFO:teuthology.orchestra.run.smithi043.stdout:(1/12): ceph-prometheus-alerts-19.1.1-324.gecab 112 kB/s | 16 kB 00:00 2024-09-13T23:23:32.064 INFO:teuthology.orchestra.run.smithi043.stdout:(2/12): ceph-grafana-dashboards-19.1.1-324.geca 184 kB/s | 32 kB 00:00 2024-09-13T23:23:32.215 INFO:teuthology.orchestra.run.smithi043.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-13T23:23:32.290 INFO:teuthology.orchestra.run.smithi043.stdout:(4/12): ceph-mgr-dashboard-19.1.1-324.gecab7be5 8.9 MB/s | 3.6 MB 00:00 2024-09-13T23:23:32.332 INFO:teuthology.orchestra.run.smithi043.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.5 MB/s | 1.0 MB 00:00 2024-09-13T23:23:32.382 INFO:teuthology.orchestra.run.smithi043.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 456 kB/s | 19 kB 00:00 2024-09-13T23:23:32.408 INFO:teuthology.orchestra.run.smithi043.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-13T23:23:32.433 INFO:teuthology.orchestra.run.smithi043.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-13T23:23:32.458 INFO:teuthology.orchestra.run.smithi043.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-13T23:23:32.492 INFO:teuthology.orchestra.run.smithi043.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-13T23:23:32.517 INFO:teuthology.orchestra.run.smithi043.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.8 MB/s | 863 kB 00:00 2024-09-13T23:23:32.559 INFO:teuthology.orchestra.run.smithi043.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-13T23:23:32.562 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:32.562 INFO:teuthology.orchestra.run.smithi043.stdout:Total 7.9 MB/s | 8.7 MB 00:01 2024-09-13T23:23:32.612 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:32.630 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:32.846 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:32.847 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:33.121 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:23:33.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 1/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 2/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 3/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T23:23:33.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T23:23:33.390 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T23:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:33.438 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:33.477 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-13T23:23:33.512 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-13T23:23:33.561 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-13T23:23:33.589 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-13T23:23:33.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T23:23:33.699 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-13T23:23:33.830 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-13T23:23:33.922 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-13T23:23:33.978 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-13T23:23:34.005 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:23:34.038 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 10/12 2024-09-13T23:23:34.277 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:10 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:34.419 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 7.4 M 2024-09-13T23:23:34.420 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T23:23:34.421 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:34.422 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:34.422 INFO:teuthology.orchestra.run.smithi099.stdout:====================================================================================== 2024-09-13T23:23:34.422 INFO:teuthology.orchestra.run.smithi099.stdout:Install 12 Packages 2024-09-13T23:23:34.422 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:34.422 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 38 M 2024-09-13T23:23:34.423 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 212 M 2024-09-13T23:23:34.423 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:34.899 INFO:teuthology.orchestra.run.smithi099.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T23:23:34.958 INFO:teuthology.orchestra.run.smithi099.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.4 MB/s | 801 kB 00:00 2024-09-13T23:23:34.991 INFO:teuthology.orchestra.run.smithi099.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-13T23:23:35.041 INFO:teuthology.orchestra.run.smithi099.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 364 kB/s | 18 kB 00:00 2024-09-13T23:23:35.100 INFO:teuthology.orchestra.run.smithi099.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 661 kB/s | 38 kB 00:00 2024-09-13T23:23:35.163 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 11/12 2024-09-13T23:23:35.196 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:23:35.209 INFO:teuthology.orchestra.run.smithi099.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-32 15 MB/s | 7.4 MB 00:00 2024-09-13T23:23:35.376 INFO:teuthology.orchestra.run.smithi099.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-13T23:23:35.476 INFO:teuthology.orchestra.run.smithi099.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2024-09-13T23:23:35.543 INFO:teuthology.orchestra.run.smithi099.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.1 MB/s | 3.0 MB 00:00 2024-09-13T23:23:35.568 INFO:teuthology.orchestra.run.smithi099.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-13T23:23:35.710 INFO:teuthology.orchestra.run.smithi099.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-13T23:23:36.235 INFO:teuthology.orchestra.run.smithi099.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-13T23:23:36.236 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:36.236 INFO:teuthology.orchestra.run.smithi099.stdout:Total 21 MB/s | 38 MB 00:01 2024-09-13T23:23:36.539 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 12/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9 1/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noar 2/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9. 3/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-13T23:23:36.540 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-13T23:23:36.541 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-13T23:23:36.541 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-13T23:23:36.589 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:36.615 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:36.615 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:36.877 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-13T23:23:36.877 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:36.877 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:36.877 INFO:teuthology.orchestra.run.smithi043.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-13T23:23:36.877 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-grafana-dashboards-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-dashboard-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-prometheus-alerts-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:36.878 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:37.033 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:37.033 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:37.108 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T23:23:37.696 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:17 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:37.790 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:37.836 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:37.837 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-13T23:23:37.837 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 7.4 M 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T23:23:37.838 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout:====================================================================================== 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout:Install 12 Packages 2024-09-13T23:23:37.839 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:37.840 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 38 M 2024-09-13T23:23:37.840 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 212 M 2024-09-13T23:23:37.840 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:37.865 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T23:23:37.912 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:23:38.006 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:23:38.043 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T23:23:38.226 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T23:23:38.258 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T23:23:38.333 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T23:23:38.408 INFO:teuthology.orchestra.run.smithi043.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-13T23:23:38.475 INFO:teuthology.orchestra.run.smithi043.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 495 kB/s | 33 kB 00:00 2024-09-13T23:23:38.509 INFO:teuthology.orchestra.run.smithi043.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-13T23:23:38.576 INFO:teuthology.orchestra.run.smithi043.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-13T23:23:38.634 INFO:teuthology.orchestra.run.smithi043.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-13T23:23:38.693 INFO:teuthology.orchestra.run.smithi043.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 14 MB/s | 3.0 MB 00:00 2024-09-13T23:23:38.743 INFO:teuthology.orchestra.run.smithi043.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-13T23:23:38.877 INFO:teuthology.orchestra.run.smithi043.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-13T23:23:38.961 INFO:teuthology.orchestra.run.smithi043.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 5.1 MB 00:00 2024-09-13T23:23:38.986 INFO:teuthology.orchestra.run.smithi043.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.3 MB/s | 250 kB 00:00 2024-09-13T23:23:38.991 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T23:23:39.104 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T23:23:39.278 INFO:teuthology.orchestra.run.smithi043.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 51 MB/s | 16 MB 00:00 2024-09-13T23:23:40.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:23:41.379 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T23:23:41.406 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:23:42.253 INFO:teuthology.orchestra.run.smithi043.stdout:(12/12): ceph-mgr-diskprediction-local-19.1.1-3 1.8 MB/s | 7.4 MB 00:04 2024-09-13T23:23:42.254 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:42.254 INFO:teuthology.orchestra.run.smithi043.stdout:Total 8.7 MB/s | 38 MB 00:04 2024-09-13T23:23:42.629 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:42.656 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:42.657 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:43.110 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:43.895 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:43.968 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T23:23:44.025 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:23:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 1/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T23:23:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:23:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T23:23:44.141 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:23:44.186 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T23:23:44.378 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T23:23:44.409 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T23:23:44.489 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T23:23:44.499 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:44.888 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-rook 2024-09-13T23:23:45.190 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T23:23:45.311 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T23:23:45.470 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:21 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:45.605 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 49 k 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:45.606 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T23:23:45.607 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.2 M 2024-09-13T23:23:45.608 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 26 M 2024-09-13T23:23:45.609 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:45.748 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 224 kB/s | 19 kB 00:00 2024-09-13T23:23:45.773 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 231 kB/s | 26 kB 00:00 2024-09-13T23:23:45.857 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-13T23:23:45.890 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): ceph-mgr-rook-19.1.1-324.gecab7be5.el9. 216 kB/s | 49 kB 00:00 2024-09-13T23:23:45.916 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-13T23:23:45.957 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 778 kB/s | 32 kB 00:00 2024-09-13T23:23:45.983 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.2 MB/s | 279 kB 00:00 2024-09-13T23:23:46.008 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 456 kB/s | 54 kB 00:00 2024-09-13T23:23:46.033 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-13T23:23:46.092 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-13T23:23:46.117 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.6 MB/s | 220 kB 00:00 2024-09-13T23:23:46.151 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 9.2 MB/s | 1.0 MB 00:00 2024-09-13T23:23:46.176 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 1.0 MB/s | 90 kB 00:00 2024-09-13T23:23:46.178 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:46.179 INFO:teuthology.orchestra.run.smithi099.stdout:Total 3.9 MB/s | 2.2 MB 00:00 2024-09-13T23:23:46.244 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:46.257 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:46.258 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:46.348 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:46.348 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:46.635 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:23:46.887 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:47.064 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T23:23:47.119 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T23:23:47.174 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T23:23:47.211 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T23:23:47.252 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T23:23:47.354 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T23:23:47.464 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T23:23:47.513 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T23:23:47.743 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T23:23:47.775 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:23:48.219 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T23:23:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T23:23:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T23:23:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T23:23:48.380 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 1/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T23:23:49.121 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T23:23:49.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T23:23:49.122 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T23:23:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T23:23:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:49.452 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T23:23:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T23:23:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T23:23:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T23:23:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:49.454 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:49.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T23:23:50.294 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:26 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 12/12 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7b 1/12 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T23:23:50.303 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T23:23:50.304 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T23:23:50.429 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:50.429 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:50.429 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:50.429 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 146 k 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-09-13T23:23:50.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:50.431 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 7.0 M 2024-09-13T23:23:50.431 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 33 M 2024-09-13T23:23:50.431 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:50.716 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T23:23:50.716 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-diskprediction-local-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T23:23:50.717 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T23:23:50.718 INFO:teuthology.orchestra.run.smithi043.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T23:23:50.718 INFO:teuthology.orchestra.run.smithi043.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T23:23:50.718 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:50.718 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:50.777 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-13T23:23:50.836 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-13T23:23:50.861 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): ceph-mgr-cephadm-19.1.1-324.gecab7be5.el 676 kB/s | 146 kB 00:00 2024-09-13T23:23:50.886 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T23:23:50.928 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-13T23:23:51.062 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-13T23:23:51.064 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:51.064 INFO:teuthology.orchestra.run.smithi099.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-13T23:23:51.111 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-rook 2024-09-13T23:23:51.135 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:51.146 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:51.146 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:51.245 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:51.246 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:51.554 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:51.704 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T23:23:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T23:23:51.844 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:51.845 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:51.845 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:51.845 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:51.845 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 49 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T23:23:51.846 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout:Install 13 Packages 2024-09-13T23:23:51.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:51.848 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 2.2 M 2024-09-13T23:23:51.848 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 26 M 2024-09-13T23:23:51.848 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:52.075 INFO:teuthology.orchestra.run.smithi043.stdout:(1/13): ceph-mgr-rook-19.1.1-324.gecab7be5.el9. 280 kB/s | 49 kB 00:00 2024-09-13T23:23:52.191 INFO:teuthology.orchestra.run.smithi043.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 65 kB/s | 19 kB 00:00 2024-09-13T23:23:52.217 INFO:teuthology.orchestra.run.smithi043.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 80 kB/s | 26 kB 00:00 2024-09-13T23:23:52.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T23:23:52.366 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T23:23:52.437 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T23:23:52.467 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:23:52.567 INFO:teuthology.orchestra.run.smithi043.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 423 kB/s | 159 kB 00:00 2024-09-13T23:23:52.651 INFO:teuthology.orchestra.run.smithi043.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 386 kB/s | 222 kB 00:00 2024-09-13T23:23:52.684 INFO:teuthology.orchestra.run.smithi043.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 597 kB/s | 279 kB 00:00 2024-09-13T23:23:52.710 INFO:teuthology.orchestra.run.smithi043.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 377 kB/s | 54 kB 00:00 2024-09-13T23:23:52.743 INFO:teuthology.orchestra.run.smithi043.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-09-13T23:23:52.777 INFO:teuthology.orchestra.run.smithi043.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 157 kB/s | 14 kB 00:00 2024-09-13T23:23:52.802 INFO:teuthology.orchestra.run.smithi043.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-13T23:23:52.827 INFO:teuthology.orchestra.run.smithi043.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-13T23:23:52.852 INFO:teuthology.orchestra.run.smithi043.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-13T23:23:52.886 INFO:teuthology.orchestra.run.smithi043.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-13T23:23:52.888 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:52.889 INFO:teuthology.orchestra.run.smithi043.stdout:Total 2.1 MB/s | 2.2 MB 00:01 2024-09-13T23:23:52.958 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:52.974 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:53.071 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:53.071 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:53.275 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:23:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/6 2024-09-13T23:23:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T23:23:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T23:23:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T23:23:53.276 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T23:23:53.550 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T23:23:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T23:23:53.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:53.551 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:53.600 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:53.765 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T23:23:53.813 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T23:23:53.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-fuse 2024-09-13T23:23:53.877 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T23:23:53.914 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T23:23:53.980 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T23:23:54.085 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T23:23:54.196 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T23:23:54.249 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T23:23:54.408 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 896 k 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T23:23:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Install 2 Packages 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 976 k 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 2.9 M 2024-09-13T23:23:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:54.697 INFO:teuthology.orchestra.run.smithi099.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 616 kB/s | 80 kB 00:00 2024-09-13T23:23:54.855 INFO:teuthology.orchestra.run.smithi099.stdout:(2/2): ceph-fuse-19.1.1-324.gecab7be5.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-09-13T23:23:54.855 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:54.856 INFO:teuthology.orchestra.run.smithi099.stdout:Total 3.0 MB/s | 976 kB 00:00 2024-09-13T23:23:54.868 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:54.890 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:54.890 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:54.970 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:54.970 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:55.011 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T23:23:55.062 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T23:23:55.096 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T23:23:55.145 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T23:23:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:55.173 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:23:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T23:23:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 13/13 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 1/13 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T23:23:55.924 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T23:23:55.925 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T23:23:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:23:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/2 2024-09-13T23:23:56.264 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-rook-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T23:23:56.265 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:56.266 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:56.358 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:56.552 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T23:23:56.667 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-volume 2024-09-13T23:23:57.143 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:23:57.241 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:23:57.284 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:23:57.284 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 146 k 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T23:23:57.285 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout:Install 6 Packages 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:23:57.286 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 7.0 M 2024-09-13T23:23:57.287 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 33 M 2024-09-13T23:23:57.287 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 285 k 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:57.382 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 285 k 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 1.3 M 2024-09-13T23:23:57.383 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:23:57.628 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-volume-19.1.1-324.gecab7be5.el9.noarch.rpm 1.1 MB/s | 285 kB 00:00 2024-09-13T23:23:57.628 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:57.628 INFO:teuthology.orchestra.run.smithi099.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-13T23:23:57.629 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:23:57.636 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:23:57.636 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:23:57.664 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:23:57.665 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:23:57.881 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:23:57.904 INFO:teuthology.orchestra.run.smithi043.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-13T23:23:57.945 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:57.961 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:57.961 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:23:57.961 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T23:23:57.961 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:57.979 INFO:teuthology.orchestra.run.smithi043.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.2 MB/s | 548 kB 00:00 2024-09-13T23:23:58.005 INFO:teuthology.orchestra.run.smithi043.stdout:(3/6): ceph-mgr-cephadm-19.1.1-324.gecab7be5.el 638 kB/s | 146 kB 00:00 2024-09-13T23:23:58.030 INFO:teuthology.orchestra.run.smithi043.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T23:23:58.080 INFO:teuthology.orchestra.run.smithi043.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 992 kB/s | 74 kB 00:00 2024-09-13T23:23:58.164 INFO:teuthology.orchestra.run.smithi043.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-13T23:23:58.167 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:23:58.167 INFO:teuthology.orchestra.run.smithi043.stdout:Total 8.0 MB/s | 7.0 MB 00:00 2024-09-13T23:23:58.241 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:23:58.253 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:23:58.253 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:23:58.358 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:23:58.359 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:23:58.683 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:23:58.862 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T23:23:58.926 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:23:58.981 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:23:59.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados-devel 2024-09-13T23:23:59.485 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T23:23:59.572 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T23:23:59.642 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T23:23:59.670 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:23:59.932 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:00.070 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:00.070 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:00.070 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-13T23:24:00.070 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 127 k 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 127 k 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 456 k 2024-09-13T23:24:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:24:00.281 INFO:teuthology.orchestra.run.smithi099.stdout:librados-devel-19.1.1-324.gecab7be5.el9.x86_64. 606 kB/s | 127 kB 00:00 2024-09-13T23:24:00.281 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:00.281 INFO:teuthology.orchestra.run.smithi099.stdout:Total 602 kB/s | 127 kB 00:00 2024-09-13T23:24:00.282 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:24:00.287 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:24:00.287 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:24:00.352 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:24:00.353 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:24:00.452 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 6/6 2024-09-13T23:24:00.452 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 1/6 2024-09-13T23:24:00.452 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T23:24:00.452 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T23:24:00.452 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T23:24:00.453 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T23:24:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:24:00.611 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:00.748 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T23:24:00.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:00.748 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:00.748 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-mgr-cephadm-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:24:00.748 INFO:teuthology.orchestra.run.smithi043.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:00.749 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:00.996 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-fuse 2024-09-13T23:24:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:01.319 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:24:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:01.319 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:01.320 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:01.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs2 2024-09-13T23:24:01.607 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:01.748 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 896 k 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:Installing dependencies: 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:01.749 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:01.750 INFO:teuthology.orchestra.run.smithi043.stdout:Install 2 Packages 2024-09-13T23:24:01.750 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:01.750 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 976 k 2024-09-13T23:24:01.750 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 2.9 M 2024-09-13T23:24:01.750 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:02.092 INFO:teuthology.orchestra.run.smithi043.stdout:(1/2): ceph-fuse-19.1.1-324.gecab7be5.el9.x86_6 3.0 MB/s | 896 kB 00:00 2024-09-13T23:24:02.146 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:02.238 INFO:teuthology.orchestra.run.smithi099.stdout:Package libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:02.282 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:02.283 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:02.283 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:02.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs-devel 2024-09-13T23:24:02.508 INFO:teuthology.orchestra.run.smithi043.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 113 kB/s | 80 kB 00:00 2024-09-13T23:24:02.509 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:02.509 INFO:teuthology.orchestra.run.smithi043.stdout:Total 1.3 MB/s | 976 kB 00:00 2024-09-13T23:24:02.522 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:02.547 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:02.548 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:02.636 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:02.636 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:02.824 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:02.921 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:38 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:02.974 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T23:24:03.052 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:24:03.055 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 32 k 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:03.056 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 32 k 2024-09-13T23:24:03.057 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 142 k 2024-09-13T23:24:03.057 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:24:03.209 INFO:teuthology.orchestra.run.smithi099.stdout:libcephfs-devel-19.1.1-324.gecab7be5.el9.x86_64 208 kB/s | 32 kB 00:00 2024-09-13T23:24:03.209 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:03.210 INFO:teuthology.orchestra.run.smithi099.stdout:Total 206 kB/s | 32 kB 00:00 2024-09-13T23:24:03.210 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:24:03.213 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:24:03.213 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:24:03.236 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:24:03.237 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:24:03.329 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:24:03.449 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2/2 2024-09-13T23:24:03.713 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/2 2024-09-13T23:24:03.845 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:04.003 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T23:24:04.004 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:04.004 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:04.004 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T23:24:04.004 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:04.004 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:04.072 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:24:04.072 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:04.073 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:04.073 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:04.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados2 2024-09-13T23:24:04.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install ceph-volume 2024-09-13T23:24:04.858 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:04.898 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:04.952 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:04.996 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:04.997 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:04.997 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repository Size 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume noarch 2:19.1.1-324.gecab7be5.el9 ceph-noarch 285 k 2024-09-13T23:24:05.038 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 285 k 2024-09-13T23:24:05.039 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 1.3 M 2024-09-13T23:24:05.040 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:05.076 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librbd1 2024-09-13T23:24:05.262 INFO:teuthology.orchestra.run.smithi043.stdout:ceph-volume-19.1.1-324.gecab7be5.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-13T23:24:05.263 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:05.263 INFO:teuthology.orchestra.run.smithi043.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-13T23:24:05.263 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:05.273 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:05.273 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:05.308 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:05.309 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:05.538 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:05.614 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:24:05.631 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:24:05.631 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:24:05.631 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T23:24:05.631 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:05.670 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:41 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:05.761 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:05.805 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:05.806 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:05.806 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:05.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rados 2024-09-13T23:24:06.445 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:06.536 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:06.580 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:06.581 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:06.581 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:06.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rgw 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 1/1 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout: ceph-volume-2:19.1.1-324.gecab7be5.el9.noarch 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:06.687 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:07.020 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librados-devel 2024-09-13T23:24:07.214 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:07.304 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:07.347 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:07.348 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:07.348 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:07.420 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-cephfs 2024-09-13T23:24:07.617 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:07.756 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 127 k 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 127 k 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 456 k 2024-09-13T23:24:07.757 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:07.943 INFO:teuthology.orchestra.run.smithi043.stdout:librados-devel-19.1.1-324.gecab7be5.el9.x86_64. 683 kB/s | 127 kB 00:00 2024-09-13T23:24:07.943 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:07.944 INFO:teuthology.orchestra.run.smithi043.stdout:Total 678 kB/s | 127 kB 00:00 2024-09-13T23:24:07.944 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:07.950 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:07.951 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:07.983 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:43 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:08.018 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:08.018 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:08.073 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:08.116 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:08.117 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:08.118 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:08.182 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:08.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rbd 2024-09-13T23:24:08.294 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:08.764 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:44 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:08.780 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:08.855 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:08.898 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:08.899 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-13T23:24:08.899 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:08.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-fuse 2024-09-13T23:24:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:09.044 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: librados-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:09.044 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:09.045 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:09.278 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install libcephfs2 2024-09-13T23:24:09.535 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:45 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:09.669 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:09.670 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:09.670 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-13T23:24:09.670 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 85 k 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 85 k 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 231 k 2024-09-13T23:24:09.671 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:24:09.861 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-fuse-19.1.1-324.gecab7be5.el9.x86_64.rpm 448 kB/s | 85 kB 00:00 2024-09-13T23:24:09.862 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:09.862 INFO:teuthology.orchestra.run.smithi099.stdout:Total 444 kB/s | 85 kB 00:00 2024-09-13T23:24:09.862 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:24:09.869 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:24:09.869 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:24:09.878 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:49 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:09.932 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:24:09.932 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:24:09.973 INFO:teuthology.orchestra.run.smithi043.stdout:Package libcephfs2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:10.020 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:10.021 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:10.021 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:24:10.091 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install libcephfs-devel 2024-09-13T23:24:10.193 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:10.682 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:10.822 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:10.822 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:10.822 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel x86_64 2:19.1.1-324.gecab7be5.el9 ceph 32 k 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 32 k 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 142 k 2024-09-13T23:24:10.823 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:10.826 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:10.972 INFO:teuthology.orchestra.run.smithi043.stdout:libcephfs-devel-19.1.1-324.gecab7be5.el9.x86_64 215 kB/s | 32 kB 00:00 2024-09-13T23:24:10.972 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:10.973 INFO:teuthology.orchestra.run.smithi043.stdout:Total 212 kB/s | 32 kB 00:00 2024-09-13T23:24:10.973 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:10.976 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:10.977 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:10.998 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:10.999 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:11.082 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:11.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-mirror 2024-09-13T23:24:11.188 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:11.559 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:11.730 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:47 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:11.804 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:11.804 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:11.804 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:11.805 INFO:teuthology.orchestra.run.smithi043.stdout: libcephfs-devel-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:11.805 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:11.805 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:11.873 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:11.873 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:11.873 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.1 M 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.1 M 2024-09-13T23:24:11.874 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 13 M 2024-09-13T23:24:11.875 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:24:12.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librados2 2024-09-13T23:24:12.314 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-mirror-19.1.1-324.gecab7be5.el9.x86_64.rpm 7.0 MB/s | 3.1 MB 00:00 2024-09-13T23:24:12.314 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:12.314 INFO:teuthology.orchestra.run.smithi099.stdout:Total 7.0 MB/s | 3.1 MB 00:00 2024-09-13T23:24:12.315 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:24:12.323 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:24:12.324 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:24:12.404 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:24:12.404 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:24:12.594 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:52 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:12.689 INFO:teuthology.orchestra.run.smithi043.stdout:Package librados2-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:12.736 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:12.737 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:12.737 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:12.806 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install librbd1 2024-09-13T23:24:12.831 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:24:12.906 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:12.932 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:12.932 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:24:12.933 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T23:24:12.933 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:24:12.933 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:24:12.933 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:13.401 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:53 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:13.496 INFO:teuthology.orchestra.run.smithi043.stdout:Package librbd1-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:13.543 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:13.544 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:13.544 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:13.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rados 2024-09-13T23:24:14.014 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:14.014 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:14.014 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:24:14.015 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:14.015 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:14.015 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:14.202 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:54 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:14.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-nbd 2024-09-13T23:24:14.296 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rados-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:14.342 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:14.343 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:14.344 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:14.415 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rgw 2024-09-13T23:24:14.856 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:50 ago on Fri 13 Sep 2024 11:22:24 PM UTC. 2024-09-13T23:24:14.993 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 170 k 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-13T23:24:14.994 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:14.995 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 170 k 2024-09-13T23:24:14.995 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 494 k 2024-09-13T23:24:14.995 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-13T23:24:15.007 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:55 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:15.101 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rgw-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:15.147 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:15.148 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:15.148 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:15.193 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-nbd-19.1.1-324.gecab7be5.el9.x86_64.rpm 861 kB/s | 170 kB 00:00 2024-09-13T23:24:15.193 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:15.194 INFO:teuthology.orchestra.run.smithi099.stdout:Total 854 kB/s | 170 kB 00:00 2024-09-13T23:24:15.194 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-13T23:24:15.201 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-13T23:24:15.201 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-13T23:24:15.223 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-cephfs 2024-09-13T23:24:15.265 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-13T23:24:15.265 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-13T23:24:15.423 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-13T23:24:15.531 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:15.813 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:55 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:15.907 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-cephfs-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:15.953 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:15.954 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:15.955 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:15.981 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:16.031 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install python3-rbd 2024-09-13T23:24:16.246 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:16.247 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-13T23:24:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:16.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:16.247 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-13T23:24:16.480 DEBUG:teuthology.parallel:result is None 2024-09-13T23:24:16.629 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:56 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:16.725 INFO:teuthology.orchestra.run.smithi043.stdout:Package python3-rbd-2:19.1.1-324.gecab7be5.el9.x86_64 is already installed. 2024-09-13T23:24:16.770 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:16.771 INFO:teuthology.orchestra.run.smithi043.stdout:Nothing to do. 2024-09-13T23:24:16.771 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:16.840 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-fuse 2024-09-13T23:24:17.437 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:57 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:17.577 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse x86_64 2:19.1.1-324.gecab7be5.el9 ceph 85 k 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:17.578 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:17.579 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:17.579 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:17.579 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 85 k 2024-09-13T23:24:17.579 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 231 k 2024-09-13T23:24:17.579 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:17.750 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-fuse-19.1.1-324.gecab7be5.el9.x86_64.rpm 499 kB/s | 85 kB 00:00 2024-09-13T23:24:17.750 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:17.750 INFO:teuthology.orchestra.run.smithi043.stdout:Total 495 kB/s | 85 kB 00:00 2024-09-13T23:24:17.751 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:17.758 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:17.758 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:17.826 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:17.826 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:17.987 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:18.092 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:18.476 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:18.751 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:18.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:18.751 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:18.751 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-fuse-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:18.751 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:18.752 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:19.003 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-mirror 2024-09-13T23:24:19.605 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:01:59 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:19.747 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout: Package Arch Version Repo Size 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror x86_64 2:19.1.1-324.gecab7be5.el9 ceph 3.1 M 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:19.748 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:19.749 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 3.1 M 2024-09-13T23:24:19.749 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 13 M 2024-09-13T23:24:19.749 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:20.195 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-mirror-19.1.1-324.gecab7be5.el9.x86_64.rpm 7.0 MB/s | 3.1 MB 00:00 2024-09-13T23:24:20.195 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:20.196 INFO:teuthology.orchestra.run.smithi043.stdout:Total 6.9 MB/s | 3.1 MB 00:00 2024-09-13T23:24:20.196 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:20.206 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:20.206 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:20.292 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:20.292 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:20.749 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:20.820 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T23:24:20.847 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:21.918 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:21.919 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:21.919 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:21.919 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-mirror-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:21.919 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:21.919 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:22.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo yum -y install rbd-nbd 2024-09-13T23:24:22.783 INFO:teuthology.orchestra.run.smithi043.stdout:Last metadata expiration check: 0:02:02 ago on Fri 13 Sep 2024 11:22:20 PM UTC. 2024-09-13T23:24:22.924 INFO:teuthology.orchestra.run.smithi043.stdout:Dependencies resolved. 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout: Package Architecture Version Repository Size 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout:Installing: 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd x86_64 2:19.1.1-324.gecab7be5.el9 ceph 170 k 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:22.925 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction Summary 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout:================================================================================ 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout:Install 1 Package 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout:Total download size: 170 k 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout:Installed size: 494 k 2024-09-13T23:24:22.926 INFO:teuthology.orchestra.run.smithi043.stdout:Downloading Packages: 2024-09-13T23:24:23.123 INFO:teuthology.orchestra.run.smithi043.stdout:rbd-nbd-19.1.1-324.gecab7be5.el9.x86_64.rpm 865 kB/s | 170 kB 00:00 2024-09-13T23:24:23.124 INFO:teuthology.orchestra.run.smithi043.stdout:-------------------------------------------------------------------------------- 2024-09-13T23:24:23.124 INFO:teuthology.orchestra.run.smithi043.stdout:Total 859 kB/s | 170 kB 00:00 2024-09-13T23:24:23.124 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction check 2024-09-13T23:24:23.132 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction check succeeded. 2024-09-13T23:24:23.133 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction test 2024-09-13T23:24:23.201 INFO:teuthology.orchestra.run.smithi043.stdout:Transaction test succeeded. 2024-09-13T23:24:23.201 INFO:teuthology.orchestra.run.smithi043.stdout:Running transaction 2024-09-13T23:24:23.357 INFO:teuthology.orchestra.run.smithi043.stdout: Preparing : 1/1 2024-09-13T23:24:23.457 INFO:teuthology.orchestra.run.smithi043.stdout: Installing : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:23.881 INFO:teuthology.orchestra.run.smithi043.stdout: Running scriptlet: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:24.134 INFO:teuthology.orchestra.run.smithi043.stdout: Verifying : rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 1/1 2024-09-13T23:24:24.135 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:24.135 INFO:teuthology.orchestra.run.smithi043.stdout:Installed: 2024-09-13T23:24:24.135 INFO:teuthology.orchestra.run.smithi043.stdout: rbd-nbd-2:19.1.1-324.gecab7be5.el9.x86_64 2024-09-13T23:24:24.135 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:24.135 INFO:teuthology.orchestra.run.smithi043.stdout:Complete! 2024-09-13T23:24:24.378 DEBUG:teuthology.parallel:result is None 2024-09-13T23:24:24.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:24:24.526 DEBUG:teuthology.orchestra.run.smithi043:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T23:24:24.549 INFO:teuthology.orchestra.run.smithi043.stdout:19.1.1-324.gecab7be5.el9 2024-09-13T23:24:24.550 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324.gecab7be5.el9 2024-09-13T23:24:24.550 INFO:teuthology.task.install:The correct ceph version 19.1.1-324.gecab7be5 is installed. 2024-09-13T23:24:24.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T23:24:24.701 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T23:24:24.726 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-324.gecab7be5.el9 2024-09-13T23:24:24.726 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-324.gecab7be5.el9 2024-09-13T23:24:24.726 INFO:teuthology.task.install:The correct ceph version 19.1.1-324.gecab7be5 is installed. 2024-09-13T23:24:24.728 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T23:24:24.728 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:24.728 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:24:24.757 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:24.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T23:24:24.795 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T23:24:24.796 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:24.796 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:24:24.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:24:24.890 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:24.890 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T23:24:24.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T23:24:24.985 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T23:24:24.986 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:24.986 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:24:25.012 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:24:25.079 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:25.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T23:24:25.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T23:24:25.176 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T23:24:25.176 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:25.176 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:24:25.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:24:25.270 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:25.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T23:24:25.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T23:24:25.366 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T23:24:25.444 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T23:24:25.445 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 777 /var/log/ceph 2024-09-13T23:24:25.447 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-13T23:24:25.474 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T23:24:25.475 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:24:25.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T23:24:25.543 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T23:24:25.543 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:24:25.584 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T23:24:25.619 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T23:24:25.619 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T23:24:25.619 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904423', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 3476, 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'targets': {'smithi043.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGCt7grJeRb7R3UlruDExlDi5SDMGrL85waKSPLsV8hBZN0dWKDtmunSNRtAuexbNPVHdtkqpLbbzc75rX4WIkE=', 'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTpkfMkT1oO+4QSjcx5RevMEcXNQGk+WOp5yiZApqAQKk/PuLfajqkJaVWlcmRQCXYX58gpqI5N53ZARUYuu80='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'ecab7be58963a5bd03910cd73eef66405d7fdd50', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T23:24:25.619 DEBUG:teuthology.orchestra.run.smithi043:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:24:25.652 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T23:24:25.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:24:25.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T23:24:25.734 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:25.734 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:24:25.791 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:24:25.791 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_1 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-13 23:24:21.108485338 +0000 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-13 23:21:40.719307530 +0000 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-13 23:21:40.719307530 +0000 2024-09-13T23:24:25.848 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-13 23:21:40.719307530 +0000 2024-09-13T23:24:25.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:24:25.914 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-13T23:24:25.914 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-13T23:24:25.914 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000110584 s, 4.6 MB/s 2024-09-13T23:24:25.916 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:24:25.974 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_2 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-13 23:24:21.108485338 +0000 2024-09-13T23:24:26.032 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-13 23:21:41.052303243 +0000 2024-09-13T23:24:26.033 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-13 23:21:41.052303243 +0000 2024-09-13T23:24:26.033 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-13 23:21:41.052303243 +0000 2024-09-13T23:24:26.033 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:24:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-13T23:24:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-13T23:24:26.098 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 0.000108119 s, 4.7 MB/s 2024-09-13T23:24:26.099 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:24:26.157 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_3 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-13 23:24:21.109485325 +0000 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-13 23:21:41.385298957 +0000 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-13 23:21:41.385298957 +0000 2024-09-13T23:24:26.215 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-13 23:21:41.385298957 +0000 2024-09-13T23:24:26.216 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:24:26.281 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-13T23:24:26.281 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-13T23:24:26.281 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 8.666e-05 s, 5.9 MB/s 2024-09-13T23:24:26.282 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:24:26.339 DEBUG:teuthology.orchestra.run.smithi043:> stat /dev/vg_nvme/lv_4 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout:Access: 2024-09-13 23:24:21.109485325 +0000 2024-09-13T23:24:26.397 INFO:teuthology.orchestra.run.smithi043.stdout:Modify: 2024-09-13 23:21:41.706294825 +0000 2024-09-13T23:24:26.398 INFO:teuthology.orchestra.run.smithi043.stdout:Change: 2024-09-13 23:21:41.706294825 +0000 2024-09-13T23:24:26.398 INFO:teuthology.orchestra.run.smithi043.stdout: Birth: 2024-09-13 23:21:41.706294825 +0000 2024-09-13T23:24:26.398 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:24:26.463 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records in 2024-09-13T23:24:26.463 INFO:teuthology.orchestra.run.smithi043.stderr:1+0 records out 2024-09-13T23:24:26.463 INFO:teuthology.orchestra.run.smithi043.stderr:512 bytes copied, 9.3308e-05 s, 5.5 MB/s 2024-09-13T23:24:26.464 DEBUG:teuthology.orchestra.run.smithi043:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:24:26.523 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:24:26.523 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:26.523 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T23:24:26.543 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T23:24:26.543 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-13T23:24:26.601 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 23:24:13.179957690 +0000 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 23:21:38.753088018 +0000 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 23:21:38.753088018 +0000 2024-09-13T23:24:26.602 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-13 23:21:38.753088018 +0000 2024-09-13T23:24:26.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T23:24:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T23:24:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T23:24:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000270579 s, 1.9 MB/s 2024-09-13T23:24:26.672 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T23:24:26.731 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-13T23:24:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T23:24:26.788 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 23:24:13.180957668 +0000 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 23:21:39.094080382 +0000 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 23:21:39.094080382 +0000 2024-09-13T23:24:26.789 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-13 23:21:39.094080382 +0000 2024-09-13T23:24:26.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T23:24:26.855 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T23:24:26.855 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T23:24:26.855 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000202414 s, 2.5 MB/s 2024-09-13T23:24:26.856 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T23:24:26.914 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 23:24:13.180957668 +0000 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 23:21:39.410073305 +0000 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 23:21:39.410073305 +0000 2024-09-13T23:24:26.971 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-13 23:21:39.410073305 +0000 2024-09-13T23:24:26.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T23:24:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T23:24:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T23:24:27.036 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000241724 s, 2.1 MB/s 2024-09-13T23:24:27.037 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T23:24:27.094 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-13T23:24:27.150 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T23:24:27.150 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T23:24:27.150 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-13T23:24:27.150 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T23:24:27.150 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T23:24:27.151 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-13 23:24:13.180957668 +0000 2024-09-13T23:24:27.151 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-13 23:21:39.747065757 +0000 2024-09-13T23:24:27.151 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-13 23:21:39.747065757 +0000 2024-09-13T23:24:27.151 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-13 23:21:39.747065757 +0000 2024-09-13T23:24:27.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T23:24:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-13T23:24:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-13T23:24:27.214 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000205965 s, 2.5 MB/s 2024-09-13T23:24:27.216 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T23:24:27.272 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:24:27.273 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:24:27.273 INFO:tasks.ceph:Generating config... 2024-09-13T23:24:27.274 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T23:24:27.274 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T23:24:27.274 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T23:24:27.274 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T23:24:27.274 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T23:24:27.274 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T23:24:27.275 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T23:24:27.276 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T23:24:27.276 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T23:24:27.276 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T23:24:27.276 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T23:24:27.276 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T23:24:27.276 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T23:24:27.276 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T23:24:27.276 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T23:24:27.276 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T23:24:27.277 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T23:24:27.333 INFO:teuthology.orchestra.run.smithi043.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T23:24:27.336 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T23:24:27.384 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:24:27.411 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.43')] 2024-09-13T23:24:27.411 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.43'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T23:24:27.412 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:27.412 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:24:27.468 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.43 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:27.550 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:24:27.550 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:24:27.551 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:27.551 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: generated fsid d45f1493-9740-4c4f-a727-0654beec83a1 2024-09-13T23:24:27.551 INFO:teuthology.orchestra.run.smithi043.stdout:setting min_mon_release = quincy 2024-09-13T23:24:27.551 INFO:teuthology.orchestra.run.smithi043.stdout:epoch 0 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:fsid d45f1493-9740-4c4f-a727-0654beec83a1 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:last_changed 2024-09-13T23:24:27.550791+0000 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:created 2024-09-13T23:24:27.550791+0000 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:min_mon_release 17 (quincy) 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:election_strategy: 1 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:0: [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] mon.a 2024-09-13T23:24:27.552 INFO:teuthology.orchestra.run.smithi043.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T23:24:27.553 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T23:24:27.611 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d45f1493-9740-4c4f-a727-0654beec83a1... 2024-09-13T23:24:27.612 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:24:27.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T23:24:27.697 INFO:teuthology.orchestra.run.smithi043.stdout:[global] 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: chdir = "" 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: auth supported = cephx 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: filestore xattr use omap = true 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: mon clock drift allowed = 1.000 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.698 INFO:teuthology.orchestra.run.smithi043.stdout: osd crush chooseleaf type = 0 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: auth debug = true 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on old message = true 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: ms die on bug = true 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: mon pg warn max object skew = 0 2024-09-13T23:24:27.699 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default size = 2 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow primary affinity = true 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd allow pg remap = true 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on no sortbitwise = false 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:24:27.700 INFO:teuthology.orchestra.run.smithi043.stdout: mon warn on too few osds = false 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: mon_allow_pool_size_one = true 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: osd default data pool replay window = 5 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: mon allow pool delete = true 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: mon cluster log file level = debug 2024-09-13T23:24:27.701 INFO:teuthology.orchestra.run.smithi043.stdout: debug asserts on shutdown = true 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: mon health detail to clog = false 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: mon host = 172.21.15.43 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: fsid = d45f1493-9740-4c4f-a727-0654beec83a1 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout:[osd] 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: osd journal size = 100 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.702 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub load threshold = 5.0 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd scrub max interval = 600 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd recover clone overlap = true 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd recovery max chunk = 1048576 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug shutdown = true 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug op order = true 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug verify stray on activate = true 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug trim objects = true 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.703 INFO:teuthology.orchestra.run.smithi043.stdout: osd open classes on start = true 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug pg log writeout = true 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: osd map max advance = 10 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: journal zero on create = true 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: filestore apply finisher threads = 3 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: bdev debug aio = true 2024-09-13T23:24:27.704 INFO:teuthology.orchestra.run.smithi043.stdout: osd debug misdirected ops = true 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug objclass = 20 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: bdev async discard = True 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: bdev enable discard = True 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore allocator = bitmap 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore block size = 96636764160 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: bluestore fsck on mount = True 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluefs = 1/20 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug bluestore = 1/20 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug osd = 20 2024-09-13T23:24:27.705 INFO:teuthology.orchestra.run.smithi043.stdout: debug rocksdb = 4/10 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd full ratio = 0.9 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: osd objectstore = bluestore 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr] 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug mgr = 20 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:24:27.706 INFO:teuthology.orchestra.run.smithi043.stdout: mgr/telemetry/nag = false 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout:[mon] 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: debug mon = 20 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: debug paxos = 20 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: debug auth = 20 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon data avail warn = 5 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon mgr mkfs grace = 240 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd reporter subtree level = osd 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon osd prime pg temp = true 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:24:27.707 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: # 1m isn't quite enough 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:24:27.708 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout:[client] 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: rgw cache enabled = true 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable ops log = true 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: rgw enable usage log = true 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: debug ms = 1 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: rgw gc obj min wait = 15 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: debug rgw = 20 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: setgroup = ceph 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout: setuser = ceph 2024-09-13T23:24:27.709 INFO:teuthology.orchestra.run.smithi043.stdout:[mon.a] 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.710 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.711 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-13T23:24:27.712 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.713 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = 172.21.15.43 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = d45f1493-9740-4c4f-a727-0654beec83a1 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.714 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.715 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-13T23:24:27.716 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug objclass = 20 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T23:24:27.717 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.718 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T23:24:27.719 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-13T23:24:27.720 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: rgw gc obj min wait = 15 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: debug rgw = 20 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: setgroup = ceph 2024-09-13T23:24:27.721 INFO:teuthology.orchestra.run.smithi099.stdout: setuser = ceph 2024-09-13T23:24:27.722 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-13T23:24:27.723 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T23:24:27.723 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T23:24:27.820 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T23:24:27.820 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:27.821 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T23:24:27.836 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:27.836 DEBUG:teuthology.orchestra.run.smithi043:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T23:24:27.892 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi043.front.sepia.ceph.com 2024-09-13T23:24:27.893 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:27.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:24:27.893 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:24:27.968 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:27.968 DEBUG:teuthology.orchestra.run.smithi043:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:28.025 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:24:28.025 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:28.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T23:24:28.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T23:24:28.062 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:28.063 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:28.119 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T23:24:28.119 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T23:24:28.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:24:28.229 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T23:24:28.232 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T23:24:28.232 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T23:24:28.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T23:24:28.273 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T23:24:28.285 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T23:24:28.285 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi043.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T23:24:28.286 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T23:24:28.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T23:24:28.312 INFO:tasks.ceph:role: osd.0 2024-09-13T23:24:28.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-13T23:24:28.312 DEBUG:teuthology.orchestra.run.smithi043:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:24:28.377 INFO:teuthology.orchestra.run.smithi043.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:24:28.378 INFO:teuthology.orchestra.run.smithi043.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:24:28.411 INFO:teuthology.orchestra.run.smithi043.stdout:Discarding blocks...Done. 2024-09-13T23:24:28.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi043.front.sepia.ceph.com -o noatime 2024-09-13T23:24:28.413 DEBUG:teuthology.orchestra.run.smithi043:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T23:24:28.482 DEBUG:teuthology.orchestra.run.smithi043:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T23:24:28.553 DEBUG:teuthology.orchestra.run.smithi043:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:28.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:28.665+0000 7fe620ba4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T23:24:28.666 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:28.665+0000 7fe620ba4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T23:24:28.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:28.665+0000 7fe620ba4640 -1 bdev(0x55eade1e9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T23:24:28.667 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:28.665+0000 7fe620ba4640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T23:24:32.337 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T23:24:32.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T23:24:32.400 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:24:32.400 INFO:tasks.ceph:role: osd.1 2024-09-13T23:24:32.400 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:24:32.401 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T23:24:32.476 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:24:32.477 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:24:32.478 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:24:32.976 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-13T23:24:32.979 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T23:24:32.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T23:24:33.085 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T23:24:33.118 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T23:24:33.184 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:24:33.184 INFO:tasks.ceph:role: osd.2 2024-09-13T23:24:33.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:24:33.185 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T23:24:33.258 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:24:33.258 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:24:33.258 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:24:33.258 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:24:33.259 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:24:33.716 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-13T23:24:33.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T23:24:33.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T23:24:33.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T23:24:33.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T23:24:33.927 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T23:24:33.927 INFO:tasks.ceph:role: osd.3 2024-09-13T23:24:33.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:24:33.927 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T23:24:33.999 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-13T23:24:34.000 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T23:24:34.000 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T23:24:34.000 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T23:24:34.000 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T23:24:34.477 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-13T23:24:34.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-13T23:24:34.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T23:24:34.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T23:24:34.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:34.714+0000 7f1eb0fbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T23:24:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:34.715+0000 7f1eb0fbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T23:24:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:34.715+0000 7f1eb0fbd640 -1 bdev(0x560b6f87d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T23:24:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:34.715+0000 7f1eb0fbd640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T23:24:38.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T23:24:38.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:38.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:38.490+0000 7f40dde19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T23:24:38.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:38.490+0000 7f40dde19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T23:24:38.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:38.491+0000 7f40dde19640 -1 bdev(0x557f6b279800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T23:24:38.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:38.491+0000 7f40dde19640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T23:24:42.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T23:24:42.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:42.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:42.268+0000 7fdf17769640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T23:24:42.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:42.268+0000 7fdf17769640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T23:24:42.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:42.268+0000 7fdf17769640 -1 bdev(0x556cdaded800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T23:24:42.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:42.268+0000 7fdf17769640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T23:24:46.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T23:24:46.205 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T23:24:46.205 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:46.205 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T23:24:46.237 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:46.237 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T23:24:46.273 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:46.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T23:24:46.340 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:46.340 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T23:24:46.406 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:46.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T23:24:46.473 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:46.473 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T23:24:46.529 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T23:24:46.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.0] 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCsyeRmHSS2JxAAiRP2VMaSk2rJfemjWzN5EQ== 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout:[mgr.x] 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCsyeRm17GtDRAAa7SvalJd3Zob9cG5qCifqQ== 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.1] 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCyyeRmK8+tKhAAlAqGRNgqgerU/A42MK/DIw== 2024-09-13T23:24:46.561 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.2] 2024-09-13T23:24:46.562 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC2yeRm01FPHRAAmdTmJtDYLnFGn/m0aU6v1Q== 2024-09-13T23:24:46.562 INFO:teuthology.orchestra.run.smithi043.stdout:[osd.3] 2024-09-13T23:24:46.562 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQC6yeRma8UPEBAAtXvaDxmVahOZZskHbM4v+w== 2024-09-13T23:24:46.562 INFO:teuthology.orchestra.run.smithi043.stdout:[client.0] 2024-09-13T23:24:46.562 INFO:teuthology.orchestra.run.smithi043.stdout: key = AQCsyeRmB6JHEBAAE31ewi5bHhsv7OtjtSnzUA== 2024-09-13T23:24:46.563 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:24:46.661 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T23:24:46.716 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:24:46.771 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:24:46.823 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T23:24:46.875 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T23:24:46.931 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T23:24:46.932 DEBUG:teuthology.orchestra.run.smithi043:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T23:24:46.957 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T23:24:47.055 DEBUG:teuthology.orchestra.run.smithi043:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T23:24:47.081 DEBUG:teuthology.orchestra.run.smithi043:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T23:24:47.136 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T23:24:47.137 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T23:24:47.137 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T23:24:47.179 INFO:tasks.ceph.mon.a:Started 2024-09-13T23:24:47.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T23:24:47.180 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T23:24:47.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T23:24:47.182 INFO:tasks.ceph.mgr.x:Started 2024-09-13T23:24:47.182 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T23:24:47.183 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T23:24:47.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.284+0000 7ff9c015a640 1 Processor -- start 2024-09-13T23:24:47.286 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9c015a640 1 -- start start 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9c015a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9b809bd50 0x7ff9b809c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9c015a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b809d3b0 con 0x7ff9b809c670 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9c015a640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b8098230 con 0x7ff9b809bd50 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bdef6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9b809bd50 0x7ff9b809c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bdef6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff9b809bd50 0x7ff9b809c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53340/0 (socket says 172.21.15.43:53340) 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bd6f5640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7ff9b809c670 0x7ff9b80990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:54814/0 (socket says 172.21.15.43:54814) 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bdef6640 1 -- 172.21.15.43:0/292627140 learned_addr learned my addr 172.21.15.43:0/292627140 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bdef6640 1 -- 172.21.15.43:0/292627140 >> v1:172.21.15.43:6789/0 conn(0x7ff9b809c670 legacy=0x7ff9b80990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bdef6640 1 -- 172.21.15.43:0/292627140 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b80983e0 con 0x7ff9b809bd50 2024-09-13T23:24:47.287 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.285+0000 7ff9bcef4640 1 -- 172.21.15.43:0/292627140 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832924495 0 0) 0x7ff9a8001110 con 0x7ff9b809c670 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.286+0000 7ff9bdef6640 1 --2- 172.21.15.43:0/292627140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b809c130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40097f0 tx=0x7ff9b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cea1c056835ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.286+0000 7ff9bcef4640 1 -- 172.21.15.43:0/292627140 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b4037070 con 0x7ff9b809bd50 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.286+0000 7ff9bcef4640 1 -- 172.21.15.43:0/292627140 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4032440 con 0x7ff9b809bd50 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.286+0000 7ff9bcef4640 1 -- 172.21.15.43:0/292627140 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b402ae60 con 0x7ff9b809bd50 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 -- 172.21.15.43:0/292627140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 msgr2=0x7ff9b809c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 --2- 172.21.15.43:0/292627140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b809c130 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40097f0 tx=0x7ff9b402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 -- 172.21.15.43:0/292627140 shutdown_connections 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 --2- 172.21.15.43:0/292627140 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b809c130 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 -- 172.21.15.43:0/292627140 >> 172.21.15.43:0/292627140 conn(0x7ff9b806d4a0 msgr2=0x7ff9b806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 -- 172.21.15.43:0/292627140 shutdown_connections 2024-09-13T23:24:47.289 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.287+0000 7ff9c015a640 1 -- 172.21.15.43:0/292627140 wait complete. 2024-09-13T23:24:47.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9c015a640 1 Processor -- start 2024-09-13T23:24:47.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9c015a640 1 -- start start 2024-09-13T23:24:47.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9c015a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9c015a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b8099b90 con 0x7ff9b809bd50 2024-09-13T23:24:47.291 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9bdef6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9bdef6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:53356/0 (socket says 172.21.15.43:53356) 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.288+0000 7ff9bdef6640 1 -- 172.21.15.43:0/1770034598 learned_addr learned my addr 172.21.15.43:0/1770034598 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9bdef6640 1 -- 172.21.15.43:0/1770034598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b81b79c0 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9bdef6640 1 --2- 172.21.15.43:0/1770034598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4035040 tx=0x7ff9b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b4041070 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b403c7a0 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b81ab7f0 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9b4037040 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b8094b80 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9b4044070 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.289+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff9b4046e00 con 0x7ff9b809bd50 2024-09-13T23:24:47.292 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.290+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b8096050 con 0x7ff9b809bd50 2024-09-13T23:24:47.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.292+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff9b8096050 con 0x7ff9b809bd50 2024-09-13T23:24:47.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.356+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff9b809a130 con 0x7ff9b809bd50 2024-09-13T23:24:47.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.357+0000 7ff9ae7fc640 1 -- 172.21.15.43:0/1770034598 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff9b81b79c0 con 0x7ff9b809bd50 2024-09-13T23:24:47.358 INFO:teuthology.orchestra.run.smithi043.stderr:adjusted tunables profile to default 2024-09-13T23:24:47.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 msgr2=0x7ff9b8094640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 --2- 172.21.15.43:0/1770034598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4035040 tx=0x7ff9b40046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 shutdown_connections 2024-09-13T23:24:47.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 --2- 172.21.15.43:0/1770034598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff9b809bd50 0x7ff9b8094640 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.359 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 >> 172.21.15.43:0/1770034598 conn(0x7ff9b806d4a0 msgr2=0x7ff9b809eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 shutdown_connections 2024-09-13T23:24:47.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:47.358+0000 7ff9c015a640 1 -- 172.21.15.43:0/1770034598 wait complete. 2024-09-13T23:24:47.369 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T23:24:47.369 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T23:24:47.370 DEBUG:teuthology.orchestra.run.smithi043:> set -ex 2024-09-13T23:24:47.370 DEBUG:teuthology.orchestra.run.smithi043:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T23:24:47.379 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.378+0000 7f61ec20d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T23:24:47.396 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:47.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T23:24:47.421 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:47.421 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T23:24:47.422 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.420+0000 7f61ec20d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T23:24:47.486 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-13T23:24:47.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T23:24:47.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new bbc19d48-8273-485f-9a6f-31c1f927425f 0 2024-09-13T23:24:47.567 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.565+0000 7f61ec20d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T23:24:47.620 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.619+0000 7f61ec20d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79be4b1640 1 Processor -- start 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79be4b1640 1 -- start start 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79be4b1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f79b8114cf0 0x7f79b81150d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79be4b1640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b8115760 con 0x7f79b810fd90 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79be4b1640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f79b8110950 con 0x7f79b8114cf0 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79b7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f79b8114cf0 0x7f79b81150d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79b7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f79b8114cf0 0x7f79b81150d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:39980/0 (socket says 172.21.15.99:39980) 2024-09-13T23:24:47.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79b7fff640 1 -- 172.21.15.99:0/733757141 learned_addr learned my addr 172.21.15.99:0/733757141 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:47.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.662+0000 7f79b77fe640 1 --1- 172.21.15.99:0/733757141 >> v1:172.21.15.43:6789/0 conn(0x7f79b810fd90 0x7f79b8110240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41290/0 (socket says 172.21.15.99:41290) 2024-09-13T23:24:47.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.663+0000 7f79b7fff640 1 -- 172.21.15.99:0/733757141 >> v1:172.21.15.43:6789/0 conn(0x7f79b810fd90 legacy=0x7f79b8110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.663+0000 7f79b7fff640 1 -- 172.21.15.99:0/733757141 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b8110b00 con 0x7f79b8114cf0 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.663+0000 7f79b7fff640 1 --2- 172.21.15.99:0/733757141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b8114cf0 0x7f79b81150d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f79a80097f0 tx=0x7f79a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b266e5a53944d687 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79b6ffd640 1 -- 172.21.15.99:0/733757141 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a8037070 con 0x7f79b8114cf0 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79b6ffd640 1 -- 172.21.15.99:0/733757141 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a8032440 con 0x7f79b8114cf0 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79b6ffd640 1 -- 172.21.15.99:0/733757141 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a802ae60 con 0x7f79b8114cf0 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 -- 172.21.15.99:0/733757141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b8114cf0 msgr2=0x7f79b81150d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 --2- 172.21.15.99:0/733757141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b8114cf0 0x7f79b81150d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f79a80097f0 tx=0x7f79a802a1e0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 -- 172.21.15.99:0/733757141 shutdown_connections 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 --2- 172.21.15.99:0/733757141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b8114cf0 0x7f79b81150d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 -- 172.21.15.99:0/733757141 >> 172.21.15.99:0/733757141 conn(0x7f79b8071290 msgr2=0x7f79b80736b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 -- 172.21.15.99:0/733757141 shutdown_connections 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.664+0000 7f79be4b1640 1 -- 172.21.15.99:0/733757141 wait complete. 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79be4b1640 1 Processor -- start 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79be4b1640 1 -- start start 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79be4b1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79be4b1640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f79b811bf80 con 0x7f79b810fd90 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79b7fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:39982/0 (socket says 172.21.15.99:39982) 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.665+0000 7f79b7fff640 1 -- 172.21.15.99:0/343994271 learned_addr learned my addr 172.21.15.99:0/343994271 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b7fff640 1 -- 172.21.15.99:0/343994271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b81a4f90 con 0x7f79b810fd90 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b7fff640 1 --2- 172.21.15.99:0/343994271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f79a8035040 tx=0x7f79a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a8041070 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a803c7a0 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79a8037040 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b81a5220 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b81a91d0 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f79a8044070 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.666+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f79a8046e00 con 0x7f79b810fd90 2024-09-13T23:24:47.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.667+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b8115150 con 0x7f79b810fd90 2024-09-13T23:24:47.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.670+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f79a8046450 con 0x7f79b810fd90 2024-09-13T23:24:47.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.739+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bbc19d48-8273-485f-9a6f-31c1f927425f", "id": 0} v 0) -- 0x7f79b8114cf0 con 0x7f79b810fd90 2024-09-13T23:24:47.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.740+0000 7f79b4ff9640 1 -- 172.21.15.99:0/343994271 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbc19d48-8273-485f-9a6f-31c1f927425f", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f79a803caa0 con 0x7f79b810fd90 2024-09-13T23:24:47.741 INFO:teuthology.orchestra.run.smithi099.stdout:0 2024-09-13T23:24:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 msgr2=0x7f79b81a4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 --2- 172.21.15.99:0/343994271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f79a8035040 tx=0x7f79a80046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 shutdown_connections 2024-09-13T23:24:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 --2- 172.21.15.99:0/343994271 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f79b810fd90 0x7f79b81a4a50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 >> 172.21.15.99:0/343994271 conn(0x7f79b8071290 msgr2=0x7f79b8072680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 shutdown_connections 2024-09-13T23:24:47.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.741+0000 7f79be4b1640 1 -- 172.21.15.99:0/343994271 wait complete. 2024-09-13T23:24:47.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 71f3004f-eb62-485d-b2f7-d466392cfba5 1 2024-09-13T23:24:47.778 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.777+0000 7f61ec20d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a2fcf640 1 Processor -- start 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a2fcf640 1 -- start start 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a2fcf640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f059c06cc30 0x7f059c11d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a2fcf640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059c06d150 con 0x7f059c110ba0 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a2fcf640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f059c11e950 con 0x7f059c06cc30 2024-09-13T23:24:47.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f059bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f059c06cc30 0x7f059c11d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a0d6b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f059c110ba0 0x7f059c06c430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41296/0 (socket says 172.21.15.99:41296) 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.849+0000 7f05a0d6b640 1 -- 172.21.15.99:0/709632833 learned_addr learned my addr 172.21.15.99:0/709632833 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.850+0000 7f059b7fe640 1 -- 172.21.15.99:0/709632833 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276056620 0 0) 0x7f059c06d150 con 0x7f059c110ba0 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.850+0000 7f059b7fe640 1 -- 172.21.15.99:0/709632833 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f058c003520 con 0x7f059c110ba0 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.850+0000 7f059bfff640 1 -- 172.21.15.99:0/709632833 >> v1:172.21.15.43:6789/0 conn(0x7f059c110ba0 legacy=0x7f059c06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.850+0000 7f059bfff640 1 -- 172.21.15.99:0/709632833 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c11ead0 con 0x7f059c06cc30 2024-09-13T23:24:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.851+0000 7f059bfff640 1 --2- 172.21.15.99:0/709632833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c11d400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0588009720 tx=0x7f058802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f6a697848f0be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.851+0000 7f059b7fe640 1 -- 172.21.15.99:0/709632833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0588037070 con 0x7f059c06cc30 2024-09-13T23:24:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.851+0000 7f059b7fe640 1 -- 172.21.15.99:0/709632833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058802ad90 con 0x7f059c06cc30 2024-09-13T23:24:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.851+0000 7f059b7fe640 1 -- 172.21.15.99:0/709632833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0588032590 con 0x7f059c06cc30 2024-09-13T23:24:47.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 -- 172.21.15.99:0/709632833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 msgr2=0x7f059c11d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 --2- 172.21.15.99:0/709632833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c11d400 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0588009720 tx=0x7f058802a110 comp rx=0 tx=0).stop 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 -- 172.21.15.99:0/709632833 shutdown_connections 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 --2- 172.21.15.99:0/709632833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c11d400 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 -- 172.21.15.99:0/709632833 >> 172.21.15.99:0/709632833 conn(0x7f059c070010 msgr2=0x7f059c072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 -- 172.21.15.99:0/709632833 shutdown_connections 2024-09-13T23:24:47.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 -- 172.21.15.99:0/709632833 wait complete. 2024-09-13T23:24:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.852+0000 7f05a2fcf640 1 Processor -- start 2024-09-13T23:24:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a2fcf640 1 -- start start 2024-09-13T23:24:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a2fcf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a2fcf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f059c11ddd0 con 0x7f059c06cc30 2024-09-13T23:24:47.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a0d6b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a0d6b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:39988/0 (socket says 172.21.15.99:39988) 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.853+0000 7f05a0d6b640 1 -- 172.21.15.99:0/1424928169 learned_addr learned my addr 172.21.15.99:0/1424928169 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05a0d6b640 1 -- 172.21.15.99:0/1424928169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059c1a6f30 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05a0d6b640 1 --2- 172.21.15.99:0/1424928169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f059000c480 tx=0x7f059000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0590017070 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0590005c10 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059c1a7220 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0590007070 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059c1ab350 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f059001a070 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.854+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0590012400 con 0x7f059c06cc30 2024-09-13T23:24:47.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.855+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059c11e390 con 0x7f059c06cc30 2024-09-13T23:24:47.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.857+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0590021070 con 0x7f059c06cc30 2024-09-13T23:24:47.895 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:47.893+0000 7f61ec20d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T23:24:47.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.926+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "71f3004f-eb62-485d-b2f7-d466392cfba5", "id": 1} v 0) -- 0x7f059c1a7450 con 0x7f059c06cc30 2024-09-13T23:24:47.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05997fa640 1 -- 172.21.15.99:0/1424928169 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71f3004f-eb62-485d-b2f7-d466392cfba5", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f059001c570 con 0x7f059c06cc30 2024-09-13T23:24:47.930 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-13T23:24:47.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 msgr2=0x7f059c1a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:47.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05a2fcf640 1 --2- 172.21.15.99:0/1424928169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f059000c480 tx=0x7f059000c940 comp rx=0 tx=0).stop 2024-09-13T23:24:47.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 shutdown_connections 2024-09-13T23:24:47.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05a2fcf640 1 --2- 172.21.15.99:0/1424928169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f059c06cc30 0x7f059c1a69f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:47.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.928+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 >> 172.21.15.99:0/1424928169 conn(0x7f059c070010 msgr2=0x7f059c1173b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:47.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.929+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 shutdown_connections 2024-09-13T23:24:47.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:47.929+0000 7f05a2fcf640 1 -- 172.21.15.99:0/1424928169 wait complete. 2024-09-13T23:24:47.940 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 8384ecd2-ff83-4338-b221-bd9590425677 2 2024-09-13T23:24:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.076+0000 7f00072e6640 1 Processor -- start 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.076+0000 7f00072e6640 1 -- start start 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.076+0000 7f00072e6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f000006d540 0x7f000006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.076+0000 7f00072e6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000006e310 con 0x7f000006de60 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.076+0000 7f00072e6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f000011e930 con 0x7f000006d540 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0005082640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f000006d540 0x7f000006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0005082640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f000006d540 0x7f000006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:39998/0 (socket says 172.21.15.99:39998) 2024-09-13T23:24:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0005082640 1 -- 172.21.15.99:0/2530043159 learned_addr learned my addr 172.21.15.99:0/2530043159 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0004881640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f000006de60 0x7f000011c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41300/0 (socket says 172.21.15.99:41300) 2024-09-13T23:24:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0005082640 1 -- 172.21.15.99:0/2530043159 >> v1:172.21.15.43:6789/0 conn(0x7f000006de60 legacy=0x7f000011c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.077+0000 7f0005082640 1 -- 172.21.15.99:0/2530043159 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000011eab0 con 0x7f000006d540 2024-09-13T23:24:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f0005082640 1 --2- 172.21.15.99:0/2530043159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f000006d920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efff00097f0 tx=0x7efff002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8f591cda0cfec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7efff7fff640 1 -- 172.21.15.99:0/2530043159 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0037070 con 0x7f000006d540 2024-09-13T23:24:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7efff7fff640 1 -- 172.21.15.99:0/2530043159 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff0032440 con 0x7f000006d540 2024-09-13T23:24:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7efff7fff640 1 -- 172.21.15.99:0/2530043159 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff002ae60 con 0x7f000006d540 2024-09-13T23:24:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 -- 172.21.15.99:0/2530043159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 msgr2=0x7f000006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 --2- 172.21.15.99:0/2530043159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f000006d920 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efff00097f0 tx=0x7efff002a1e0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 -- 172.21.15.99:0/2530043159 shutdown_connections 2024-09-13T23:24:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 --2- 172.21.15.99:0/2530043159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f000006d920 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 -- 172.21.15.99:0/2530043159 >> 172.21.15.99:0/2530043159 conn(0x7f0000071040 msgr2=0x7f0000073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 -- 172.21.15.99:0/2530043159 shutdown_connections 2024-09-13T23:24:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.078+0000 7f00072e6640 1 -- 172.21.15.99:0/2530043159 wait complete. 2024-09-13T23:24:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f00072e6640 1 Processor -- start 2024-09-13T23:24:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f00072e6640 1 -- start start 2024-09-13T23:24:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f00072e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f00072e6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f000011ddb0 con 0x7f000006d540 2024-09-13T23:24:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f0005082640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f0005082640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:40008/0 (socket says 172.21.15.99:40008) 2024-09-13T23:24:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.079+0000 7f0005082640 1 -- 172.21.15.99:0/73653165 learned_addr learned my addr 172.21.15.99:0/73653165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7f0005082640 1 -- 172.21.15.99:0/73653165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00001a71a0 con 0x7f000006d540 2024-09-13T23:24:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7f0005082640 1 --2- 172.21.15.99:0/73653165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efff0035040 tx=0x7efff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0041070 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff003c7a0 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00001a7430 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efff0037040 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001ab500 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efff0044070 con 0x7f000006d540 2024-09-13T23:24:48.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.080+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7efff003d3f0 con 0x7f000006d540 2024-09-13T23:24:48.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.081+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000006d9a0 con 0x7f000006d540 2024-09-13T23:24:48.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.083+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efff0046450 con 0x7f000006d540 2024-09-13T23:24:48.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.152+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8384ecd2-ff83-4338-b221-bd9590425677", "id": 2} v 0) -- 0x7f00001a7600 con 0x7f000006d540 2024-09-13T23:24:48.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.153+0000 7efff5ffb640 1 -- 172.21.15.99:0/73653165 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8384ecd2-ff83-4338-b221-bd9590425677", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7efff003caa0 con 0x7f000006d540 2024-09-13T23:24:48.155 INFO:teuthology.orchestra.run.smithi099.stdout:2 2024-09-13T23:24:48.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 msgr2=0x7f00001a6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 --2- 172.21.15.99:0/73653165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efff0035040 tx=0x7efff00046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 shutdown_connections 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 --2- 172.21.15.99:0/73653165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f000006d540 0x7f00001a6bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 >> 172.21.15.99:0/73653165 conn(0x7f0000071040 msgr2=0x7f000011d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 shutdown_connections 2024-09-13T23:24:48.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.154+0000 7f00072e6640 1 -- 172.21.15.99:0/73653165 wait complete. 2024-09-13T23:24:48.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd new 975b1f77-fef9-4942-9b24-2ef1bd202e62 3 2024-09-13T23:24:48.224 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:48.223+0000 7f61ec20d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T23:24:48.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f6a22b640 1 Processor -- start 2024-09-13T23:24:48.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f6a22b640 1 -- start start 2024-09-13T23:24:48.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f6a22b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f6406f7b0 0x7f1f6406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f6a22b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64070560 con 0x7f1f640700d0 2024-09-13T23:24:48.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f6a22b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1f64122d20 con 0x7f1f6406f7b0 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.262+0000 7f1f637fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f6406f7b0 0x7f1f6406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.263+0000 7f1f637fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1f6406f7b0 0x7f1f6406fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:40024/0 (socket says 172.21.15.99:40024) 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.263+0000 7f1f637fe640 1 -- 172.21.15.99:0/429813293 learned_addr learned my addr 172.21.15.99:0/429813293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.263+0000 7f1f637fe640 1 -- 172.21.15.99:0/429813293 >> v1:172.21.15.43:6789/0 conn(0x7f1f640700d0 legacy=0x7f1f641205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.263+0000 7f1f637fe640 1 -- 172.21.15.99:0/429813293 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64122ea0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.263+0000 7f1f637fe640 1 --2- 172.21.15.99:0/429813293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f6406fb90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f540097f0 tx=0x7f1f5402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbdbbf91c0960bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f627fc640 1 -- 172.21.15.99:0/429813293 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f54037070 con 0x7f1f6406f7b0 2024-09-13T23:24:48.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f627fc640 1 -- 172.21.15.99:0/429813293 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f54032440 con 0x7f1f6406f7b0 2024-09-13T23:24:48.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f627fc640 1 -- 172.21.15.99:0/429813293 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f5402ae60 con 0x7f1f6406f7b0 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 -- 172.21.15.99:0/429813293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 msgr2=0x7f1f6406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 --2- 172.21.15.99:0/429813293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f6406fb90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f540097f0 tx=0x7f1f5402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 -- 172.21.15.99:0/429813293 shutdown_connections 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 --2- 172.21.15.99:0/429813293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f6406fb90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 -- 172.21.15.99:0/429813293 >> 172.21.15.99:0/429813293 conn(0x7f1f6406e5e0 msgr2=0x7f1f6406e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 -- 172.21.15.99:0/429813293 shutdown_connections 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.264+0000 7f1f6a22b640 1 -- 172.21.15.99:0/429813293 wait complete. 2024-09-13T23:24:48.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.265+0000 7f1f6a22b640 1 Processor -- start 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.265+0000 7f1f6a22b640 1 -- start start 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.265+0000 7f1f6a22b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.265+0000 7f1f6a22b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1f641221c0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f637fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f637fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:40026/0 (socket says 172.21.15.99:40026) 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f637fe640 1 -- 172.21.15.99:0/493411375 learned_addr learned my addr 172.21.15.99:0/493411375 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f637fe640 1 -- 172.21.15.99:0/493411375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f641b1140 con 0x7f1f6406f7b0 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f637fe640 1 --2- 172.21.15.99:0/493411375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f54035040 tx=0x7f1f540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f54041070 con 0x7f1f6406f7b0 2024-09-13T23:24:48.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5403c7a0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f641b1370 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f54037040 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f641aac80 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f54044070 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.266+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1f5403d3f0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.267+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6406fb90 con 0x7f1f6406f7b0 2024-09-13T23:24:48.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.270+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1f54046450 con 0x7f1f6406f7b0 2024-09-13T23:24:48.280 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:48.279+0000 7f61ec20d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T23:24:48.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.338+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd new", "uuid": "975b1f77-fef9-4942-9b24-2ef1bd202e62", "id": 3} v 0) -- 0x7f1f640700d0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.339+0000 7f1f4bfff640 1 -- 172.21.15.99:0/493411375 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "975b1f77-fef9-4942-9b24-2ef1bd202e62", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1f5403caa0 con 0x7f1f6406f7b0 2024-09-13T23:24:48.340 INFO:teuthology.orchestra.run.smithi099.stdout:3 2024-09-13T23:24:48.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 msgr2=0x7f1f641b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 --2- 172.21.15.99:0/493411375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1f54035040 tx=0x7f1f540046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 shutdown_connections 2024-09-13T23:24:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 --2- 172.21.15.99:0/493411375 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1f6406f7b0 0x7f1f641b0b70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 >> 172.21.15.99:0/493411375 conn(0x7f1f6406e5e0 msgr2=0x7f1f6410f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 shutdown_connections 2024-09-13T23:24:48.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:24:48.340+0000 7f1f6a22b640 1 -- 172.21.15.99:0/493411375 wait complete. 2024-09-13T23:24:48.351 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T23:24:48.351 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T23:24:48.354 INFO:tasks.ceph.osd.0:Started 2024-09-13T23:24:48.354 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T23:24:48.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T23:24:48.356 INFO:tasks.ceph.osd.1:Started 2024-09-13T23:24:48.356 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T23:24:48.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T23:24:48.358 INFO:tasks.ceph.osd.2:Started 2024-09-13T23:24:48.359 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T23:24:48.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T23:24:48.361 INFO:tasks.ceph.osd.3:Started 2024-09-13T23:24:48.361 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:24:48.442 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:48.440+0000 7f61ec20d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T23:24:48.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.469+0000 7fce09f78640 1 Processor -- start 2024-09-13T23:24:48.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.469+0000 7fce09f78640 1 -- start start 2024-09-13T23:24:48.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce09f78640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fce0409a100 0x7fce04133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.471 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce09f78640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce0409d3b0 con 0x7fce0409bd50 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce09f78640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fce0409c840 con 0x7fce0409a100 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce037fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fce0409bd50 0x7fce0409c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53534/0 (socket says 172.21.15.43:53534) 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce037fe640 1 -- 172.21.15.43:0/2108810112 learned_addr learned my addr 172.21.15.43:0/2108810112 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce02ffd640 1 --2- 172.21.15.43:0/2108810112 >> v2:172.21.15.43:3300/0 conn(0x7fce0409a100 0x7fce04133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce027fc640 1 -- 172.21.15.43:0/2108810112 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801943581 0 0) 0x7fcdf4001110 con 0x7fce0409bd50 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce027fc640 1 -- 172.21.15.43:0/2108810112 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec003520 con 0x7fce0409bd50 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce02ffd640 1 -- 172.21.15.43:0/2108810112 >> v1:172.21.15.43:6789/0 conn(0x7fce0409bd50 legacy=0x7fce0409c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.472 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.470+0000 7fce02ffd640 1 -- 172.21.15.43:0/2108810112 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce04098230 con 0x7fce0409a100 2024-09-13T23:24:48.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.471+0000 7fce02ffd640 1 --2- 172.21.15.43:0/2108810112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04133da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009720 tx=0x7fcdf802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1af595c376d3fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.475 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.471+0000 7fce027fc640 1 -- 172.21.15.43:0/2108810112 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdf8037070 con 0x7fce0409a100 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.471+0000 7fce027fc640 1 -- 172.21.15.43:0/2108810112 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf802ad90 con 0x7fce0409a100 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.471+0000 7fce027fc640 1 -- 172.21.15.43:0/2108810112 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdf8032590 con 0x7fce0409a100 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 -- 172.21.15.43:0/2108810112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 msgr2=0x7fce04133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 --2- 172.21.15.43:0/2108810112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04133da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009720 tx=0x7fcdf802a110 comp rx=0 tx=0).stop 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 -- 172.21.15.43:0/2108810112 shutdown_connections 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 --2- 172.21.15.43:0/2108810112 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04133da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 -- 172.21.15.43:0/2108810112 >> 172.21.15.43:0/2108810112 conn(0x7fce0406d4a0 msgr2=0x7fce0406d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 -- 172.21.15.43:0/2108810112 shutdown_connections 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.472+0000 7fce09f78640 1 -- 172.21.15.43:0/2108810112 wait complete. 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce09f78640 1 Processor -- start 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce09f78640 1 -- start start 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce09f78640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:48.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce09f78640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fce04134670 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce037fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce037fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44024/0 (socket says 172.21.15.43:44024) 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.473+0000 7fce037fe640 1 -- 172.21.15.43:0/1320044166 learned_addr learned my addr 172.21.15.43:0/1320044166 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fce037fe640 1 -- 172.21.15.43:0/1320044166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce04125fc0 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fce037fe640 1 --2- 172.21.15.43:0/1320044166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c6b0 tx=0x7fcdf400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdf4017070 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf40058b0 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce04096570 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdf4005bd0 con 0x7fce0409a100 2024-09-13T23:24:48.477 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce04096f80 con 0x7fce0409a100 2024-09-13T23:24:48.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcdf401a070 con 0x7fce0409a100 2024-09-13T23:24:48.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.474+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcdf401c440 con 0x7fce0409a100 2024-09-13T23:24:48.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.475+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce04126360 con 0x7fce0409a100 2024-09-13T23:24:48.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.477+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fce04125fc0 con 0x7fce0409a100 2024-09-13T23:24:48.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.536+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce0409d020 con 0x7fce0409a100 2024-09-13T23:24:48.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.537+0000 7fcdebfff640 1 -- 172.21.15.43:0/1320044166 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fce0409d3b0 con 0x7fce0409a100 2024-09-13T23:24:48.539 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:24:48.539 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":6,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:24:48.339973+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:24:48.540 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 msgr2=0x7fce04132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:48.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 --2- 172.21.15.43:0/1320044166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400c6b0 tx=0x7fcdf400cb70 comp rx=0 tx=0).stop 2024-09-13T23:24:48.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 shutdown_connections 2024-09-13T23:24:48.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 --2- 172.21.15.43:0/1320044166 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fce0409a100 0x7fce04132a40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:48.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 >> 172.21.15.43:0/1320044166 conn(0x7fce0406d4a0 msgr2=0x7fce0408d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:48.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 shutdown_connections 2024-09-13T23:24:48.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:24:48.538+0000 7fce09f78640 1 -- 172.21.15.43:0/1320044166 wait complete. 2024-09-13T23:24:48.550 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T23:24:48.550 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T23:24:48.953 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:24:49.048 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.047+0000 7f8adb4e6640 1 Processor -- start 2024-09-13T23:24:49.048 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.047+0000 7f8adb4e6640 1 -- start start 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8adb4e6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ad412ea30 0x7f8ad412ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8adb4e6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad41162f0 con 0x7f8ad41157c0 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8adb4e6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad4116000 con 0x7f8ad412ea30 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8ad9282640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8ad412ea30 0x7f8ad412ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8ad8a81640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8ad41157c0 0x7f8ad412afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53550/0 (socket says 172.21.15.43:53550) 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8ad8a81640 1 -- 172.21.15.43:0/1444605036 learned_addr learned my addr 172.21.15.43:0/1444605036 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8ad9282640 1 -- 172.21.15.43:0/1444605036 >> v1:172.21.15.43:6789/0 conn(0x7f8ad41157c0 legacy=0x7f8ad412afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.048+0000 7f8ad9282640 1 -- 172.21.15.43:0/1444605036 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad406f8e0 con 0x7f8ad412ea30 2024-09-13T23:24:49.050 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8ad9282640 1 --2- 172.21.15.43:0/1444605036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad412ea30 0x7f8ad412ee10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009750 tx=0x7f8ad002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f36861bcc6b9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:49.051 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8acbfff640 1 -- 172.21.15.43:0/1444605036 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0037070 con 0x7f8ad412ea30 2024-09-13T23:24:49.051 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8acbfff640 1 -- 172.21.15.43:0/1444605036 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad002ad80 con 0x7f8ad412ea30 2024-09-13T23:24:49.051 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8acbfff640 1 -- 172.21.15.43:0/1444605036 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0032590 con 0x7f8ad412ea30 2024-09-13T23:24:49.053 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8adb4e6640 1 -- 172.21.15.43:0/1444605036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad412ea30 msgr2=0x7f8ad412ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:49.053 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8adb4e6640 1 --2- 172.21.15.43:0/1444605036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad412ea30 0x7f8ad412ee10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009750 tx=0x7f8ad002a140 comp rx=0 tx=0).stop 2024-09-13T23:24:49.053 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.049+0000 7f8adb4e6640 1 -- 172.21.15.43:0/1444605036 shutdown_connections 2024-09-13T23:24:49.053 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 --2- 172.21.15.43:0/1444605036 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad412ea30 0x7f8ad412ee10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:49.053 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 -- 172.21.15.43:0/1444605036 >> 172.21.15.43:0/1444605036 conn(0x7f8ad4071510 msgr2=0x7f8ad4071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 -- 172.21.15.43:0/1444605036 shutdown_connections 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 -- 172.21.15.43:0/1444605036 wait complete. 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 Processor -- start 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.050+0000 7f8adb4e6640 1 -- start start 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8adb4e6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8adb4e6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad412e720 con 0x7f8ad41157c0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ad9282640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ad9282640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44038/0 (socket says 172.21.15.43:44038) 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ad9282640 1 -- 172.21.15.43:0/2443225749 learned_addr learned my addr 172.21.15.43:0/2443225749 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ad9282640 1 -- 172.21.15.43:0/2443225749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad411b0f0 con 0x7f8ad41157c0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ad9282640 1 --2- 172.21.15.43:0/2443225749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009750 tx=0x7f8ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0041070 con 0x7f8ad41157c0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad003c590 con 0x7f8ad41157c0 2024-09-13T23:24:49.054 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.051+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad411b8c0 con 0x7f8ad41157c0 2024-09-13T23:24:49.055 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.052+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ad0037040 con 0x7f8ad41157c0 2024-09-13T23:24:49.055 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.052+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad41c39d0 con 0x7f8ad41157c0 2024-09-13T23:24:49.055 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.052+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8ad0044070 con 0x7f8ad41157c0 2024-09-13T23:24:49.055 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.052+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8ad0046cd0 con 0x7f8ad41157c0 2024-09-13T23:24:49.055 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.053+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad411c890 con 0x7f8ad41157c0 2024-09-13T23:24:49.056 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.055+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8ad002ad10 con 0x7f8ad41157c0 2024-09-13T23:24:49.115 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.114+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ad411c060 con 0x7f8ad41157c0 2024-09-13T23:24:49.115 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.114+0000 7f8ac9ffb640 1 -- 172.21.15.43:0/2443225749 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f8ad00469d0 con 0x7f8ad41157c0 2024-09-13T23:24:49.116 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-13T23:24:49.116 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":6,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:24:48.339973+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 msgr2=0x7f8ad41c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 --2- 172.21.15.43:0/2443225749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8ad0009750 tx=0x7f8ad00046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 shutdown_connections 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 --2- 172.21.15.43:0/2443225749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8ad41157c0 0x7f8ad41c3490 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 >> 172.21.15.43:0/2443225749 conn(0x7f8ad4071510 msgr2=0x7f8ad4099a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 shutdown_connections 2024-09-13T23:24:49.117 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:49.115+0000 7f8adb4e6640 1 -- 172.21.15.43:0/2443225749 wait complete. 2024-09-13T23:24:49.125 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:24:49.398 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:49.397+0000 7f61ec20d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T23:24:49.450 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:49.449+0000 7f61ec20d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T23:24:49.790 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-13T23:24:49.789+0000 7f136ab1e640 -1 Falling back to public interface 2024-09-13T23:24:49.819 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:49.818+0000 7f61ec20d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T23:24:49.903 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:49.902+0000 7f61ec20d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T23:24:50.009 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.008+0000 7f61ec20d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T23:24:50.056 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.054+0000 7f61ec20d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T23:24:50.070 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-13T23:24:50.069+0000 7f9a587ae640 -1 Falling back to public interface 2024-09-13T23:24:50.070 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-13T23:24:50.069+0000 7f2c4b745640 -1 Falling back to public interface 2024-09-13T23:24:50.070 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-13T23:24:50.069+0000 7f9a57756640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-13T23:24:50.071 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-13T23:24:50.069+0000 7f2c4a6ed640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-09-13T23:24:50.171 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.170+0000 7f61ec20d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T23:24:50.224 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.223+0000 7f61ec20d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T23:24:50.269 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.267+0000 7f61ec20d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T23:24:50.311 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-13T23:24:50.309+0000 7ff7de42e640 -1 Falling back to public interface 2024-09-13T23:24:50.383 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.381+0000 7f61ec20d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T23:24:50.433 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.431+0000 7f61ec20d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T23:24:50.484 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.483+0000 7f61ec20d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T23:24:50.550 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.549+0000 7f61ec20d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T23:24:50.596 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.594+0000 7f61ec20d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T23:24:50.640 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:50.639+0000 7f61ec20d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T23:24:51.289 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:51.288+0000 7f61ec20d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T23:24:52.298 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-09-13T23:24:52.297+0000 7f618bee8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T23:24:53.540 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-13T23:24:53.539+0000 7f136ab1e640 -1 osd.0 0 log_to_monitors true 2024-09-13T23:24:54.140 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-13T23:24:54.140+0000 7f9a587ae640 -1 osd.1 0 log_to_monitors true 2024-09-13T23:24:54.142 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-13T23:24:54.142+0000 7f2c4b745640 -1 osd.2 0 log_to_monitors true 2024-09-13T23:24:54.579 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-13T23:24:54.579+0000 7ff7de42e640 -1 osd.3 0 log_to_monitors true 2024-09-13T23:24:55.529 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:24:55.635 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.634+0000 7f0a362c9640 1 Processor -- start 2024-09-13T23:24:55.635 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.634+0000 7f0a362c9640 1 -- start start 2024-09-13T23:24:55.636 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a362c9640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a30094350 0x7f0a30094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:55.636 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a362c9640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3006ed00 con 0x7f0a3012c4d0 2024-09-13T23:24:55.636 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a362c9640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f0a30073ce0 con 0x7f0a30094350 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a30094350 0x7f0a30094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2f7fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f0a3012c4d0 0x7f0a3012c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53556/0 (socket says 172.21.15.43:53556) 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2f7fe640 1 -- 172.21.15.43:0/1696245170 learned_addr learned my addr 172.21.15.43:0/1696245170 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f0a30094350 0x7f0a30094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44060/0 (socket says 172.21.15.43:44060) 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2ffff640 1 -- 172.21.15.43:0/1696245170 >> v1:172.21.15.43:6789/0 conn(0x7f0a3012c4d0 legacy=0x7f0a3012c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:55.637 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.635+0000 7f0a2ffff640 1 -- 172.21.15.43:0/1696245170 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a30097d00 con 0x7f0a30094350 2024-09-13T23:24:55.638 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.636+0000 7f0a2ffff640 1 --2- 172.21.15.43:0/1696245170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30094730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009720 tx=0x7f0a2002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5c7482205a401c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:55.638 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.636+0000 7f0a2effd640 1 -- 172.21.15.43:0/1696245170 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037070 con 0x7f0a30094350 2024-09-13T23:24:55.638 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.636+0000 7f0a2effd640 1 -- 172.21.15.43:0/1696245170 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2002ad90 con 0x7f0a30094350 2024-09-13T23:24:55.638 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.636+0000 7f0a2effd640 1 -- 172.21.15.43:0/1696245170 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20032590 con 0x7f0a30094350 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 -- 172.21.15.43:0/1696245170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 msgr2=0x7f0a30094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 --2- 172.21.15.43:0/1696245170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30094730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009720 tx=0x7f0a2002a110 comp rx=0 tx=0).stop 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 -- 172.21.15.43:0/1696245170 shutdown_connections 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 --2- 172.21.15.43:0/1696245170 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30094730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 -- 172.21.15.43:0/1696245170 >> 172.21.15.43:0/1696245170 conn(0x7f0a3009dfe0 msgr2=0x7f0a3009e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 -- 172.21.15.43:0/1696245170 shutdown_connections 2024-09-13T23:24:55.639 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.637+0000 7f0a362c9640 1 -- 172.21.15.43:0/1696245170 wait complete. 2024-09-13T23:24:55.640 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.638+0000 7f0a362c9640 1 Processor -- start 2024-09-13T23:24:55.640 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a362c9640 1 -- start start 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a362c9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a362c9640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3006f2c0 con 0x7f0a30094350 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:44066/0 (socket says 172.21.15.43:44066) 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.639+0000 7f0a2ffff640 1 -- 172.21.15.43:0/3625829155 learned_addr learned my addr 172.21.15.43:0/3625829155 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:24:55.641 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a2ffff640 1 -- 172.21.15.43:0/3625829155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a30093bd0 con 0x7f0a30094350 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a2ffff640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009720 tx=0x7f0a200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20041070 con 0x7f0a30094350 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2003c460 con 0x7f0a30094350 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a20037040 con 0x7f0a30094350 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a30093da0 con 0x7f0a30094350 2024-09-13T23:24:55.642 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.640+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3008b2e0 con 0x7f0a30094350 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.641+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a30094730 con 0x7f0a30094350 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.642+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 4) ==== 45681+0+0 (secure 0 0 0) 0x7f0a20044070 con 0x7f0a30094350 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.642+0000 7f0a2cff9640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 0x7f0a1c03a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.642+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1607+0+0 (secure 0 0 0) 0x7f0a2006b270 con 0x7f0a30094350 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.642+0000 7f0a2f7fe640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 0x7f0a1c03a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:24:55.643 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.642+0000 7f0a2f7fe640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 0x7f0a1c03a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a24005880 tx=0x7f0a24007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:24:55.652 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.651+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a2003cc60 con 0x7f0a30094350 2024-09-13T23:24:55.892 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.891+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a300729e0 con 0x7f0a30094350 2024-09-13T23:24:55.892 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.891+0000 7f0a2cff9640 1 -- 172.21.15.43:0/3625829155 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f0a2003c740 con 0x7f0a30094350 2024-09-13T23:24:55.893 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-13T23:24:55.893 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":8,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:24:55.299742+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:24:55.896 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 msgr2=0x7f0a1c03a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:55.896 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 0x7f0a1c03a6d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a24005880 tx=0x7f0a24007a80 comp rx=0 tx=0).stop 2024-09-13T23:24:55.896 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 msgr2=0x7f0a30070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:24:55.896 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009720 tx=0x7f0a200046c0 comp rx=0 tx=0).stop 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 shutdown_connections 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0a1c038210 0x7f0a1c03a6d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 --2- 172.21.15.43:0/3625829155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f0a30094350 0x7f0a30070f60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 >> 172.21.15.43:0/3625829155 conn(0x7f0a3009dfe0 msgr2=0x7f0a30098ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 shutdown_connections 2024-09-13T23:24:55.897 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:24:55.895+0000 7f0a362c9640 1 -- 172.21.15.43:0/3625829155 wait complete. 2024-09-13T23:24:55.907 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T23:24:56.077 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-13T23:24:56.076+0000 7f136628a640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T23:24:56.087 INFO:tasks.ceph.osd.0.smithi043.stderr:2024-09-13T23:24:56.086+0000 7f135e8bc640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:24:56.645 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-13T23:24:56.644+0000 7f9a53f1a640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T23:24:56.648 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-13T23:24:56.647+0000 7f2c46eb1640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T23:24:56.653 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-13T23:24:56.652+0000 7f9a4c54c640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:24:56.665 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-13T23:24:56.664+0000 7f2c3f4e3640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:24:57.215 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-13T23:24:57.214+0000 7ff7da24e640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T23:24:57.227 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-13T23:24:57.226+0000 7ff7d1849640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T23:25:02.311 DEBUG:teuthology.orchestra.run.smithi043:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T23:25:02.413 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.411+0000 7f8ce0065640 1 Processor -- start 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8ce0065640 1 -- start start 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8ce0065640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f8cd812c2b0 0x7f8cd812c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8ce0065640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd809d730 con 0x7f8cd812cd80 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8ce0065640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd812d1f0 con 0x7f8cd812c2b0 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8cdd600640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f8cd812cd80 0x7f8cd8128d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38862/0 (socket says 172.21.15.43:38862) 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8cdd600640 1 -- 172.21.15.43:0/3901604466 learned_addr learned my addr 172.21.15.43:0/3901604466 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8cdde01640 1 --2- 172.21.15.43:0/3901604466 >> v2:172.21.15.43:3300/0 conn(0x7f8cd812c2b0 0x7f8cd812c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8cdcdff640 1 -- 172.21.15.43:0/3901604466 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281745938 0 0) 0x7f8cd809d730 con 0x7f8cd812cd80 2024-09-13T23:25:02.415 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.412+0000 7f8cdcdff640 1 -- 172.21.15.43:0/3901604466 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cc4003520 con 0x7f8cd812cd80 2024-09-13T23:25:02.416 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.413+0000 7f8cdde01640 1 -- 172.21.15.43:0/3901604466 >> v1:172.21.15.43:6789/0 conn(0x7f8cd812cd80 legacy=0x7f8cd8128d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.416 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.413+0000 7f8cdde01640 1 -- 172.21.15.43:0/3901604466 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd809d980 con 0x7f8cd812c2b0 2024-09-13T23:25:02.417 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.413+0000 7f8cdde01640 1 --2- 172.21.15.43:0/3901604466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd812c840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009720 tx=0x7f8cd402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5756c234247660dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.417 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.413+0000 7f8cdcdff640 1 -- 172.21.15.43:0/3901604466 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4037070 con 0x7f8cd812c2b0 2024-09-13T23:25:02.417 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8cdcdff640 1 -- 172.21.15.43:0/3901604466 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd402ad90 con 0x7f8cd812c2b0 2024-09-13T23:25:02.417 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8cdcdff640 1 -- 172.21.15.43:0/3901604466 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4032590 con 0x7f8cd812c2b0 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 -- 172.21.15.43:0/3901604466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 msgr2=0x7f8cd812c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 --2- 172.21.15.43:0/3901604466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd812c840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009720 tx=0x7f8cd402a110 comp rx=0 tx=0).stop 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 -- 172.21.15.43:0/3901604466 shutdown_connections 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 --2- 172.21.15.43:0/3901604466 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd812c840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 -- 172.21.15.43:0/3901604466 >> 172.21.15.43:0/3901604466 conn(0x7f8cd8071750 msgr2=0x7f8cd8071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 -- 172.21.15.43:0/3901604466 shutdown_connections 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.414+0000 7f8ce0065640 1 -- 172.21.15.43:0/3901604466 wait complete. 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.415+0000 7f8ce0065640 1 Processor -- start 2024-09-13T23:25:02.418 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.415+0000 7f8ce0065640 1 -- start start 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8ce0065640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8ce0065640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd809e8e0 con 0x7f8cd812c2b0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cdde01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cdde01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33556/0 (socket says 172.21.15.43:33556) 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cdde01640 1 -- 172.21.15.43:0/687781699 learned_addr learned my addr 172.21.15.43:0/687781699 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cdde01640 1 -- 172.21.15.43:0/687781699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd8126a40 con 0x7f8cd812c2b0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cdde01640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009720 tx=0x7f8cd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4041070 con 0x7f8cd812c2b0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd403c460 con 0x7f8cd812c2b0 2024-09-13T23:25:02.421 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.416+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd811ca40 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.417+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cd4037040 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.417+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd811a4b0 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.417+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8cd4044070 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.418+0000 7f8cce7fc640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 0x7f8cbc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.418+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f8cd406b820 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.418+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd812c840 con 0x7f8cd812c2b0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.418+0000 7f8cdd600640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 0x7f8cbc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.422 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.418+0000 7f8cdd600640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 0x7f8cbc03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80010e0 tx=0x7f8cc8007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.425 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.423+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8cd8126a40 con 0x7f8cd812c2b0 2024-09-13T23:25:02.600 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.598+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cd811b910 con 0x7f8cd812c2b0 2024-09-13T23:25:02.601 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.598+0000 7f8cce7fc640 1 -- 172.21.15.43:0/687781699 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7966 (secure 0 0 0) 0x7f8cd403a360 con 0x7f8cd812c2b0 2024-09-13T23:25:02.601 INFO:teuthology.misc.health.smithi043.stdout: 2024-09-13T23:25:02.601 INFO:teuthology.misc.health.smithi043.stdout:{"epoch":14,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:25:01.392982+0000","last_up_change":"2024-09-13T23:24:57.309620+0000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:24:59.339268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6801","nonce":3849931173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6803","nonce":3849931173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6807","nonce":3849931173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6805","nonce":3849931173}]},"public_addr":"172.21.15.43:6801/3849931173","cluster_addr":"172.21.15.43:6803/3849931173","heartbeat_back_addr":"172.21.15.43:6807/3849931173","heartbeat_front_addr":"172.21.15.43:6805/3849931173","state":["exists","up"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6803","nonce":642925376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6807","nonce":642925376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6815","nonce":642925376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6811","nonce":642925376}]},"public_addr":"172.21.15.99:6803/642925376","cluster_addr":"172.21.15.99:6807/642925376","heartbeat_back_addr":"172.21.15.99:6815/642925376","heartbeat_front_addr":"172.21.15.99:6811/642925376","state":["exists","up"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6802","nonce":2157953423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6806","nonce":2157953423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6814","nonce":2157953423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6810","nonce":2157953423}]},"public_addr":"172.21.15.99:6802/2157953423","cluster_addr":"172.21.15.99:6806/2157953423","heartbeat_back_addr":"172.21.15.99:6814/2157953423","heartbeat_front_addr":"172.21.15.99:6810/2157953423","state":["exists","up"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6817","nonce":1212313328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6819","nonce":1212313328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6823","nonce":1212313328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6821","nonce":1212313328}]},"public_addr":"172.21.15.99:6817/1212313328","cluster_addr":"172.21.15.99:6819/1212313328","heartbeat_back_addr":"172.21.15.99:6823/1212313328","heartbeat_front_addr":"172.21.15.99:6821/1212313328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:54.573871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.107874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.159232+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.590066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 msgr2=0x7f8cbc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 0x7f8cbc03a760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80010e0 tx=0x7f8cc8007970 comp rx=0 tx=0).stop 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 msgr2=0x7f8cd8119d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009720 tx=0x7f8cd40046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 shutdown_connections 2024-09-13T23:25:02.603 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8cbc0382a0 0x7f8cbc03a760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:02.604 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 --2- 172.21.15.43:0/687781699 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f8cd812c2b0 0x7f8cd8119d90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:02.604 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 >> 172.21.15.43:0/687781699 conn(0x7f8cd8071750 msgr2=0x7f8cd8072350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:02.604 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 shutdown_connections 2024-09-13T23:25:02.604 INFO:teuthology.misc.health.smithi043.stderr:2024-09-13T23:25:02.601+0000 7f8ce0065640 1 -- 172.21.15.43:0/687781699 wait complete. 2024-09-13T23:25:02.613 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T23:25:02.613 INFO:tasks.ceph:Creating RBD pool 2024-09-13T23:25:02.613 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T23:25:02.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09e4a47640 1 Processor -- start 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09e4a47640 1 -- start start 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09e4a47640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09e0096630 0x7f09e0096a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09e4a47640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e00702f0 con 0x7f09e006d910 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09e4a47640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f09e006f1f0 con 0x7f09e0096630 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09de59c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f09e0096630 0x7f09e0096a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09d7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f09e006d910 0x7f09e006dd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38868/0 (socket says 172.21.15.43:38868) 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.712+0000 7f09d7fff640 1 -- 172.21.15.43:0/1362004998 learned_addr learned my addr 172.21.15.43:0/1362004998 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09de59c640 1 -- 172.21.15.43:0/1362004998 >> v1:172.21.15.43:6789/0 conn(0x7f09e006d910 legacy=0x7f09e006dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09de59c640 1 -- 172.21.15.43:0/1362004998 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e006fb80 con 0x7f09e0096630 2024-09-13T23:25:02.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09ddd9b640 1 -- 172.21.15.43:0/1362004998 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103858527 0 0) 0x7f09e00702f0 con 0x7f09e006d910 2024-09-13T23:25:02.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09de59c640 1 --2- 172.21.15.43:0/1362004998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e0096630 0x7f09e0096a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009720 tx=0x7f09d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d125dd06550f9e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09ddd9b640 1 -- 172.21.15.43:0/1362004998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09d0037070 con 0x7f09e0096630 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09ddd9b640 1 -- 172.21.15.43:0/1362004998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d002ad90 con 0x7f09e0096630 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.713+0000 7f09ddd9b640 1 -- 172.21.15.43:0/1362004998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09d0032590 con 0x7f09e0096630 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 -- 172.21.15.43:0/1362004998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e0096630 msgr2=0x7f09e0096a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 --2- 172.21.15.43:0/1362004998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e0096630 0x7f09e0096a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009720 tx=0x7f09d002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 -- 172.21.15.43:0/1362004998 shutdown_connections 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 --2- 172.21.15.43:0/1362004998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e0096630 0x7f09e0096a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 -- 172.21.15.43:0/1362004998 >> 172.21.15.43:0/1362004998 conn(0x7f09e009a890 msgr2=0x7f09e009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 -- 172.21.15.43:0/1362004998 shutdown_connections 2024-09-13T23:25:02.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.714+0000 7f09e4a47640 1 -- 172.21.15.43:0/1362004998 wait complete. 2024-09-13T23:25:02.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.715+0000 7f09e4a47640 1 Processor -- start 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.715+0000 7f09e4a47640 1 -- start start 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.715+0000 7f09e4a47640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.715+0000 7f09e4a47640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f09e006d410 con 0x7f09e006d910 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09de59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33586/0 (socket says 172.21.15.43:33586) 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09de59c640 1 -- 172.21.15.43:0/71676661 learned_addr learned my addr 172.21.15.43:0/71676661 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09de59c640 1 -- 172.21.15.43:0/71676661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e0128820 con 0x7f09e006d910 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09de59c640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009720 tx=0x7f09d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09d0037050 con 0x7f09e006d910 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d0038040 con 0x7f09e006d910 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09d00042f0 con 0x7f09e006d910 2024-09-13T23:25:02.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e01265c0 con 0x7f09e006d910 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.716+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e0126ea0 con 0x7f09e006d910 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.717+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f09d0003610 con 0x7f09e006d910 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.717+0000 7f09d6ffd640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 0x7f09c003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.717+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f09d006ba10 con 0x7f09e006d910 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.717+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e00008d0 con 0x7f09e006d910 2024-09-13T23:25:02.721 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.717+0000 7f09d7fff640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 0x7f09c003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:02.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.718+0000 7f09d7fff640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 0x7f09c003a710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f09c8000c00 tx=0x7f09c8007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:02.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.722+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09d002ace0 con 0x7f09e006d910 2024-09-13T23:25:02.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:02.901+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f09e0074990 con 0x7f09e006d910 2024-09-13T23:25:03.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.396+0000 7f09d6ffd640 1 -- 172.21.15.43:0/71676661 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f09d0003c80 con 0x7f09e006d910 2024-09-13T23:25:03.399 INFO:teuthology.orchestra.run.smithi043.stderr:pool 'rbd' created 2024-09-13T23:25:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 msgr2=0x7f09c003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:03.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 0x7f09c003a710 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f09c8000c00 tx=0x7f09c8007910 comp rx=0 tx=0).stop 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 msgr2=0x7f09e01c1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009720 tx=0x7f09d00046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 shutdown_connections 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f09c0038250 0x7f09c003a710 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 --2- 172.21.15.43:0/71676661 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f09e006d910 0x7f09e01c1140 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 >> 172.21.15.43:0/71676661 conn(0x7f09e009a890 msgr2=0x7f09e0097390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 shutdown_connections 2024-09-13T23:25:03.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.399+0000 7f09e4a47640 1 -- 172.21.15.43:0/71676661 wait complete. 2024-09-13T23:25:03.414 DEBUG:teuthology.orchestra.run.smithi043:> rbd --cluster ceph pool init rbd 2024-09-13T23:25:03.472 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:03.472 INFO:teuthology.orchestra.run.smithi043.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:03.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c75120d80 1 Processor -- start 2024-09-13T23:25:03.473 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c75120d80 1 -- start start 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c75120d80 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557442d444b0 0x557442d44890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c75120d80 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x557442b1f050 con 0x557442cafea0 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c75120d80 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x557442b2d930 con 0x557442d444b0 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c73c16640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557442d444b0 0x557442d44890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c73415640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x557442cafea0 0x557442c997e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38882/0 (socket says 172.21.15.43:38882) 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c73c16640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557442d444b0 0x557442d44890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33596/0 (socket says 172.21.15.43:33596) 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.471+0000 7f4c73415640 1 -- 172.21.15.43:0/2398809594 learned_addr learned my addr 172.21.15.43:0/2398809594 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.472+0000 7f4c73c16640 1 -- 172.21.15.43:0/2398809594 >> v1:172.21.15.43:6789/0 conn(0x557442cafea0 legacy=0x557442c997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:03.474 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.472+0000 7f4c73c16640 1 -- 172.21.15.43:0/2398809594 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557442b08ce0 con 0x557442d444b0 2024-09-13T23:25:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.473+0000 7f4c73c16640 1 --2- 172.21.15.43:0/2398809594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442d444b0 0x557442d44890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a4a0 tx=0x7f4c64045ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ee39aea863b05c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c72c14640 1 -- 172.21.15.43:0/2398809594 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64056020 con 0x557442d444b0 2024-09-13T23:25:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c72c14640 1 -- 172.21.15.43:0/2398809594 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64052570 con 0x557442d444b0 2024-09-13T23:25:03.476 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c72c14640 1 -- 172.21.15.43:0/2398809594 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c6404e040 con 0x557442d444b0 2024-09-13T23:25:03.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 -- 172.21.15.43:0/2398809594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442d444b0 msgr2=0x557442d44890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:03.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 --2- 172.21.15.43:0/2398809594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442d444b0 0x557442d44890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400a4a0 tx=0x7f4c64045ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:03.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 -- 172.21.15.43:0/2398809594 shutdown_connections 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 --2- 172.21.15.43:0/2398809594 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442d444b0 0x557442d44890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 -- 172.21.15.43:0/2398809594 >> 172.21.15.43:0/2398809594 conn(0x557442cb6060 msgr2=0x557442cb24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 -- 172.21.15.43:0/2398809594 shutdown_connections 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.474+0000 7f4c75120d80 1 -- 172.21.15.43:0/2398809594 wait complete. 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.475+0000 7f4c75120d80 1 Processor -- start 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.475+0000 7f4c75120d80 1 -- start start 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.475+0000 7f4c75120d80 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.475+0000 7f4c75120d80 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557442b2f540 con 0x557442cafea0 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c73c16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c73c16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33604/0 (socket says 172.21.15.43:33604) 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c73c16640 1 -- 172.21.15.43:0/1771302529 learned_addr learned my addr 172.21.15.43:0/1771302529 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:03.479 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c73c16640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557442d340b0 con 0x557442cafea0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c73c16640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c64045b00 tx=0x7f4c64002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64052bb0 con 0x557442cafea0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64052d50 con 0x557442cafea0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c64066570 con 0x557442cafea0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557442d33910 con 0x557442cafea0 2024-09-13T23:25:03.480 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.476+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557442d316f0 con 0x557442cafea0 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.477+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4c64059020 con 0x557442cafea0 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.477+0000 7f4c63fff640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 0x7f4c58039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.477+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f4c6408e250 con 0x557442cafea0 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.477+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x557442d31b90 con 0x557442cafea0 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.478+0000 7f4c73415640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 0x7f4c58039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:03.481 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:03.478+0000 7f4c73415640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 0x7f4c58039000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000f60 tx=0x7f4c680012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:04.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.397+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7f4c64018cd0 con 0x557442cafea0 2024-09-13T23:25:04.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.397+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c64052570 con 0x557442cafea0 2024-09-13T23:25:04.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.400+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f4c6405c430 con 0x557442cafea0 2024-09-13T23:25:04.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.400+0000 7f4c72413640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f4c50002ae0 con 0x557442cafea0 2024-09-13T23:25:04.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.402+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 8 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7f4c6405a790 con 0x557442cafea0 2024-09-13T23:25:04.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.402+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 0x557442d57f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:04.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.402+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x557442d58450 con 0x557442d444b0 2024-09-13T23:25:04.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.403+0000 7f4c74e78640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 0x557442d57f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:04.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.403+0000 7f4c74e78640 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 0x557442d57f10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:04.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.411+0000 7f4c74e78640 1 -- 172.21.15.43:0/1771302529 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f4c6c002040 con 0x557442d444b0 2024-09-13T23:25:04.415 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.413+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x557442da99c0 con 0x557442d444b0 2024-09-13T23:25:04.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.414+0000 7f4c74e78640 1 -- 172.21.15.43:0/1771302529 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c002040 con 0x557442d444b0 2024-09-13T23:25:04.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.414+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x557442da8ad0 con 0x557442d444b0 2024-09-13T23:25:04.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.414+0000 7f4c74e78640 1 -- 172.21.15.43:0/1771302529 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c002040 con 0x557442d444b0 2024-09-13T23:25:04.416 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:04.414+0000 7f4c71c12640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f4c54001f00 con 0x557442cafea0 2024-09-13T23:25:05.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.404+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f4c6401af50 con 0x557442cafea0 2024-09-13T23:25:05.407 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.404+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f4c5803c6f0 con 0x557442cafea0 2024-09-13T23:25:05.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.404+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 10 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7f4c64006ba0 con 0x557442cafea0 2024-09-13T23:25:05.408 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.405+0000 7f4c72413640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f4c50005680 con 0x557442d444b0 2024-09-13T23:25:05.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.408+0000 7f4c74e78640 1 -- 172.21.15.43:0/1771302529 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c6c002040 con 0x557442d444b0 2024-09-13T23:25:05.410 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:05.408+0000 7f4c71c12640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f4c54003350 con 0x557442cafea0 2024-09-13T23:25:06.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.406+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f4c64086030 con 0x557442cafea0 2024-09-13T23:25:06.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.406+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f4c5803c7a0 con 0x557442cafea0 2024-09-13T23:25:06.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.407+0000 7f4c63fff640 1 -- 172.21.15.43:0/1771302529 <== mon.0 v2:172.21.15.43:3300/0 12 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7f4c6405ad40 con 0x557442cafea0 2024-09-13T23:25:06.409 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.407+0000 7f4c72413640 1 -- 172.21.15.43:0/1771302529 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f4c50005a40 con 0x557442d444b0 2024-09-13T23:25:06.412 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.410+0000 7f4c74e78640 1 -- 172.21.15.43:0/1771302529 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c6c002040 con 0x557442d444b0 2024-09-13T23:25:06.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 msgr2=0x557442d57f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.413 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 0x557442d57f10 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 msgr2=0x7f4c58039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 0x7f4c58039000 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c68000f60 tx=0x7f4c680012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 msgr2=0x557442d311b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c64045b00 tx=0x7f4c64002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 shutdown_connections 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557442d444b0 0x557442d57f10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4c58036b40 0x7f4c58039000 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 --2- 172.21.15.43:0/1771302529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557442cafea0 0x557442d311b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 >> 172.21.15.43:0/1771302529 conn(0x557442cb6060 msgr2=0x557442cb10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 shutdown_connections 2024-09-13T23:25:06.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.411+0000 7f4c75120d80 1 -- 172.21.15.43:0/1771302529 wait complete. 2024-09-13T23:25:06.418 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T23:25:06.418 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T23:25:06.418 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T23:25:06.418 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T23:25:06.419 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T23:25:06.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.528+0000 7fb62ad9f640 1 Processor -- start 2024-09-13T23:25:06.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.528+0000 7fb62ad9f640 1 -- start start 2024-09-13T23:25:06.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb62ad9f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb62412e6c0 0x7fb62406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb62ad9f640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62412ede0 con 0x7fb62412b1c0 2024-09-13T23:25:06.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb62ad9f640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb624098970 con 0x7fb62412e6c0 2024-09-13T23:25:06.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb629d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb62412e6c0 0x7fb62406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb62959c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fb62412b1c0 0x7fb62412b5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38886/0 (socket says 172.21.15.43:38886) 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb629d9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb62412e6c0 0x7fb62406e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33618/0 (socket says 172.21.15.43:33618) 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb62959c640 1 -- 172.21.15.43:0/3835456893 learned_addr learned my addr 172.21.15.43:0/3835456893 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb629d9d640 1 -- 172.21.15.43:0/3835456893 >> v1:172.21.15.43:6789/0 conn(0x7fb62412b1c0 legacy=0x7fb62412b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.529+0000 7fb629d9d640 1 -- 172.21.15.43:0/3835456893 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62412eaa0 con 0x7fb62412e6c0 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.530+0000 7fb629d9d640 1 --2- 172.21.15.43:0/3835456893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412e6c0 0x7fb62406e5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb620009720 tx=0x7fb62002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60eb28ba59d29f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.530+0000 7fb628d9b640 1 -- 172.21.15.43:0/3835456893 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb620037070 con 0x7fb62412e6c0 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.530+0000 7fb628d9b640 1 -- 172.21.15.43:0/3835456893 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62002ad90 con 0x7fb62412e6c0 2024-09-13T23:25:06.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.530+0000 7fb628d9b640 1 -- 172.21.15.43:0/3835456893 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb620032590 con 0x7fb62412e6c0 2024-09-13T23:25:06.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3835456893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412e6c0 msgr2=0x7fb62406e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3835456893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412e6c0 0x7fb62406e5e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb620009720 tx=0x7fb62002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3835456893 shutdown_connections 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3835456893 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412e6c0 0x7fb62406e5e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3835456893 >> 172.21.15.43:0/3835456893 conn(0x7fb62409ef40 msgr2=0x7fb62409f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3835456893 shutdown_connections 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.531+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3835456893 wait complete. 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb62ad9f640 1 Processor -- start 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb62ad9f640 1 -- start start 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb62ad9f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb62ad9f640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb62406eca0 con 0x7fb62412b1c0 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb629d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb629d9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33620/0 (socket says 172.21.15.43:33620) 2024-09-13T23:25:06.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb629d9d640 1 -- 172.21.15.43:0/3912611220 learned_addr learned my addr 172.21.15.43:0/3912611220 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.532+0000 7fb629d9d640 1 -- 172.21.15.43:0/3912611220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62408daa0 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb629d9d640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb620009840 tx=0x7fb6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb620041070 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb62003c460 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62408e7a0 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb620037040 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.533+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6241c3ef0 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.534+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb620044070 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.534+0000 7fb61a7fc640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 0x7fb60803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.534+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb62006bac0 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.534+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624074d10 con 0x7fb62412b1c0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.534+0000 7fb62959c640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 0x7fb60803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.535+0000 7fb62959c640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 0x7fb60803a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb614007fd0 tx=0x7fb614007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.539+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb624074d10 con 0x7fb62412b1c0 2024-09-13T23:25:06.762 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.760+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb624050ea0 con 0x7fb62412b1c0 2024-09-13T23:25:06.764 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.762+0000 7fb61a7fc640 1 -- 172.21.15.43:0/3912611220 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87482 (secure 0 0 0) 0x7fb624050ea0 con 0x7fb62412b1c0 2024-09-13T23:25:06.766 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 msgr2=0x7fb60803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 0x7fb60803a790 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb614007fd0 tx=0x7fb614007ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 msgr2=0x7fb6241c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb620009840 tx=0x7fb6200046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 shutdown_connections 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb6080382d0 0x7fb60803a790 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.767 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 --2- 172.21.15.43:0/3912611220 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb62412b1c0 0x7fb6241c37d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 >> 172.21.15.43:0/3912611220 conn(0x7fb62409ef40 msgr2=0x7fb6240997d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 shutdown_connections 2024-09-13T23:25:06.768 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.764+0000 7fb62ad9f640 1 -- 172.21.15.43:0/3912611220 wait complete. 2024-09-13T23:25:06.777 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1176945367},{"type":"v1","addr":"172.21.15.99:6825","nonce":1176945367}]},"active_addr":"172.21.15.99:6825/1176945367","active_change":"2024-09-13T23:24:51.290419+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":216163933}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3163280588}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3458510806}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1245791530}]}]} 2024-09-13T23:25:06.779 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T23:25:06.779 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T23:25:06.779 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.878+0000 7fc29618d640 1 Processor -- start 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.878+0000 7fc29618d640 1 -- start start 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.878+0000 7fc29618d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc29012e8f0 0x7fc29012ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.878+0000 7fc29618d640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc290096ee0 con 0x7fc29012f210 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.878+0000 7fc29618d640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc29009e090 con 0x7fc29012e8f0 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.879+0000 7fc28f7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc29012e8f0 0x7fc29012ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.879+0000 7fc28effd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc29012f210 0x7fc29012a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38888/0 (socket says 172.21.15.43:38888) 2024-09-13T23:25:06.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.879+0000 7fc28effd640 1 -- 172.21.15.43:0/4065566233 learned_addr learned my addr 172.21.15.43:0/4065566233 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:06.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.879+0000 7fc28f7fe640 1 -- 172.21.15.43:0/4065566233 >> v1:172.21.15.43:6789/0 conn(0x7fc29012f210 legacy=0x7fc29012a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.882 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.879+0000 7fc28f7fe640 1 -- 172.21.15.43:0/4065566233 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc290074e50 con 0x7fc29012e8f0 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc28f7fe640 1 --2- 172.21.15.43:0/4065566233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29012ecd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc280009720 tx=0x7fc28002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29695f9c64636684 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc28e7fc640 1 -- 172.21.15.43:0/4065566233 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc280037070 con 0x7fc29012e8f0 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc28e7fc640 1 -- 172.21.15.43:0/4065566233 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28002ad90 con 0x7fc29012e8f0 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc28e7fc640 1 -- 172.21.15.43:0/4065566233 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc280032590 con 0x7fc29012e8f0 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 -- 172.21.15.43:0/4065566233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 msgr2=0x7fc29012ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 --2- 172.21.15.43:0/4065566233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29012ecd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc280009720 tx=0x7fc28002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 -- 172.21.15.43:0/4065566233 shutdown_connections 2024-09-13T23:25:06.883 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 --2- 172.21.15.43:0/4065566233 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29012ecd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:06.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 -- 172.21.15.43:0/4065566233 >> 172.21.15.43:0/4065566233 conn(0x7fc29009d860 msgr2=0x7fc290099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:06.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 -- 172.21.15.43:0/4065566233 shutdown_connections 2024-09-13T23:25:06.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.880+0000 7fc29618d640 1 -- 172.21.15.43:0/4065566233 wait complete. 2024-09-13T23:25:06.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.881+0000 7fc29618d640 1 Processor -- start 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.881+0000 7fc29618d640 1 -- start start 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc29618d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc29618d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc290096ac0 con 0x7fc29012e8f0 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc28f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc28f7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33634/0 (socket says 172.21.15.43:33634) 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc28f7fe640 1 -- 172.21.15.43:0/122691543 learned_addr learned my addr 172.21.15.43:0/122691543 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc28f7fe640 1 -- 172.21.15.43:0/122691543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc290070d70 con 0x7fc29012e8f0 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.882+0000 7fc28f7fe640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc280009840 tx=0x7fc2800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc280041070 con 0x7fc29012e8f0 2024-09-13T23:25:06.886 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc28003c460 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc290071540 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc280037040 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2900733d0 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.883+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc280044070 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.884+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29012e080 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.884+0000 7fc277fff640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 0x7fc27c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.884+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc28006bae0 con 0x7fc29012e8f0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.884+0000 7fc28effd640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 0x7fc27c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:06.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.884+0000 7fc28effd640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 0x7fc27c03a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc284007fd0 tx=0x7fc284007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:06.890 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:06.888+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc29012e080 con 0x7fc29012e8f0 2024-09-13T23:25:07.066 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.064+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2900709b0 con 0x7fc29012e8f0 2024-09-13T23:25:07.067 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.065+0000 7fc277fff640 1 -- 172.21.15.43:0/122691543 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9866 (secure 0 0 0) 0x7fc280044360 con 0x7fc29012e8f0 2024-09-13T23:25:07.067 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:07.067 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:25:06.405077+0000","last_up_change":"2024-09-13T23:24:57.309620+0000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:24:59.339268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:25:02.932517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6801","nonce":3849931173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6803","nonce":3849931173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6807","nonce":3849931173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6805","nonce":3849931173}]},"public_addr":"172.21.15.43:6801/3849931173","cluster_addr":"172.21.15.43:6803/3849931173","heartbeat_back_addr":"172.21.15.43:6807/3849931173","heartbeat_front_addr":"172.21.15.43:6805/3849931173","state":["exists","up"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6803","nonce":642925376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6807","nonce":642925376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6815","nonce":642925376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6811","nonce":642925376}]},"public_addr":"172.21.15.99:6803/642925376","cluster_addr":"172.21.15.99:6807/642925376","heartbeat_back_addr":"172.21.15.99:6815/642925376","heartbeat_front_addr":"172.21.15.99:6811/642925376","state":["exists","up"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6802","nonce":2157953423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6806","nonce":2157953423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6814","nonce":2157953423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6810","nonce":2157953423}]},"public_addr":"172.21.15.99:6802/2157953423","cluster_addr":"172.21.15.99:6806/2157953423","heartbeat_back_addr":"172.21.15.99:6814/2157953423","heartbeat_front_addr":"172.21.15.99:6810/2157953423","state":["exists","up"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6817","nonce":1212313328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6819","nonce":1212313328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6823","nonce":1212313328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6821","nonce":1212313328}]},"public_addr":"172.21.15.99:6817/1212313328","cluster_addr":"172.21.15.99:6819/1212313328","heartbeat_back_addr":"172.21.15.99:6823/1212313328","heartbeat_front_addr":"172.21.15.99:6821/1212313328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:54.573871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.107874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.159232+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.590066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:25:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 msgr2=0x7fc27c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 0x7fc27c03a760 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc284007fd0 tx=0x7fc284007ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 msgr2=0x7fc29006ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.069 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc280009840 tx=0x7fc2800046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 shutdown_connections 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc27c0382a0 0x7fc27c03a760 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 --2- 172.21.15.43:0/122691543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc29012e8f0 0x7fc29006ee60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 >> 172.21.15.43:0/122691543 conn(0x7fc29009d860 msgr2=0x7fc290095de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 shutdown_connections 2024-09-13T23:25:07.070 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.067+0000 7fc29618d640 1 -- 172.21.15.43:0/122691543 wait complete. 2024-09-13T23:25:07.080 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T23:25:07.080 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:25:07.182 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.179+0000 7fa47145e640 1 Processor -- start 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa47145e640 1 -- start start 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa47145e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa46c12f1e0 0x7fa46c133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa47145e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa46c06e9a0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa47145e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa46c12f5f0 con 0x7fa46c12f1e0 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa46a7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa46c12f1e0 0x7fa46c133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa46affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa46c12e6f0 0x7fa46c12ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38894/0 (socket says 172.21.15.43:38894) 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa46affd640 1 -- 172.21.15.43:0/1823056196 learned_addr learned my addr 172.21.15.43:0/1823056196 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa46a7fc640 1 -- 172.21.15.43:0/1823056196 >> v1:172.21.15.43:6789/0 conn(0x7fa46c12e6f0 legacy=0x7fa46c12ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.183 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa469ffb640 1 -- 172.21.15.43:0/1823056196 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502704908 0 0) 0x7fa46c06e9a0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.184 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.180+0000 7fa46a7fc640 1 -- 172.21.15.43:0/1823056196 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c134fc0 con 0x7fa46c12f1e0 2024-09-13T23:25:07.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.181+0000 7fa46a7fc640 1 --2- 172.21.15.43:0/1823056196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12f1e0 0x7fa46c133a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa460009720 tx=0x7fa46002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58caf0978404341 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.181+0000 7fa469ffb640 1 -- 172.21.15.43:0/1823056196 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460037070 con 0x7fa46c12f1e0 2024-09-13T23:25:07.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.181+0000 7fa469ffb640 1 -- 172.21.15.43:0/1823056196 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa46002ad90 con 0x7fa46c12f1e0 2024-09-13T23:25:07.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.181+0000 7fa469ffb640 1 -- 172.21.15.43:0/1823056196 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa460032590 con 0x7fa46c12f1e0 2024-09-13T23:25:07.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 -- 172.21.15.43:0/1823056196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12f1e0 msgr2=0x7fa46c133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 --2- 172.21.15.43:0/1823056196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12f1e0 0x7fa46c133a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa460009720 tx=0x7fa46002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 -- 172.21.15.43:0/1823056196 shutdown_connections 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 --2- 172.21.15.43:0/1823056196 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12f1e0 0x7fa46c133a70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 -- 172.21.15.43:0/1823056196 >> 172.21.15.43:0/1823056196 conn(0x7fa46c09f020 msgr2=0x7fa46c09f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 -- 172.21.15.43:0/1823056196 shutdown_connections 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.182+0000 7fa47145e640 1 -- 172.21.15.43:0/1823056196 wait complete. 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa47145e640 1 Processor -- start 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa47145e640 1 -- start start 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa47145e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa47145e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa46c134340 con 0x7fa46c12e6f0 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa46affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa46affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33658/0 (socket says 172.21.15.43:33658) 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.183+0000 7fa46affd640 1 -- 172.21.15.43:0/3918298047 learned_addr learned my addr 172.21.15.43:0/3918298047 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa46affd640 1 -- 172.21.15.43:0/3918298047 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46c133560 con 0x7fa46c12e6f0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa46affd640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c370 tx=0x7fa45c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c007410 con 0x7fa46c12e6f0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c0075d0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46c1255b0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45c004950 con 0x7fa46c12e6f0 2024-09-13T23:25:07.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.184+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46c125170 con 0x7fa46c12e6f0 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.185+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa45c011070 con 0x7fa46c12e6f0 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.185+0000 7fa4537fe640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 0x7fa45803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.185+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fa45c04ae20 con 0x7fa46c12e6f0 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.185+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c12ead0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.185+0000 7fa46a7fc640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 0x7fa45803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.186+0000 7fa46a7fc640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 0x7fa45803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa460034000 tx=0x7fa46002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.190+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa45c01cbd0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.365+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa46c06e550 con 0x7fa46c12e6f0 2024-09-13T23:25:07.367 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.365+0000 7fa4537fe640 1 -- 172.21.15.43:0/3918298047 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9866 (secure 0 0 0) 0x7fa45c0138e0 con 0x7fa46c12e6f0 2024-09-13T23:25:07.367 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:07.368 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":18,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:25:06.405077+0000","last_up_change":"2024-09-13T23:24:57.309620+0000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:24:59.339268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:25:02.932517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6801","nonce":3849931173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6803","nonce":3849931173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6807","nonce":3849931173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6805","nonce":3849931173}]},"public_addr":"172.21.15.43:6801/3849931173","cluster_addr":"172.21.15.43:6803/3849931173","heartbeat_back_addr":"172.21.15.43:6807/3849931173","heartbeat_front_addr":"172.21.15.43:6805/3849931173","state":["exists","up"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6803","nonce":642925376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6807","nonce":642925376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6815","nonce":642925376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6811","nonce":642925376}]},"public_addr":"172.21.15.99:6803/642925376","cluster_addr":"172.21.15.99:6807/642925376","heartbeat_back_addr":"172.21.15.99:6815/642925376","heartbeat_front_addr":"172.21.15.99:6811/642925376","state":["exists","up"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6802","nonce":2157953423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6806","nonce":2157953423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6814","nonce":2157953423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6810","nonce":2157953423}]},"public_addr":"172.21.15.99:6802/2157953423","cluster_addr":"172.21.15.99:6806/2157953423","heartbeat_back_addr":"172.21.15.99:6814/2157953423","heartbeat_front_addr":"172.21.15.99:6810/2157953423","state":["exists","up"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6817","nonce":1212313328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6819","nonce":1212313328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6823","nonce":1212313328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6821","nonce":1212313328}]},"public_addr":"172.21.15.99:6817/1212313328","cluster_addr":"172.21.15.99:6819/1212313328","heartbeat_back_addr":"172.21.15.99:6823/1212313328","heartbeat_front_addr":"172.21.15.99:6821/1212313328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:54.573871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.107874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.159232+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.590066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:25:07.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 msgr2=0x7fa45803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 0x7fa45803a760 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa460034000 tx=0x7fa46002e000 comp rx=0 tx=0).stop 2024-09-13T23:25:07.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 msgr2=0x7fa46c1319e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00c370 tx=0x7fa45c00c830 comp rx=0 tx=0).stop 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 shutdown_connections 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa4580382a0 0x7fa45803a760 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 --2- 172.21.15.43:0/3918298047 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa46c12e6f0 0x7fa46c1319e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 >> 172.21.15.43:0/3918298047 conn(0x7fa46c09f020 msgr2=0x7fa46c099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 shutdown_connections 2024-09-13T23:25:07.370 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.367+0000 7fa47145e640 1 -- 172.21.15.43:0/3918298047 wait complete. 2024-09-13T23:25:07.380 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T23:25:07.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T23:25:07.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T23:25:07.381 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T23:25:07.488 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.486+0000 7f1327fe4640 1 Processor -- start 2024-09-13T23:25:07.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.486+0000 7fc090d31640 1 Processor -- start 2024-09-13T23:25:07.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.486+0000 7fc090d31640 1 -- start start 2024-09-13T23:25:07.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.486+0000 7f1327fe4640 1 -- start start 2024-09-13T23:25:07.489 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc6b5b9d640 1 Processor -- start 2024-09-13T23:25:07.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f798a9f6640 1 Processor -- start 2024-09-13T23:25:07.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f798a9f6640 1 -- start start 2024-09-13T23:25:07.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc6b5b9d640 1 -- start start 2024-09-13T23:25:07.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc090d31640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc08c1294a0 0x7fc08c129880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f1327fe4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f132009bd50 0x7f132009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.491 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc090d31640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c071f00 con 0x7fc08c129dc0 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc090d31640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c06be10 con 0x7fc08c1294a0 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc08a59c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc08c1294a0 0x7fc08c129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f1327fe4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f132009d3b0 con 0x7f132009c670 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f1327fe4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1320098230 con 0x7f132009bd50 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f132557f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f132009c670 0x7f13200990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38910/0 (socket says 172.21.15.43:38910) 2024-09-13T23:25:07.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f132557f640 1 -- 172.21.15.43:0/1516570792 learned_addr learned my addr 172.21.15.43:0/1516570792 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f1325d80640 1 --2- 172.21.15.43:0/1516570792 >> v2:172.21.15.43:3300/0 conn(0x7f132009bd50 0x7f132009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc6b5b9d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b0128720 0x7fc6b0130450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc6b5b9d640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6b0070190 con 0x7fc6b0127c30 2024-09-13T23:25:07.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc6b5b9d640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc6b0070750 con 0x7fc6b0128720 2024-09-13T23:25:07.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc08a59c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc08c1294a0 0x7fc08c129880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33672/0 (socket says 172.21.15.43:33672) 2024-09-13T23:25:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc089d9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc08c129dc0 0x7fc08c12c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38902/0 (socket says 172.21.15.43:38902) 2024-09-13T23:25:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7fc08a59c640 1 -- 172.21.15.43:0/1930937678 learned_addr learned my addr 172.21.15.43:0/1930937678 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.487+0000 7f798a9f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f798406e7a0 0x7f798406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.494 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6affff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b0128720 0x7fc6b0130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f798a9f6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f798406be10 con 0x7f798406f0c0 2024-09-13T23:25:07.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f798a9f6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f798406ffb0 con 0x7f798406e7a0 2024-09-13T23:25:07.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6affff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc6b0128720 0x7fc6b0130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33682/0 (socket says 172.21.15.43:33682) 2024-09-13T23:25:07.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc08a59c640 1 -- 172.21.15.43:0/1930937678 >> v1:172.21.15.43:6789/0 conn(0x7fc08c129dc0 legacy=0x7fc08c12c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc08a59c640 1 -- 172.21.15.43:0/1930937678 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c129280 con 0x7fc08c1294a0 2024-09-13T23:25:07.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6affff640 1 -- 172.21.15.43:0/647821127 learned_addr learned my addr 172.21.15.43:0/647821127 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f7983fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f798406e7a0 0x7f798406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f7983fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f798406e7a0 0x7f798406eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33690/0 (socket says 172.21.15.43:33690) 2024-09-13T23:25:07.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f7983fff640 1 -- 172.21.15.43:0/2146368565 learned_addr learned my addr 172.21.15.43:0/2146368565 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6af7fe640 1 -- 172.21.15.43:0/647821127 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697078819 0 0) 0x7fc6b0070190 con 0x7fc6b0127c30 2024-09-13T23:25:07.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6af7fe640 1 -- 172.21.15.43:0/647821127 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a0003520 con 0x7fc6b0127c30 2024-09-13T23:25:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f1325d80640 1 -- 172.21.15.43:0/1516570792 >> v1:172.21.15.43:6789/0 conn(0x7f132009c670 legacy=0x7f13200990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f1325d80640 1 -- 172.21.15.43:0/1516570792 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13200983e0 con 0x7f132009bd50 2024-09-13T23:25:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6affff640 1 -- 172.21.15.43:0/647821127 >> v1:172.21.15.43:6789/0 conn(0x7fc6b0127c30 legacy=0x7fc6b0128010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f7983fff640 1 -- 172.21.15.43:0/2146368565 >> v1:172.21.15.43:6789/0 conn(0x7f798406f0c0 legacy=0x7f798412ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:25:07.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7f7983fff640 1 -- 172.21.15.43:0/2146368565 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798406c470 con 0x7f798406e7a0 2024-09-13T23:25:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.488+0000 7fc6affff640 1 -- 172.21.15.43:0/647821127 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b0070a60 con 0x7fc6b0128720 2024-09-13T23:25:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc08a59c640 1 --2- 172.21.15.43:0/1930937678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c129880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0097f0 tx=0x7fc07c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5504bc40ffb50b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc08959a640 1 -- 172.21.15.43:0/1930937678 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07c037070 con 0x7fc08c1294a0 2024-09-13T23:25:07.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc08959a640 1 -- 172.21.15.43:0/1930937678 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c032440 con 0x7fc08c1294a0 2024-09-13T23:25:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc08959a640 1 -- 172.21.15.43:0/1930937678 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07c032740 con 0x7fc08c1294a0 2024-09-13T23:25:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7f1325d80640 1 --2- 172.21.15.43:0/1516570792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f132009c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131c009720 tx=0x7f131c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2d38a647135b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc6affff640 1 --2- 172.21.15.43:0/647821127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0128720 0x7fc6b0130450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097f0 tx=0x7fc69c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b959a6fc746b4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7f1324d7e640 1 -- 172.21.15.43:0/1516570792 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f131c037070 con 0x7f132009bd50 2024-09-13T23:25:07.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7f1324d7e640 1 -- 172.21.15.43:0/1516570792 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c02ad90 con 0x7f132009bd50 2024-09-13T23:25:07.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7f1324d7e640 1 -- 172.21.15.43:0/1516570792 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f131c032590 con 0x7f132009bd50 2024-09-13T23:25:07.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7f7983fff640 1 --2- 172.21.15.43:0/2146368565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f798406eb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f79740097f0 tx=0x7f797402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bc4603c840a535 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc6af7fe640 1 -- 172.21.15.43:0/647821127 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc69c037070 con 0x7fc6b0128720 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc6af7fe640 1 -- 172.21.15.43:0/647821127 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc69c032440 con 0x7fc6b0128720 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.489+0000 7fc6af7fe640 1 -- 172.21.15.43:0/647821127 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc69c02ae60 con 0x7fc6b0128720 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f7982ffd640 1 -- 172.21.15.43:0/2146368565 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7974037070 con 0x7f798406e7a0 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f7982ffd640 1 -- 172.21.15.43:0/2146368565 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797402ade0 con 0x7f798406e7a0 2024-09-13T23:25:07.502 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f7982ffd640 1 -- 172.21.15.43:0/2146368565 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7974032590 con 0x7f798406e7a0 2024-09-13T23:25:07.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 -- 172.21.15.43:0/1930937678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 msgr2=0x7fc08c129880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 --2- 172.21.15.43:0/1930937678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c129880 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0097f0 tx=0x7fc07c02a270 comp rx=0 tx=0).stop 2024-09-13T23:25:07.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 -- 172.21.15.43:0/1930937678 shutdown_connections 2024-09-13T23:25:07.503 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 --2- 172.21.15.43:0/1930937678 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c129880 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 -- 172.21.15.43:0/1930937678 >> 172.21.15.43:0/1930937678 conn(0x7fc08c09aa80 msgr2=0x7fc08c09ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 -- 172.21.15.43:0/1930937678 shutdown_connections 2024-09-13T23:25:07.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc090d31640 1 -- 172.21.15.43:0/1930937678 wait complete. 2024-09-13T23:25:07.504 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/647821127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0128720 msgr2=0x7fc6b0130450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/647821127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0128720 0x7fc6b0130450 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097f0 tx=0x7fc69c02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f1327fe4640 1 -- 172.21.15.43:0/1516570792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 msgr2=0x7f132009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f1327fe4640 1 --2- 172.21.15.43:0/1516570792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f132009c130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131c009720 tx=0x7f131c02a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.505 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/647821127 shutdown_connections 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/647821127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0128720 0x7fc6b0130450 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/647821127 >> 172.21.15.43:0/647821127 conn(0x7fc6b009a330 msgr2=0x7fc6b009a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f1327fe4640 1 -- 172.21.15.43:0/1516570792 shutdown_connections 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f1327fe4640 1 --2- 172.21.15.43:0/1516570792 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f132009c130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f1327fe4640 1 -- 172.21.15.43:0/1516570792 >> 172.21.15.43:0/1516570792 conn(0x7f132006d4a0 msgr2=0x7f132006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f798a9f6640 1 -- 172.21.15.43:0/2146368565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 msgr2=0x7f798406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.506 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f798a9f6640 1 --2- 172.21.15.43:0/2146368565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f798406eb80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f79740097f0 tx=0x7f797402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/647821127 shutdown_connections 2024-09-13T23:25:07.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/647821127 wait complete. 2024-09-13T23:25:07.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f798a9f6640 1 -- 172.21.15.43:0/2146368565 shutdown_connections 2024-09-13T23:25:07.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f798a9f6640 1 --2- 172.21.15.43:0/2146368565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f798406eb80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.507 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.490+0000 7f798a9f6640 1 -- 172.21.15.43:0/2146368565 >> 172.21.15.43:0/2146368565 conn(0x7f798409ac20 msgr2=0x7f798406d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7f1327fe4640 1 -- 172.21.15.43:0/1516570792 shutdown_connections 2024-09-13T23:25:07.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7f1327fe4640 1 -- 172.21.15.43:0/1516570792 wait complete. 2024-09-13T23:25:07.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7f798a9f6640 1 -- 172.21.15.43:0/2146368565 shutdown_connections 2024-09-13T23:25:07.508 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7f798a9f6640 1 -- 172.21.15.43:0/2146368565 wait complete. 2024-09-13T23:25:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7fc6b5b9d640 1 Processor -- start 2024-09-13T23:25:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7fc6b5b9d640 1 -- start start 2024-09-13T23:25:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.491+0000 7fc090d31640 1 Processor -- start 2024-09-13T23:25:07.509 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc090d31640 1 -- start start 2024-09-13T23:25:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f798a9f6640 1 Processor -- start 2024-09-13T23:25:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f1327fe4640 1 Processor -- start 2024-09-13T23:25:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f1327fe4640 1 -- start start 2024-09-13T23:25:07.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f798a9f6640 1 -- start start 2024-09-13T23:25:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc6b5b9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc6b5b9d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b0130d20 con 0x7fc6b0127c30 2024-09-13T23:25:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc6b4b9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc090d31640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc090d31640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c12ce50 con 0x7fc08c1294a0 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc6b4b9b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33706/0 (socket says 172.21.15.43:33706) 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc6b4b9b640 1 -- 172.21.15.43:0/4235749585 learned_addr learned my addr 172.21.15.43:0/4235749585 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f798a9f6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f798a9f6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f798409b4d0 con 0x7f798406e7a0 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f1327fe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7f1327fe4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1320099b90 con 0x7f132009bd50 2024-09-13T23:25:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6b4b9b640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b012dc80 con 0x7fc6b0127c30 2024-09-13T23:25:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc08a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc08a59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33710/0 (socket says 172.21.15.43:33710) 2024-09-13T23:25:07.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.492+0000 7fc08a59c640 1 -- 172.21.15.43:0/1744849114 learned_addr learned my addr 172.21.15.43:0/1744849114 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7983fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f1325d80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f1325d80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33730/0 (socket says 172.21.15.43:33730) 2024-09-13T23:25:07.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f1325d80640 1 -- 172.21.15.43:0/2978784850 learned_addr learned my addr 172.21.15.43:0/2978784850 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7983fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33718/0 (socket says 172.21.15.43:33718) 2024-09-13T23:25:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7983fff640 1 -- 172.21.15.43:0/1277549781 learned_addr learned my addr 172.21.15.43:0/1277549781 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc08a59c640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c08daf0 con 0x7fc08c1294a0 2024-09-13T23:25:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6b4b9b640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e690 tx=0x7fc6a400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.515 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc08a59c640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc07c02a2b0 tx=0x7fc07c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f1325d80640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13201c32d0 con 0x7f132009bd50 2024-09-13T23:25:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7983fff640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79841243e0 con 0x7f798406e7a0 2024-09-13T23:25:07.516 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7983fff640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7974035040 tx=0x7f7974004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f1325d80640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131c035040 tx=0x7f131c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a4005200 con 0x7fc6b0127c30 2024-09-13T23:25:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a40053a0 con 0x7fc6b0127c30 2024-09-13T23:25:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b012bca0 con 0x7fc6b0127c30 2024-09-13T23:25:07.517 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7974041070 con 0x7f798406e7a0 2024-09-13T23:25:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.494+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797403c590 con 0x7f798406e7a0 2024-09-13T23:25:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.494+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7984125bc0 con 0x7f798406e7a0 2024-09-13T23:25:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6a400c9c0 con 0x7fc6b0127c30 2024-09-13T23:25:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b012c740 con 0x7fc6b0127c30 2024-09-13T23:25:07.518 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07c041020 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c030710 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc07c037040 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c08f330 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.493+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c1c1b50 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.494+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc08c12d390 con 0x7fc08c1294a0 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f131c037040 con 0x7f132009bd50 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f131c042070 con 0x7f132009bd50 2024-09-13T23:25:07.519 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13201b3e90 con 0x7f132009bd50 2024-09-13T23:25:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f131c030860 con 0x7f132009bd50 2024-09-13T23:25:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201b4780 con 0x7f132009bd50 2024-09-13T23:25:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.494+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7974041070 con 0x7f798406e7a0 2024-09-13T23:25:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.494+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798412f080 con 0x7f798406e7a0 2024-09-13T23:25:07.520 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6b0125920 con 0x7fc6b0127c30 2024-09-13T23:25:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc07c044020 con 0x7fc08c1294a0 2024-09-13T23:25:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc07affd640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 0x7fc06c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc6a400cb60 con 0x7fc6b0127c30 2024-09-13T23:25:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc6ad7fa640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 0x7fc69403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.521 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc089d9b640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 0x7fc06c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc6a404da20 con 0x7fc6b0127c30 2024-09-13T23:25:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f132008c360 con 0x7f132009bd50 2024-09-13T23:25:07.522 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6ad7fa640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 0x7fc69403fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6a400ce50 con 0x7fc69403da70 2024-09-13T23:25:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.495+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc07c0457b0 con 0x7fc08c1294a0 2024-09-13T23:25:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc07affd640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 0x7fc06c0407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc06c040eb0 con 0x7fc06c03e340 2024-09-13T23:25:07.523 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f798412f8c0 con 0x7f798406e7a0 2024-09-13T23:25:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc07c03dae0 con 0x7fc08c1294a0 2024-09-13T23:25:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6b539c640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 0x7fc69403fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.524 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6affff640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 0x7fc69403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc08ad9d640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 0x7fc06c0407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fc6a4023b70 con 0x7fc6b0127c30 2024-09-13T23:25:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc089d9b640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 0x7fc06c03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc080000f60 tx=0x7fc080007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.525 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7974044070 con 0x7f798406e7a0 2024-09-13T23:25:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc6b539c640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 0x7fc69403fef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f131c030a00 con 0x7f132009bd50 2024-09-13T23:25:07.526 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.496+0000 7fc08ad9d640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 0x7fc06c0407e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7980ff9640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 0x7f797003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f797406b8f0 con 0x7f798406e7a0 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7980ff9640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 0x7f7970040030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f79837fe640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 0x7f797003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f797402ade0 con 0x7f797003dbb0 2024-09-13T23:25:07.527 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f79740702a0 con 0x7f798406e7a0 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f13167fc640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 0x7f130403a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f131c06ca30 con 0x7f132009bd50 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7fc6affff640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 0x7fc69403a7b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097f0 tx=0x7fc69c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f13167fc640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 0x7f130403fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f131c02ad90 con 0x7f130403da70 2024-09-13T23:25:07.528 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f131c06cd70 con 0x7f132009bd50 2024-09-13T23:25:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f7988f93640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 0x7f7970040030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f132557f640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 0x7f130403a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f1326581640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 0x7f130403fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.529 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6a400ce50 con 0x7fc69403da70 2024-09-13T23:25:07.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.497+0000 7f79837fe640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 0x7f797003a8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7978003cf0 tx=0x7f7978007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7f1326581640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 0x7f130403fef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7f132557f640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 0x7f130403a7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.530 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc06c040eb0 con 0x7fc06c03e340 2024-09-13T23:25:07.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7f7988f93640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 0x7f7970040030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f131c02ad90 con 0x7f130403da70 2024-09-13T23:25:07.531 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.498+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f797402ade0 con 0x7f797003dbb0 2024-09-13T23:25:07.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.511+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc08c08ea60 con 0x7fc06c03e340 2024-09-13T23:25:07.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc07affd640 1 -- 172.21.15.43:0/1744849114 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc08c08ea60 con 0x7fc06c03e340 2024-09-13T23:25:07.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f798412f380 con 0x7f797003dbb0 2024-09-13T23:25:07.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 msgr2=0x7fc06c0407e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.532 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 0x7fc06c0407e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7f7980ff9640 1 -- 172.21.15.43:0/1277549781 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f798412f380 con 0x7f797003dbb0 2024-09-13T23:25:07.533 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 msgr2=0x7fc06c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 0x7fc06c03a760 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc080000f60 tx=0x7fc080007a80 comp rx=0 tx=0).stop 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 msgr2=0x7fc08c1c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.512+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc07c02a2b0 tx=0x7fc07c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 shutdown_connections 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 msgr2=0x7f7970040030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.534 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 0x7f7970040030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7fc06c03e340 0x7fc06c0407e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc06c0382a0 0x7fc06c03a760 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 --2- 172.21.15.43:0/1744849114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc08c1294a0 0x7fc08c1c1610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 >> 172.21.15.43:0/1744849114 conn(0x7fc08c09aa80 msgr2=0x7fc08c126fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.535 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 msgr2=0x7f797003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 0x7f797003a8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7978003cf0 tx=0x7f7978007a50 comp rx=0 tx=0).stop 2024-09-13T23:25:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 msgr2=0x7f7984122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7974035040 tx=0x7f7974004730 comp rx=0 tx=0).stop 2024-09-13T23:25:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 shutdown_connections 2024-09-13T23:25:07.536 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 shutdown_connections 2024-09-13T23:25:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7fc090d31640 1 -- 172.21.15.43:0/1744849114 wait complete. 2024-09-13T23:25:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f797003dbb0 0x7f7970040030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7970038430 0x7f797003a8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 --2- 172.21.15.43:0/1277549781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f798406e7a0 0x7f7984122bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.537 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 >> 172.21.15.43:0/1277549781 conn(0x7f798409ac20 msgr2=0x7f79840984f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 shutdown_connections 2024-09-13T23:25:07.538 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.513+0000 7f798a9f6640 1 -- 172.21.15.43:0/1277549781 wait complete. 2024-09-13T23:25:07.539 INFO:teuthology.orchestra.run.smithi043.stdout:42949672966 2024-09-13T23:25:07.539 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:25:07.540 INFO:teuthology.orchestra.run.smithi043.stdout:42949672965 2024-09-13T23:25:07.540 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:25:07.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.528+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6b012f330 con 0x7fc69403da70 2024-09-13T23:25:07.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6ad7fa640 1 -- 172.21.15.43:0/4235749585 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6b012f330 con 0x7fc69403da70 2024-09-13T23:25:07.541 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f132009e810 con 0x7f130403da70 2024-09-13T23:25:07.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 msgr2=0x7fc69403fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 0x7fc69403fef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.542 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 msgr2=0x7fc69403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7f13167fc640 1 -- 172.21.15.43:0/2978784850 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f132009e810 con 0x7f130403da70 2024-09-13T23:25:07.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 0x7fc69403a7b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc69c0097f0 tx=0x7fc69c02e000 comp rx=0 tx=0).stop 2024-09-13T23:25:07.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 msgr2=0x7fc6b012c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.543 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.529+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400e690 tx=0x7fc6a400eb50 comp rx=0 tx=0).stop 2024-09-13T23:25:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 shutdown_connections 2024-09-13T23:25:07.544 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7fc69403da70 0x7fc69403fef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc6940382f0 0x7fc69403a7b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 --2- 172.21.15.43:0/4235749585 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc6b0127c30 0x7fc6b012c200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 >> 172.21.15.43:0/4235749585 conn(0x7fc6b009a330 msgr2=0x7fc6b0071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 shutdown_connections 2024-09-13T23:25:07.545 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7fc6b5b9d640 1 -- 172.21.15.43:0/4235749585 wait complete. 2024-09-13T23:25:07.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 msgr2=0x7f130403fef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 0x7f130403fef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 msgr2=0x7f130403a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 0x7f130403a7b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1310007fd0 tx=0x7f1310007ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.546 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 msgr2=0x7f13201c3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131c035040 tx=0x7f131c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 shutdown_connections 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f13040382f0 0x7f130403a7b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f130403da70 0x7f130403fef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 --2- 172.21.15.43:0/2978784850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f132009bd50 0x7f13201c3690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 >> 172.21.15.43:0/2978784850 conn(0x7f132006d4a0 msgr2=0x7f132009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 shutdown_connections 2024-09-13T23:25:07.547 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.530+0000 7f1327fe4640 1 -- 172.21.15.43:0/2978784850 wait complete. 2024-09-13T23:25:07.548 INFO:teuthology.orchestra.run.smithi043.stdout:42949672964 2024-09-13T23:25:07.549 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:25:07.549 INFO:teuthology.orchestra.run.smithi043.stdout:38654705669 2024-09-13T23:25:07.550 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:25:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a30f8640 1 Processor -- start 2024-09-13T23:25:07.652 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a30f8640 1 -- start start 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a30f8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f079c09bd50 0x7f079c09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a30f8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c09d3b0 con 0x7f079c09c670 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a30f8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f079c098230 con 0x7f079c09bd50 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f079bfff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f079c09c670 0x7f079c0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38940/0 (socket says 172.21.15.43:38940) 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.650+0000 7f07a0e94640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f079c09bd50 0x7f079c09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.653 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.651+0000 7f079bfff640 1 -- 172.21.15.43:0/2840180053 learned_addr learned my addr 172.21.15.43:0/2840180053 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.651+0000 7f07a0e94640 1 -- 172.21.15.43:0/2840180053 >> v1:172.21.15.43:6789/0 conn(0x7f079c09c670 legacy=0x7f079c0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.651+0000 7f07a0e94640 1 -- 172.21.15.43:0/2840180053 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c0983e0 con 0x7f079c09bd50 2024-09-13T23:25:07.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.651+0000 7f079b7fe640 1 -- 172.21.15.43:0/2840180053 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987750435 0 0) 0x7f0788001110 con 0x7f079c09c670 2024-09-13T23:25:07.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.652+0000 7f07a0e94640 1 --2- 172.21.15.43:0/2840180053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c09c130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0790009720 tx=0x7f079002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352da18538d8baf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.654 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.652+0000 7f079b7fe640 1 -- 172.21.15.43:0/2840180053 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0790037070 con 0x7f079c09bd50 2024-09-13T23:25:07.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.652+0000 7f079b7fe640 1 -- 172.21.15.43:0/2840180053 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079002ad90 con 0x7f079c09bd50 2024-09-13T23:25:07.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.652+0000 7f079b7fe640 1 -- 172.21.15.43:0/2840180053 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0790032590 con 0x7f079c09bd50 2024-09-13T23:25:07.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.653+0000 7f07a30f8640 1 -- 172.21.15.43:0/2840180053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 msgr2=0x7f079c09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.653+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2840180053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c09c130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0790009720 tx=0x7f079002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.653+0000 7f07a30f8640 1 -- 172.21.15.43:0/2840180053 shutdown_connections 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.653+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2840180053 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c09c130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.653+0000 7f07a30f8640 1 -- 172.21.15.43:0/2840180053 >> 172.21.15.43:0/2840180053 conn(0x7f079c06d4a0 msgr2=0x7f079c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.654+0000 7f07a30f8640 1 -- 172.21.15.43:0/2840180053 shutdown_connections 2024-09-13T23:25:07.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.654+0000 7f07a30f8640 1 -- 172.21.15.43:0/2840180053 wait complete. 2024-09-13T23:25:07.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.655+0000 7f07a30f8640 1 Processor -- start 2024-09-13T23:25:07.657 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.655+0000 7f07a30f8640 1 -- start start 2024-09-13T23:25:07.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a30f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a30f8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f079c099b90 con 0x7f079c09bd50 2024-09-13T23:25:07.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a0e94640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a0e94640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33742/0 (socket says 172.21.15.43:33742) 2024-09-13T23:25:07.658 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a0e94640 1 -- 172.21.15.43:0/2038577014 learned_addr learned my addr 172.21.15.43:0/2038577014 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a0e94640 1 -- 172.21.15.43:0/2038577014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c09a760 con 0x7f079c09bd50 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.656+0000 7f07a0e94640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0790009720 tx=0x7f07900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.657+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0790041070 con 0x7f079c09bd50 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.657+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079003c460 con 0x7f079c09bd50 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.657+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c1ab4a0 con 0x7f079c09bd50 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.657+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0790037040 con 0x7f079c09bd50 2024-09-13T23:25:07.659 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.657+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c094980 con 0x7f079c09bd50 2024-09-13T23:25:07.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.658+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0790044070 con 0x7f079c09bd50 2024-09-13T23:25:07.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.658+0000 7f07997fa640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 0x7f078003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.658+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079c09a130 con 0x7f079c09bd50 2024-09-13T23:25:07.660 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.658+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f079006bec0 con 0x7f079c09bd50 2024-09-13T23:25:07.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.658+0000 7f079bfff640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 0x7f078003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.661 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.659+0000 7f079bfff640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 0x7f078003a7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c00 tx=0x7f0788001250 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.665 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.663+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f079003ce70 con 0x7f079c09bd50 2024-09-13T23:25:07.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.693+0000 7f88801c4640 1 Processor -- start 2024-09-13T23:25:07.695 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f88801c4640 1 -- start start 2024-09-13T23:25:07.696 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f88801c4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f887809a100 0x7f8878133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f88801c4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887809d3b0 con 0x7f887809bd50 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f88801c4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f887809c840 con 0x7f887809a100 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f887d75f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f887809a100 0x7f8878133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f887df60640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f887809bd50 0x7f887809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38950/0 (socket says 172.21.15.43:38950) 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f887d75f640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f887809a100 0x7f8878133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33756/0 (socket says 172.21.15.43:33756) 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f887df60640 1 -- 172.21.15.43:0/3308416225 learned_addr learned my addr 172.21.15.43:0/3308416225 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.694+0000 7f887d75f640 1 -- 172.21.15.43:0/3308416225 >> v1:172.21.15.43:6789/0 conn(0x7f887809bd50 legacy=0x7f887809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.697 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.695+0000 7f887d75f640 1 -- 172.21.15.43:0/3308416225 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8878098230 con 0x7f887809a100 2024-09-13T23:25:07.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.695+0000 7f887d75f640 1 --2- 172.21.15.43:0/3308416225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f8878133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f886c009720 tx=0x7f886c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6a800ea052282b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.698 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.695+0000 7f887cf5e640 1 -- 172.21.15.43:0/3308416225 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f886c037070 con 0x7f887809a100 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.695+0000 7f887cf5e640 1 -- 172.21.15.43:0/3308416225 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886c02ad90 con 0x7f887809a100 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.695+0000 7f887cf5e640 1 -- 172.21.15.43:0/3308416225 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f886c032590 con 0x7f887809a100 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 -- 172.21.15.43:0/3308416225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 msgr2=0x7f8878133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 --2- 172.21.15.43:0/3308416225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f8878133da0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f886c009720 tx=0x7f886c02a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 -- 172.21.15.43:0/3308416225 shutdown_connections 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 --2- 172.21.15.43:0/3308416225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f8878133da0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 -- 172.21.15.43:0/3308416225 >> 172.21.15.43:0/3308416225 conn(0x7f887806d4a0 msgr2=0x7f887806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 -- 172.21.15.43:0/3308416225 shutdown_connections 2024-09-13T23:25:07.699 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.696+0000 7f88801c4640 1 -- 172.21.15.43:0/3308416225 wait complete. 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.697+0000 7f88801c4640 1 Processor -- start 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.697+0000 7f88801c4640 1 -- start start 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88801c4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88801c4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f8878134670 con 0x7f887809a100 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f887df60640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f887df60640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33762/0 (socket says 172.21.15.43:33762) 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f887df60640 1 -- 172.21.15.43:0/815151680 learned_addr learned my addr 172.21.15.43:0/815151680 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f887df60640 1 -- 172.21.15.43:0/815151680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8878125ee0 con 0x7f887809a100 2024-09-13T23:25:07.701 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f887df60640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f886800cb20 tx=0x7f886800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8868017070 con 0x7f887809a100 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f886800abf0 con 0x7f887809a100 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8878095510 con 0x7f887809a100 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.698+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8868012400 con 0x7f887809a100 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.699+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88780961a0 con 0x7f887809a100 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.699+0000 7f32610b7640 1 Processor -- start 2024-09-13T23:25:07.702 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.699+0000 7f32610b7640 1 -- start start 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f32610b7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f325c12e770 0x7f325c12ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f32610b7640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325c098b00 con 0x7f325c12eba0 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f32610b7640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f325c12f4c0 con 0x7f325c12e770 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f886801a070 con 0x7f887809a100 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f325ad9d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f325c12eba0 0x7f325c12b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38952/0 (socket says 172.21.15.43:38952) 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f325ad9d640 1 -- 172.21.15.43:0/3036576338 learned_addr learned my addr 172.21.15.43:0/3036576338 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.703 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f325a59c640 1 --2- 172.21.15.43:0/3036576338 >> v2:172.21.15.43:3300/0 conn(0x7f325c12e770 0x7f325c12ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8878096490 con 0x7f887809a100 2024-09-13T23:25:07.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f3259d9b640 1 -- 172.21.15.43:0/3036576338 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126181834 0 0) 0x7f325c098b00 con 0x7f325c12eba0 2024-09-13T23:25:07.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f3259d9b640 1 -- 172.21.15.43:0/3036576338 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3244003520 con 0x7f325c12eba0 2024-09-13T23:25:07.704 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f325a59c640 1 -- 172.21.15.43:0/3036576338 >> v1:172.21.15.43:6789/0 conn(0x7f325c12eba0 legacy=0x7f325c12b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f88767fc640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 0x7f886403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f325a59c640 1 -- 172.21.15.43:0/3036576338 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c0986c0 con 0x7f325c12e770 2024-09-13T23:25:07.705 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.700+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f886804afa0 con 0x7f887809a100 2024-09-13T23:25:07.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.701+0000 7f887d75f640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 0x7f886403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.701+0000 7f887d75f640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 0x7f886403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f886c034000 tx=0x7f886c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.706 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.701+0000 7f325a59c640 1 --2- 172.21.15.43:0/3036576338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c12ef80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3250009720 tx=0x7f325002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6175d1f6f68180f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.705+0000 7f3259d9b640 1 -- 172.21.15.43:0/3036576338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3250037070 con 0x7f325c12e770 2024-09-13T23:25:07.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f3259d9b640 1 -- 172.21.15.43:0/3036576338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325002ad90 con 0x7f325c12e770 2024-09-13T23:25:07.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f3259d9b640 1 -- 172.21.15.43:0/3036576338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3250032570 con 0x7f325c12e770 2024-09-13T23:25:07.708 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8878096490 con 0x7f887809a100 2024-09-13T23:25:07.709 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 -- 172.21.15.43:0/3036576338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 msgr2=0x7f325c12ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 --2- 172.21.15.43:0/3036576338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c12ef80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3250009720 tx=0x7f325002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 -- 172.21.15.43:0/3036576338 shutdown_connections 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 --2- 172.21.15.43:0/3036576338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c12ef80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 -- 172.21.15.43:0/3036576338 >> 172.21.15.43:0/3036576338 conn(0x7f325c06d030 msgr2=0x7f325c06d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 -- 172.21.15.43:0/3036576338 shutdown_connections 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.706+0000 7f32610b7640 1 -- 172.21.15.43:0/3036576338 wait complete. 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f32610b7640 1 Processor -- start 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f32610b7640 1 -- start start 2024-09-13T23:25:07.710 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f6bb81ef640 1 Processor -- start 2024-09-13T23:25:07.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f6bb81ef640 1 -- start start 2024-09-13T23:25:07.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f32610b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.711 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f32610b7640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f325c09cb70 con 0x7f325c12e770 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f325ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f325ad9d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33784/0 (socket says 172.21.15.43:33784) 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.708+0000 7f325ad9d640 1 -- 172.21.15.43:0/2050990481 learned_addr learned my addr 172.21.15.43:0/2050990481 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f325ad9d640 1 -- 172.21.15.43:0/2050990481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f325c08d8a0 con 0x7f325c12e770 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f325ad9d640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c480 tx=0x7f324c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb81ef640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6bb0098a20 0x7f6bb012d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb81ef640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb0131890 con 0x7f6bb012c570 2024-09-13T23:25:07.712 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb5f8b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6bb012c570 0x7f6bb012c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:38958/0 (socket says 172.21.15.43:38958) 2024-09-13T23:25:07.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb5f8b640 1 -- 172.21.15.43:0/302793774 learned_addr learned my addr 172.21.15.43:0/302793774 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:07.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c017070 con 0x7f325c12e770 2024-09-13T23:25:07.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324c005c10 con 0x7f325c12e770 2024-09-13T23:25:07.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f324c007070 con 0x7f325c12e770 2024-09-13T23:25:07.713 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb0098550 con 0x7f6bb0098a20 2024-09-13T23:25:07.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f325c128d40 con 0x7f325c12e770 2024-09-13T23:25:07.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb578a640 1 --2- 172.21.15.43:0/302793774 >> v2:172.21.15.43:3300/0 conn(0x7f6bb0098a20 0x7f6bb012d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.714 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325c08e810 con 0x7f325c12e770 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb4f89640 1 -- 172.21.15.43:0/302793774 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274170279 0 0) 0x7f6bb0131890 con 0x7f6bb012c570 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb4f89640 1 -- 172.21.15.43:0/302793774 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c003520 con 0x7f6bb012c570 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb578a640 1 -- 172.21.15.43:0/302793774 >> v1:172.21.15.43:6789/0 conn(0x7f6bb012c570 legacy=0x7f6bb012c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.709+0000 7f6bb578a640 1 -- 172.21.15.43:0/302793774 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb0132a70 con 0x7f6bb0098a20 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.710+0000 7f6bb578a640 1 --2- 172.21.15.43:0/302793774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb012d060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009720 tx=0x7f6ba002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56e3dd51ba930d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.715 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.710+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325c098b00 con 0x7f325c12e770 2024-09-13T23:25:07.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f6bb4f89640 1 -- 172.21.15.43:0/302793774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0037070 con 0x7f6bb0098a20 2024-09-13T23:25:07.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f6bb4f89640 1 -- 172.21.15.43:0/302793774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba002ad90 con 0x7f6bb0098a20 2024-09-13T23:25:07.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f324c01a070 con 0x7f325c12e770 2024-09-13T23:25:07.716 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f6bb4f89640 1 -- 172.21.15.43:0/302793774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0037070 con 0x7f6bb0098a20 2024-09-13T23:25:07.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f32437fe640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 0x7f324803a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f324c04a520 con 0x7f325c12e770 2024-09-13T23:25:07.717 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.711+0000 7f325a59c640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 0x7f324803a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 msgr2=0x7f6bb012d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/302793774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb012d060 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009720 tx=0x7f6ba002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 shutdown_connections 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/302793774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb012d060 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 >> 172.21.15.43:0/302793774 conn(0x7f6bb009f020 msgr2=0x7f6bb009f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 shutdown_connections 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f6bb81ef640 1 -- 172.21.15.43:0/302793774 wait complete. 2024-09-13T23:25:07.718 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.712+0000 7f325a59c640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 0x7f324803a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3250009720 tx=0x7f325002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb81ef640 1 Processor -- start 2024-09-13T23:25:07.719 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb81ef640 1 -- start start 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb81ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb81ef640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0131df0 con 0x7f6bb0098a20 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb5f8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb5f8b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33798/0 (socket says 172.21.15.43:33798) 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb5f8b640 1 -- 172.21.15.43:0/3617821849 learned_addr learned my addr 172.21.15.43:0/3617821849 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.713+0000 7f6bb5f8b640 1 -- 172.21.15.43:0/3617821849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb012ead0 con 0x7f6bb0098a20 2024-09-13T23:25:07.720 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.714+0000 7f6bb5f8b640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c480 tx=0x7f6bac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.722 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f324c01a790 con 0x7f325c12e770 2024-09-13T23:25:07.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac018070 con 0x7f6bb0098a20 2024-09-13T23:25:07.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0074d0 con 0x7f6bb0098a20 2024-09-13T23:25:07.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac0047e0 con 0x7f6bb0098a20 2024-09-13T23:25:07.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb0129620 con 0x7f6bb0098a20 2024-09-13T23:25:07.723 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.721+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb012f940 con 0x7f6bb0098a20 2024-09-13T23:25:07.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.722+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6bac01b070 con 0x7f6bb0098a20 2024-09-13T23:25:07.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.722+0000 7f6ba67fc640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 0x7f6b9403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:07.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.722+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f6bac04a6f0 con 0x7f6bb0098a20 2024-09-13T23:25:07.724 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.722+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb01322a0 con 0x7f6bb0098a20 2024-09-13T23:25:07.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.723+0000 7f6bb578a640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 0x7f6b9403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:07.725 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.723+0000 7f6bb578a640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 0x7f6b9403a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0034000 tx=0x7f6ba002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:07.734 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.732+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bac01ae10 con 0x7f6bb0098a20 2024-09-13T23:25:07.880 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.878+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f079c1ab240 con 0x7f079c09bd50 2024-09-13T23:25:07.881 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.879+0000 7f07997fa640 1 -- 172.21.15.43:0/2038577014 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f079003a520 con 0x7f079c09bd50 2024-09-13T23:25:07.881 INFO:teuthology.orchestra.run.smithi043.stdout:42949672965 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.881+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 msgr2=0x7f078003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.881+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 0x7f078003a7e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c00 tx=0x7f0788001250 comp rx=0 tx=0).stop 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 msgr2=0x7f079c094440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0790009720 tx=0x7f07900046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 shutdown_connections 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0780038320 0x7f078003a7e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.884 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 --2- 172.21.15.43:0/2038577014 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f079c09bd50 0x7f079c094440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 >> 172.21.15.43:0/2038577014 conn(0x7f079c06d4a0 msgr2=0x7f079c09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 shutdown_connections 2024-09-13T23:25:07.885 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.882+0000 7f07a30f8640 1 -- 172.21.15.43:0/2038577014 wait complete. 2024-09-13T23:25:07.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-09-13T23:25:07.902 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.900+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f325c075b40 con 0x7f325c12e770 2024-09-13T23:25:07.903 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.901+0000 7f32437fe640 1 -- 172.21.15.43:0/2050990481 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f324c01a9b0 con 0x7f325c12e770 2024-09-13T23:25:07.903 INFO:teuthology.orchestra.run.smithi043.stdout:42949672964 2024-09-13T23:25:07.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.902+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f88781260b0 con 0x7f887809a100 2024-09-13T23:25:07.904 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.902+0000 7f88767fc640 1 -- 172.21.15.43:0/815151680 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f887809d3b0 con 0x7f887809a100 2024-09-13T23:25:07.904 INFO:teuthology.orchestra.run.smithi043.stdout:38654705668 2024-09-13T23:25:07.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 msgr2=0x7f324803a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 0x7f324803a7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3250009720 tx=0x7f325002e000 comp rx=0 tx=0).stop 2024-09-13T23:25:07.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 msgr2=0x7f325c1c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.905 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c480 tx=0x7f324c00c940 comp rx=0 tx=0).stop 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 shutdown_connections 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f32480382f0 0x7f324803a7b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 --2- 172.21.15.43:0/2050990481 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f325c12e770 0x7f325c1c36b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 >> 172.21.15.43:0/2050990481 conn(0x7f325c06d030 msgr2=0x7f325c09f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 shutdown_connections 2024-09-13T23:25:07.906 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.903+0000 7f32610b7640 1 -- 172.21.15.43:0/2050990481 wait complete. 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 msgr2=0x7f886403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 0x7f886403a760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f886c034000 tx=0x7f886c02e000 comp rx=0 tx=0).stop 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 msgr2=0x7f88781c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f886800cb20 tx=0x7f886800a060 comp rx=0 tx=0).stop 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 shutdown_connections 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f88640382a0 0x7f886403a760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 --2- 172.21.15.43:0/815151680 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f887809a100 0x7f88781c3990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 >> 172.21.15.43:0/815151680 conn(0x7f887806d4a0 msgr2=0x7f8878096af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.907 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 shutdown_connections 2024-09-13T23:25:07.908 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.904+0000 7f88801c4640 1 -- 172.21.15.43:0/815151680 wait complete. 2024-09-13T23:25:07.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-13T23:25:07.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-13T23:25:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.927+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6bb0097bd0 con 0x7f6bb0098a20 2024-09-13T23:25:07.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.927+0000 7f6ba67fc640 1 -- 172.21.15.43:0/3617821849 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bac010e00 con 0x7f6bb0098a20 2024-09-13T23:25:07.929 INFO:teuthology.orchestra.run.smithi043.stdout:42949672963 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 msgr2=0x7f6b9403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 0x7f6b9403a760 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0034000 tx=0x7f6ba002e000 comp rx=0 tx=0).stop 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 msgr2=0x7f6bb0130620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c480 tx=0x7f6bac00c940 comp rx=0 tx=0).stop 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 shutdown_connections 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6b940382a0 0x7f6b9403a760 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 --2- 172.21.15.43:0/3617821849 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6bb0098a20 0x7f6bb0130620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 >> 172.21.15.43:0/3617821849 conn(0x7f6bb009f020 msgr2=0x7f6bb0099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 shutdown_connections 2024-09-13T23:25:07.932 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:07.929+0000 7f6bb81ef640 1 -- 172.21.15.43:0/3617821849 wait complete. 2024-09-13T23:25:07.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-13T23:25:08.899 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:25:08.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:25:08.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:25:08.943 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:25:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb35552640 1 Processor -- start 2024-09-13T23:25:09.019 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb35552640 1 -- start start 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb35552640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb30098a20 0x7feb3012d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb35552640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30131890 con 0x7feb3012c570 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb35552640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7feb30098550 con 0x7feb30098a20 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb2e7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb30098a20 0x7feb3012d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb2e7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feb30098a20 0x7feb3012d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48572/0 (socket says 172.21.15.43:48572) 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb2effd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7feb3012c570 0x7feb3012c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37346/0 (socket says 172.21.15.43:37346) 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.017+0000 7feb2e7fc640 1 -- 172.21.15.43:0/2567217573 learned_addr learned my addr 172.21.15.43:0/2567217573 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.018+0000 7feb2e7fc640 1 -- 172.21.15.43:0/2567217573 >> v1:172.21.15.43:6789/0 conn(0x7feb3012c570 legacy=0x7feb3012c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.020 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.018+0000 7feb2e7fc640 1 -- 172.21.15.43:0/2567217573 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30132a70 con 0x7feb30098a20 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.018+0000 7feb2e7fc640 1 --2- 172.21.15.43:0/2567217573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb3012d060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb240097f0 tx=0x7feb2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec00d1aca3c61d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb2dffb640 1 -- 172.21.15.43:0/2567217573 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb24037070 con 0x7feb30098a20 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb2dffb640 1 -- 172.21.15.43:0/2567217573 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb24032440 con 0x7feb30098a20 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb2dffb640 1 -- 172.21.15.43:0/2567217573 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb2402ae60 con 0x7feb30098a20 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb35552640 1 -- 172.21.15.43:0/2567217573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 msgr2=0x7feb3012d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb35552640 1 --2- 172.21.15.43:0/2567217573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb3012d060 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb240097f0 tx=0x7feb2402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb35552640 1 -- 172.21.15.43:0/2567217573 shutdown_connections 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.019+0000 7feb35552640 1 --2- 172.21.15.43:0/2567217573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb3012d060 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.020+0000 7feb35552640 1 -- 172.21.15.43:0/2567217573 >> 172.21.15.43:0/2567217573 conn(0x7feb3009f020 msgr2=0x7feb3009f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.020+0000 7feb35552640 1 -- 172.21.15.43:0/2567217573 shutdown_connections 2024-09-13T23:25:09.022 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.020+0000 7feb35552640 1 -- 172.21.15.43:0/2567217573 wait complete. 2024-09-13T23:25:09.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb35552640 1 Processor -- start 2024-09-13T23:25:09.023 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb35552640 1 -- start start 2024-09-13T23:25:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb35552640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb35552640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feb30131df0 con 0x7feb30098a20 2024-09-13T23:25:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb2effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb2effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48584/0 (socket says 172.21.15.43:48584) 2024-09-13T23:25:09.024 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.021+0000 7feb2effd640 1 -- 172.21.15.43:0/1842077762 learned_addr learned my addr 172.21.15.43:0/1842077762 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb2effd640 1 -- 172.21.15.43:0/1842077762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30095a90 con 0x7feb30098a20 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb2effd640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c450 tx=0x7feb2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb20007410 con 0x7feb30098a20 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb200075b0 con 0x7feb30098a20 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb30095d20 con 0x7feb30098a20 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb20004910 con 0x7feb30098a20 2024-09-13T23:25:09.025 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.022+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb30071580 con 0x7feb30098a20 2024-09-13T23:25:09.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.024+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feb2001a020 con 0x7feb30098a20 2024-09-13T23:25:09.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.024+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb30126d60 con 0x7feb30098a20 2024-09-13T23:25:09.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.024+0000 7feb177fe640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 0x7feb1c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.026 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.024+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7feb2004ab50 con 0x7feb30098a20 2024-09-13T23:25:09.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.024+0000 7feb2e7fc640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 0x7feb1c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.027 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.025+0000 7feb2e7fc640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 0x7feb1c03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb24034000 tx=0x7feb2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.033+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb30126d60 con 0x7feb30098a20 2024-09-13T23:25:09.057 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.055+0000 7feed3e08640 1 Processor -- start 2024-09-13T23:25:09.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.055+0000 7f168ba5e640 1 Processor -- start 2024-09-13T23:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.055+0000 7feed3e08640 1 -- start start 2024-09-13T23:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f168ba5e640 1 -- start start 2024-09-13T23:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f168ba5e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f168406eda0 0x7f168406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f168ba5e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168406eba0 con 0x7f168406f6c0 2024-09-13T23:25:09.096 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f168ba5e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f168406d2f0 con 0x7f168406eda0 2024-09-13T23:25:09.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed3e08640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feecc09a100 0x7feecc133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f16897fa640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f168406eda0 0x7f168406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f16897fa640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f168406eda0 0x7f168406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48594/0 (socket says 172.21.15.43:48594) 2024-09-13T23:25:09.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7f16897fa640 1 -- 172.21.15.43:0/3004719246 learned_addr learned my addr 172.21.15.43:0/3004719246 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed13a3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feecc09a100 0x7feecc133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed13a3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7feecc09a100 0x7feecc133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48606/0 (socket says 172.21.15.43:48606) 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed13a3640 1 -- 172.21.15.43:0/1482694590 learned_addr learned my addr 172.21.15.43:0/1482694590 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc09d3b0 con 0x7feecc09bd50 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.056+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7feecc09c840 con 0x7feecc09a100 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.057+0000 7feed13a3640 1 -- 172.21.15.43:0/1482694590 >> v1:172.21.15.43:6789/0 conn(0x7feecc09bd50 legacy=0x7feecc09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.057+0000 7feed13a3640 1 -- 172.21.15.43:0/1482694590 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc098230 con 0x7feecc09a100 2024-09-13T23:25:09.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.057+0000 7f16897fa640 1 -- 172.21.15.43:0/3004719246 >> v1:172.21.15.43:6789/0 conn(0x7f168406f6c0 legacy=0x7f1684121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.057+0000 7f16897fa640 1 -- 172.21.15.43:0/3004719246 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1684070d50 con 0x7f168406eda0 2024-09-13T23:25:09.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7feed13a3640 1 --2- 172.21.15.43:0/1482694590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc133da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feebc0097f0 tx=0x7feebc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d8ebfc5b79353c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7f16897fa640 1 --2- 172.21.15.43:0/3004719246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168406f180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16800097f0 tx=0x7f168002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ff3fee67829b40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7feed0ba2640 1 -- 172.21.15.43:0/1482694590 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feebc037070 con 0x7feecc09a100 2024-09-13T23:25:09.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7feed0ba2640 1 -- 172.21.15.43:0/1482694590 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feebc032440 con 0x7feecc09a100 2024-09-13T23:25:09.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7feed0ba2640 1 -- 172.21.15.43:0/1482694590 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feebc02ae60 con 0x7feecc09a100 2024-09-13T23:25:09.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7f167bfff640 1 -- 172.21.15.43:0/3004719246 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1680037070 con 0x7f168406eda0 2024-09-13T23:25:09.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7fdf9690a640 1 Processor -- start 2024-09-13T23:25:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7f167bfff640 1 -- 172.21.15.43:0/3004719246 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680032440 con 0x7f168406eda0 2024-09-13T23:25:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7f167bfff640 1 -- 172.21.15.43:0/3004719246 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1680032740 con 0x7f168406eda0 2024-09-13T23:25:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.058+0000 7fdf9690a640 1 -- start start 2024-09-13T23:25:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 msgr2=0x7feecc133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.101 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 --2- 172.21.15.43:0/1482694590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc133da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7feebc0097f0 tx=0x7feebc02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf9690a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf9009bd50 0x7fdf9009c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 shutdown_connections 2024-09-13T23:25:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 --2- 172.21.15.43:0/1482694590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc133da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 >> 172.21.15.43:0/1482694590 conn(0x7feecc06d4a0 msgr2=0x7feecc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf8ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf9009bd50 0x7fdf9009c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf9690a640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9009d3b0 con 0x7fdf9009c670 2024-09-13T23:25:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf8ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fdf9009bd50 0x7fdf9009c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48614/0 (socket says 172.21.15.43:48614) 2024-09-13T23:25:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf8ffff640 1 -- 172.21.15.43:0/61052703 learned_addr learned my addr 172.21.15.43:0/61052703 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 shutdown_connections 2024-09-13T23:25:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fdf90098230 con 0x7fdf9009bd50 2024-09-13T23:25:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8ffff640 1 -- 172.21.15.43:0/61052703 >> v1:172.21.15.43:6789/0 conn(0x7fdf9009c670 legacy=0x7fdf900990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8ffff640 1 -- 172.21.15.43:0/61052703 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf900983e0 con 0x7fdf9009bd50 2024-09-13T23:25:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7f168ba5e640 1 -- 172.21.15.43:0/3004719246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 msgr2=0x7f168406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7f168ba5e640 1 --2- 172.21.15.43:0/3004719246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168406f180 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16800097f0 tx=0x7f168002a270 comp rx=0 tx=0).stop 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7f168ba5e640 1 -- 172.21.15.43:0/3004719246 shutdown_connections 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7f168ba5e640 1 --2- 172.21.15.43:0/3004719246 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168406f180 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7f168ba5e640 1 -- 172.21.15.43:0/3004719246 >> 172.21.15.43:0/3004719246 conn(0x7f168409a890 msgr2=0x7f168409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7f168ba5e640 1 -- 172.21.15.43:0/3004719246 shutdown_connections 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7f168ba5e640 1 -- 172.21.15.43:0/3004719246 wait complete. 2024-09-13T23:25:09.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.059+0000 7feed3e08640 1 -- 172.21.15.43:0/1482694590 wait complete. 2024-09-13T23:25:09.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8ffff640 1 --2- 172.21.15.43:0/61052703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf9009c130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097f0 tx=0x7fdf8002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a16cb9d34c8d071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8effd640 1 -- 172.21.15.43:0/61052703 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf80037070 con 0x7fdf9009bd50 2024-09-13T23:25:09.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8effd640 1 -- 172.21.15.43:0/61052703 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf80032440 con 0x7fdf9009bd50 2024-09-13T23:25:09.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.060+0000 7fdf8effd640 1 -- 172.21.15.43:0/61052703 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8002ae60 con 0x7fdf9009bd50 2024-09-13T23:25:09.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed3e08640 1 Processor -- start 2024-09-13T23:25:09.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7f168ba5e640 1 Processor -- start 2024-09-13T23:25:09.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed3e08640 1 -- start start 2024-09-13T23:25:09.107 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7f168ba5e640 1 -- start start 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 msgr2=0x7fdf9009c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 --2- 172.21.15.43:0/61052703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf9009c130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdf800097f0 tx=0x7fdf8002a1e0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 shutdown_connections 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 --2- 172.21.15.43:0/61052703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf9009c130 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 >> 172.21.15.43:0/61052703 conn(0x7fdf9006d4a0 msgr2=0x7fdf9006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed3e08640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7f168ba5e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 shutdown_connections 2024-09-13T23:25:09.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7fdf9690a640 1 -- 172.21.15.43:0/61052703 wait complete. 2024-09-13T23:25:09.109 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed3e08640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7feecc134670 con 0x7feecc09a100 2024-09-13T23:25:09.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7f168ba5e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1684122160 con 0x7f168406eda0 2024-09-13T23:25:09.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed1ba4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed1ba4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48626/0 (socket says 172.21.15.43:48626) 2024-09-13T23:25:09.110 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f16897fa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.061+0000 7feed1ba4640 1 -- 172.21.15.43:0/2818779596 learned_addr learned my addr 172.21.15.43:0/2818779596 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f16897fa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48634/0 (socket says 172.21.15.43:48634) 2024-09-13T23:25:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f16897fa640 1 -- 172.21.15.43:0/957381228 learned_addr learned my addr 172.21.15.43:0/957381228 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.111 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feed1ba4640 1 -- 172.21.15.43:0/2818779596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc096080 con 0x7feecc09a100 2024-09-13T23:25:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f16897fa640 1 -- 172.21.15.43:0/957381228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168412e130 con 0x7f168406eda0 2024-09-13T23:25:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feed1ba4640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feec800c450 tx=0x7feec800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f16897fa640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f168002a2b0 tx=0x7f16800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.112 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7fdf9690a640 1 Processor -- start 2024-09-13T23:25:09.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feecc09a100 2024-09-13T23:25:09.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec8005200 con 0x7feecc09a100 2024-09-13T23:25:09.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc096a90 con 0x7feecc09a100 2024-09-13T23:25:09.113 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc097130 con 0x7feecc09a100 2024-09-13T23:25:09.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1680041070 con 0x7f168406eda0 2024-09-13T23:25:09.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f168003c7a0 con 0x7f168406eda0 2024-09-13T23:25:09.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.063+0000 7fdf9690a640 1 -- start start 2024-09-13T23:25:09.114 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.062+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1680037040 con 0x7f168406eda0 2024-09-13T23:25:09.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.063+0000 7f168ba5e640 1 -- 172.21.15.43:0/957381228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168412c890 con 0x7f168406eda0 2024-09-13T23:25:09.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.063+0000 7f168ba5e640 1 -- 172.21.15.43:0/957381228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168412afc0 con 0x7f168406eda0 2024-09-13T23:25:09.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.063+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feecc09a100 2024-09-13T23:25:09.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.063+0000 7fdf9690a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.115 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf9690a640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90099b90 con 0x7fdf9009bd50 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48638/0 (socket says 172.21.15.43:48638) 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8ffff640 1 -- 172.21.15.43:0/1980725313 learned_addr learned my addr 172.21.15.43:0/1980725313 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8ffff640 1 -- 172.21.15.43:0/1980725313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf901b3080 con 0x7fdf9009bd50 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc0a1d10 con 0x7feecc09a100 2024-09-13T23:25:09.116 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1680044070 con 0x7f168406eda0 2024-09-13T23:25:09.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8ffff640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf80035040 tx=0x7fdf800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1684122670 con 0x7f168406eda0 2024-09-13T23:25:09.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf80041070 con 0x7fdf9009bd50 2024-09-13T23:25:09.117 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7f1679ffb640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 0x7f166803a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8003c7a0 con 0x7fdf9009bd50 2024-09-13T23:25:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf901b4880 con 0x7fdf9009bd50 2024-09-13T23:25:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feec801a070 con 0x7feecc09a100 2024-09-13T23:25:09.118 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.064+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f168006bd80 con 0x7f168406eda0 2024-09-13T23:25:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf80037040 con 0x7fdf9009bd50 2024-09-13T23:25:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf901b1a80 con 0x7fdf9009bd50 2024-09-13T23:25:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7feec27fc640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 0x7feeb003a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7feec80053b0 con 0x7feecc09a100 2024-09-13T23:25:09.119 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7f1688ff9640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 0x7f166803a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.065+0000 7feed13a3640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 0x7feeb003a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.066+0000 7f1688ff9640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 0x7f166803a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.120 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.066+0000 7feed13a3640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 0x7feeb003a8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feebc034000 tx=0x7feebc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.066+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9009a130 con 0x7fdf9009bd50 2024-09-13T23:25:09.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.070+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f168412e130 con 0x7f168406eda0 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.070+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdf80044070 con 0x7fdf9009bd50 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.070+0000 7fdf8cff9640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 0x7fdf7c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.071+0000 7fdf8f7fe640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 0x7fdf7c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.071+0000 7fdf8f7fe640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 0x7fdf7c03a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf84000f60 tx=0x7fdf84007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.075+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fdf80050480 con 0x7fdf9009bd50 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.075+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feecc097130 con 0x7feecc09a100 2024-09-13T23:25:09.122 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.079+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf901b3080 con 0x7fdf9009bd50 2024-09-13T23:25:09.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.221+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb301322a0 con 0x7feb30098a20 2024-09-13T23:25:09.223 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.221+0000 7feb177fe640 1 -- 172.21.15.43:0/1842077762 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb2001bc30 con 0x7feb30098a20 2024-09-13T23:25:09.224 INFO:teuthology.orchestra.run.smithi043.stdout:42949672965 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 msgr2=0x7feb1c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 0x7feb1c03a760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feb24034000 tx=0x7feb2402e000 comp rx=0 tx=0).stop 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 msgr2=0x7feb30072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c450 tx=0x7feb2000c910 comp rx=0 tx=0).stop 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 shutdown_connections 2024-09-13T23:25:09.226 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feb1c0382a0 0x7feb1c03a760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 --2- 172.21.15.43:0/1842077762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feb30098a20 0x7feb30072260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 >> 172.21.15.43:0/1842077762 conn(0x7feb3009f020 msgr2=0x7feb3012ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 shutdown_connections 2024-09-13T23:25:09.227 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.224+0000 7feb35552640 1 -- 172.21.15.43:0/1842077762 wait complete. 2024-09-13T23:25:09.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-09-13T23:25:09.259 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.257+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdf9009d020 con 0x7fdf9009bd50 2024-09-13T23:25:09.260 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.258+0000 7fdf8cff9640 1 -- 172.21.15.43:0/1980725313 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf8003ca80 con 0x7fdf9009bd50 2024-09-13T23:25:09.260 INFO:teuthology.orchestra.run.smithi043.stdout:42949672964 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 msgr2=0x7fdf7c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 0x7fdf7c03a790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf84000f60 tx=0x7fdf84007a30 comp rx=0 tx=0).stop 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 msgr2=0x7fdf901c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf80035040 tx=0x7fdf800046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 shutdown_connections 2024-09-13T23:25:09.262 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c0382d0 0x7fdf7c03a790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 --2- 172.21.15.43:0/1980725313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fdf9009bd50 0x7fdf901c3900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 >> 172.21.15.43:0/1980725313 conn(0x7fdf9006d4a0 msgr2=0x7fdf9009eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 shutdown_connections 2024-09-13T23:25:09.263 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.260+0000 7fdf9690a640 1 -- 172.21.15.43:0/1980725313 wait complete. 2024-09-13T23:25:09.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-13T23:25:09.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.287+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1684074990 con 0x7f168406eda0 2024-09-13T23:25:09.290 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.287+0000 7f1679ffb640 1 -- 172.21.15.43:0/957381228 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f168003abf0 con 0x7f168406eda0 2024-09-13T23:25:09.290 INFO:teuthology.orchestra.run.smithi043.stdout:38654705668 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 msgr2=0x7f166803a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 0x7f166803a7b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1674000f60 tx=0x7f1674007a30 comp rx=0 tx=0).stop 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 msgr2=0x7f168412aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f168002a2b0 tx=0x7f16800046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 shutdown_connections 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f16680382f0 0x7f166803a7b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.293 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 --2- 172.21.15.43:0/957381228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f168406eda0 0x7f168412aa80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 >> 172.21.15.43:0/957381228 conn(0x7f168409a890 msgr2=0x7f1684097bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 shutdown_connections 2024-09-13T23:25:09.294 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.290+0000 7f16677fe640 1 -- 172.21.15.43:0/957381228 wait complete. 2024-09-13T23:25:09.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.292+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feecc09d020 con 0x7feecc09a100 2024-09-13T23:25:09.295 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.292+0000 7feec27fc640 1 -- 172.21.15.43:0/2818779596 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feecc097130 con 0x7feecc09a100 2024-09-13T23:25:09.295 INFO:teuthology.orchestra.run.smithi043.stdout:42949672963 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.294+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 msgr2=0x7feeb003a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.294+0000 7feed3e08640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 0x7feeb003a8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7feebc034000 tx=0x7feebc02e000 comp rx=0 tx=0).stop 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 msgr2=0x7feecc1339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feec800c450 tx=0x7feec800c910 comp rx=0 tx=0).stop 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 shutdown_connections 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb0038430 0x7feeb003a8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 --2- 172.21.15.43:0/2818779596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7feecc09a100 0x7feecc1339e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 >> 172.21.15.43:0/2818779596 conn(0x7feecc06d4a0 msgr2=0x7feecc08d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:09.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 shutdown_connections 2024-09-13T23:25:09.299 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:09.295+0000 7feed3e08640 1 -- 172.21.15.43:0/2818779596 wait complete. 2024-09-13T23:25:09.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-13T23:25:09.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-13T23:25:10.238 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T23:25:10.274 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T23:25:10.305 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T23:25:10.308 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T23:25:10.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a8a7e4640 1 Processor -- start 2024-09-13T23:25:10.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a8a7e4640 1 -- start start 2024-09-13T23:25:10.357 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a8a7e4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a8406f0b0 0x7f3a84133d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a8a7e4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8406be10 con 0x7f3a8406e5c0 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a8a7e4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f3a8409b5a0 con 0x7f3a8406f0b0 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.354+0000 7f3a837fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a8406f0b0 0x7f3a84133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.355+0000 7f3a83fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f3a8406e5c0 0x7f3a8406e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37376/0 (socket says 172.21.15.43:37376) 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.355+0000 7f3a837fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f3a8406f0b0 0x7f3a84133d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48642/0 (socket says 172.21.15.43:48642) 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.355+0000 7f3a83fff640 1 -- 172.21.15.43:0/2520202342 learned_addr learned my addr 172.21.15.43:0/2520202342 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.355+0000 7f3a837fe640 1 -- 172.21.15.43:0/2520202342 >> v1:172.21.15.43:6789/0 conn(0x7f3a8406e5c0 legacy=0x7f3a8406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.358 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.355+0000 7f3a837fe640 1 -- 172.21.15.43:0/2520202342 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8406c400 con 0x7f3a8406f0b0 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.356+0000 7f3a837fe640 1 --2- 172.21.15.43:0/2520202342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406f0b0 0x7f3a84133d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009720 tx=0x7f3a7802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53c2e692f282e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.356+0000 7f3a82ffd640 1 -- 172.21.15.43:0/2520202342 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a78037070 con 0x7f3a8406f0b0 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.356+0000 7f3a82ffd640 1 -- 172.21.15.43:0/2520202342 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7802ae20 con 0x7f3a8406f0b0 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.356+0000 7f3a82ffd640 1 -- 172.21.15.43:0/2520202342 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a78032590 con 0x7f3a8406f0b0 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/2520202342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406f0b0 msgr2=0x7f3a84133d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/2520202342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406f0b0 0x7f3a84133d10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a78009720 tx=0x7f3a7802a1a0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/2520202342 shutdown_connections 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/2520202342 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406f0b0 0x7f3a84133d10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.360 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/2520202342 >> 172.21.15.43:0/2520202342 conn(0x7f3a8409aa80 msgr2=0x7f3a8409ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/2520202342 shutdown_connections 2024-09-13T23:25:10.361 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.357+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/2520202342 wait complete. 2024-09-13T23:25:10.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.358+0000 7f3a8a7e4640 1 Processor -- start 2024-09-13T23:25:10.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.359+0000 7f3a8a7e4640 1 -- start start 2024-09-13T23:25:10.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.359+0000 7f3a8a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.359+0000 7f3a8a7e4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84134250 con 0x7f3a8406e5c0 2024-09-13T23:25:10.363 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a83fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a83fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48652/0 (socket says 172.21.15.43:48652) 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a83fff640 1 -- 172.21.15.43:0/3506683597 learned_addr learned my addr 172.21.15.43:0/3506683597 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a83fff640 1 -- 172.21.15.43:0/3506683597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a84096eb0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a83fff640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c380 tx=0x7f3a7400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a74005c10 con 0x7f3a8406e5c0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a74005db0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.360+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a84094700 con 0x7f3a8406e5c0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.361+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a74004930 con 0x7f3a8406e5c0 2024-09-13T23:25:10.364 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.361+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a840951a0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.362+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3a7401a020 con 0x7f3a8406e5c0 2024-09-13T23:25:10.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.362+0000 7f3a80ff9640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 0x7f3a7003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.362+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f3a7404e120 con 0x7f3a8406e5c0 2024-09-13T23:25:10.365 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.362+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8406e9a0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.364+0000 7f3a837fe640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 0x7f3a7003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.366 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.364+0000 7f3a837fe640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 0x7f3a7003a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a78034000 tx=0x7f3a7802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.369 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.368+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a840951a0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.395+0000 7fb408c06640 1 Processor -- start 2024-09-13T23:25:10.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.395+0000 7fb408c06640 1 -- start start 2024-09-13T23:25:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb408c06640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb404098a20 0x7fb40412d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb408c06640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb404131890 con 0x7fb40412c570 2024-09-13T23:25:10.399 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb408c06640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fb404098550 con 0x7fb404098a20 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb401d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb404098a20 0x7fb40412d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb401d9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fb404098a20 0x7fb40412d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48656/0 (socket says 172.21.15.43:48656) 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb401d9b640 1 -- 172.21.15.43:0/3683020051 learned_addr learned my addr 172.21.15.43:0/3683020051 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb401d9b640 1 -- 172.21.15.43:0/3683020051 >> v1:172.21.15.43:6789/0 conn(0x7fb40412c570 legacy=0x7fb40412c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.396+0000 7fb401d9b640 1 -- 172.21.15.43:0/3683020051 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404132a70 con 0x7fb404098a20 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.397+0000 7fb401d9b640 1 --2- 172.21.15.43:0/3683020051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb40412d060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80097f0 tx=0x7fb3f802a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdce839f0b0f7a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.397+0000 7fb40159a640 1 -- 172.21.15.43:0/3683020051 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f8037070 con 0x7fb404098a20 2024-09-13T23:25:10.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.397+0000 7fb40159a640 1 -- 172.21.15.43:0/3683020051 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f8032440 con 0x7fb404098a20 2024-09-13T23:25:10.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.397+0000 7fb40159a640 1 -- 172.21.15.43:0/3683020051 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f8032740 con 0x7fb404098a20 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 -- 172.21.15.43:0/3683020051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 msgr2=0x7fb40412d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 --2- 172.21.15.43:0/3683020051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb40412d060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80097f0 tx=0x7fb3f802a1f0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 -- 172.21.15.43:0/3683020051 shutdown_connections 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 --2- 172.21.15.43:0/3683020051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb40412d060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 -- 172.21.15.43:0/3683020051 >> 172.21.15.43:0/3683020051 conn(0x7fb40409f020 msgr2=0x7fb40409f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.403 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 -- 172.21.15.43:0/3683020051 shutdown_connections 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.398+0000 7fb408c06640 1 -- 172.21.15.43:0/3683020051 wait complete. 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.399+0000 7fb408c06640 1 Processor -- start 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.399+0000 7fb408c06640 1 -- start start 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb408c06640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb408c06640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fb404131df0 con 0x7fb404098a20 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb40259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb40259c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48668/0 (socket says 172.21.15.43:48668) 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb40259c640 1 -- 172.21.15.43:0/4289352608 learned_addr learned my addr 172.21.15.43:0/4289352608 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb40259c640 1 -- 172.21.15.43:0/4289352608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb404126d60 con 0x7fb404098a20 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.400+0000 7fb40259c640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c450 tx=0x7fb3f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.401+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f4017070 con 0x7fb404098a20 2024-09-13T23:25:10.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.401+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f4005220 con 0x7fb404098a20 2024-09-13T23:25:10.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.401+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4040709a0 con 0x7fb404098a20 2024-09-13T23:25:10.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.401+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40035f0 con 0x7fb404098a20 2024-09-13T23:25:10.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.401+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb404070e70 con 0x7fb404098a20 2024-09-13T23:25:10.405 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.402+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4041322a0 con 0x7fb404098a20 2024-09-13T23:25:10.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.402+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb3f401a070 con 0x7fb404098a20 2024-09-13T23:25:10.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.402+0000 7fb3f2ffd640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 0x7fb3e403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.402+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fb3f404a5b0 con 0x7fb404098a20 2024-09-13T23:25:10.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.403+0000 7fb401d9b640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 0x7fb3e403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.406 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.403+0000 7fb401d9b640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 0x7fb3e403a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034000 tx=0x7fb3f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.414 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.412+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3f4019e10 con 0x7fb404098a20 2024-09-13T23:25:10.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.436+0000 7f5f3ccdd640 1 Processor -- start 2024-09-13T23:25:10.438 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.436+0000 7f5f3ccdd640 1 -- start start 2024-09-13T23:25:10.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7ff4955a5640 1 Processor -- start 2024-09-13T23:25:10.439 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7ff4955a5640 1 -- start start 2024-09-13T23:25:10.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3ccdd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f5f3809a100 0x7f5f38133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3ccdd640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3809d3b0 con 0x7f5f3809bd50 2024-09-13T23:25:10.440 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3ccdd640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f5f3809c840 con 0x7f5f3809a100 2024-09-13T23:25:10.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3659c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f5f3809bd50 0x7f5f3809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37400/0 (socket says 172.21.15.43:37400) 2024-09-13T23:25:10.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3659c640 1 -- 172.21.15.43:0/2208148414 learned_addr learned my addr 172.21.15.43:0/2208148414 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:10.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f35d9b640 1 --2- 172.21.15.43:0/2208148414 >> v2:172.21.15.43:3300/0 conn(0x7f5f3809a100 0x7f5f38133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3559a640 1 -- 172.21.15.43:0/2208148414 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1457733166 0 0) 0x7f5f28001110 con 0x7f5f3809bd50 2024-09-13T23:25:10.441 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7f5f3559a640 1 -- 172.21.15.43:0/2208148414 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f20003520 con 0x7f5f3809bd50 2024-09-13T23:25:10.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7ff4955a5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff490094d10 0x7ff4900950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.437+0000 7ff4955a5640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff490097450 con 0x7ff490095630 2024-09-13T23:25:10.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff4955a5640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff490097220 con 0x7ff490094d10 2024-09-13T23:25:10.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff48effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff490094d10 0x7ff4900950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff48effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff490094d10 0x7ff4900950f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48696/0 (socket says 172.21.15.43:48696) 2024-09-13T23:25:10.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff48effd640 1 -- 172.21.15.43:0/3951425040 learned_addr learned my addr 172.21.15.43:0/3951425040 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7f5f35d9b640 1 -- 172.21.15.43:0/2208148414 >> v1:172.21.15.43:6789/0 conn(0x7f5f3809bd50 legacy=0x7f5f3809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.443 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7f5f35d9b640 1 -- 172.21.15.43:0/2208148414 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f38098230 con 0x7f5f3809a100 2024-09-13T23:25:10.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff48effd640 1 -- 172.21.15.43:0/3951425040 >> v1:172.21.15.43:6789/0 conn(0x7ff490095630 legacy=0x7ff490095a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T23:25:10.444 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.438+0000 7ff48effd640 1 -- 172.21.15.43:0/3951425040 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff490131270 con 0x7ff490094d10 2024-09-13T23:25:10.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7f5f35d9b640 1 --2- 172.21.15.43:0/2208148414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38133da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009720 tx=0x7f5f2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5c3f2392fd3db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7f5f3559a640 1 -- 172.21.15.43:0/2208148414 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c037070 con 0x7f5f3809a100 2024-09-13T23:25:10.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7f5f3559a640 1 -- 172.21.15.43:0/2208148414 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c02ad90 con 0x7f5f3809a100 2024-09-13T23:25:10.445 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7f5f3559a640 1 -- 172.21.15.43:0/2208148414 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f2c032590 con 0x7f5f3809a100 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7ff48effd640 1 --2- 172.21.15.43:0/3951425040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff4900950f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4800097f0 tx=0x7ff48002b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f11110716a6d8b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7ff48dffb640 1 -- 172.21.15.43:0/3951425040 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480038070 con 0x7ff490094d10 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7ff48dffb640 1 -- 172.21.15.43:0/3951425040 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff480033570 con 0x7ff490094d10 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.439+0000 7ff48dffb640 1 -- 172.21.15.43:0/3951425040 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480033870 con 0x7ff490094d10 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 -- 172.21.15.43:0/3951425040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 msgr2=0x7ff4900950f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.446 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 --2- 172.21.15.43:0/3951425040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff4900950f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4800097f0 tx=0x7ff48002b3d0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2208148414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 msgr2=0x7f5f38133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2208148414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38133da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009720 tx=0x7f5f2c02a110 comp rx=0 tx=0).stop 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 -- 172.21.15.43:0/3951425040 shutdown_connections 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 --2- 172.21.15.43:0/3951425040 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff4900950f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 -- 172.21.15.43:0/3951425040 >> 172.21.15.43:0/3951425040 conn(0x7ff49009d500 msgr2=0x7ff49009d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 -- 172.21.15.43:0/3951425040 shutdown_connections 2024-09-13T23:25:10.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2208148414 shutdown_connections 2024-09-13T23:25:10.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2208148414 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38133da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7ff4955a5640 1 -- 172.21.15.43:0/3951425040 wait complete. 2024-09-13T23:25:10.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2208148414 >> 172.21.15.43:0/2208148414 conn(0x7f5f3806d4a0 msgr2=0x7f5f3806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2208148414 shutdown_connections 2024-09-13T23:25:10.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.440+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2208148414 wait complete. 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.441+0000 7ff4955a5640 1 Processor -- start 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.441+0000 7ff4955a5640 1 -- start start 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff4955a5640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff4955a5640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff490075000 con 0x7ff490094d10 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff48effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7f5f3ccdd640 1 Processor -- start 2024-09-13T23:25:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff48effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48704/0 (socket says 172.21.15.43:48704) 2024-09-13T23:25:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff48effd640 1 -- 172.21.15.43:0/406915517 learned_addr learned my addr 172.21.15.43:0/406915517 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7f5f3ccdd640 1 -- start start 2024-09-13T23:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff48effd640 1 -- 172.21.15.43:0/406915517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff490092c30 con 0x7ff490094d10 2024-09-13T23:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.442+0000 7ff48effd640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff480033540 tx=0x7ff4800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480038040 con 0x7ff490094d10 2024-09-13T23:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff490072900 con 0x7ff490094d10 2024-09-13T23:25:10.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff480031670 con 0x7ff490094d10 2024-09-13T23:25:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7f5f3ccdd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff490093860 con 0x7ff490094d10 2024-09-13T23:25:10.453 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff480031950 con 0x7ff490094d10 2024-09-13T23:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48712/0 (socket says 172.21.15.43:48712) 2024-09-13T23:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7f5f3659c640 1 -- 172.21.15.43:0/2655249957 learned_addr learned my addr 172.21.15.43:0/2655249957 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.443+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38134670 con 0x7f5f3809a100 2024-09-13T23:25:10.454 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4900950f0 con 0x7ff490094d10 2024-09-13T23:25:10.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7f5f3659c640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f38094be0 con 0x7f5f3809a100 2024-09-13T23:25:10.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff480045020 con 0x7ff490094d10 2024-09-13T23:25:10.455 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7f5f3659c640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c6b0 tx=0x7f5f2800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7ff4777fe640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 0x7ff47c03a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.444+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff480043020 con 0x7ff490094d10 2024-09-13T23:25:10.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.445+0000 7ff48e7fc640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 0x7ff47c03a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.445+0000 7ff48e7fc640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 0x7ff47c03a710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff490096170 tx=0x7ff484007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.456 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.453+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff480032e80 con 0x7ff490094d10 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.453+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f28017070 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.453+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f280058b0 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.453+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f28005bd0 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.453+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3809a760 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.454+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f38095a50 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.455+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5f2801a070 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.455+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f380008d0 con 0x7f5f3809a100 2024-09-13T23:25:10.458 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.455+0000 7f5f26ffd640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 0x7f5f1803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.455+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f5f2804a5b0 con 0x7f5f3809a100 2024-09-13T23:25:10.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.455+0000 7f5f35d9b640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 0x7f5f1803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.459 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.456+0000 7f5f35d9b640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 0x7f5f1803a800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c034000 tx=0x7f5f2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.466 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.464+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f3809d3b0 con 0x7f5f3809a100 2024-09-13T23:25:10.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.562+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3a8406c020 con 0x7f3a8406e5c0 2024-09-13T23:25:10.565 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.563+0000 7f3a80ff9640 1 -- 172.21.15.43:0/3506683597 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a740493b0 con 0x7f3a8406e5c0 2024-09-13T23:25:10.566 INFO:teuthology.orchestra.run.smithi043.stdout:42949672967 2024-09-13T23:25:10.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 msgr2=0x7f3a7003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 0x7f3a7003a760 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3a78034000 tx=0x7f3a7802e000 comp rx=0 tx=0).stop 2024-09-13T23:25:10.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 msgr2=0x7f3a84096080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.568 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c380 tx=0x7f3a7400c840 comp rx=0 tx=0).stop 2024-09-13T23:25:10.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 shutdown_connections 2024-09-13T23:25:10.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3a700382a0 0x7f3a7003a760 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 --2- 172.21.15.43:0/3506683597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f3a8406e5c0 0x7f3a84096080 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 >> 172.21.15.43:0/3506683597 conn(0x7f3a8409aa80 msgr2=0x7f3a84130f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.569 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 shutdown_connections 2024-09-13T23:25:10.570 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.565+0000 7f3a8a7e4640 1 -- 172.21.15.43:0/3506683597 wait complete. 2024-09-13T23:25:10.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672967 for osd.2 2024-09-13T23:25:10.579 DEBUG:teuthology.parallel:result is None 2024-09-13T23:25:10.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.595+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb40412e160 con 0x7fb404098a20 2024-09-13T23:25:10.597 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.595+0000 7fb3f2ffd640 1 -- 172.21.15.43:0/4289352608 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3f401a760 con 0x7fb404098a20 2024-09-13T23:25:10.597 INFO:teuthology.orchestra.run.smithi043.stdout:42949672966 2024-09-13T23:25:10.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 msgr2=0x7fb3e403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.599 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 0x7fb3e403a710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8034000 tx=0x7fb3f802e000 comp rx=0 tx=0).stop 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 msgr2=0x7fb4041311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400c450 tx=0x7fb3f400c910 comp rx=0 tx=0).stop 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 shutdown_connections 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb3e4038250 0x7fb3e403a710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 --2- 172.21.15.43:0/4289352608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fb404098a20 0x7fb4041311c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 >> 172.21.15.43:0/4289352608 conn(0x7fb40409f020 msgr2=0x7fb40412ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 shutdown_connections 2024-09-13T23:25:10.600 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.597+0000 7fb408c06640 1 -- 172.21.15.43:0/4289352608 wait complete. 2024-09-13T23:25:10.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.1 2024-09-13T23:25:10.610 DEBUG:teuthology.parallel:result is None 2024-09-13T23:25:10.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.635+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff4900931c0 con 0x7ff490094d10 2024-09-13T23:25:10.637 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.635+0000 7ff4777fe640 1 -- 172.21.15.43:0/406915517 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff48006a850 con 0x7ff490094d10 2024-09-13T23:25:10.637 INFO:teuthology.orchestra.run.smithi043.stdout:42949672965 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 msgr2=0x7ff47c03a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 0x7ff47c03a710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff490096170 tx=0x7ff484007a50 comp rx=0 tx=0).stop 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 msgr2=0x7ff490090d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff480033540 tx=0x7ff4800046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 shutdown_connections 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff47c038250 0x7ff47c03a710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 --2- 172.21.15.43:0/406915517 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff490094d10 0x7ff490090d40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 >> 172.21.15.43:0/406915517 conn(0x7ff49009d500 msgr2=0x7ff490071400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 shutdown_connections 2024-09-13T23:25:10.640 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.637+0000 7ff4955a5640 1 -- 172.21.15.43:0/406915517 wait complete. 2024-09-13T23:25:10.645 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.643+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5f38074970 con 0x7f5f3809a100 2024-09-13T23:25:10.646 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.644+0000 7f5f26ffd640 1 -- 172.21.15.43:0/2655249957 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f28005d70 con 0x7f5f3809a100 2024-09-13T23:25:10.646 INFO:teuthology.orchestra.run.smithi043.stdout:38654705669 2024-09-13T23:25:10.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 msgr2=0x7f5f1803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 0x7f5f1803a800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c034000 tx=0x7f5f2c02e000 comp rx=0 tx=0).stop 2024-09-13T23:25:10.648 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 msgr2=0x7f5f38092f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c6b0 tx=0x7f5f2800cb70 comp rx=0 tx=0).stop 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 shutdown_connections 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5f18038340 0x7f5f1803a800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 --2- 172.21.15.43:0/2655249957 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f5f3809a100 0x7f5f38092f40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 >> 172.21.15.43:0/2655249957 conn(0x7f5f3806d4a0 msgr2=0x7f5f3809f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 shutdown_connections 2024-09-13T23:25:10.649 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.646+0000 7f5f3ccdd640 1 -- 172.21.15.43:0/2655249957 wait complete. 2024-09-13T23:25:10.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.3 2024-09-13T23:25:10.650 DEBUG:teuthology.parallel:result is None 2024-09-13T23:25:10.658 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-13T23:25:10.659 DEBUG:teuthology.parallel:result is None 2024-09-13T23:25:10.659 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T23:25:10.659 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:25:10.801 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.798+0000 7f01c3427640 1 Processor -- start 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c3427640 1 -- start start 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c3427640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f01bc09bd50 0x7f01bc09c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c3427640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01bc09d3b0 con 0x7f01bc09c670 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c3427640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f01bc098230 con 0x7f01bc09bd50 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c11c3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f01bc09bd50 0x7f01bc09c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c09c2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f01bc09c670 0x7f01bc0990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37418/0 (socket says 172.21.15.43:37418) 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c09c2640 1 -- 172.21.15.43:0/1078521288 learned_addr learned my addr 172.21.15.43:0/1078521288 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c11c3640 1 -- 172.21.15.43:0/1078521288 >> v1:172.21.15.43:6789/0 conn(0x7f01bc09c670 legacy=0x7f01bc0990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.802 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.799+0000 7f01c11c3640 1 -- 172.21.15.43:0/1078521288 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc0983e0 con 0x7f01bc09bd50 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.800+0000 7f01c11c3640 1 --2- 172.21.15.43:0/1078521288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc09c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009720 tx=0x7f01b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc63ecd41716015c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.800+0000 7f01b3fff640 1 -- 172.21.15.43:0/1078521288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b8037070 con 0x7f01bc09bd50 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.800+0000 7f01b3fff640 1 -- 172.21.15.43:0/1078521288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b802ad90 con 0x7f01bc09bd50 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.800+0000 7f01b3fff640 1 -- 172.21.15.43:0/1078521288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b8032590 con 0x7f01bc09bd50 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 -- 172.21.15.43:0/1078521288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 msgr2=0x7f01bc09c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 --2- 172.21.15.43:0/1078521288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc09c130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009720 tx=0x7f01b802a110 comp rx=0 tx=0).stop 2024-09-13T23:25:10.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 -- 172.21.15.43:0/1078521288 shutdown_connections 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 --2- 172.21.15.43:0/1078521288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc09c130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 -- 172.21.15.43:0/1078521288 >> 172.21.15.43:0/1078521288 conn(0x7f01bc06d4a0 msgr2=0x7f01bc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 -- 172.21.15.43:0/1078521288 shutdown_connections 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.801+0000 7f01c3427640 1 -- 172.21.15.43:0/1078521288 wait complete. 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c3427640 1 Processor -- start 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c3427640 1 -- start start 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c3427640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c3427640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f01bc099b90 con 0x7f01bc09bd50 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c11c3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c11c3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48738/0 (socket says 172.21.15.43:48738) 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.802+0000 7f01c11c3640 1 -- 172.21.15.43:0/369368164 learned_addr learned my addr 172.21.15.43:0/369368164 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01c11c3640 1 -- 172.21.15.43:0/369368164 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01bc094eb0 con 0x7f01bc09bd50 2024-09-13T23:25:10.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01c11c3640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009840 tx=0x7f01b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b8041070 con 0x7f01bc09bd50 2024-09-13T23:25:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01b803c460 con 0x7f01bc09bd50 2024-09-13T23:25:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01b8037040 con 0x7f01bc09bd50 2024-09-13T23:25:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01bc095590 con 0x7f01bc09bd50 2024-09-13T23:25:10.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.803+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01bc0961c0 con 0x7f01bc09bd50 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.804+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f01b8044070 con 0x7f01bc09bd50 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.804+0000 7f01b1ffb640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 0x7f01a003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.804+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01bc09a130 con 0x7f01bc09bd50 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.804+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f01b806bae0 con 0x7f01bc09bd50 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.804+0000 7f01c09c2640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 0x7f01a003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:10.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.805+0000 7f01c09c2640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 0x7f01a003a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01ac007fd0 tx=0x7f01ac007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:10.811 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.809+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01bc0961c0 con 0x7f01bc09bd50 2024-09-13T23:25:10.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.980+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01bc09d020 con 0x7f01a00382a0 2024-09-13T23:25:10.984 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.982+0000 7f01b1ffb640 1 -- 172.21.15.43:0/369368164 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32182 (secure 0 0 0) 0x7f01bc09d020 con 0x7f01a00382a0 2024-09-13T23:25:10.985 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:10.985 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.983+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 msgr2=0x7f01a003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.983+0000 7f01c3427640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 0x7f01a003a760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01ac007fd0 tx=0x7f01ac007ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.983+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 msgr2=0x7f01bc093570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.983+0000 7f01c3427640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009840 tx=0x7f01b80046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 shutdown_connections 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f01a00382a0 0x7f01a003a760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 --2- 172.21.15.43:0/369368164 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f01bc09bd50 0x7f01bc093570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:10.986 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 >> 172.21.15.43:0/369368164 conn(0x7f01bc06d4a0 msgr2=0x7f01bc09eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:10.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 shutdown_connections 2024-09-13T23:25:10.987 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:10.984+0000 7f01c3427640 1 -- 172.21.15.43:0/369368164 wait complete. 2024-09-13T23:25:10.996 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T23:25:09.297353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118228,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369132,"statfs":{"total":386547056640,"available":386425991168,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.898344"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411831+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:06.411831+0000","last_peered":"2024-09-13T23:25:06.411831+0000","last_clean":"2024-09-13T23:25:06.411831+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:06.411831+0000","last_undegraded":"2024-09-13T23:25:06.411831+0000","last_fullsized":"2024-09-13T23:25:06.411831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.413218+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:06.413218+0000","last_peered":"2024-09-13T23:25:06.413218+0000","last_clean":"2024-09-13T23:25:06.413218+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:06.413218+0000","last_undegraded":"2024-09-13T23:25:06.413218+0000","last_fullsized":"2024-09-13T23:25:06.413218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411042+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:06.411042+0000","last_peered":"2024-09-13T23:25:06.411042+0000","last_clean":"2024-09-13T23:25:06.411042+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:06.411042+0000","last_undegraded":"2024-09-13T23:25:06.411042+0000","last_fullsized":"2024-09-13T23:25:06.411042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.413281+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:06.413281+0000","last_peered":"2024-09-13T23:25:06.413281+0000","last_clean":"2024-09-13T23:25:06.413281+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:06.413281+0000","last_undegraded":"2024-09-13T23:25:06.413281+0000","last_fullsized":"2024-09-13T23:25:06.413281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.412468+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:06.412468+0000","last_peered":"2024-09-13T23:25:06.412468+0000","last_clean":"2024-09-13T23:25:06.412468+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:06.412468+0000","last_undegraded":"2024-09-13T23:25:06.412468+0000","last_fullsized":"2024-09-13T23:25:06.412468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.444234+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:06.444234+0000","last_peered":"2024-09-13T23:25:06.444234+0000","last_clean":"2024-09-13T23:25:06.444234+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:06.444234+0000","last_undegraded":"2024-09-13T23:25:06.444234+0000","last_fullsized":"2024-09-13T23:25:06.444234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411034+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:06.411034+0000","last_peered":"2024-09-13T23:25:06.411034+0000","last_clean":"2024-09-13T23:25:06.411034+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:06.411034+0000","last_undegraded":"2024-09-13T23:25:06.411034+0000","last_fullsized":"2024-09-13T23:25:06.411034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.412073+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:06.412073+0000","last_peered":"2024-09-13T23:25:06.412073+0000","last_clean":"2024-09-13T23:25:06.412073+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:06.412073+0000","last_undegraded":"2024-09-13T23:25:06.412073+0000","last_fullsized":"2024-09-13T23:25:06.412073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":169,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.408862+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:25:06.408862+0000","last_peered":"2024-09-13T23:25:06.408862+0000","last_clean":"2024-09-13T23:25:06.408862+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:25:06.408862+0000","last_undegraded":"2024-09-13T23:25:06.408862+0000","last_fullsized":"2024-09-13T23:25:06.408862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:42.131218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:25:10.997 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf0a84c640 1 Processor -- start 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf0a84c640 1 -- start start 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf0a84c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf0406eda0 0x7faf0406f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf0a84c640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0406eba0 con 0x7faf0406f6c0 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf0a84c640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7faf0406d2f0 con 0x7faf0406eda0 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf03fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf0406eda0 0x7faf0406f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf03fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7faf0406eda0 0x7faf0406f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48754/0 (socket says 172.21.15.43:48754) 2024-09-13T23:25:11.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf037fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7faf0406f6c0 0x7faf04121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37426/0 (socket says 172.21.15.43:37426) 2024-09-13T23:25:11.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.096+0000 7faf03fff640 1 -- 172.21.15.43:0/3743895954 learned_addr learned my addr 172.21.15.43:0/3743895954 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:11.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.097+0000 7faf03fff640 1 -- 172.21.15.43:0/3743895954 >> v1:172.21.15.43:6789/0 conn(0x7faf0406f6c0 legacy=0x7faf04121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.097+0000 7faf03fff640 1 -- 172.21.15.43:0/3743895954 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf04070d50 con 0x7faf0406eda0 2024-09-13T23:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.097+0000 7faf03fff640 1 --2- 172.21.15.43:0/3743895954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf0406f180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faef400ba90 tx=0x7faef402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4287d0f4be9a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.097+0000 7faf02ffd640 1 -- 172.21.15.43:0/3743895954 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4036020 con 0x7faf0406eda0 2024-09-13T23:25:11.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.097+0000 7faf02ffd640 1 -- 172.21.15.43:0/3743895954 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4032770 con 0x7faf0406eda0 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf02ffd640 1 -- 172.21.15.43:0/3743895954 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4032a70 con 0x7faf0406eda0 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 -- 172.21.15.43:0/3743895954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 msgr2=0x7faf0406f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 --2- 172.21.15.43:0/3743895954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf0406f180 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faef400ba90 tx=0x7faef402c940 comp rx=0 tx=0).stop 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 -- 172.21.15.43:0/3743895954 shutdown_connections 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 --2- 172.21.15.43:0/3743895954 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf0406f180 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 -- 172.21.15.43:0/3743895954 >> 172.21.15.43:0/3743895954 conn(0x7faf0409a890 msgr2=0x7faf0409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 -- 172.21.15.43:0/3743895954 shutdown_connections 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.098+0000 7faf0a84c640 1 -- 172.21.15.43:0/3743895954 wait complete. 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.099+0000 7faf0a84c640 1 Processor -- start 2024-09-13T23:25:11.103 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.099+0000 7faf0a84c640 1 -- start start 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf0a84c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf0a84c640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7faf04122160 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf03fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf03fff640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48764/0 (socket says 172.21.15.43:48764) 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf03fff640 1 -- 172.21.15.43:0/1115805527 learned_addr learned my addr 172.21.15.43:0/1115805527 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf03fff640 1 -- 172.21.15.43:0/1115805527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0408f700 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf03fff640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faef400b2c0 tx=0x7faef4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef403ac90 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef403ae30 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faef4046480 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0408fb40 con 0x7faf0406eda0 2024-09-13T23:25:11.104 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.100+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf041c3ee0 con 0x7faf0406eda0 2024-09-13T23:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.101+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faef4039020 con 0x7faf0406eda0 2024-09-13T23:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.101+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf04122670 con 0x7faf0406eda0 2024-09-13T23:25:11.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.102+0000 7faf00ff9640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 0x7faef003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.102+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7faef402f070 con 0x7faf0406eda0 2024-09-13T23:25:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.102+0000 7faf037fe640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 0x7faef003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.106 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.102+0000 7faf037fe640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 0x7faef003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faef80015f0 tx=0x7faef8007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.108 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.106+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faef4046e20 con 0x7faf0406eda0 2024-09-13T23:25:11.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.276+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf04090ed0 con 0x7faef00382a0 2024-09-13T23:25:11.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.279+0000 7faf00ff9640 1 -- 172.21.15.43:0/1115805527 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32182 (secure 0 0 0) 0x7faf04090ed0 con 0x7faef00382a0 2024-09-13T23:25:11.280 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:11.281 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:25:11.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 msgr2=0x7faef003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 0x7faef003a760 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faef80015f0 tx=0x7faef8007a40 comp rx=0 tx=0).stop 2024-09-13T23:25:11.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 msgr2=0x7faf041c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.282 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faef400b2c0 tx=0x7faef4004730 comp rx=0 tx=0).stop 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 shutdown_connections 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faef00382a0 0x7faef003a760 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 --2- 172.21.15.43:0/1115805527 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7faf0406eda0 0x7faf041c37c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 >> 172.21.15.43:0/1115805527 conn(0x7faf0409a890 msgr2=0x7faf040721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 shutdown_connections 2024-09-13T23:25:11.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.280+0000 7faf0a84c640 1 -- 172.21.15.43:0/1115805527 wait complete. 2024-09-13T23:25:11.292 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T23:25:09.297353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118228,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369132,"statfs":{"total":386547056640,"available":386425991168,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.898344"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411831+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:06.411831+0000","last_peered":"2024-09-13T23:25:06.411831+0000","last_clean":"2024-09-13T23:25:06.411831+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:06.411831+0000","last_undegraded":"2024-09-13T23:25:06.411831+0000","last_fullsized":"2024-09-13T23:25:06.411831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.413218+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:06.413218+0000","last_peered":"2024-09-13T23:25:06.413218+0000","last_clean":"2024-09-13T23:25:06.413218+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:06.413218+0000","last_undegraded":"2024-09-13T23:25:06.413218+0000","last_fullsized":"2024-09-13T23:25:06.413218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411042+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:06.411042+0000","last_peered":"2024-09-13T23:25:06.411042+0000","last_clean":"2024-09-13T23:25:06.411042+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:06.411042+0000","last_undegraded":"2024-09-13T23:25:06.411042+0000","last_fullsized":"2024-09-13T23:25:06.411042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.413281+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:06.413281+0000","last_peered":"2024-09-13T23:25:06.413281+0000","last_clean":"2024-09-13T23:25:06.413281+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:06.413281+0000","last_undegraded":"2024-09-13T23:25:06.413281+0000","last_fullsized":"2024-09-13T23:25:06.413281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.412468+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:06.412468+0000","last_peered":"2024-09-13T23:25:06.412468+0000","last_clean":"2024-09-13T23:25:06.412468+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:06.412468+0000","last_undegraded":"2024-09-13T23:25:06.412468+0000","last_fullsized":"2024-09-13T23:25:06.412468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.444234+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:06.444234+0000","last_peered":"2024-09-13T23:25:06.444234+0000","last_clean":"2024-09-13T23:25:06.444234+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:06.444234+0000","last_undegraded":"2024-09-13T23:25:06.444234+0000","last_fullsized":"2024-09-13T23:25:06.444234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.411034+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:06.411034+0000","last_peered":"2024-09-13T23:25:06.411034+0000","last_clean":"2024-09-13T23:25:06.411034+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:06.411034+0000","last_undegraded":"2024-09-13T23:25:06.411034+0000","last_fullsized":"2024-09-13T23:25:06.411034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.412073+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:06.412073+0000","last_peered":"2024-09-13T23:25:06.412073+0000","last_clean":"2024-09-13T23:25:06.412073+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:06.412073+0000","last_undegraded":"2024-09-13T23:25:06.412073+0000","last_fullsized":"2024-09-13T23:25:06.412073+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":169,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-13T23:25:06.408862+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:25:06.408862+0000","last_peered":"2024-09-13T23:25:06.408862+0000","last_clean":"2024-09-13T23:25:06.408862+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:25:06.408862+0000","last_undegraded":"2024-09-13T23:25:06.408862+0000","last_fullsized":"2024-09-13T23:25:06.408862+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:42.131218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35508,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336332,"statfs":{"total":96636764160,"available":96600403968,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:25:11.293 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T23:25:11.293 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T23:25:11.293 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T23:25:11.293 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12d53e8640 1 Processor -- start 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12d53e8640 1 -- start start 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12d53e8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12d012cca0 0x7f12d012d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12d53e8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d012d5c0 con 0x7f12d01290e0 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12d53e8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f12d006e350 con 0x7f12d012cca0 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12ceffd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f12d012cca0 0x7f12d012d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12ce7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f12d01290e0 0x7f12d0129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:37440/0 (socket says 172.21.15.43:37440) 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.392+0000 7f12ce7fc640 1 -- 172.21.15.43:0/498827263 learned_addr learned my addr 172.21.15.43:0/498827263 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:25:11.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.393+0000 7f12ceffd640 1 -- 172.21.15.43:0/498827263 >> v1:172.21.15.43:6789/0 conn(0x7f12d01290e0 legacy=0x7f12d0129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.393+0000 7f12ceffd640 1 -- 172.21.15.43:0/498827263 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d0071f70 con 0x7f12d012cca0 2024-09-13T23:25:11.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.393+0000 7f12cdffb640 1 -- 172.21.15.43:0/498827263 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397143979 0 0) 0x7f12d012d5c0 con 0x7f12d01290e0 2024-09-13T23:25:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12ceffd640 1 --2- 172.21.15.43:0/498827263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d012cca0 0x7f12d012d080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009720 tx=0x7f12c002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e475d1c6574d7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12cdffb640 1 -- 172.21.15.43:0/498827263 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c0037070 con 0x7f12d012cca0 2024-09-13T23:25:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12cdffb640 1 -- 172.21.15.43:0/498827263 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c002ad90 con 0x7f12d012cca0 2024-09-13T23:25:11.397 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12cdffb640 1 -- 172.21.15.43:0/498827263 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c0032590 con 0x7f12d012cca0 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 -- 172.21.15.43:0/498827263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d012cca0 msgr2=0x7f12d012d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 --2- 172.21.15.43:0/498827263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d012cca0 0x7f12d012d080 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f12c0009720 tx=0x7f12c002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 -- 172.21.15.43:0/498827263 shutdown_connections 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 --2- 172.21.15.43:0/498827263 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d012cca0 0x7f12d012d080 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 -- 172.21.15.43:0/498827263 >> 172.21.15.43:0/498827263 conn(0x7f12d009a890 msgr2=0x7f12d009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 -- 172.21.15.43:0/498827263 shutdown_connections 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.394+0000 7f12d53e8640 1 -- 172.21.15.43:0/498827263 wait complete. 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.395+0000 7f12d53e8640 1 Processor -- start 2024-09-13T23:25:11.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.395+0000 7f12d53e8640 1 -- start start 2024-09-13T23:25:11.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12d53e8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.400 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12d53e8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0070e60 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12ceffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:48778/0 (socket says 172.21.15.43:48778) 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12ceffd640 1 -- 172.21.15.43:0/2275212623 learned_addr learned my addr 172.21.15.43:0/2275212623 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12ceffd640 1 -- 172.21.15.43:0/2275212623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d0070980 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12ceffd640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12c0035040 tx=0x7f12c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c0037040 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12c0004030 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d008f650 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12c0004310 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.396+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01263a0 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.397+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f12c003a040 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.397+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d0090160 con 0x7f12d01290e0 2024-09-13T23:25:11.401 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.398+0000 7f12b77fe640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 0x7f12bc03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.398+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f12c006bd20 con 0x7f12d01290e0 2024-09-13T23:25:11.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.398+0000 7f12ce7fc640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 0x7f12bc03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.402 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.398+0000 7f12ce7fc640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 0x7f12bc03a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12c4000c00 tx=0x7f12c4007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.404 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.402+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12c0042020 con 0x7f12d01290e0 2024-09-13T23:25:11.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.618+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f12d006e510 con 0x7f12d01290e0 2024-09-13T23:25:11.621 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.619+0000 7f12b77fe640 1 -- 172.21.15.43:0/2275212623 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f12c003ee20 con 0x7f12d01290e0 2024-09-13T23:25:11.621 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:25:11.621 INFO:teuthology.orchestra.run.smithi043.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T23:25:11.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 msgr2=0x7f12bc03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 0x7f12bc03a760 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f12c4000c00 tx=0x7f12c4007a40 comp rx=0 tx=0).stop 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 msgr2=0x7f12d006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12c0035040 tx=0x7f12c00046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 shutdown_connections 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f12bc0382a0 0x7f12bc03a760 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 --2- 172.21.15.43:0/2275212623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f12d01290e0 0x7f12d006ea20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 >> 172.21.15.43:0/2275212623 conn(0x7f12d009a890 msgr2=0x7f12d0128910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 shutdown_connections 2024-09-13T23:25:11.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:25:11.621+0000 7f12d53e8640 1 -- 172.21.15.43:0/2275212623 wait complete. 2024-09-13T23:25:11.634 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T23:25:11.634 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T23:25:11.652 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T23:25:11.652 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T23:25:11.652 INFO:tasks.rgw:Creating data pools 2024-09-13T23:25:11.652 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T23:25:11.652 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-13T23:25:11.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.761+0000 7f99df911640 1 Processor -- start 2024-09-13T23:25:11.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.761+0000 7f99df911640 1 -- start start 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.761+0000 7f99df911640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f99d8115b80 0x7f99d8115f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.761+0000 7f99df911640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99d81146e0 con 0x7f99d8113a30 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.761+0000 7f99df911640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f99d8122ce0 con 0x7f99d8115b80 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.762+0000 7f99dd6ad640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f99d8115b80 0x7f99d8115f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.762+0000 7f99dceac640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f99d8113a30 0x7f99d8113ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:60974/0 (socket says 172.21.15.99:60974) 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.762+0000 7f99dceac640 1 -- 172.21.15.99:0/1003649826 learned_addr learned my addr 172.21.15.99:0/1003649826 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.762+0000 7f99dd6ad640 1 -- 172.21.15.99:0/1003649826 >> v1:172.21.15.43:6789/0 conn(0x7f99d8113a30 legacy=0x7f99d8113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.762+0000 7f99dd6ad640 1 -- 172.21.15.99:0/1003649826 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8122e60 con 0x7f99d8115b80 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.763+0000 7f99dd6ad640 1 --2- 172.21.15.99:0/1003649826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8115b80 0x7f99d8115f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009720 tx=0x7f99d002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399411b669de409d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.763+0000 7f99d7fff640 1 -- 172.21.15.99:0/1003649826 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d0037070 con 0x7f99d8115b80 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.763+0000 7f99d7fff640 1 -- 172.21.15.99:0/1003649826 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d002ad90 con 0x7f99d8115b80 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.763+0000 7f99d7fff640 1 -- 172.21.15.99:0/1003649826 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d0032590 con 0x7f99d8115b80 2024-09-13T23:25:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 -- 172.21.15.99:0/1003649826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8115b80 msgr2=0x7f99d8115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 --2- 172.21.15.99:0/1003649826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8115b80 0x7f99d8115f60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009720 tx=0x7f99d002a110 comp rx=0 tx=0).stop 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 -- 172.21.15.99:0/1003649826 shutdown_connections 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 --2- 172.21.15.99:0/1003649826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8115b80 0x7f99d8115f60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 -- 172.21.15.99:0/1003649826 >> 172.21.15.99:0/1003649826 conn(0x7f99d806f300 msgr2=0x7f99d8071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 -- 172.21.15.99:0/1003649826 shutdown_connections 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.764+0000 7f99df911640 1 -- 172.21.15.99:0/1003649826 wait complete. 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.769+0000 7f99df911640 1 Processor -- start 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.769+0000 7f99df911640 1 -- start start 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.769+0000 7f99df911640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.769+0000 7f99df911640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8112c30 con 0x7f99d8113a30 2024-09-13T23:25:11.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99dd6ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99dd6ad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:38620/0 (socket says 172.21.15.99:38620) 2024-09-13T23:25:11.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99dd6ad640 1 -- 172.21.15.99:0/1314447055 learned_addr learned my addr 172.21.15.99:0/1314447055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99dd6ad640 1 -- 172.21.15.99:0/1314447055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d8122930 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99dd6ad640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99d002a150 tx=0x7f99d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d0041070 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d0032e30 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d0037040 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.770+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d811d370 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.771+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d811d7e0 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.771+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f99d0044070 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.771+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d8113170 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.772+0000 7f99d5ffb640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 0x7f99c403a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.772+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f99d006bec0 con 0x7f99d8113a30 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.772+0000 7f99dceac640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 0x7f99c403a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:11.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.772+0000 7f99dceac640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 0x7f99c403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000f60 tx=0x7f99cc007a60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:11.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.777+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99d003cdf0 con 0x7f99d8113a30 2024-09-13T23:25:11.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:11.941+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f99d8116d00 con 0x7f99d8113a30 2024-09-13T23:25:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.262+0000 7f99d5ffb640 1 -- 172.21.15.99:0/1314447055 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v19) ==== 167+0+0 (secure 0 0 0) 0x7f99d006ad50 con 0x7f99d8113a30 2024-09-13T23:25:12.263 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T23:25:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.264+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 msgr2=0x7f99c403a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.264+0000 7f99df911640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 0x7f99c403a710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000f60 tx=0x7f99cc007a60 comp rx=0 tx=0).stop 2024-09-13T23:25:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.264+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 msgr2=0x7f99d8122360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.264+0000 7f99df911640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f99d002a150 tx=0x7f99d00046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:12.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 shutdown_connections 2024-09-13T23:25:12.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99c4038250 0x7f99c403a710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:12.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 --2- 172.21.15.99:0/1314447055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f99d8113a30 0x7f99d8122360 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:12.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 >> 172.21.15.99:0/1314447055 conn(0x7f99d806f300 msgr2=0x7f99d81103c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:12.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 shutdown_connections 2024-09-13T23:25:12.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.265+0000 7f99df911640 1 -- 172.21.15.99:0/1314447055 wait complete. 2024-09-13T23:25:12.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T23:25:12.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.379+0000 7f0494af8640 1 Processor -- start 2024-09-13T23:25:12.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.379+0000 7f0494af8640 1 -- start start 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.379+0000 7f0494af8640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f049010f870 0x7f049011b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.379+0000 7f0494af8640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049011b650 con 0x7f049010ed80 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.379+0000 7f0494af8640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f049011c830 con 0x7f049010f870 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f0487fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f049010f870 0x7f049011b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f048e59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f049010ed80 0x7f049010f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:60988/0 (socket says 172.21.15.99:60988) 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f048e59c640 1 -- 172.21.15.99:0/3560653204 learned_addr learned my addr 172.21.15.99:0/3560653204 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f048dd9b640 1 -- 172.21.15.99:0/3560653204 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075826064 0 0) 0x7f049011b650 con 0x7f049010ed80 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f048dd9b640 1 -- 172.21.15.99:0/3560653204 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f047c003520 con 0x7f049010ed80 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f0487fff640 1 -- 172.21.15.99:0/3560653204 >> v1:172.21.15.43:6789/0 conn(0x7f049010ed80 legacy=0x7f049010f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:12.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.380+0000 7f0487fff640 1 -- 172.21.15.99:0/3560653204 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049011c9b0 con 0x7f049010f870 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0487fff640 1 --2- 172.21.15.99:0/3560653204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010f870 0x7f049011b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0478009720 tx=0x7f047802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1220e31191b3ebce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f048dd9b640 1 -- 172.21.15.99:0/3560653204 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0478037070 con 0x7f049010f870 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f048dd9b640 1 -- 172.21.15.99:0/3560653204 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047802ad90 con 0x7f049010f870 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f048dd9b640 1 -- 172.21.15.99:0/3560653204 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0478032570 con 0x7f049010f870 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 -- 172.21.15.99:0/3560653204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010f870 msgr2=0x7f049011b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 --2- 172.21.15.99:0/3560653204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010f870 0x7f049011b110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0478009720 tx=0x7f047802a110 comp rx=0 tx=0).stop 2024-09-13T23:25:12.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 -- 172.21.15.99:0/3560653204 shutdown_connections 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 --2- 172.21.15.99:0/3560653204 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010f870 0x7f049011b110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 -- 172.21.15.99:0/3560653204 >> 172.21.15.99:0/3560653204 conn(0x7f049006f300 msgr2=0x7f0490071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 -- 172.21.15.99:0/3560653204 shutdown_connections 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.381+0000 7f0494af8640 1 -- 172.21.15.99:0/3560653204 wait complete. 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.382+0000 7f0494af8640 1 Processor -- start 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.382+0000 7f0494af8640 1 -- start start 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.382+0000 7f0494af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.382+0000 7f0494af8640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f049011bc70 con 0x7f049010ed80 2024-09-13T23:25:12.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f048e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f048e59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:38640/0 (socket says 172.21.15.99:38640) 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f048e59c640 1 -- 172.21.15.99:0/261002653 learned_addr learned my addr 172.21.15.99:0/261002653 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f048e59c640 1 -- 172.21.15.99:0/261002653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04901aa8b0 con 0x7f049010ed80 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f048e59c640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f048000c380 tx=0x7f048000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0480017070 con 0x7f049010ed80 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0480005c10 con 0x7f049010ed80 2024-09-13T23:25:12.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04901aab40 con 0x7f049010ed80 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04800070d0 con 0x7f049010ed80 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.383+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04901a45d0 con 0x7f049010ed80 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.384+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049011c1b0 con 0x7f049010ed80 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.384+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f048001a070 con 0x7f049010ed80 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.385+0000 7f0486ffd640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 0x7f047003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:12.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.385+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3873+0+0 (secure 0 0 0) 0x7f048004a800 con 0x7f049010ed80 2024-09-13T23:25:12.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.385+0000 7f0487fff640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 0x7f047003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:12.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.385+0000 7f0487fff640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 0x7f047003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0478034000 tx=0x7f047802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:12.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.390+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0480010950 con 0x7f049010ed80 2024-09-13T23:25:12.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:12.555+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f04901aade0 con 0x7f049010ed80 2024-09-13T23:25:13.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.263+0000 7f0486ffd640 1 -- 172.21.15.99:0/261002653 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v20) ==== 185+0+0 (secure 0 0 0) 0x7f0480010bb0 con 0x7f049010ed80 2024-09-13T23:25:13.264 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T23:25:13.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.269+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 msgr2=0x7f047003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:13.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.269+0000 7f0494af8640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 0x7f047003a760 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0478034000 tx=0x7f047802e000 comp rx=0 tx=0).stop 2024-09-13T23:25:13.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.269+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 msgr2=0x7f04901aa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:13.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.269+0000 7f0494af8640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f048000c380 tx=0x7f048000c840 comp rx=0 tx=0).stop 2024-09-13T23:25:13.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.271+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 shutdown_connections 2024-09-13T23:25:13.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.271+0000 7f0494af8640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f04700382a0 0x7f047003a760 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0478034000 tx=0x7f047802e000 comp rx=0 tx=0).stop 2024-09-13T23:25:13.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.271+0000 7f0494af8640 1 --2- 172.21.15.99:0/261002653 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f049010ed80 0x7f04901aa2e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:13.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.271+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 >> 172.21.15.99:0/261002653 conn(0x7f049006f300 msgr2=0x7f0490112940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:13.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.273+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 shutdown_connections 2024-09-13T23:25:13.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.275+0000 7f0494af8640 1 -- 172.21.15.99:0/261002653 wait complete. 2024-09-13T23:25:13.298 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f429ae1e640 1 Processor -- start 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f429ae1e640 1 -- start start 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f429ae1e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f429410ed80 0x7f429410f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f429ae1e640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429410fb50 con 0x7f429410f6a0 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f429ae1e640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f429411c830 con 0x7f429410ed80 2024-09-13T23:25:13.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f4298bba640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f429410ed80 0x7f429410f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:13.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f4293fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f429410f6a0 0x7f429411a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:32772/0 (socket says 172.21.15.99:32772) 2024-09-13T23:25:13.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.399+0000 7f4293fff640 1 -- 172.21.15.99:0/2308317464 learned_addr learned my addr 172.21.15.99:0/2308317464 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:13.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.400+0000 7f4298bba640 1 -- 172.21.15.99:0/2308317464 >> v1:172.21.15.43:6789/0 conn(0x7f429410f6a0 legacy=0x7f429411a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:13.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.400+0000 7f4298bba640 1 -- 172.21.15.99:0/2308317464 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429411c9b0 con 0x7f429410ed80 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f4298bba640 1 --2- 172.21.15.99:0/2308317464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f429410f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4284009720 tx=0x7f428402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a78081f12f1658 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f42937fe640 1 -- 172.21.15.99:0/2308317464 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4284037070 con 0x7f429410ed80 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f42937fe640 1 -- 172.21.15.99:0/2308317464 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428402ad90 con 0x7f429410ed80 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f42937fe640 1 -- 172.21.15.99:0/2308317464 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4284032590 con 0x7f429410ed80 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 -- 172.21.15.99:0/2308317464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 msgr2=0x7f429410f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 --2- 172.21.15.99:0/2308317464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f429410f160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4284009720 tx=0x7f428402a110 comp rx=0 tx=0).stop 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 -- 172.21.15.99:0/2308317464 shutdown_connections 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 --2- 172.21.15.99:0/2308317464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f429410f160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 -- 172.21.15.99:0/2308317464 >> 172.21.15.99:0/2308317464 conn(0x7f429406f300 msgr2=0x7f4294071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:13.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 -- 172.21.15.99:0/2308317464 shutdown_connections 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.401+0000 7f429ae1e640 1 -- 172.21.15.99:0/2308317464 wait complete. 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f429ae1e640 1 Processor -- start 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f429ae1e640 1 -- start start 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f429ae1e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f429ae1e640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f429411bc70 con 0x7f429410ed80 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f4298bba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f4298bba640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:38650/0 (socket says 172.21.15.99:38650) 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.402+0000 7f4298bba640 1 -- 172.21.15.99:0/216867219 learned_addr learned my addr 172.21.15.99:0/216867219 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:13.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f4298bba640 1 -- 172.21.15.99:0/216867219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42941a4f60 con 0x7f429410ed80 2024-09-13T23:25:13.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f4298bba640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4284009720 tx=0x7f42840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4284041070 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428403c590 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4284037040 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42941a5250 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.403+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42941a92a0 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.404+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4284044070 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.404+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429410f160 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.404+0000 7f42917fa640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 0x7f428003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.404+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3856+0+0 (secure 0 0 0) 0x7f428406be70 con 0x7f429410ed80 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.404+0000 7f4293fff640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 0x7f428003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:13.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.405+0000 7f4293fff640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 0x7f428003a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4288000f60 tx=0x7f4288007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:13.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.409+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f428403a760 con 0x7f429410ed80 2024-09-13T23:25:13.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:13.575+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f429410f6a0 con 0x7f429410ed80 2024-09-13T23:25:14.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.266+0000 7f42917fa640 1 -- 172.21.15.99:0/216867219 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v21) ==== 169+0+0 (secure 0 0 0) 0x7f428403d3f0 con 0x7f429410ed80 2024-09-13T23:25:14.267 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 msgr2=0x7f428003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 0x7f428003a710 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4288000f60 tx=0x7f4288007a80 comp rx=0 tx=0).stop 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 msgr2=0x7f42941a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4284009720 tx=0x7f42840046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 shutdown_connections 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4280038250 0x7f428003a710 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 --2- 172.21.15.99:0/216867219 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f429410ed80 0x7f42941a4990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 >> 172.21.15.99:0/216867219 conn(0x7f429406f300 msgr2=0x7f42941186b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 shutdown_connections 2024-09-13T23:25:14.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.269+0000 7f429ae1e640 1 -- 172.21.15.99:0/216867219 wait complete. 2024-09-13T23:25:14.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T23:25:14.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff6415f6640 1 Processor -- start 2024-09-13T23:25:14.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff6415f6640 1 -- start start 2024-09-13T23:25:14.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff6415f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff63c073330 0x7ff63c073710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff6415f6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff63c074100 con 0x7ff63c073c50 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff6415f6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7ff63c11c830 con 0x7ff63c073330 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff63affd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff63c073330 0x7ff63c073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff63affd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7ff63c073330 0x7ff63c073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:43014/0 (socket says 172.21.15.99:43014) 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.390+0000 7ff63affd640 1 -- 172.21.15.99:0/3581076114 learned_addr learned my addr 172.21.15.99:0/3581076114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.391+0000 7ff63affd640 1 -- 172.21.15.99:0/3581076114 >> v1:172.21.15.43:6789/0 conn(0x7ff63c073c50 legacy=0x7ff63c11a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:14.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.391+0000 7ff63affd640 1 -- 172.21.15.99:0/3581076114 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c11c9b0 con 0x7ff63c073330 2024-09-13T23:25:14.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.391+0000 7ff63affd640 1 --2- 172.21.15.99:0/3581076114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c073710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097f0 tx=0x7ff63402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7006dab863e95dfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff639ffb640 1 -- 172.21.15.99:0/3581076114 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff634037070 con 0x7ff63c073330 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff639ffb640 1 -- 172.21.15.99:0/3581076114 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff634032440 con 0x7ff63c073330 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff639ffb640 1 -- 172.21.15.99:0/3581076114 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff63402ae60 con 0x7ff63c073330 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 -- 172.21.15.99:0/3581076114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 msgr2=0x7ff63c073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 --2- 172.21.15.99:0/3581076114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c073710 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff6340097f0 tx=0x7ff63402a1e0 comp rx=0 tx=0).stop 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 -- 172.21.15.99:0/3581076114 shutdown_connections 2024-09-13T23:25:14.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 --2- 172.21.15.99:0/3581076114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c073710 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 -- 172.21.15.99:0/3581076114 >> 172.21.15.99:0/3581076114 conn(0x7ff63c06f370 msgr2=0x7ff63c071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 -- 172.21.15.99:0/3581076114 shutdown_connections 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.392+0000 7ff6415f6640 1 -- 172.21.15.99:0/3581076114 wait complete. 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.393+0000 7ff6415f6640 1 Processor -- start 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.393+0000 7ff6415f6640 1 -- start start 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.393+0000 7ff6415f6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.393+0000 7ff6415f6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7ff63c11bce0 con 0x7ff63c073330 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.393+0000 7ff63affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff63affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:43026/0 (socket says 172.21.15.99:43026) 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff63affd640 1 -- 172.21.15.99:0/187727484 learned_addr learned my addr 172.21.15.99:0/187727484 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff63affd640 1 -- 172.21.15.99:0/187727484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff63c1a4f80 con 0x7ff63c073330 2024-09-13T23:25:14.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff63affd640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff63402a220 tx=0x7ff6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:14.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff634041070 con 0x7ff63c073330 2024-09-13T23:25:14.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63403c7a0 con 0x7ff63c073330 2024-09-13T23:25:14.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63c1a5270 con 0x7ff63c073330 2024-09-13T23:25:14.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff634037040 con 0x7ff63c073330 2024-09-13T23:25:14.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.394+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63c1a9320 con 0x7ff63c073330 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.395+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff63c073710 con 0x7ff63c073330 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.395+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff634044070 con 0x7ff63c073330 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.395+0000 7ff6237fe640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 0x7ff62803a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.396+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4220+0+0 (secure 0 0 0) 0x7ff63406c0f0 con 0x7ff63c073330 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.396+0000 7ff63a7fc640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 0x7ff62803a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:14.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.396+0000 7ff63a7fc640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 0x7ff62803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff630001560 tx=0x7ff630007a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:14.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.401+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff634030580 con 0x7ff63c073330 2024-09-13T23:25:14.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:14.567+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7ff63c1a54a0 con 0x7ff63c073330 2024-09-13T23:25:15.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.267+0000 7ff6237fe640 1 -- 172.21.15.99:0/187727484 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v22) ==== 187+0+0 (secure 0 0 0) 0x7ff6340307e0 con 0x7ff63c073330 2024-09-13T23:25:15.269 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T23:25:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.271+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 msgr2=0x7ff62803a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.271+0000 7ff6415f6640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 0x7ff62803a710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff630001560 tx=0x7ff630007a50 comp rx=0 tx=0).stop 2024-09-13T23:25:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.271+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 msgr2=0x7ff63c1a4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.271+0000 7ff6415f6640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff63402a220 tx=0x7ff6340046c0 comp rx=0 tx=0).stop 2024-09-13T23:25:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.272+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 shutdown_connections 2024-09-13T23:25:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.272+0000 7ff6415f6640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff628038250 0x7ff62803a710 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff630001560 tx=0x7ff630007a50 comp rx=0 tx=0).stop 2024-09-13T23:25:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.272+0000 7ff6415f6640 1 --2- 172.21.15.99:0/187727484 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7ff63c073330 0x7ff63c1a4a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.272+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 >> 172.21.15.99:0/187727484 conn(0x7ff63c06f370 msgr2=0x7ff63c11a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:15.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.275+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 shutdown_connections 2024-09-13T23:25:15.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:15.276+0000 7ff6415f6640 1 -- 172.21.15.99:0/187727484 wait complete. 2024-09-13T23:25:15.302 DEBUG:tasks.rgw:Pools created 2024-09-13T23:25:15.302 INFO:tasks.rgw:Starting rgw... 2024-09-13T23:25:15.302 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T23:25:15.302 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T23:25:15.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo echo -n http://smithi099.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T23:25:15.330 INFO:teuthology.orchestra.run.smithi099.stdout:http://smithi099.front.sepia.ceph.com:80 2024-09-13T23:25:15.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T23:25:15.397 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T23:25:15.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T23:25:15.440 INFO:tasks.rgw.client.0:Started 2024-09-13T23:25:15.440 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:15.440 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:15.465 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:25:15.466 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:25:15.466 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:25:15.466 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:25:15.466 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:25:16.467 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:16.489 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:25:16.489 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:25:16.490 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:25:16.491 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:25:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:25:18.491 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:18.516 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:25:18.516 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:25:18.516 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:25:18.516 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:25:18.516 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:25:22.518 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:22.541 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:25:22.541 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:25:22.542 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T23:25:22.542 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T23:25:22.543 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80: Connection refused 2024-09-13T23:25:24.382 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-13T23:25:24.381+0000 7f8c6ebd9880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T23:25:30.544 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-13T23:25:30.567 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T23:25:30.567 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-13T23:25:30.570 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-13T23:25:30.570 INFO:teuthology.orchestra.run.smithi099.stdout:anonymous 2024-09-13T23:25:30.571 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T23:25:30.670 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T23:25:30.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:25:30.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:25:30.671 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:25:30.723 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:30.723 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:30.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.722+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.722+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827f930800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563a5c7324b0 0x563a5c7328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827f930800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563a5c5f2b30 con 0x563a5c732df0 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827f930800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x563a5c5d4360 con 0x563a5c7324b0 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827b663640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563a5c7324b0 0x563a5c7328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827b663640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563a5c7324b0 0x563a5c7328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48480/0 (socket says 172.21.15.99:48480) 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827b663640 1 -- 172.21.15.99:0/1158599346 learned_addr learned my addr 172.21.15.99:0/1158599346 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f8273fff640 1 --1- 172.21.15.99:0/1158599346 >> v1:172.21.15.43:6789/0 conn(0x563a5c732df0 0x563a5c737970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43758/0 (socket says 172.21.15.99:43758) 2024-09-13T23:25:30.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827b663640 1 -- 172.21.15.99:0/1158599346 >> v1:172.21.15.43:6789/0 conn(0x563a5c732df0 legacy=0x563a5c737970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827ae62640 1 -- 172.21.15.99:0/1158599346 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777073184 0 0) 0x563a5c5f2b30 con 0x563a5c732df0 2024-09-13T23:25:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.723+0000 7f827b663640 1 -- 172.21.15.99:0/1158599346 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c5fae00 con 0x563a5c7324b0 2024-09-13T23:25:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.725+0000 7f827b663640 1 --2- 172.21.15.99:0/1158599346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c7328b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f826c00a520 tx=0x7f826c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf79c6eaca01263d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827ae62640 1 -- 172.21.15.99:0/1158599346 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c055070 con 0x563a5c7324b0 2024-09-13T23:25:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827ae62640 1 -- 172.21.15.99:0/1158599346 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0515b0 con 0x563a5c7324b0 2024-09-13T23:25:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827ae62640 1 -- 172.21.15.99:0/1158599346 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c0518d0 con 0x563a5c7324b0 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 -- 172.21.15.99:0/1158599346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 msgr2=0x563a5c7328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 --2- 172.21.15.99:0/1158599346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c7328b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f826c00a520 tx=0x7f826c045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 -- 172.21.15.99:0/1158599346 shutdown_connections 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 --2- 172.21.15.99:0/1158599346 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c7328b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 -- 172.21.15.99:0/1158599346 >> 172.21.15.99:0/1158599346 conn(0x563a5c72dde0 msgr2=0x563a5c730200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 -- 172.21.15.99:0/1158599346 shutdown_connections 2024-09-13T23:25:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.726+0000 7f827f930800 1 -- 172.21.15.99:0/1158599346 wait complete. 2024-09-13T23:25:30.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.742+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.742+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.742+0000 7f827f930800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.742+0000 7f827f930800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563a5c67f320 con 0x563a5c7324b0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f827b663640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f827b663640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48492/0 (socket says 172.21.15.99:48492) 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f827b663640 1 -- 172.21.15.99:0/2853655476 learned_addr learned my addr 172.21.15.99:0/2853655476 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f827b663640 1 -- 172.21.15.99:0/2853655476 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c5ccbc0 con 0x563a5c7324b0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f827b663640 1 --2- 172.21.15.99:0/2853655476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f826c025da0 tx=0x7f826c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1998b52c8b136e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.743+0000 7f816960a640 1 -- 172.21.15.99:0/2853655476 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c051ac0 con 0x563a5c7324b0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f816960a640 1 -- 172.21.15.99:0/2853655476 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c051c60 con 0x563a5c7324b0 2024-09-13T23:25:30.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f816960a640 1 -- 172.21.15.99:0/2853655476 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c066460 con 0x563a5c7324b0 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 -- 172.21.15.99:0/2853655476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 msgr2=0x563a5c820410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 --2- 172.21.15.99:0/2853655476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f826c025da0 tx=0x7f826c051000 comp rx=0 tx=0).stop 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 -- 172.21.15.99:0/2853655476 shutdown_connections 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 --2- 172.21.15.99:0/2853655476 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c820410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 -- 172.21.15.99:0/2853655476 >> 172.21.15.99:0/2853655476 conn(0x563a5c72dde0 msgr2=0x563a5c81bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 -- 172.21.15.99:0/2853655476 shutdown_connections 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.744+0000 7f827f930800 1 -- 172.21.15.99:0/2853655476 wait complete. 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827f930800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827f930800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563a5c7394d0 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827b663640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827b663640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48496/0 (socket says 172.21.15.99:48496) 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827b663640 1 -- 172.21.15.99:0/1881898030 learned_addr learned my addr 172.21.15.99:0/1881898030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.745+0000 7f827b663640 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c5e0fe0 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f827b663640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f826c0460a0 tx=0x7f826c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f8167e07640 1 -- 172.21.15.99:0/1881898030 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c066650 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f8167e07640 1 -- 172.21.15.99:0/1881898030 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826c0667f0 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5c828280 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f8167e07640 1 -- 172.21.15.99:0/1881898030 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f826c066af0 con 0x563a5c7324b0 2024-09-13T23:25:30.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.746+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5c8287a0 con 0x563a5c7324b0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f8167e07640 1 -- 172.21.15.99:0/1881898030 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f826c079060 con 0x563a5c7324b0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f8167e07640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 0x7f8160039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f8167e07640 1 -- 172.21.15.99:0/1881898030 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f826c062070 con 0x563a5c7324b0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f8273fff640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 0x7f8160039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 0x563a5c82edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c82f2f0 con 0x563a5c732df0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.747+0000 7f827be64640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 0x563a5c82edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f8273fff640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 0x7f8160039000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8264000c00 tx=0x7f82640013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827be64640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 0x563a5c82edb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827be64640 1 -- 172.21.15.99:0/1881898030 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f827400a4a0 con 0x563a5c732df0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c82c360 con 0x563a5c732df0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827be64640 1 -- 172.21.15.99:0/1881898030 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f827400a4a0 con 0x563a5c732df0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 0x563a5c833a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.748+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8340b0 con 0x563a5c831620 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827b663640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 0x563a5c833a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827b663640 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 0x563a5c833a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827b663640 1 -- 172.21.15.99:0/1881898030 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f826c057030 con 0x563a5c831620 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8304c0 con 0x563a5c732df0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827be64640 1 -- 172.21.15.99:0/1881898030 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f827400a4a0 con 0x563a5c732df0 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.749+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8309a0 con 0x563a5c831620 2024-09-13T23:25:30.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.750+0000 7f827b663640 1 -- 172.21.15.99:0/1881898030 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f826c057030 con 0x563a5c831620 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.750+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.750+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.750+0000 7f827f930800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.750+0000 7f827f930800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563a5c5ce580 con 0x563a5c846dc0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48504/0 (socket says 172.21.15.99:48504) 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f827be64640 1 -- 172.21.15.99:0/162698152 learned_addr learned my addr 172.21.15.99:0/162698152 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f827be64640 1 -- 172.21.15.99:0/162698152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c847720 con 0x563a5c846dc0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f827be64640 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x563a5c828df0 tx=0x7f82740167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.751+0000 7f8165602640 1 -- 172.21.15.99:0/162698152 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274013640 con 0x563a5c846dc0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.752+0000 7f8165602640 1 -- 172.21.15.99:0/162698152 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82740137e0 con 0x563a5c846dc0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.752+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5c8479b0 con 0x563a5c846dc0 2024-09-13T23:25:30.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.752+0000 7f8165602640 1 -- 172.21.15.99:0/162698152 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274013ae0 con 0x563a5c846dc0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.752+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5c84a690 con 0x563a5c846dc0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.752+0000 7f8165602640 1 -- 172.21.15.99:0/162698152 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8274011040 con 0x563a5c846dc0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f8165602640 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 0x7f8154039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f8165602640 1 -- 172.21.15.99:0/162698152 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f827400e040 con 0x563a5c846dc0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827b663640 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 0x7f8154039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827b663640 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 0x7f8154039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f826c08e800 tx=0x7f826c08e6d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827f930800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827f930800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563a5c820b00 con 0x563a5c853ae0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.753+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48512/0 (socket says 172.21.15.99:48512) 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f827be64640 1 -- 172.21.15.99:0/1732785590 learned_addr learned my addr 172.21.15.99:0/1732785590 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f827be64640 1 -- 172.21.15.99:0/1732785590 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c8544b0 con 0x563a5c853ae0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f827be64640 1 --2- 172.21.15.99:0/1732785590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f827404ce10 tx=0x7f8274020450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59173a61239826ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f815effd640 1 -- 172.21.15.99:0/1732785590 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274012c00 con 0x563a5c853ae0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f815effd640 1 -- 172.21.15.99:0/1732785590 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8274021960 con 0x563a5c853ae0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.754+0000 7f815effd640 1 -- 172.21.15.99:0/1732785590 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274021440 con 0x563a5c853ae0 2024-09-13T23:25:30.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- 172.21.15.99:0/1732785590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 msgr2=0x563a5c853ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 --2- 172.21.15.99:0/1732785590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f827404ce10 tx=0x7f8274020450 comp rx=0 tx=0).stop 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- 172.21.15.99:0/1732785590 shutdown_connections 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 --2- 172.21.15.99:0/1732785590 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c853ee0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- 172.21.15.99:0/1732785590 >> 172.21.15.99:0/1732785590 conn(0x563a5c84fe40 msgr2=0x563a5c84df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- 172.21.15.99:0/1732785590 shutdown_connections 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- 172.21.15.99:0/1732785590 wait complete. 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 Processor -- start 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- start start 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.755+0000 7f827f930800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563a5c854b20 con 0x563a5c853ae0 2024-09-13T23:25:30.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827be64640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48518/0 (socket says 172.21.15.99:48518) 2024-09-13T23:25:30.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 learned_addr learned my addr 172.21.15.99:0/458732582 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a5c85b490 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827be64640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f827403d040 tx=0x7f827400af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f815d7fa640 1 -- 172.21.15.99:0/458732582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274039070 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f815d7fa640 1 -- 172.21.15.99:0/458732582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8274021440 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563a5c85b720 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f815d7fa640 1 -- 172.21.15.99:0/458732582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8274013e60 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.756+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a5c85e3d0 con 0x563a5c853ae0 2024-09-13T23:25:30.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.757+0000 7f815d7fa640 1 -- 172.21.15.99:0/458732582 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f827401f6c0 con 0x563a5c853ae0 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f815d7fa640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8144036af0 0x7f8144038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f815d7fa640 1 -- 172.21.15.99:0/458732582 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f8274031050 con 0x563a5c853ae0 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f827b663640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8144036af0 0x7f8144038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c866a20 0x563a5c868eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c869600 con 0x563a5c866a20 2024-09-13T23:25:30.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f8273fff640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c866a20 0x563a5c868eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f827b663640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8144036af0 0x7f8144038fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f826c090010 tx=0x7f826c086000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.758+0000 7f8273fff640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c866a20 0x563a5c868eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 realm 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c865f30 con 0x563a5c866a20 2024-09-13T23:25:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86a0d0 con 0x563a5c866a20 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86a620 con 0x563a5c866a20 2024-09-13T23:25:30.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:30.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c86b420 0x563a5c86d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.759+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86de20 con 0x563a5c86b420 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827be64640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c86b420 0x563a5c86d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827be64640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c86b420 0x563a5c86d810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827f930800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827f930800 20 searching for the correct realm 2024-09-13T23:25:30.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563a5c86fea0 0x563a5c872360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.760+0000 7f827b663640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563a5c86fea0 0x563a5c872360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827b663640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563a5c86fea0 0x563a5c872360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827be64640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8274041c20 0x7f827404b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.761+0000 7f8273fff640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8274041c20 0x7f827404b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.762+0000 7f8273fff640 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8274041c20 0x7f827404b290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.762+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.762+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.763+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.764+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.765+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.766+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.767+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.767+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.767+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.767+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.768+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.769+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86fea0 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x7f8274041c20 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c866a20 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.770+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c872a30 con 0x563a5c86b420 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86e8a0 con 0x563a5c866a20 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86ed20 con 0x563a5c866a20 2024-09-13T23:25:30.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.771+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c86f200 con 0x563a5c86b420 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 zone default found 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 4 Realm: () 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 zonegroup default 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c873360 con 0x7f8274041c20 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8750e0 con 0x563a5c86fea0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.772+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c875570 con 0x563a5c86fea0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.773+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.773+0000 7f827f930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.773+0000 7f827f930800 20 started sync module instance, tier type = 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.773+0000 7f827f930800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:30.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.773+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86b420 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.774+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.774+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94808660461936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c875e80 con 0x563a5c86b420 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.774+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8766d0 con 0x563a5c866a20 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.775+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94808660461936] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.775+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.775+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94808660466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8763a0 con 0x563a5c866a20 2024-09-13T23:25:30.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.775+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c876ea0 con 0x563a5c86fea0 2024-09-13T23:25:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.778+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94808660466128] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.778+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.778+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94808660470160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8772c0 con 0x563a5c86fea0 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.778+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c877ce0 con 0x563a5c86b420 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.779+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.779+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94808660470160] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.779+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94808660473808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c878100 con 0x563a5c86b420 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.779+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c878b50 con 0x563a5c866a20 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.783+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.783+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94808660477504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c878b10 con 0x563a5c866a20 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.783+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c879b10 con 0x7f8274041c20 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.783+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94808660473808] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.784+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94808660477504] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.784+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.784+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94808660481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c878cf0 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.784+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c87a3b0 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.785+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94808660481600] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.787+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.787+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94808660467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c878cf0 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.787+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c87a9d0 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94808660467184] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94808660483760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c87a9d0 con 0x7f8274041c20 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=0 2024-09-13T23:25:30.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=1 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=2 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=3 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=4 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=5 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.790+0000 7f827f930800 20 add_watcher() i=6 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94808660483760] v31'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f827f930800 20 add_watcher() i=7 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f827f930800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563a5c87dcf0 con 0x563a5c866a20 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.793+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94808660485776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c87af60 con 0x563a5c866a20 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.794+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94808660485776] v31'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.794+0000 7f8131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.794+0000 7f827f930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.794+0000 7f827f930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.794+0000 7f827f930800 5 note: GC not initialized 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f8130fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f827f930800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f827f930800 20 Filter name: none 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f80aa7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:30.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8b07f0 con 0x563a5c86fea0 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.795+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8b07f0 con 0x563a5c86fea0 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8b07f0 con 0x563a5c866a20 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c873360 con 0x563a5c866a20 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c873360 con 0x563a5c86b420 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.796+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86b420 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.797+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.798+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.799+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86b420 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(80 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.800+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86fea0 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86b420 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.801+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x7f8274041c20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x563a5c86fea0 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.802+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x563a5c86b420 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x7f8274041c20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x563a5c866a20 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x563a5c86fea0 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.803+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f8264043040 con 0x563a5c86b420 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.804+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.804+0000 7f8131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.804+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94808660485776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c873360 con 0x563a5c866a20 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.806+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94808660485776] v31'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.806+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94808660461936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c86b420 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.807+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94808660461936] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.807+0000 7f827f930800 20 remove_watcher() i=0 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.807+0000 7f827f930800 2 removed watcher, disabling cache 2024-09-13T23:25:30.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.807+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94808660466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c874580 con 0x563a5c866a20 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.809+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94808660466128] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.810+0000 7f827f930800 20 remove_watcher() i=1 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.810+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94808660470160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c8759d0 con 0x563a5c86fea0 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.811+0000 7f827b663640 1 -- 172.21.15.99:0/458732582 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94808660470160] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f826c057030 con 0x563a5c86fea0 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.811+0000 7f827f930800 20 remove_watcher() i=2 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.811+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94808660473808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c876990 con 0x563a5c86b420 2024-09-13T23:25:30.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.812+0000 7f827be64640 1 -- 172.21.15.99:0/458732582 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94808660473808] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f827403b030 con 0x563a5c86b420 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.812+0000 7f827f930800 20 remove_watcher() i=3 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.812+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94808660477504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c876990 con 0x563a5c866a20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.813+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94808660477504] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x563a5c866a20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.813+0000 7f827f930800 20 remove_watcher() i=4 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.813+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94808660481600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c876990 con 0x7f8274041c20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.814+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94808660481600] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.814+0000 7f827f930800 20 remove_watcher() i=5 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.814+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94808660467184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c879640 con 0x7f8274041c20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.817+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94808660467184] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.817+0000 7f827f930800 20 remove_watcher() i=6 2024-09-13T23:25:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.817+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94808660483760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563a5c876990 con 0x7f8274041c20 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94808660483760] v31'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8264018410 con 0x7f8274041c20 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 20 remove_watcher() i=7 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8274041c20 msgr2=0x7f827404b290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8274041c20 0x7f827404b290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c866a20 msgr2=0x563a5c868eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c866a20 0x563a5c868eb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c86b420 msgr2=0x563a5c86d810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c86b420 0x563a5c86d810 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563a5c86fea0 msgr2=0x563a5c872360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563a5c86fea0 0x563a5c872360 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8144036af0 msgr2=0x7f8144038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8144036af0 0x7f8144038fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f826c090010 tx=0x7f826c086000 comp rx=0 tx=0).stop 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 msgr2=0x563a5c85af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f827403d040 tx=0x7f827400af70 comp rx=0 tx=0).stop 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f8273fff640 1 -- 172.21.15.99:0/458732582 reap_dead start 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 shutdown_connections 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 --2- 172.21.15.99:0/458732582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c853ae0 0x563a5c85af50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 >> 172.21.15.99:0/458732582 conn(0x563a5c84fe40 msgr2=0x563a5c84df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 shutdown_connections 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.819+0000 7f827f930800 1 -- 172.21.15.99:0/458732582 wait complete. 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 msgr2=0x7f8154039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 0x7f8154039050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f826c08e800 tx=0x7f826c08e6d0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 msgr2=0x563a5c8471e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x563a5c828df0 tx=0x7f82740167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 shutdown_connections 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8154036b90 0x7f8154039050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/162698152 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c846dc0 0x563a5c8471e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 >> 172.21.15.99:0/162698152 conn(0x563a5c837940 msgr2=0x563a5c83a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 shutdown_connections 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/162698152 wait complete. 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 msgr2=0x563a5c82edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 0x563a5c82edb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 msgr2=0x563a5c833a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 0x563a5c833a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 msgr2=0x7f8160039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 0x7f8160039000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8264000c00 tx=0x7f82640013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 msgr2=0x563a5c827d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f826c0460a0 tx=0x7f826c003020 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 shutdown_connections 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563a5c831620 0x563a5c833a10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563a5c732df0 0x563a5c82edb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8160036b40 0x7f8160039000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 --2- 172.21.15.99:0/1881898030 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563a5c7324b0 0x563a5c827d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 >> 172.21.15.99:0/1881898030 conn(0x563a5c72dde0 msgr2=0x563a5c81a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 shutdown_connections 2024-09-13T23:25:30.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.820+0000 7f827f930800 1 -- 172.21.15.99:0/1881898030 wait complete. 2024-09-13T23:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-13T23:25:30.831 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:25:30.832 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T23:25:30.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T23:25:30.832 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T23:25:30.876 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:30.876 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:30.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.875+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.875+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d2db19800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a5265db900 0x55a5265ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d2db19800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a526497b30 con 0x55a5265d74c0 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d2db19800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a526479360 con 0x55a5265db900 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d22e13640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a5265db900 0x55a5265ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d2b614640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55a5265d74c0 0x55a5265d78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43766/0 (socket says 172.21.15.99:43766) 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d22e13640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a5265db900 0x55a5265ddcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48528/0 (socket says 172.21.15.99:48528) 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d2b614640 1 -- 172.21.15.99:0/218090423 learned_addr learned my addr 172.21.15.99:0/218090423 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d22e13640 1 -- 172.21.15.99:0/218090423 >> v1:172.21.15.43:6789/0 conn(0x55a5265d74c0 legacy=0x55a5265d78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.876+0000 7f7d22e13640 1 -- 172.21.15.99:0/218090423 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a52649fe00 con 0x55a5265db900 2024-09-13T23:25:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.878+0000 7f7d22e13640 1 --2- 172.21.15.99:0/218090423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5265ddcf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a470 tx=0x7f7d14045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b334c4734dcaa8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.878+0000 7f7d2ae13640 1 -- 172.21.15.99:0/218090423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d14053570 con 0x55a5265db900 2024-09-13T23:25:30.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.878+0000 7f7d2ae13640 1 -- 172.21.15.99:0/218090423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d14058070 con 0x55a5265db900 2024-09-13T23:25:30.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.878+0000 7f7d2ae13640 1 -- 172.21.15.99:0/218090423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d14053880 con 0x55a5265db900 2024-09-13T23:25:30.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 -- 172.21.15.99:0/218090423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 msgr2=0x55a5265ddcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 --2- 172.21.15.99:0/218090423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5265ddcf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d1400a470 tx=0x7f7d14045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:30.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 -- 172.21.15.99:0/218090423 shutdown_connections 2024-09-13T23:25:30.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 --2- 172.21.15.99:0/218090423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5265ddcf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 -- 172.21.15.99:0/218090423 >> 172.21.15.99:0/218090423 conn(0x55a5265d2df0 msgr2=0x55a5265d5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 -- 172.21.15.99:0/218090423 shutdown_connections 2024-09-13T23:25:30.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.879+0000 7f7d2db19800 1 -- 172.21.15.99:0/218090423 wait complete. 2024-09-13T23:25:30.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.892+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2db19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2db19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a526524330 con 0x55a5265d74c0 2024-09-13T23:25:30.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2b614640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2b614640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48530/0 (socket says 172.21.15.99:48530) 2024-09-13T23:25:30.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2b614640 1 -- 172.21.15.99:0/1743735284 learned_addr learned my addr 172.21.15.99:0/1743735284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2b614640 1 -- 172.21.15.99:0/1743735284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a526471bc0 con 0x55a5265d74c0 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.893+0000 7f7d2b614640 1 --2- 172.21.15.99:0/1743735284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c001e10 tx=0x7f7d1c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717de1d6391b38e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7c1960a640 1 -- 172.21.15.99:0/1743735284 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1c012020 con 0x55a5265d74c0 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7c1960a640 1 -- 172.21.15.99:0/1743735284 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c00e5a0 con 0x55a5265d74c0 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7c1960a640 1 -- 172.21.15.99:0/1743735284 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1c00e8e0 con 0x55a5265d74c0 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 -- 172.21.15.99:0/1743735284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 msgr2=0x55a52654bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1743735284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c001e10 tx=0x7f7d1c00b780 comp rx=0 tx=0).stop 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 -- 172.21.15.99:0/1743735284 shutdown_connections 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1743735284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265d74c0 0x55a52654bd80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 -- 172.21.15.99:0/1743735284 >> 172.21.15.99:0/1743735284 conn(0x55a5265d2df0 msgr2=0x55a5266c2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 -- 172.21.15.99:0/1743735284 shutdown_connections 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.894+0000 7f7d2db19800 1 -- 172.21.15.99:0/1743735284 wait complete. 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2db19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2db19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a5265de530 con 0x55a5265db900 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2b614640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2b614640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48544/0 (socket says 172.21.15.99:48544) 2024-09-13T23:25:30.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2b614640 1 -- 172.21.15.99:0/1670762087 learned_addr learned my addr 172.21.15.99:0/1670762087 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2b614640 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a526485fe0 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.895+0000 7f7d2b614640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00b7c0 tx=0x7f7d1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.896+0000 7f7c17e07640 1 -- 172.21.15.99:0/1670762087 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1c012030 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.896+0000 7f7c17e07640 1 -- 172.21.15.99:0/1670762087 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c001470 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.896+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5266cf970 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.896+0000 7f7c17e07640 1 -- 172.21.15.99:0/1670762087 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d1c01a700 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.896+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5266cfe90 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7c17e07640 1 -- 172.21.15.99:0/1670762087 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d1c015020 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7c17e07640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 0x7f7c10039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7c17e07640 1 -- 172.21.15.99:0/1670762087 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7d1c020030 con 0x55a5265db900 2024-09-13T23:25:30.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d22e13640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 0x7f7c10039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 0x55a5266d6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5266d6e00 con 0x55a5266d4490 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d2be15640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 0x55a5266d6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d22e13640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 0x7f7c10039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d14057000 tx=0x7f7d14052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.897+0000 7f7d2be15640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 0x55a5266d6880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2be15640 1 -- 172.21.15.99:0/1670762087 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a5266d4490 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5266d3a70 con 0x55a5266d4490 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2be15640 1 -- 172.21.15.99:0/1670762087 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a5266d4490 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 0x55a5266db500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5266dbba0 con 0x55a5266d9110 2024-09-13T23:25:30.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2b614640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 0x55a5266db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.898+0000 7f7d2b614640 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 0x55a5266db500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2b614640 1 -- 172.21.15.99:0/1670762087 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a5266d9110 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5266d7fb0 con 0x55a5266d4490 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2be15640 1 -- 172.21.15.99:0/1670762087 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a5266d4490 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5266d8490 con 0x55a5266d9110 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2b614640 1 -- 172.21.15.99:0/1670762087 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a5266d9110 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.899+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2db19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2db19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a526473580 con 0x55a5266ea550 2024-09-13T23:25:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48552/0 (socket says 172.21.15.99:48552) 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2be15640 1 -- 172.21.15.99:0/3323597086 learned_addr learned my addr 172.21.15.99:0/3323597086 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2be15640 1 -- 172.21.15.99:0/3323597086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5266eaeb0 con 0x55a5266ea550 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.900+0000 7f7d2be15640 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a5266d04e0 tx=0x7f7d240167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7c15602640 1 -- 172.21.15.99:0/3323597086 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d24013640 con 0x55a5266ea550 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7c15602640 1 -- 172.21.15.99:0/3323597086 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d240137e0 con 0x55a5266ea550 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5266eb140 con 0x55a5266ea550 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7c15602640 1 -- 172.21.15.99:0/3323597086 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d24013ae0 con 0x55a5266ea550 2024-09-13T23:25:30.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5266ede20 con 0x55a5266ea550 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.901+0000 7f7c15602640 1 -- 172.21.15.99:0/3323597086 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d24011040 con 0x55a5266ea550 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7c15602640 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 0x7f7c04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7c15602640 1 -- 172.21.15.99:0/3323597086 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7d2400e040 con 0x55a5266ea550 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2b614640 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 0x7f7c04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2b614640 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 0x7f7c04039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55a5266d3990 tx=0x7f7d1c018510 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2db19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2db19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a5266ca730 con 0x55a5266f7210 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.902+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48564/0 (socket says 172.21.15.99:48564) 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2be15640 1 -- 172.21.15.99:0/1459051343 learned_addr learned my addr 172.21.15.99:0/1459051343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2be15640 1 -- 172.21.15.99:0/1459051343 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5266f7be0 con 0x55a5266f7210 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2be15640 1 --2- 172.21.15.99:0/1459051343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400afb0 tx=0x7f7d2401fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32456f96902cfbde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7c0effd640 1 -- 172.21.15.99:0/1459051343 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d24021570 con 0x55a5266f7210 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7c0effd640 1 -- 172.21.15.99:0/1459051343 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2401f340 con 0x55a5266f7210 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7c0effd640 1 -- 172.21.15.99:0/1459051343 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d24014cc0 con 0x55a5266f7210 2024-09-13T23:25:30.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2db19800 1 -- 172.21.15.99:0/1459051343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 msgr2=0x55a5266f7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.903+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1459051343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400afb0 tx=0x7f7d2401fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- 172.21.15.99:0/1459051343 shutdown_connections 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1459051343 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266f7610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- 172.21.15.99:0/1459051343 >> 172.21.15.99:0/1459051343 conn(0x55a5266f3570 msgr2=0x55a5266f1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- 172.21.15.99:0/1459051343 shutdown_connections 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- 172.21.15.99:0/1459051343 wait complete. 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 Processor -- start 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- start start 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2db19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a5266f8250 con 0x55a5266f7210 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2be15640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48568/0 (socket says 172.21.15.99:48568) 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.904+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 learned_addr learned my addr 172.21.15.99:0/2896062801 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5266fec20 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7d2be15640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d2404cd60 tx=0x7f7d2404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7c0d7fa640 1 -- 172.21.15.99:0/2896062801 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d24040360 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7c0d7fa640 1 -- 172.21.15.99:0/2896062801 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2404e2b0 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a5266feeb0 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7c0d7fa640 1 -- 172.21.15.99:0/2896062801 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d2404e590 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.905+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a526701b60 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.906+0000 7f7c0d7fa640 1 -- 172.21.15.99:0/2896062801 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d2403b020 con 0x55a5266f7210 2024-09-13T23:25:30.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.906+0000 7f7c0d7fa640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7bf4036b90 0x7f7bf4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.906+0000 7f7c0d7fa640 1 -- 172.21.15.99:0/2896062801 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7d24039020 con 0x55a5266f7210 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.906+0000 7f7d2b614640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7bf4036b90 0x7f7bf4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2b614640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7bf4036b90 0x7f7bf4039050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c000ea0 tx=0x7f7d1c037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a52670a1d0 0x55a52670c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a52670cde0 con 0x55a52670a1d0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d22e13640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a52670a1d0 0x55a52670c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d22e13640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a52670a1d0 0x55a52670c690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 20 realm 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.907+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a52670d210 con 0x55a52670a1d0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a52670dae0 con 0x55a52670a1d0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a52670de80 con 0x55a52670a1d0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a52670ebe0 0x55a526710fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5267115e0 con 0x55a52670ebe0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2be15640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a52670ebe0 0x55a526710fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.908+0000 7f7d2be15640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a52670ebe0 0x55a526710fd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2db19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:30.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2db19800 20 searching for the correct realm 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a526713570 0x55a526715a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2b614640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a526713570 0x55a526715a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2b614640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a526713570 0x55a526715a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.909+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.910+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.910+0000 7f7d2be15640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d24044070 0x7f7d24044450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.910+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.910+0000 7f7d22e13640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d24044070 0x7f7d24044450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.910+0000 7f7d22e13640 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d24044070 0x7f7d24044450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:30.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.911+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.912+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.913+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.914+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.915+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.916+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a526713570 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.917+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x7f7d24044070 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670a1d0 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a526716100 con 0x55a52670ebe0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a526712ac0 con 0x55a52670a1d0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.918+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a526712330 con 0x55a52670a1d0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a526716580 con 0x55a52670ebe0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 zone default found 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 4 Realm: () 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:30.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 zonegroup default 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5267169d0 con 0x7f7d24044070 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.919+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a526718ca0 con 0x55a526713570 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a526719040 con 0x55a526713570 2024-09-13T23:25:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 started sync module instance, tier type = 2024-09-13T23:25:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:30.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.920+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526718130 con 0x55a52670ebe0 2024-09-13T23:25:30.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.923+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.924+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94167802938704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526719890 con 0x55a52670ebe0 2024-09-13T23:25:30.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.924+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671a0e0 con 0x55a52670a1d0 2024-09-13T23:25:30.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.925+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94167802938704] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.925+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.925+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94167802942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671a480 con 0x55a52670a1d0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.925+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671acd0 con 0x55a526713570 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.926+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94167802942432] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.926+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.926+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94167802946688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671a8a0 con 0x55a526713570 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.926+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671bb40 con 0x55a52670ebe0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.927+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.927+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94167802951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671c320 con 0x55a52670ebe0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.928+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671ce40 con 0x55a52670a1d0 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.928+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94167802946688] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.930+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.930+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94167802956048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671ce00 con 0x55a52670a1d0 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.930+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671d8a0 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.930+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94167802951792] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.931+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94167802956048] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.933+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.933+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94167802949744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671d8a0 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.933+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671e140 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.935+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94167802949744] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.938+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.938+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94167802958800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671dd50 con 0x7f7d24044070 2024-09-13T23:25:30.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.938+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671e710 con 0x7f7d24044070 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94167802962528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671eb30 con 0x7f7d24044070 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=0 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=1 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=2 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=3 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=4 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=5 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94167802958800] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.941+0000 7f7d2db19800 20 add_watcher() i=6 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94167802962528] v31'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d2db19800 20 add_watcher() i=7 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d2db19800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a52671eb30 con 0x55a52670a1d0 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.942+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94167802963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671eaa0 con 0x55a52670a1d0 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.943+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94167802963584] v31'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.943+0000 7f7be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.943+0000 7f7d2db19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.943+0000 7f7d2db19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.943+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5267283e0 con 0x55a52670a1d0 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.945+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.945+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526728ab0 con 0x7f7d24044070 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.946+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.946+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526728ed0 con 0x55a526713570 2024-09-13T23:25:30.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.947+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.947+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729720 con 0x55a52670a1d0 2024-09-13T23:25:30.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.948+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.948+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5267297b0 con 0x55a52670ebe0 2024-09-13T23:25:30.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.949+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.949+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729840 con 0x55a526713570 2024-09-13T23:25:30.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.951+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.951+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729cf0 con 0x55a52670a1d0 2024-09-13T23:25:30.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.952+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.952+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729cf0 con 0x7f7d24044070 2024-09-13T23:25:30.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.953+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.953+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729cf0 con 0x55a52670ebe0 2024-09-13T23:25:30.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.954+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.954+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729cf0 con 0x55a526713570 2024-09-13T23:25:30.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.955+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.955+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729d80 con 0x55a52670ebe0 2024-09-13T23:25:30.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.956+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'21 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.956+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729e10 con 0x7f7d24044070 2024-09-13T23:25:30.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.957+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.957+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729f40 con 0x55a52670ebe0 2024-09-13T23:25:30.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.958+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.958+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a526729fd0 con 0x7f7d24044070 2024-09-13T23:25:30.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.959+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.959+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a3a0 con 0x55a52670a1d0 2024-09-13T23:25:30.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.960+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.961+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a3a0 con 0x55a526713570 2024-09-13T23:25:30.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.962+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'14 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.962+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a52670ebe0 2024-09-13T23:25:30.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.963+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.963+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.964+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.964+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a52670a1d0 2024-09-13T23:25:30.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.965+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.965+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a52670a1d0 2024-09-13T23:25:30.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.966+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.966+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.968+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.968+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a52670ebe0 2024-09-13T23:25:30.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.969+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.969+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.970+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.970+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.972+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.972+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.973+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.973+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.974+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.974+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x7f7d24044070 2024-09-13T23:25:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.976+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.976+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.977+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.977+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x7f7d24044070 2024-09-13T23:25:30.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.978+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.978+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a526713570 2024-09-13T23:25:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.980+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.980+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x7f7d24044070 2024-09-13T23:25:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.981+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.981+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52672a850 con 0x55a52670ebe0 2024-09-13T23:25:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.982+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.982+0000 7f7be0fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.982+0000 7f7d2db19800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.982+0000 7f7d2db19800 20 Filter name: none 2024-09-13T23:25:30.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.982+0000 7f7b5a7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a5267551b0 con 0x55a52670ebe0 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.983+0000 7f7d2db19800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:25:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:25:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.984+0000 7f7be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.984+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94167802963584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5266be300 con 0x55a52670a1d0 2024-09-13T23:25:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.985+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94167802963584] v31'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.985+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94167802938704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671e680 con 0x55a52670ebe0 2024-09-13T23:25:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.986+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94167802938704] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.986+0000 7f7d2db19800 20 remove_watcher() i=0 2024-09-13T23:25:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.986+0000 7f7d2db19800 2 removed watcher, disabling cache 2024-09-13T23:25:30.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.986+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94167802942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671e680 con 0x55a52670a1d0 2024-09-13T23:25:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.987+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94167802942432] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.987+0000 7f7d2db19800 20 remove_watcher() i=1 2024-09-13T23:25:30.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.987+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94167802946688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5267193e0 con 0x55a526713570 2024-09-13T23:25:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.988+0000 7f7d2b614640 1 -- 172.21.15.99:0/2896062801 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94167802946688] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d1c02dcf0 con 0x55a526713570 2024-09-13T23:25:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.988+0000 7f7d2db19800 20 remove_watcher() i=2 2024-09-13T23:25:30.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.988+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94167802951792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671a480 con 0x55a52670ebe0 2024-09-13T23:25:30.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.989+0000 7f7d2be15640 1 -- 172.21.15.99:0/2896062801 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94167802951792] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d2400a4a0 con 0x55a52670ebe0 2024-09-13T23:25:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.989+0000 7f7d2db19800 20 remove_watcher() i=3 2024-09-13T23:25:30.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.989+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94167802956048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5267193e0 con 0x55a52670a1d0 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.990+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94167802956048] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x55a52670a1d0 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.990+0000 7f7d2db19800 20 remove_watcher() i=4 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.990+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94167802949744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671a480 con 0x7f7d24044070 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.991+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94167802949744] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.991+0000 7f7d2db19800 20 remove_watcher() i=5 2024-09-13T23:25:30.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.991+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94167802958800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a52671c910 con 0x7f7d24044070 2024-09-13T23:25:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.993+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94167802958800] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.993+0000 7f7d2db19800 20 remove_watcher() i=6 2024-09-13T23:25:30.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.993+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94167802962528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a5267193e0 con 0x7f7d24044070 2024-09-13T23:25:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94167802962528] v31'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d14051070 con 0x7f7d24044070 2024-09-13T23:25:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 20 remove_watcher() i=7 2024-09-13T23:25:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d24044070 msgr2=0x7f7d24044450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d24044070 0x7f7d24044450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a52670a1d0 msgr2=0x55a52670c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a52670a1d0 0x55a52670c690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a52670ebe0 msgr2=0x55a526710fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a52670ebe0 0x55a526710fd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a526713570 msgr2=0x55a526715a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a526713570 0x55a526715a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7bf4036b90 msgr2=0x7f7bf4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7bf4036b90 0x7f7bf4039050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c000ea0 tx=0x7f7d1c037000 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 msgr2=0x55a5266fe6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d22e13640 1 -- 172.21.15.99:0/2896062801 reap_dead start 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d2404cd60 tx=0x7f7d2404cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 shutdown_connections 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 --2- 172.21.15.99:0/2896062801 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266f7210 0x55a5266fe6e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 >> 172.21.15.99:0/2896062801 conn(0x55a5266f3570 msgr2=0x55a5266f1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 shutdown_connections 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.994+0000 7f7d2db19800 1 -- 172.21.15.99:0/2896062801 wait complete. 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 msgr2=0x7f7c04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 0x7f7c04039050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55a5266d3990 tx=0x7f7d1c018510 comp rx=0 tx=0).stop 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 msgr2=0x55a5266ea970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a5266d04e0 tx=0x7f7d240167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 shutdown_connections 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c04036b90 0x7f7c04039050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/3323597086 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5266ea550 0x55a5266ea970 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 >> 172.21.15.99:0/3323597086 conn(0x55a5266df4e0 msgr2=0x55a5266e2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 shutdown_connections 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/3323597086 wait complete. 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 msgr2=0x55a5266d6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 0x55a5266d6880 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 msgr2=0x55a5266db500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 0x55a5266db500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 msgr2=0x7f7c10039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 0x7f7c10039000 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d14057000 tx=0x7f7d14052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 msgr2=0x55a5266cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00b7c0 tx=0x7f7d1c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 shutdown_connections 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a5266d9110 0x55a5266db500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a5266d4490 0x55a5266d6880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c10036b40 0x7f7c10039000 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 --2- 172.21.15.99:0/1670762087 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a5265db900 0x55a5266cf430 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 >> 172.21.15.99:0/1670762087 conn(0x55a5265d2df0 msgr2=0x55a5266c0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 shutdown_connections 2024-09-13T23:25:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:30.995+0000 7f7d2db19800 1 -- 172.21.15.99:0/1670762087 wait complete. 2024-09-13T23:25:31.005 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:25:31.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T23:25:31.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T23:25:31.005 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T23:25:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.049 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9bb19800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557d9c2d1ad0 0x557d9c2d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9bb19800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d9c18cb30 con 0x557d9c2cba30 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9bb19800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x557d9c16e360 con 0x557d9c2d1ad0 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea98e0c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557d9c2d1ad0 0x557d9c2d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea98e0c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557d9c2d1ad0 0x557d9c2d3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48580/0 (socket says 172.21.15.99:48580) 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea98e0c640 1 -- 172.21.15.99:0/852539813 learned_addr learned my addr 172.21.15.99:0/852539813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.049+0000 7fea9960d640 1 --1- 172.21.15.99:0/852539813 >> v1:172.21.15.43:6789/0 conn(0x557d9c2cba30 0x557d9c2cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43778/0 (socket says 172.21.15.99:43778) 2024-09-13T23:25:31.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.050+0000 7fea98e0c640 1 -- 172.21.15.99:0/852539813 >> v1:172.21.15.43:6789/0 conn(0x557d9c2cba30 legacy=0x557d9c2cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.050+0000 7fea98e0c640 1 -- 172.21.15.99:0/852539813 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c194e00 con 0x557d9c2d1ad0 2024-09-13T23:25:31.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.051+0000 7fea98e0c640 1 --2- 172.21.15.99:0/852539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2d1ad0 0x557d9c2d3ec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea9000a520 tx=0x7fea90045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a341fdbff61543 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.051+0000 7fea8bfff640 1 -- 172.21.15.99:0/852539813 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea90055070 con 0x557d9c2d1ad0 2024-09-13T23:25:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.051+0000 7fea8bfff640 1 -- 172.21.15.99:0/852539813 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea900515b0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.051+0000 7fea8bfff640 1 -- 172.21.15.99:0/852539813 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea900518d0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 -- 172.21.15.99:0/852539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2d1ad0 msgr2=0x557d9c2d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 --2- 172.21.15.99:0/852539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2d1ad0 0x557d9c2d3ec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea9000a520 tx=0x7fea90045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 -- 172.21.15.99:0/852539813 shutdown_connections 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 --2- 172.21.15.99:0/852539813 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2d1ad0 0x557d9c2d3ec0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 -- 172.21.15.99:0/852539813 >> 172.21.15.99:0/852539813 conn(0x557d9c2c75c0 msgr2=0x557d9c2c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 -- 172.21.15.99:0/852539813 shutdown_connections 2024-09-13T23:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.052+0000 7fea9bb19800 1 -- 172.21.15.99:0/852539813 wait complete. 2024-09-13T23:25:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9bb19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9bb19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d9c219330 con 0x557d9c2cba30 2024-09-13T23:25:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9960d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9960d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48590/0 (socket says 172.21.15.99:48590) 2024-09-13T23:25:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9960d640 1 -- 172.21.15.99:0/3237296959 learned_addr learned my addr 172.21.15.99:0/3237296959 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.066+0000 7fea9960d640 1 -- 172.21.15.99:0/3237296959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c166bc0 con 0x557d9c2cba30 2024-09-13T23:25:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fea9960d640 1 --2- 172.21.15.99:0/3237296959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b230 tx=0x7fea8c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2abe053a979b218d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fe987606640 1 -- 172.21.15.99:0/3237296959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c00e5c0 con 0x557d9c2cba30 2024-09-13T23:25:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fe987606640 1 -- 172.21.15.99:0/3237296959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c006070 con 0x557d9c2cba30 2024-09-13T23:25:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fe987606640 1 -- 172.21.15.99:0/3237296959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c00e890 con 0x557d9c2cba30 2024-09-13T23:25:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fea9bb19800 1 -- 172.21.15.99:0/3237296959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 msgr2=0x557d9c3bc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.067+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3237296959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00b230 tx=0x7fea8c00b6f0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- 172.21.15.99:0/3237296959 shutdown_connections 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3237296959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3bc840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- 172.21.15.99:0/3237296959 >> 172.21.15.99:0/3237296959 conn(0x557d9c2c75c0 msgr2=0x557d9c3b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- 172.21.15.99:0/3237296959 shutdown_connections 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- 172.21.15.99:0/3237296959 wait complete. 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9bb19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d9c2d4700 con 0x557d9c2cba30 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9960d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9960d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48600/0 (socket says 172.21.15.99:48600) 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9960d640 1 -- 172.21.15.99:0/1506145591 learned_addr learned my addr 172.21.15.99:0/1506145591 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.068+0000 7fea9960d640 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c17afe0 con 0x557d9c2cba30 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fea9960d640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fe985e03640 1 -- 172.21.15.99:0/1506145591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c00f8d0 con 0x557d9c2cba30 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fe985e03640 1 -- 172.21.15.99:0/1506145591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8c00fa90 con 0x557d9c2cba30 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9c3c47b0 con 0x557d9c2cba30 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fe985e03640 1 -- 172.21.15.99:0/1506145591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8c00fdb0 con 0x557d9c2cba30 2024-09-13T23:25:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.069+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9c3c4cd0 con 0x557d9c2cba30 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fe985e03640 1 -- 172.21.15.99:0/1506145591 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea8c017070 con 0x557d9c2cba30 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fe985e03640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 0x7fe980039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fe985e03640 1 -- 172.21.15.99:0/1506145591 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea8c015020 con 0x557d9c2cba30 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fea98e0c640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 0x7fe980039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 0x557d9c3cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c3cb8b0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fea99e0e640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 0x557d9c3cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.070+0000 7fea98e0c640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 0x7fe980039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea90057000 tx=0x7fea90052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea99e0e640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 0x557d9c3cb2e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea99e0e640 1 -- 172.21.15.99:0/1506145591 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c3c8890 con 0x557d9c2d1ad0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea99e0e640 1 -- 172.21.15.99:0/1506145591 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 0x557d9c3cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c3d0650 con 0x557d9c3cdbc0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.071+0000 7fea9960d640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 0x557d9c3cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea9960d640 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 0x557d9c3cffb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea9960d640 1 -- 172.21.15.99:0/1506145591 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c3cdbc0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c3cca60 con 0x557d9c2d1ad0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea99e0e640 1 -- 172.21.15.99:0/1506145591 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c2d1ad0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c3ccf40 con 0x557d9c3cdbc0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.072+0000 7fea9960d640 1 -- 172.21.15.99:0/1506145591 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c3cdbc0 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea9bb19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea9bb19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d9c168580 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48608/0 (socket says 172.21.15.99:48608) 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea99e0e640 1 -- 172.21.15.99:0/2777486143 learned_addr learned my addr 172.21.15.99:0/2777486143 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.073+0000 7fea99e0e640 1 -- 172.21.15.99:0/2777486143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c2ce890 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fea99e0e640 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557d9c3c5320 tx=0x7fea940167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fe97effd640 1 -- 172.21.15.99:0/2777486143 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94013640 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fe97effd640 1 -- 172.21.15.99:0/2777486143 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea940137e0 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9c2cd0c0 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fe97effd640 1 -- 172.21.15.99:0/2777486143 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94013ae0 con 0x557d9c2ce470 2024-09-13T23:25:31.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.074+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9c2cd5c0 con 0x557d9c2ce470 2024-09-13T23:25:31.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fe97effd640 1 -- 172.21.15.99:0/2777486143 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea94011040 con 0x557d9c2ce470 2024-09-13T23:25:31.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fe97effd640 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 0x7fe970039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fe97effd640 1 -- 172.21.15.99:0/2777486143 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea9400e040 con 0x557d9c2ce470 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9960d640 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 0x7fe970039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9960d640 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 0x7fe970039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x557d9c3c87d0 tx=0x7fea8c00ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9bb19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.075+0000 7fea9bb19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d9c3bcff0 con 0x557d9c3edec0 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48624/0 (socket says 172.21.15.99:48624) 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea99e0e640 1 -- 172.21.15.99:0/3092641031 learned_addr learned my addr 172.21.15.99:0/3092641031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea99e0e640 1 -- 172.21.15.99:0/3092641031 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c3ee890 con 0x557d9c3edec0 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea99e0e640 1 --2- 172.21.15.99:0/3092641031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea9404cde0 tx=0x7fea940203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841b21f4923a413a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fe97cff9640 1 -- 172.21.15.99:0/3092641031 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94021960 con 0x557d9c3edec0 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fe97cff9640 1 -- 172.21.15.99:0/3092641031 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea94021440 con 0x557d9c3edec0 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fe97cff9640 1 -- 172.21.15.99:0/3092641031 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94021b00 con 0x557d9c3edec0 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea9bb19800 1 -- 172.21.15.99:0/3092641031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 msgr2=0x557d9c3ee2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.076+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3092641031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea9404cde0 tx=0x7fea940203a0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- 172.21.15.99:0/3092641031 shutdown_connections 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3092641031 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3ee2c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- 172.21.15.99:0/3092641031 >> 172.21.15.99:0/3092641031 conn(0x557d9c3ea270 msgr2=0x557d9c3e8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- 172.21.15.99:0/3092641031 shutdown_connections 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- 172.21.15.99:0/3092641031 wait complete. 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 Processor -- start 2024-09-13T23:25:31.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- start start 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea9bb19800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557d9c3eeea0 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea99e0e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48636/0 (socket says 172.21.15.99:48636) 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.077+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 learned_addr learned my addr 172.21.15.99:0/3425388638 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d9c3f58a0 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fea99e0e640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3f5360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea940203e0 tx=0x7fea9404cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fe96effd640 1 -- 172.21.15.99:0/3425388638 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea94021a90 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fe96effd640 1 -- 172.21.15.99:0/3425388638 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9401f6c0 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d9c3f5b30 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fe96effd640 1 -- 172.21.15.99:0/3425388638 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea9401f9a0 con 0x557d9c3edec0 2024-09-13T23:25:31.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.078+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d9c3f87e0 con 0x557d9c3edec0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.079+0000 7fe96effd640 1 -- 172.21.15.99:0/3425388638 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fea9403b060 con 0x557d9c3edec0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.079+0000 7fe96effd640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe964036b40 0x7fe964039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.079+0000 7fe96effd640 1 -- 172.21.15.99:0/3425388638 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fea94019cd0 con 0x557d9c3edec0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.079+0000 7fea9960d640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe964036b40 0x7fe964039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.079+0000 7fea9960d640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe964036b40 0x7fe964039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea8c01b540 tx=0x7fea8c037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c400ee0 0x557d9c4033a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c403af0 con 0x557d9c400ee0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea98e0c640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c400ee0 0x557d9c4033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea98e0c640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c400ee0 0x557d9c4033a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 20 realm 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.080+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c403f20 con 0x557d9c400ee0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4047f0 con 0x557d9c400ee0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c404b90 con 0x557d9c400ee0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c4058f0 0x557d9c407ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c408330 con 0x557d9c4058f0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea99e0e640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c4058f0 0x557d9c407ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.081+0000 7fea99e0e640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c4058f0 0x557d9c407ce0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9bb19800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9bb19800 20 searching for the correct realm 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557d9c40a2e0 0x557d9c40c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9960d640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557d9c40a2e0 0x557d9c40c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9960d640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557d9c40a2e0 0x557d9c40c7a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.082+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea99e0e640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fea94050030 0x7fea9404e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea98e0c640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fea94050030 0x7fea9404e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea98e0c640 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fea94050030 0x7fea9404e960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.083+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.084+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.085+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.086+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.087+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.088+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.089+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.089+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.089+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.089+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c40a2e0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x7fea94050030 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.090+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c400ee0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ce70 con 0x557d9c4058f0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c408cf0 con 0x557d9c400ee0 2024-09-13T23:25:31.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c409590 con 0x557d9c400ee0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.091+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40d2f0 con 0x557d9c4058f0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 zone default found 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 4 Realm: () 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 zonegroup default 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40db40 con 0x7fea94050030 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f8c0 con 0x557d9c40a2e0 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.092+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40fce0 con 0x557d9c40a2e0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.093+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.093+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.093+0000 7fea9bb19800 20 started sync module instance, tier type = 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.093+0000 7fea9bb19800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.093+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40ed60 con 0x557d9c4058f0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.094+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.094+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93997980774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4105f0 con 0x557d9c4058f0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.094+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c410e40 con 0x557d9c400ee0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.095+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.095+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93997980780016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c411020 con 0x557d9c400ee0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.095+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c411b10 con 0x557d9c40a2e0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.096+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93997980774736] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.097+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.097+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93997980784096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c411eb0 con 0x557d9c40a2e0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.097+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c412960 con 0x557d9c4058f0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.097+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93997980780016] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.099+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93997980784096] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.099+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.099+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93997980778816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c412960 con 0x557d9c4058f0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.099+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c413200 con 0x557d9c400ee0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.103+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.103+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93997980790096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c413620 con 0x557d9c400ee0 2024-09-13T23:25:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.103+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c413e70 con 0x7fea94050030 2024-09-13T23:25:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.107+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93997980778816] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.108+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93997980790096] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.108+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.108+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93997980791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c413a40 con 0x7fea94050030 2024-09-13T23:25:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.108+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c414290 con 0x7fea94050030 2024-09-13T23:25:31.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.112+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93997980791152] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.116+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.116+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93997980792688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c414100 con 0x7fea94050030 2024-09-13T23:25:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.116+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c414c20 con 0x7fea94050030 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.119+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93997980792688] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93997980796656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c414be0 con 0x7fea94050030 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=0 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=1 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=2 2024-09-13T23:25:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=3 2024-09-13T23:25:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=4 2024-09-13T23:25:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=5 2024-09-13T23:25:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea9bb19800 20 add_watcher() i=6 2024-09-13T23:25:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.120+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93997980796656] v31'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.121+0000 7fea9bb19800 20 add_watcher() i=7 2024-09-13T23:25:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.121+0000 7fea9bb19800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.121+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c418070 con 0x557d9c400ee0 2024-09-13T23:25:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.121+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.121+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93997980793744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c415590 con 0x557d9c400ee0 2024-09-13T23:25:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.122+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93997980793744] v31'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.122+0000 7fe94f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.122+0000 7fea9bb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.122+0000 7fea9bb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.122+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c417e40 con 0x557d9c400ee0 2024-09-13T23:25:31.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.123+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.123+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4211a0 con 0x7fea94050030 2024-09-13T23:25:31.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.124+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.124+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4215e0 con 0x557d9c40a2e0 2024-09-13T23:25:31.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.125+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.125+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c421b50 con 0x557d9c400ee0 2024-09-13T23:25:31.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.126+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'32 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.126+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4220c0 con 0x557d9c4058f0 2024-09-13T23:25:31.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.127+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.127+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422150 con 0x557d9c40a2e0 2024-09-13T23:25:31.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.128+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.128+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422150 con 0x557d9c400ee0 2024-09-13T23:25:31.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.129+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.129+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422150 con 0x7fea94050030 2024-09-13T23:25:31.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.130+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.130+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c4058f0 2024-09-13T23:25:31.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.131+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.132+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c40a2e0 2024-09-13T23:25:31.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.132+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.132+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c4058f0 2024-09-13T23:25:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.134+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'24 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.134+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x7fea94050030 2024-09-13T23:25:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.135+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.135+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c4058f0 2024-09-13T23:25:31.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.136+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.136+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x7fea94050030 2024-09-13T23:25:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.139+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.139+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c400ee0 2024-09-13T23:25:31.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.141+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.141+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422590 con 0x557d9c40a2e0 2024-09-13T23:25:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.143+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'17 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.143+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422680 con 0x557d9c4058f0 2024-09-13T23:25:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.144+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.144+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422680 con 0x557d9c40a2e0 2024-09-13T23:25:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.145+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.145+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422620 con 0x557d9c400ee0 2024-09-13T23:25:31.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.146+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.146+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422620 con 0x557d9c400ee0 2024-09-13T23:25:31.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.147+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.147+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422620 con 0x557d9c40a2e0 2024-09-13T23:25:31.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.148+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.148+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c4058f0 2024-09-13T23:25:31.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.149+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.149+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.150+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.150+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.151+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.151+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.152+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.152+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.153+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.153+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x7fea94050030 2024-09-13T23:25:31.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.154+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.154+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.155+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.155+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x7fea94050030 2024-09-13T23:25:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.156+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.156+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c40a2e0 2024-09-13T23:25:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.158+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.158+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x7fea94050030 2024-09-13T23:25:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.159+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.159+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c422670 con 0x557d9c4058f0 2024-09-13T23:25:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.160+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.160+0000 7fe94e7e4640 20 reqs_thread_entry: start 2024-09-13T23:25:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.160+0000 7fea9bb19800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.160+0000 7fea9bb19800 20 Filter name: none 2024-09-13T23:25:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.160+0000 7fe8bffff640 20 reqs_thread_entry: start 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557d9c44d430 con 0x7fea94050030 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.161+0000 7fea9bb19800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:25:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:25:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.162+0000 7fe94f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.162+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93997980793744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c4203e0 con 0x557d9c400ee0 2024-09-13T23:25:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.163+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93997980793744] v31'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.163+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93997980774736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c413b90 con 0x557d9c4058f0 2024-09-13T23:25:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.164+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93997980774736] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.164+0000 7fea9bb19800 20 remove_watcher() i=0 2024-09-13T23:25:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.164+0000 7fea9bb19800 2 removed watcher, disabling cache 2024-09-13T23:25:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.164+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93997980780016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f150 con 0x557d9c400ee0 2024-09-13T23:25:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.165+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93997980780016] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.165+0000 7fea9bb19800 20 remove_watcher() i=1 2024-09-13T23:25:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.165+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93997980784096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f150 con 0x557d9c40a2e0 2024-09-13T23:25:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.166+0000 7fea9960d640 1 -- 172.21.15.99:0/3425388638 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93997980784096] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea8c02e070 con 0x557d9c40a2e0 2024-09-13T23:25:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.166+0000 7fea9bb19800 20 remove_watcher() i=2 2024-09-13T23:25:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.166+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93997980778816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f150 con 0x557d9c4058f0 2024-09-13T23:25:31.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.167+0000 7fea99e0e640 1 -- 172.21.15.99:0/3425388638 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93997980778816] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea9400a4a0 con 0x557d9c4058f0 2024-09-13T23:25:31.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.167+0000 7fea9bb19800 20 remove_watcher() i=3 2024-09-13T23:25:31.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.167+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93997980790096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c410140 con 0x557d9c400ee0 2024-09-13T23:25:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.168+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93997980790096] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x557d9c400ee0 2024-09-13T23:25:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.168+0000 7fea9bb19800 20 remove_watcher() i=4 2024-09-13T23:25:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.168+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93997980791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f150 con 0x7fea94050030 2024-09-13T23:25:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93997980791152] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea9bb19800 20 remove_watcher() i=5 2024-09-13T23:25:31.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93997980792688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c410140 con 0x7fea94050030 2024-09-13T23:25:31.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93997980792688] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea9bb19800 20 remove_watcher() i=6 2024-09-13T23:25:31.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.169+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93997980796656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557d9c40f150 con 0x7fea94050030 2024-09-13T23:25:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.170+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93997980796656] v31'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea90057030 con 0x7fea94050030 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.170+0000 7fea9bb19800 20 remove_watcher() i=7 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fea94050030 msgr2=0x7fea9404e960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fea94050030 0x7fea9404e960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c400ee0 msgr2=0x557d9c4033a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c400ee0 0x557d9c4033a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c4058f0 msgr2=0x557d9c407ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c4058f0 0x557d9c407ce0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557d9c40a2e0 msgr2=0x557d9c40c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557d9c40a2e0 0x557d9c40c7a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe964036b40 msgr2=0x7fe964039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe964036b40 0x7fe964039000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea8c01b540 tx=0x7fea8c037000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 msgr2=0x557d9c3f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/3425388638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c3edec0 0x557d9c3f5360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fea940203e0 tx=0x7fea9404cd70 comp rx=0 tx=0).stop 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea98e0c640 1 -- 172.21.15.99:0/3425388638 reap_dead start 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 shutdown_connections 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 >> 172.21.15.99:0/3425388638 conn(0x557d9c3ea270 msgr2=0x557d9c3e8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 shutdown_connections 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/3425388638 wait complete. 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 msgr2=0x7fe970039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 0x7fe970039050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x557d9c3c87d0 tx=0x7fea8c00ff90 comp rx=0 tx=0).stop 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 msgr2=0x557d9c2ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x557d9c3c5320 tx=0x7fea940167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 shutdown_connections 2024-09-13T23:25:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe970036b90 0x7fe970039050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 --2- 172.21.15.99:0/2777486143 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2ce470 0x557d9c2ccac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 >> 172.21.15.99:0/2777486143 conn(0x557d9c3d3f80 msgr2=0x557d9c3d6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 shutdown_connections 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.171+0000 7fea9bb19800 1 -- 172.21.15.99:0/2777486143 wait complete. 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 msgr2=0x557d9c3cb2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 0x557d9c3cb2e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 msgr2=0x557d9c3cffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 0x557d9c3cffb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 msgr2=0x7fe980039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 0x7fe980039050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea90057000 tx=0x7fea90052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 msgr2=0x557d9c3c4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fea8c000c00 tx=0x7fea8c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 shutdown_connections 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557d9c3cdbc0 0x557d9c3cffb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557d9c2d1ad0 0x557d9c3cb2e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe980036b90 0x7fe980039050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 --2- 172.21.15.99:0/1506145591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557d9c2cba30 0x557d9c3c4270 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 >> 172.21.15.99:0/1506145591 conn(0x557d9c2c75c0 msgr2=0x557d9c3b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 shutdown_connections 2024-09-13T23:25:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.172+0000 7fea9bb19800 1 -- 172.21.15.99:0/1506145591 wait complete. 2024-09-13T23:25:31.181 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:25:31.181 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:31.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:31.182 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:25:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.225+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.225+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.225+0000 7f52a3922800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556907e8f610 0x556907f20670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.225+0000 7f52a3922800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556907ddab30 con 0x556907f20bb0 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.225+0000 7f52a3922800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x556907dbc360 con 0x556907e8f610 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.226+0000 7f529f6ac640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556907e8f610 0x556907f20670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.226+0000 7f5297fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x556907f20bb0 0x556907f22fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43784/0 (socket says 172.21.15.99:43784) 2024-09-13T23:25:31.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.226+0000 7f5297fff640 1 -- 172.21.15.99:0/2118041212 learned_addr learned my addr 172.21.15.99:0/2118041212 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:31.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.226+0000 7f529f6ac640 1 -- 172.21.15.99:0/2118041212 >> v1:172.21.15.43:6789/0 conn(0x556907f20bb0 legacy=0x556907f22fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.226+0000 7f529f6ac640 1 -- 172.21.15.99:0/2118041212 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556907de2e00 con 0x556907e8f610 2024-09-13T23:25:31.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2118041212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x556907f20670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f529000a470 tx=0x7f5290045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb7bd4fe7001e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f529eeab640 1 -- 172.21.15.99:0/2118041212 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290053570 con 0x556907e8f610 2024-09-13T23:25:31.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f529eeab640 1 -- 172.21.15.99:0/2118041212 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5290058070 con 0x556907e8f610 2024-09-13T23:25:31.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f529eeab640 1 -- 172.21.15.99:0/2118041212 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5290053880 con 0x556907e8f610 2024-09-13T23:25:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 -- 172.21.15.99:0/2118041212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 msgr2=0x556907f20670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 --2- 172.21.15.99:0/2118041212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x556907f20670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f529000a470 tx=0x7f5290045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 -- 172.21.15.99:0/2118041212 shutdown_connections 2024-09-13T23:25:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 --2- 172.21.15.99:0/2118041212 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x556907f20670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 -- 172.21.15.99:0/2118041212 >> 172.21.15.99:0/2118041212 conn(0x556907f15de0 msgr2=0x556907f18200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 -- 172.21.15.99:0/2118041212 shutdown_connections 2024-09-13T23:25:31.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.228+0000 7f52a3922800 1 -- 172.21.15.99:0/2118041212 wait complete. 2024-09-13T23:25:31.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.242+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.242+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.242+0000 7f52a3922800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.242+0000 7f52a3922800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556907e67330 con 0x556907e8f610 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.242+0000 7f529f6ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f529f6ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48648/0 (socket says 172.21.15.99:48648) 2024-09-13T23:25:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f529f6ac640 1 -- 172.21.15.99:0/2762480924 learned_addr learned my addr 172.21.15.99:0/2762480924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f529f6ac640 1 -- 172.21.15.99:0/2762480924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556907db4bc0 con 0x556907e8f610 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2762480924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5290025c20 tx=0x7f5290051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7230d0a47ce23a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f518d60a640 1 -- 172.21.15.99:0/2762480924 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529005c580 con 0x556907e8f610 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f518d60a640 1 -- 172.21.15.99:0/2762480924 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5290063030 con 0x556907e8f610 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.243+0000 7f518d60a640 1 -- 172.21.15.99:0/2762480924 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529005c850 con 0x556907e8f610 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- 172.21.15.99:0/2762480924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 msgr2=0x55690800ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 --2- 172.21.15.99:0/2762480924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5290025c20 tx=0x7f5290051000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- 172.21.15.99:0/2762480924 shutdown_connections 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 --2- 172.21.15.99:0/2762480924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907e8f610 0x55690800ca80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- 172.21.15.99:0/2762480924 >> 172.21.15.99:0/2762480924 conn(0x556907f15de0 msgr2=0x556908008440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- 172.21.15.99:0/2762480924 shutdown_connections 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- 172.21.15.99:0/2762480924 wait complete. 2024-09-13T23:25:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.244+0000 7f52a3922800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556907f24990 con 0x556907f20bb0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f529f6ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f529f6ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48660/0 (socket says 172.21.15.99:48660) 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f529f6ac640 1 -- 172.21.15.99:0/173086922 learned_addr learned my addr 172.21.15.99:0/173086922 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f529f6ac640 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556907dc8fe0 con 0x556907f20bb0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f529f6ac640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f529000a330 tx=0x7f5290002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f518be07640 1 -- 172.21.15.99:0/173086922 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529006c030 con 0x556907f20bb0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f518be07640 1 -- 172.21.15.99:0/173086922 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f529005c450 con 0x556907f20bb0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556908014ab0 con 0x556907f20bb0 2024-09-13T23:25:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f518be07640 1 -- 172.21.15.99:0/173086922 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529005c730 con 0x556907f20bb0 2024-09-13T23:25:31.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.245+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556908015030 con 0x556907f20bb0 2024-09-13T23:25:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.246+0000 7f518be07640 1 -- 172.21.15.99:0/173086922 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5290053440 con 0x556907f20bb0 2024-09-13T23:25:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.246+0000 7f518be07640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 0x7f5184039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.246+0000 7f518be07640 1 -- 172.21.15.99:0/173086922 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5290070020 con 0x556907f20bb0 2024-09-13T23:25:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f5297fff640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 0x7f5184039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 0x55690801b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690801bf90 con 0x5569080195d0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f529fead640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 0x55690801b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f5297fff640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 0x7f5184039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5288000f60 tx=0x7f52880012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f529fead640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 0x55690801b9c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f529fead640 1 -- 172.21.15.99:0/173086922 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f529800a4a0 con 0x5569080195d0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.247+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908018bb0 con 0x5569080195d0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f529fead640 1 -- 172.21.15.99:0/173086922 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f529800a4a0 con 0x5569080195d0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 0x556908020720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908020e10 con 0x55690801e330 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f529f6ac640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 0x556908020720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f529f6ac640 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 0x556908020720 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f529f6ac640 1 -- 172.21.15.99:0/173086922 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f529007b070 con 0x55690801e330 2024-09-13T23:25:31.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.248+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690801d1d0 con 0x5569080195d0 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f529fead640 1 -- 172.21.15.99:0/173086922 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f529800a4a0 con 0x5569080195d0 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690801d6b0 con 0x55690801e330 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f529f6ac640 1 -- 172.21.15.99:0/173086922 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f529007b070 con 0x55690801e330 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f52a3922800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.249+0000 7f52a3922800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556907db6580 con 0x55690802f770 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48676/0 (socket says 172.21.15.99:48676) 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f529fead640 1 -- 172.21.15.99:0/2526126538 learned_addr learned my addr 172.21.15.99:0/2526126538 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f529fead640 1 -- 172.21.15.99:0/2526126538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569080300d0 con 0x55690802f770 2024-09-13T23:25:31.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f529fead640 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55690801c390 tx=0x7f52980163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f5189602640 1 -- 172.21.15.99:0/2526126538 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5298013450 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f5189602640 1 -- 172.21.15.99:0/2526126538 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52980135f0 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556908030360 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f5189602640 1 -- 172.21.15.99:0/2526126538 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52980138d0 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.250+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556908033040 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.251+0000 7f5189602640 1 -- 172.21.15.99:0/2526126538 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5298011040 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.251+0000 7f5189602640 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 0x7f5178039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.251+0000 7f5189602640 1 -- 172.21.15.99:0/2526126538 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f529800e040 con 0x55690802f770 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.251+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 0x7f5178039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.251+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 0x7f5178039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f529008efd0 tx=0x7f529005e820 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f52a3922800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f52a3922800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55690800d1d0 con 0x55690803c460 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48680/0 (socket says 172.21.15.99:48680) 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529fead640 1 -- 172.21.15.99:0/2303045943 learned_addr learned my addr 172.21.15.99:0/2303045943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529fead640 1 -- 172.21.15.99:0/2303045943 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55690803ce30 con 0x55690803c460 2024-09-13T23:25:31.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f529fead640 1 --2- 172.21.15.99:0/2303045943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5298014e60 tx=0x7f5298014f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9ad48a7d881772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f5182ffd640 1 -- 172.21.15.99:0/2303045943 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529804a070 con 0x55690803c460 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f5182ffd640 1 -- 172.21.15.99:0/2303045943 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298020da0 con 0x55690803c460 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.252+0000 7f5182ffd640 1 -- 172.21.15.99:0/2303045943 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529802aab0 con 0x55690803c460 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- 172.21.15.99:0/2303045943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 msgr2=0x55690803c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 --2- 172.21.15.99:0/2303045943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5298014e60 tx=0x7f5298014f50 comp rx=0 tx=0).stop 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- 172.21.15.99:0/2303045943 shutdown_connections 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 --2- 172.21.15.99:0/2303045943 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x55690803c860 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- 172.21.15.99:0/2303045943 >> 172.21.15.99:0/2303045943 conn(0x5569080387c0 msgr2=0x5569080368c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- 172.21.15.99:0/2303045943 shutdown_connections 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- 172.21.15.99:0/2303045943 wait complete. 2024-09-13T23:25:31.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 Processor -- start 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- start start 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.253+0000 7f52a3922800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55690803d4a0 con 0x55690803c460 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f529fead640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48692/0 (socket says 172.21.15.99:48692) 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 learned_addr learned my addr 172.21.15.99:0/2699058815 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556908043df0 con 0x55690803c460 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f529fead640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f529804bc70 tx=0x7f529804cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f51817fa640 1 -- 172.21.15.99:0/2699058815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529802a980 con 0x55690803c460 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f51817fa640 1 -- 172.21.15.99:0/2699058815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5298013a70 con 0x55690803c460 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f51817fa640 1 -- 172.21.15.99:0/2699058815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f529802ab20 con 0x55690803c460 2024-09-13T23:25:31.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556908044080 con 0x55690803c460 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.254+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556908046d30 con 0x55690803c460 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.255+0000 7f51817fa640 1 -- 172.21.15.99:0/2699058815 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f529804e220 con 0x55690803c460 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.255+0000 7f51817fa640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5168036b40 0x7f5168039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.255+0000 7f51817fa640 1 -- 172.21.15.99:0/2699058815 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5298053850 con 0x55690803c460 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.255+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5168036b40 0x7f5168039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5168036b40 0x7f5168039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5290001eb0 tx=0x7f5290082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55690804f480 0x556908051940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908052090 con 0x55690804f480 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f5297fff640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55690804f480 0x556908051940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.256+0000 7f5297fff640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55690804f480 0x556908051940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5288009050 con 0x55690804f480 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 realm 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690804e8d0 con 0x55690804f480 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5288009050 con 0x55690804f480 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908052b80 con 0x55690804f480 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5288009050 con 0x55690804f480 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908053450 con 0x55690804f480 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5288009050 con 0x55690804f480 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556908053d90 0x556908056180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908056910 con 0x556908053d90 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.257+0000 7f529fead640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556908053d90 0x556908056180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f529fead640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556908053d90 0x556908056180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f52a3922800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f52a3922800 20 searching for the correct realm 2024-09-13T23:25:31.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556908058910 0x55690805add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556908058910 0x55690805add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.258+0000 7f529f6ac640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556908058910 0x55690805add0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f529fead640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5298013070 0x7f5298008980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f5297fff640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5298013070 0x7f5298008980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.259+0000 7f5297fff640 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5298013070 0x7f5298008980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288009050 con 0x7f5298013070 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288009050 con 0x55690804f480 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.260+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.261+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.262+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.263+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.264+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.265+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908058910 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x7f5298013070 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x55690804f480 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55690805b4a0 con 0x556908053d90 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:31.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5569080571d0 con 0x55690804f480 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.266+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5569080575c0 con 0x55690804f480 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690805b920 con 0x556908053d90 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 zone default found 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 4 Realm: () 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 zonegroup default 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690805c170 con 0x7f5298013070 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.267+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690805df20 con 0x556908058910 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690805e360 con 0x556908058910 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 20 started sync module instance, tier type = 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.268+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805d390 con 0x556908053d90 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.269+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.269+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93909594527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805cff0 con 0x556908053d90 2024-09-13T23:25:31.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.269+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805f2c0 con 0x55690804f480 2024-09-13T23:25:31.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.271+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.271+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93909594533392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805f6e0 con 0x55690804f480 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.271+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908060200 con 0x556908058910 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.272+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93909594527616] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.273+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93909594533392] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.273+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.273+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93909594531824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805f6e0 con 0x556908058910 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.273+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908060ae0 con 0x556908053d90 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.274+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93909594531824] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.277+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.277+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93909594534448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908060ed0 con 0x556908053d90 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.277+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080618d0 con 0x55690804f480 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.278+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.278+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93909594543072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908061840 con 0x55690804f480 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.278+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080628c0 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.278+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93909594534448] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.279+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93909594543072] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.281+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.281+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93909594547088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908062880 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.281+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908063190 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.282+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.282+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93909594549392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908062880 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.282+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908063ca0 con 0x7f5298013070 2024-09-13T23:25:31.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v31'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93909594552240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908064150 con 0x7f5298013070 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 20 add_watcher() i=0 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 20 add_watcher() i=1 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 20 add_watcher() i=2 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 20 add_watcher() i=3 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.283+0000 7f52a3922800 20 add_watcher() i=4 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.284+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93909594552240] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.285+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 93909594547088] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.285+0000 7f52a3922800 20 add_watcher() i=5 2024-09-13T23:25:31.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.287+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93909594549392] v31'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.287+0000 7f52a3922800 20 add_watcher() i=6 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.287+0000 7f52a3922800 20 add_watcher() i=7 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.287+0000 7f52a3922800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.287+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556908063ca0 con 0x55690804f480 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.288+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.288+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93909594539504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908063ca0 con 0x55690804f480 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.289+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93909594539504] v31'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.289+0000 7f5155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.289+0000 7f52a3922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.289+0000 7f52a3922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.289+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690806f6c0 con 0x55690804f480 2024-09-13T23:25:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.291+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.291+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690806fd90 con 0x7f5298013070 2024-09-13T23:25:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.292+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.292+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080701b0 con 0x556908058910 2024-09-13T23:25:31.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.293+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.293+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070720 con 0x55690804f480 2024-09-13T23:25:31.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.295+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.295+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070c90 con 0x556908053d90 2024-09-13T23:25:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.296+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.296+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070c90 con 0x556908058910 2024-09-13T23:25:31.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.298+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.298+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070c90 con 0x55690804f480 2024-09-13T23:25:31.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.299+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.299+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070f70 con 0x7f5298013070 2024-09-13T23:25:31.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.300+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.300+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070f70 con 0x556908053d90 2024-09-13T23:25:31.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.302+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.302+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070f70 con 0x556908058910 2024-09-13T23:25:31.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.303+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.303+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908070f70 con 0x556908053d90 2024-09-13T23:25:31.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.304+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'27 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.304+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x7f5298013070 2024-09-13T23:25:31.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.305+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.305+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908053d90 2024-09-13T23:25:31.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.306+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.306+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x7f5298013070 2024-09-13T23:25:31.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.307+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.307+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x55690804f480 2024-09-13T23:25:31.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.308+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'38 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.308+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.309+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.309+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908053d90 2024-09-13T23:25:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.310+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.310+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.311+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.311+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x55690804f480 2024-09-13T23:25:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.313+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.313+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x55690804f480 2024-09-13T23:25:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.314+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.314+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.315+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.315+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908053d90 2024-09-13T23:25:31.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.316+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.316+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.318+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.318+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.319+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.319+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.322+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.322+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.325+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.325+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x7f5298013070 2024-09-13T23:25:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.327+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.327+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.328+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.328+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x7f5298013070 2024-09-13T23:25:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.330+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.330+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908058910 2024-09-13T23:25:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.331+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.331+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x7f5298013070 2024-09-13T23:25:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.332+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.332+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908071550 con 0x556908053d90 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f5154fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f52a3922800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f52a3922800 20 Filter name: none 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f50ce7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f52a3922800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f52a3922800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55690809c490 con 0x7f5298013070 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.333+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.334+0000 7f52a3922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.334+0000 7f52a3922800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:25:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.334+0000 7f52a3922800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:25:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.334+0000 7f5155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.334+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93909594539504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690806ad80 con 0x55690804f480 2024-09-13T23:25:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.335+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93909594539504] v31'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.336+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93909594527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080605f0 con 0x556908053d90 2024-09-13T23:25:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.336+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93909594527616] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.336+0000 7f52a3922800 20 remove_watcher() i=0 2024-09-13T23:25:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.336+0000 7f52a3922800 2 removed watcher, disabling cache 2024-09-13T23:25:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.336+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93909594533392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080605f0 con 0x55690804f480 2024-09-13T23:25:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.337+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93909594533392] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.338+0000 7f52a3922800 20 remove_watcher() i=1 2024-09-13T23:25:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.338+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93909594531824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55690805ee10 con 0x556908058910 2024-09-13T23:25:31.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.339+0000 7f529f6ac640 1 -- 172.21.15.99:0/2699058815 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93909594531824] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5290099070 con 0x556908058910 2024-09-13T23:25:31.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.339+0000 7f52a3922800 20 remove_watcher() i=2 2024-09-13T23:25:31.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.339+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93909594534448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080605f0 con 0x556908053d90 2024-09-13T23:25:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.340+0000 7f529fead640 1 -- 172.21.15.99:0/2699058815 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93909594534448] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5298027020 con 0x556908053d90 2024-09-13T23:25:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.340+0000 7f52a3922800 20 remove_watcher() i=3 2024-09-13T23:25:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.340+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93909594543072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080605f0 con 0x55690804f480 2024-09-13T23:25:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.341+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93909594543072] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x55690804f480 2024-09-13T23:25:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.341+0000 7f52a3922800 20 remove_watcher() i=4 2024-09-13T23:25:31.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.341+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93909594547088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080613e0 con 0x7f5298013070 2024-09-13T23:25:31.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.342+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93909594547088] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.342+0000 7f52a3922800 20 remove_watcher() i=5 2024-09-13T23:25:31.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.342+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93909594549392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5569080605f0 con 0x7f5298013070 2024-09-13T23:25:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.343+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93909594549392] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.343+0000 7f52a3922800 20 remove_watcher() i=6 2024-09-13T23:25:31.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.343+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93909594552240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556908062c90 con 0x7f5298013070 2024-09-13T23:25:31.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93909594552240] v31'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5288029040 con 0x7f5298013070 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 20 remove_watcher() i=7 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5298013070 msgr2=0x7f5298008980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5298013070 0x7f5298008980 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55690804f480 msgr2=0x556908051940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55690804f480 0x556908051940 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556908053d90 msgr2=0x556908056180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556908053d90 0x556908056180 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556908058910 msgr2=0x55690805add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556908058910 0x55690805add0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5168036b40 msgr2=0x7f5168039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5168036b40 0x7f5168039000 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5290001eb0 tx=0x7f5290082000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 msgr2=0x5569080438b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f5297fff640 1 -- 172.21.15.99:0/2699058815 reap_dead start 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f529804bc70 tx=0x7f529804cd30 comp rx=0 tx=0).stop 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 shutdown_connections 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 --2- 172.21.15.99:0/2699058815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690803c460 0x5569080438b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 >> 172.21.15.99:0/2699058815 conn(0x5569080387c0 msgr2=0x556908036890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 shutdown_connections 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.344+0000 7f52a3922800 1 -- 172.21.15.99:0/2699058815 wait complete. 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 msgr2=0x7f5178039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 0x7f5178039050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f529008efd0 tx=0x7f529005e820 comp rx=0 tx=0).stop 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 msgr2=0x55690802fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55690801c390 tx=0x7f52980163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 shutdown_connections 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5178036b90 0x7f5178039050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/2526126538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55690802f770 0x55690802fb90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 >> 172.21.15.99:0/2526126538 conn(0x556908024700 msgr2=0x556908027280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 shutdown_connections 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/2526126538 wait complete. 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 msgr2=0x55690801b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 0x55690801b9c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 msgr2=0x556908020720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 0x556908020720 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 msgr2=0x7f5184039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 0x7f5184039000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5288000f60 tx=0x7f52880012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 msgr2=0x556908014570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f529000a330 tx=0x7f5290002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 shutdown_connections 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55690801e330 0x556908020720 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5569080195d0 0x55690801b9c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5184036b40 0x7f5184039000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 --2- 172.21.15.99:0/173086922 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556907f20bb0 0x556908014570 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 >> 172.21.15.99:0/173086922 conn(0x556907f15de0 msgr2=0x556908006cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 shutdown_connections 2024-09-13T23:25:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.345+0000 7f52a3922800 1 -- 172.21.15.99:0/173086922 wait complete. 2024-09-13T23:25:31.355 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:25:31.355 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:31.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:31.356 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:25:31.439 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.439 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.438+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.438+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a22c98800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5647d2fc7db0 0x5647d2fca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a22c98800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647d2e80b30 con 0x5647d2f355f0 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a22c98800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5647d2e62360 con 0x5647d2fc7db0 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a17f8b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5647d2fc7db0 0x5647d2fca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a17f8b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5647d2fc7db0 0x5647d2fca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48706/0 (socket says 172.21.15.99:48706) 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a2078c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5647d2f355f0 0x5647d2fc6690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43798/0 (socket says 172.21.15.99:43798) 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a17f8b640 1 -- 172.21.15.99:0/1007138970 learned_addr learned my addr 172.21.15.99:0/1007138970 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a17f8b640 1 -- 172.21.15.99:0/1007138970 >> v1:172.21.15.43:6789/0 conn(0x5647d2f355f0 legacy=0x5647d2fc6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a1ff8b640 1 -- 172.21.15.99:0/1007138970 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273897282 0 0) 0x5647d2e80b30 con 0x5647d2f355f0 2024-09-13T23:25:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.439+0000 7f0a17f8b640 1 -- 172.21.15.99:0/1007138970 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d2e88e00 con 0x5647d2fc7db0 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.441+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/1007138970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2fc7db0 0x5647d2fca1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800a520 tx=0x7f0a08045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ff15e32bf33ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.441+0000 7f0a1ff8b640 1 -- 172.21.15.99:0/1007138970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a08055070 con 0x5647d2fc7db0 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.441+0000 7f0a1ff8b640 1 -- 172.21.15.99:0/1007138970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a080515b0 con 0x5647d2fc7db0 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.441+0000 7f0a1ff8b640 1 -- 172.21.15.99:0/1007138970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a080518d0 con 0x5647d2fc7db0 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 -- 172.21.15.99:0/1007138970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2fc7db0 msgr2=0x5647d2fca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 --2- 172.21.15.99:0/1007138970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2fc7db0 0x5647d2fca1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800a520 tx=0x7f0a08045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 -- 172.21.15.99:0/1007138970 shutdown_connections 2024-09-13T23:25:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 --2- 172.21.15.99:0/1007138970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2fc7db0 0x5647d2fca1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 -- 172.21.15.99:0/1007138970 >> 172.21.15.99:0/1007138970 conn(0x5647d2fbbde0 msgr2=0x5647d2fbe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 -- 172.21.15.99:0/1007138970 shutdown_connections 2024-09-13T23:25:31.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.442+0000 7f0a22c98800 1 -- 172.21.15.99:0/1007138970 wait complete. 2024-09-13T23:25:31.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.455+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.455+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.455+0000 7f0a22c98800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.455+0000 7f0a22c98800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647d2f0d330 con 0x5647d2f355f0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f0a2078c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f0a2078c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48712/0 (socket says 172.21.15.99:48712) 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f0a2078c640 1 -- 172.21.15.99:0/3458233283 learned_addr learned my addr 172.21.15.99:0/3458233283 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f0a2078c640 1 -- 172.21.15.99:0/3458233283 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d2e5abc0 con 0x5647d2f355f0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f0a2078c640 1 --2- 172.21.15.99:0/3458233283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b240 tx=0x7f0a1000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6326efcc15f862eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f090e60c640 1 -- 172.21.15.99:0/3458233283 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10008070 con 0x5647d2f355f0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f090e60c640 1 -- 172.21.15.99:0/3458233283 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1000d500 con 0x5647d2f355f0 2024-09-13T23:25:31.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.456+0000 7f090e60c640 1 -- 172.21.15.99:0/3458233283 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1000d860 con 0x5647d2f355f0 2024-09-13T23:25:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- 172.21.15.99:0/3458233283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 msgr2=0x5647d30b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 --2- 172.21.15.99:0/3458233283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000b240 tx=0x7f0a1000b700 comp rx=0 tx=0).stop 2024-09-13T23:25:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- 172.21.15.99:0/3458233283 shutdown_connections 2024-09-13T23:25:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 --2- 172.21.15.99:0/3458233283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30b2820 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- 172.21.15.99:0/3458233283 >> 172.21.15.99:0/3458233283 conn(0x5647d2fbbde0 msgr2=0x5647d30ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- 172.21.15.99:0/3458233283 shutdown_connections 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- 172.21.15.99:0/3458233283 wait complete. 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.457+0000 7f0a22c98800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647d2fca980 con 0x5647d2f355f0 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a2078c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a2078c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48722/0 (socket says 172.21.15.99:48722) 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a2078c640 1 -- 172.21.15.99:0/2108742940 learned_addr learned my addr 172.21.15.99:0/2108742940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a2078c640 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d2e6efe0 con 0x5647d2f355f0 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a2078c640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5647d30b3680 tx=0x7f0a10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f090ce09640 1 -- 172.21.15.99:0/2108742940 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10019870 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f090ce09640 1 -- 172.21.15.99:0/2108742940 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a10019a10 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647d30ba7e0 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f090ce09640 1 -- 172.21.15.99:0/2108742940 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a10019d30 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.458+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d30bad00 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f090ce09640 1 -- 172.21.15.99:0/2108742940 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0a10017040 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f090ce09640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 0x7f0908039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f090ce09640 1 -- 172.21.15.99:0/2108742940 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0a10015020 con 0x5647d2f355f0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 0x7f0908039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 0x5647d30c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.459+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30c1850 con 0x5647d2fc7db0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 0x5647d30c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 0x7f0908039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a08057000 tx=0x7f0a08052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 0x5647d30c1310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a20f8d640 1 -- 172.21.15.99:0/2108742940 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a1800a4a0 con 0x5647d2fc7db0 2024-09-13T23:25:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30be8c0 con 0x5647d2fc7db0 2024-09-13T23:25:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a20f8d640 1 -- 172.21.15.99:0/2108742940 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x5647d2fc7db0 2024-09-13T23:25:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.460+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 0x5647d30c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30c65f0 con 0x5647d30c3b60 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a2078c640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 0x5647d30c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a2078c640 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 0x5647d30c5f50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a2078c640 1 -- 172.21.15.99:0/2108742940 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a1002d070 con 0x5647d30c3b60 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30c2a00 con 0x5647d2fc7db0 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a20f8d640 1 -- 172.21.15.99:0/2108742940 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a1800a4a0 con 0x5647d2fc7db0 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.461+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30c2ee0 con 0x5647d30c3b60 2024-09-13T23:25:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.462+0000 7f0a2078c640 1 -- 172.21.15.99:0/2108742940 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a1002d070 con 0x5647d30c3b60 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.462+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.462+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.462+0000 7f0a22c98800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.462+0000 7f0a22c98800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647d2e5c580 con 0x5647d30d4f80 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48738/0 (socket says 172.21.15.99:48738) 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a20f8d640 1 -- 172.21.15.99:0/2204879694 learned_addr learned my addr 172.21.15.99:0/2204879694 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a20f8d640 1 -- 172.21.15.99:0/2204879694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d30d58e0 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5647d30bb350 tx=0x7f0a180167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0905ffb640 1 -- 172.21.15.99:0/2204879694 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18013640 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0905ffb640 1 -- 172.21.15.99:0/2204879694 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a180137e0 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647d30d5b70 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0905ffb640 1 -- 172.21.15.99:0/2204879694 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18013ae0 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.463+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d30d8850 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0905ffb640 1 -- 172.21.15.99:0/2204879694 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0a18011040 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0905ffb640 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 0x7f08f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0905ffb640 1 -- 172.21.15.99:0/2204879694 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0a1800e040 con 0x5647d30d4f80 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0a2078c640 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 0x7f08f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0a2078c640 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 0x7f08f8039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5647d30be800 tx=0x7f0a1001b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.464+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a22c98800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a22c98800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647d30b2fd0 con 0x5647d30e1c10 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48744/0 (socket says 172.21.15.99:48744) 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a20f8d640 1 -- 172.21.15.99:0/541330041 learned_addr learned my addr 172.21.15.99:0/541330041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a20f8d640 1 -- 172.21.15.99:0/541330041 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d30e25e0 con 0x5647d30e1c10 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/541330041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800afb0 tx=0x7f0a1801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd513d214beddbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f08ff7fe640 1 -- 172.21.15.99:0/541330041 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18021570 con 0x5647d30e1c10 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f08ff7fe640 1 -- 172.21.15.99:0/541330041 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a1801f340 con 0x5647d30e1c10 2024-09-13T23:25:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.465+0000 7f08ff7fe640 1 -- 172.21.15.99:0/541330041 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18014cc0 con 0x5647d30e1c10 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- 172.21.15.99:0/541330041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 msgr2=0x5647d30e2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 --2- 172.21.15.99:0/541330041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800afb0 tx=0x7f0a1801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- 172.21.15.99:0/541330041 shutdown_connections 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 --2- 172.21.15.99:0/541330041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e2010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- 172.21.15.99:0/541330041 >> 172.21.15.99:0/541330041 conn(0x5647d30ddfc0 msgr2=0x5647d30dc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- 172.21.15.99:0/541330041 shutdown_connections 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- 172.21.15.99:0/541330041 wait complete. 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 Processor -- start 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- start start 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a22c98800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647d30e2bb0 con 0x5647d30e1c10 2024-09-13T23:25:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a20f8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48750/0 (socket says 172.21.15.99:48750) 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.466+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 learned_addr learned my addr 172.21.15.99:0/998968682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d30e9590 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e9050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a18048010 tx=0x7f0a1804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f08fdffb640 1 -- 172.21.15.99:0/998968682 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18013e60 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f08fdffb640 1 -- 172.21.15.99:0/998968682 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a18040360 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647d30e9820 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f08fdffb640 1 -- 172.21.15.99:0/998968682 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a1804e2b0 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.467+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d30ec4d0 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.468+0000 7f08fdffb640 1 -- 172.21.15.99:0/998968682 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0a1804e470 con 0x5647d30e1c10 2024-09-13T23:25:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.468+0000 7f08fdffb640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f0036b90 0x7f08f0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.468+0000 7f08fdffb640 1 -- 172.21.15.99:0/998968682 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0a18007050 con 0x5647d30e1c10 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.468+0000 7f0a2078c640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f0036b90 0x7f08f0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.468+0000 7f0a2078c640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f0036b90 0x7f08f0039050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a1003ffd0 tx=0x7f0a10031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d30f4970 0x5647d30f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30f7580 con 0x5647d30f4970 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d30f4970 0x5647d30f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d30f4970 0x5647d30f6e30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 20 realm 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.469+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30f79b0 con 0x5647d30f4970 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30f8280 con 0x5647d30f4970 2024-09-13T23:25:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30f8620 con 0x5647d30f4970 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30f9380 0x5647d30fb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30fbd80 con 0x5647d30f9380 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.470+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30f9380 0x5647d30fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30f9380 0x5647d30fb770 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a22c98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a22c98800 20 searching for the correct realm 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647d30fdd10 0x5647d31001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a2078c640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647d30fdd10 0x5647d31001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a2078c640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647d30fdd10 0x5647d31001d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.471+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.472+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.472+0000 7f0a20f8d640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0a18044070 0x7f0a180205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.472+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.472+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0a18044070 0x7f0a180205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.472+0000 7f0a17f8b640 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0a18044070 0x7f0a180205b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.473+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v24'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.474+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.475+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.476+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.477+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.478+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30fdd10 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x7f0a18044070 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f4970 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.479+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647d31008a0 con 0x5647d30f9380 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:31.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30fd260 con 0x5647d30f4970 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d30fcad0 con 0x5647d30f4970 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d3100d20 con 0x5647d30f9380 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 zone default found 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 4 Realm: () 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 zonegroup default 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.480+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d3101150 con 0x7f0a18044070 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d3103420 con 0x5647d30fdd10 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d31037c0 con 0x5647d30fdd10 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 started sync module instance, tier type = 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.481+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31028b0 con 0x5647d30f9380 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.482+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.482+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94866483719376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104010 con 0x5647d30f9380 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.482+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104860 con 0x5647d30f4970 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.483+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94866483719376] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.484+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.484+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94866483723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104c00 con 0x5647d30f4970 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.484+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3105450 con 0x5647d30fdd10 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.485+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.485+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94866483727872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3105ca0 con 0x5647d30fdd10 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.485+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3106750 con 0x5647d30f9380 2024-09-13T23:25:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.485+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94866483723104] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.487+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94866483727872] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.487+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.487+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94866483730416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3106230 con 0x5647d30f9380 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.487+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3107160 con 0x5647d30f4970 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.490+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.490+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94866483735728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3107580 con 0x5647d30f4970 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.490+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3107fc0 con 0x7f0a18044070 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.490+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94866483730416] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.491+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94866483735728] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.493+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.493+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94866483739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31070d0 con 0x7f0a18044070 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.493+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3108860 con 0x7f0a18044070 2024-09-13T23:25:31.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.495+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.495+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94866483741616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31070d0 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.495+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3109360 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v31'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94866483739280] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94866483744336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3109320 con 0x7f0a18044070 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=0 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=1 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=2 2024-09-13T23:25:31.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=3 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=4 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.498+0000 7f0a22c98800 20 add_watcher() i=5 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94866483741616] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a22c98800 20 add_watcher() i=6 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94866483744336] v31'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a22c98800 20 add_watcher() i=7 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a22c98800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.499+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d31087d0 con 0x5647d30f4970 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.500+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.500+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94866483724160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31087d0 con 0x5647d30f4970 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.501+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94866483724160] v31'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.501+0000 7f08d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.501+0000 7f0a22c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.501+0000 7f0a22c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.501+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3114d10 con 0x5647d30f4970 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.502+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.502+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31153e0 con 0x7f0a18044070 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.503+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.503+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3115800 con 0x5647d30fdd10 2024-09-13T23:25:31.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.504+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.504+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116110 con 0x5647d30f4970 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.506+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.506+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110bb0 con 0x5647d30f9380 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.509+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.509+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110bb0 con 0x5647d30fdd10 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.510+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.510+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110b50 con 0x5647d30f4970 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.511+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.511+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110c50 con 0x7f0a18044070 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.512+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.512+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110ce0 con 0x5647d30f9380 2024-09-13T23:25:31.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.513+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.513+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3110ce0 con 0x5647d30fdd10 2024-09-13T23:25:31.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.514+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.514+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f9380 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.518+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'30 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.518+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x7f0a18044070 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.519+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.519+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f9380 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.520+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.520+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x7f0a18044070 2024-09-13T23:25:31.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.523+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.524+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f4970 2024-09-13T23:25:31.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.524+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'43 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.525+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30fdd10 2024-09-13T23:25:31.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.527+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.527+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f9380 2024-09-13T23:25:31.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.530+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.530+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30fdd10 2024-09-13T23:25:31.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.533+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.533+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f4970 2024-09-13T23:25:31.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.534+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.534+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f4970 2024-09-13T23:25:31.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.535+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.535+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30fdd10 2024-09-13T23:25:31.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.536+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.536+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3116c50 con 0x5647d30f9380 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.537+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.537+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.538+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.538+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.539+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.539+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.540+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.540+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.541+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.541+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x7f0a18044070 2024-09-13T23:25:31.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.542+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.542+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.543+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.543+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x7f0a18044070 2024-09-13T23:25:31.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.544+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.544+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30fdd10 2024-09-13T23:25:31.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.545+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.545+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x7f0a18044070 2024-09-13T23:25:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.546+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.546+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3117260 con 0x5647d30f9380 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.547+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.547+0000 7f08d57e2640 20 reqs_thread_entry: start 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 20 Filter name: none 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0846ffd640 20 reqs_thread_entry: start 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647d3141b30 con 0x5647d30f4970 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.548+0000 7f0a22c98800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.549+0000 7f08d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.549+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94866483724160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d31160f0 con 0x5647d30f4970 2024-09-13T23:25:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.550+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94866483724160] v31'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.550+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94866483719376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3103f80 con 0x5647d30f9380 2024-09-13T23:25:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.551+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94866483719376] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.551+0000 7f0a22c98800 20 remove_watcher() i=0 2024-09-13T23:25:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.551+0000 7f0a22c98800 2 removed watcher, disabling cache 2024-09-13T23:25:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.551+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94866483723104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3103f80 con 0x5647d30f4970 2024-09-13T23:25:31.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.552+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94866483723104] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.552+0000 7f0a22c98800 20 remove_watcher() i=1 2024-09-13T23:25:31.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.552+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94866483727872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3102cd0 con 0x5647d30fdd10 2024-09-13T23:25:31.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.553+0000 7f0a2078c640 1 -- 172.21.15.99:0/998968682 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94866483727872] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a10044d70 con 0x5647d30fdd10 2024-09-13T23:25:31.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.553+0000 7f0a22c98800 20 remove_watcher() i=2 2024-09-13T23:25:31.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.553+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94866483730416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104e00 con 0x5647d30f9380 2024-09-13T23:25:31.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.554+0000 7f0a20f8d640 1 -- 172.21.15.99:0/998968682 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94866483730416] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a18055070 con 0x5647d30f9380 2024-09-13T23:25:31.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.554+0000 7f0a22c98800 20 remove_watcher() i=3 2024-09-13T23:25:31.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.554+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94866483735728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104e00 con 0x5647d30f4970 2024-09-13T23:25:31.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.555+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94866483735728] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x5647d30f4970 2024-09-13T23:25:31.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.555+0000 7f0a22c98800 20 remove_watcher() i=4 2024-09-13T23:25:31.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.555+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94866483739280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3106cb0 con 0x7f0a18044070 2024-09-13T23:25:31.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.556+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94866483739280] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.556+0000 7f0a22c98800 20 remove_watcher() i=5 2024-09-13T23:25:31.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.556+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94866483741616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3104e00 con 0x7f0a18044070 2024-09-13T23:25:31.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.557+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94866483741616] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.557+0000 7f0a22c98800 20 remove_watcher() i=6 2024-09-13T23:25:31.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.557+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94866483744336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647d3107a90 con 0x7f0a18044070 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94866483744336] v31'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a08057030 con 0x7f0a18044070 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 20 remove_watcher() i=7 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0a18044070 msgr2=0x7f0a180205b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0a18044070 0x7f0a180205b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d30f4970 msgr2=0x5647d30f6e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d30f4970 0x5647d30f6e30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30f9380 msgr2=0x5647d30fb770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30f9380 0x5647d30fb770 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647d30fdd10 msgr2=0x5647d31001d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647d30fdd10 0x5647d31001d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f0036b90 msgr2=0x7f08f0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f0036b90 0x7f08f0039050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0a1003ffd0 tx=0x7f0a10031000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 msgr2=0x5647d30e9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 --2- 172.21.15.99:0/998968682 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30e1c10 0x5647d30e9050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0a18048010 tx=0x7f0a1804cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 reap_dead start 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a17f8b640 1 -- 172.21.15.99:0/998968682 reap_dead start 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 shutdown_connections 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 >> 172.21.15.99:0/998968682 conn(0x5647d30ddfc0 msgr2=0x5647d30e3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.558+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 shutdown_connections 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/998968682 wait complete. 2024-09-13T23:25:31.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 msgr2=0x7f08f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 0x7f08f8039050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5647d30be800 tx=0x7f0a1001b540 comp rx=0 tx=0).stop 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 msgr2=0x5647d30d53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5647d30bb350 tx=0x7f0a180167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 shutdown_connections 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f08f8036b90 0x7f08f8039050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2204879694 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d30d4f80 0x5647d30d53a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 >> 172.21.15.99:0/2204879694 conn(0x5647d30c9f10 msgr2=0x5647d30cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 shutdown_connections 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2204879694 wait complete. 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 msgr2=0x5647d30c1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 0x5647d30c1310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 msgr2=0x5647d30c5f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 0x5647d30c5f50 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 msgr2=0x7f0908039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 0x7f0908039000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a08057000 tx=0x7f0a08052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 msgr2=0x5647d30ba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5647d30b3680 tx=0x7f0a10000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 shutdown_connections 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647d30c3b60 0x5647d30c5f50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647d2fc7db0 0x5647d30c1310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0908036b40 0x7f0908039000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 --2- 172.21.15.99:0/2108742940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647d2f355f0 0x5647d30ba2a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 >> 172.21.15.99:0/2108742940 conn(0x5647d2fbbde0 msgr2=0x5647d30aca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 shutdown_connections 2024-09-13T23:25:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.559+0000 7f0a22c98800 1 -- 172.21.15.99:0/2108742940 wait complete. 2024-09-13T23:25:31.568 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T23:25:31.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:25:31.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:25:31.569 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:25:31.655 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.655 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f8f3e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a95346ca20 0x55a95346ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f8f3e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a953328b30 con 0x55a9534685e0 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f8f3e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a95330a360 con 0x55a95346ca20 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31effff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a95346ca20 0x55a95346ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31effff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a95346ca20 0x55a95346ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48754/0 (socket says 172.21.15.99:48754) 2024-09-13T23:25:31.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31effff640 1 -- 172.21.15.99:0/1929513238 learned_addr learned my addr 172.21.15.99:0/1929513238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31f4c3b640 1 --1- 172.21.15.99:0/1929513238 >> v1:172.21.15.43:6789/0 conn(0x55a9534685e0 0x55a9534689e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43812/0 (socket says 172.21.15.99:43812) 2024-09-13T23:25:31.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31effff640 1 -- 172.21.15.99:0/1929513238 >> v1:172.21.15.43:6789/0 conn(0x55a9534685e0 legacy=0x55a9534689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.655+0000 7f31ef7fe640 1 -- 172.21.15.99:0/1929513238 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838659749 0 0) 0x55a953328b30 con 0x55a9534685e0 2024-09-13T23:25:31.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.656+0000 7f31effff640 1 -- 172.21.15.99:0/1929513238 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953330e00 con 0x55a95346ca20 2024-09-13T23:25:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.657+0000 7f31effff640 1 --2- 172.21.15.99:0/1929513238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95346ca20 0x55a95346ee10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31e000a520 tx=0x7f31e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bd68a3834da5a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.657+0000 7f31ef7fe640 1 -- 172.21.15.99:0/1929513238 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e0055070 con 0x55a95346ca20 2024-09-13T23:25:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.657+0000 7f31ef7fe640 1 -- 172.21.15.99:0/1929513238 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e00515b0 con 0x55a95346ca20 2024-09-13T23:25:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.657+0000 7f31ef7fe640 1 -- 172.21.15.99:0/1929513238 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e00518d0 con 0x55a95346ca20 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1929513238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95346ca20 msgr2=0x55a95346ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1929513238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95346ca20 0x55a95346ee10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f31e000a520 tx=0x7f31e0045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1929513238 shutdown_connections 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1929513238 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95346ca20 0x55a95346ee10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1929513238 >> 172.21.15.99:0/1929513238 conn(0x55a953463e90 msgr2=0x55a9534662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1929513238 shutdown_connections 2024-09-13T23:25:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.658+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1929513238 wait complete. 2024-09-13T23:25:31.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.671+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.671+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f8f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f8f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a9533b5350 con 0x55a9534685e0 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48756/0 (socket says 172.21.15.99:48756) 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3364920660 learned_addr learned my addr 172.21.15.99:0/3364920660 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3364920660 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953302bc0 con 0x55a9534685e0 2024-09-13T23:25:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.672+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3364920660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31e800b240 tx=0x7f31e800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d38c2c27e2c5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f30e2e05640 1 -- 172.21.15.99:0/3364920660 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8008070 con 0x55a9534685e0 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f30e2e05640 1 -- 172.21.15.99:0/3364920660 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e800d500 con 0x55a9534685e0 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f30e2e05640 1 -- 172.21.15.99:0/3364920660 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e800d860 con 0x55a9534685e0 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3364920660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 msgr2=0x55a9533dd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3364920660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f31e800b240 tx=0x7f31e800b700 comp rx=0 tx=0).stop 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3364920660 shutdown_connections 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3364920660 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a9533dd6b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3364920660 >> 172.21.15.99:0/3364920660 conn(0x55a953463e90 msgr2=0x55a953553020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3364920660 shutdown_connections 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.673+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3364920660 wait complete. 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f8f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f8f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a95346f650 con 0x55a9534685e0 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48768/0 (socket says 172.21.15.99:48768) 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3309339806 learned_addr learned my addr 172.21.15.99:0/3309339806 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953316fe0 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.674+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55a9533dcdb0 tx=0x7f31e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f30e1602640 1 -- 172.21.15.99:0/3309339806 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8019870 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f30e1602640 1 -- 172.21.15.99:0/3309339806 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e8019a10 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f30e1602640 1 -- 172.21.15.99:0/3309339806 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e8019d30 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9535592b0 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953557800 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f8f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a953304580 con 0x55a95356f0f0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f30e1602640 1 -- 172.21.15.99:0/3309339806 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31e8017040 con 0x55a9534685e0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.675+0000 7f31f543c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f543c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48774/0 (socket says 172.21.15.99:48774) 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f543c640 1 -- 172.21.15.99:0/2359360381 learned_addr learned my addr 172.21.15.99:0/2359360381 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f30e1602640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 0x7f30dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f30e1602640 1 -- 172.21.15.99:0/3309339806 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f31e8015020 con 0x55a9534685e0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 0x7f30dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f543c640 1 -- 172.21.15.99:0/2359360381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a95356fa30 con 0x55a95356f0f0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f543c640 1 --2- 172.21.15.99:0/2359360381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f31f000a430 tx=0x7f31f000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582586c92ed373c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 0x7f30dc039050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e8b0 tx=0x7f31e800e740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f30daffd640 1 -- 172.21.15.99:0/2359360381 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f0015070 con 0x55a95356f0f0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f30daffd640 1 -- 172.21.15.99:0/2359360381 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f0001670 con 0x55a95356f0f0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.676+0000 7f30daffd640 1 -- 172.21.15.99:0/2359360381 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f0001990 con 0x55a95356f0f0 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- 172.21.15.99:0/2359360381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 msgr2=0x55a95356f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/2359360381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f31f000a430 tx=0x7f31f000a8f0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- 172.21.15.99:0/2359360381 shutdown_connections 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/2359360381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a95356f4f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- 172.21.15.99:0/2359360381 >> 172.21.15.99:0/2359360381 conn(0x55a95346ca20 msgr2=0x55a95356a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- 172.21.15.99:0/2359360381 shutdown_connections 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- 172.21.15.99:0/2359360381 wait complete. 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f8f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a9535703e0 con 0x55a95356f0f0 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f543c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f543c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48786/0 (socket says 172.21.15.99:48786) 2024-09-13T23:25:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f543c640 1 -- 172.21.15.99:0/3324396624 learned_addr learned my addr 172.21.15.99:0/3324396624 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.677+0000 7f31f543c640 1 -- 172.21.15.99:0/3324396624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a953576c20 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f31f543c640 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31f000a930 tx=0x7f31f0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f30d97fa640 1 -- 172.21.15.99:0/3324396624 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f0020020 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f30d97fa640 1 -- 172.21.15.99:0/3324396624 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f00108b0 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f30d97fa640 1 -- 172.21.15.99:0/3324396624 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31f0015040 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a953576eb0 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.678+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953579b60 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f30d97fa640 1 -- 172.21.15.99:0/3324396624 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31f0023020 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f30d97fa640 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 0x7f30cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f30d97fa640 1 -- 172.21.15.99:0/3324396624 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f31f004c080 con 0x55a95356f0f0 2024-09-13T23:25:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f31effff640 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 0x7f30cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f31f8f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f31f8f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f31effff640 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 0x7f30cc039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31e0057000 tx=0x7f31e0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.679+0000 7f31f8f3e800 1 Processor -- start 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f8f3e800 1 -- start start 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f8f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f8f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a95355b640 con 0x55a953590700 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f4c3b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48788/0 (socket says 172.21.15.99:48788) 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f4c3b640 1 -- 172.21.15.99:0/1868186633 learned_addr learned my addr 172.21.15.99:0/1868186633 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f4c3b640 1 -- 172.21.15.99:0/1868186633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9535910f0 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31e801aaa0 tx=0x7f31e800e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.680+0000 7f30b97e2640 1 -- 172.21.15.99:0/1868186633 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e801a3c0 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f30b97e2640 1 -- 172.21.15.99:0/1868186633 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e804bc40 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a953593d40 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f30b97e2640 1 -- 172.21.15.99:0/1868186633 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31e801c610 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a953594120 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f30b97e2640 1 -- 172.21.15.99:0/1868186633 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f31e804b120 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f30b97e2640 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 0x7f302c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.681+0000 7f30b97e2640 1 -- 172.21.15.99:0/1868186633 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f31e8037070 con 0x55a953590700 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31effff640 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 0x7f302c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f3042ffd640 20 reqs_thread_entry: start 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31effff640 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 0x7f302c039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31e0045be0 tx=0x7f31e0005ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 0x55a9535a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a9535a0e40 con 0x55a95359e2b0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31f543c640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 0x55a9535a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.682+0000 7f31f543c640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 0x55a9535a0770 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f543c640 1 -- 172.21.15.99:0/3309339806 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f31f0010d70 con 0x55a95359e2b0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 0x55a9535a5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:2 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a9535a5650 con 0x55a9535a2c10 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 0x55a9535a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f4c3b640 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 0x55a9535a5000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3309339806 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(2 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f31e802d070 con 0x55a9535a2c10 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.683+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a9535a2110 con 0x55a9535a2c10 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f4c3b640 1 -- 172.21.15.99:0/3309339806 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [stat,call,call,writefull 0~993] v31'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f31e802d070 con 0x55a9535a2c10 2024-09-13T23:25:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 msgr2=0x7f30cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 0x7f30cc039050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f31e0057000 tx=0x7f31e0052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 msgr2=0x55a9535766e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f31f000a930 tx=0x7f31f0003370 comp rx=0 tx=0).stop 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 shutdown_connections 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30cc036b90 0x7f30cc039050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3324396624 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a95356f0f0 0x55a9535766e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.685+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 >> 172.21.15.99:0/3324396624 conn(0x55a95346ca20 msgr2=0x55a95356a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 shutdown_connections 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3324396624 wait complete. 2024-09-13T23:25:31.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 msgr2=0x7f302c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 0x7f302c039050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f31e0045be0 tx=0x7f31e0005ac0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 msgr2=0x55a953590b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f31e801aaa0 tx=0x7f31e800e690 comp rx=0 tx=0).stop 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 shutdown_connections 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f302c036b90 0x7f302c039050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/1868186633 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a953590700 0x55a953590b20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 >> 172.21.15.99:0/1868186633 conn(0x55a9535855e0 msgr2=0x55a953587f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 shutdown_connections 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/1868186633 wait complete. 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 msgr2=0x55a9535a0770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 0x55a9535a0770 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 msgr2=0x55a9535a5000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 0x55a9535a5000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 msgr2=0x7f30dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 0x7f30dc039050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e8b0 tx=0x7f31e800e740 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 msgr2=0x55a953558d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55a9533dcdb0 tx=0x7f31e8000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 shutdown_connections 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a9535a2c10 0x55a9535a5000 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a95359e2b0 0x55a9535a0770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f30dc036b90 0x7f30dc039050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 --2- 172.21.15.99:0/3309339806 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a9534685e0 0x55a953558d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 >> 172.21.15.99:0/3309339806 conn(0x55a953463e90 msgr2=0x55a953551990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 shutdown_connections 2024-09-13T23:25:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.686+0000 7f31f8f3e800 1 -- 172.21.15.99:0/3309339806 wait complete. 2024-09-13T23:25:31.697 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:25:31.698 DEBUG:tasks.util.rgw: json result: {'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:25:31.699 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:25:31.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:25:31.699 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:25:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff57640e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55abe44fad80 0x55abe44fd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff57640e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55abe43b3b30 con 0x55abe4468600 2024-09-13T23:25:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff57640e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55abe4395360 con 0x55abe44fad80 2024-09-13T23:25:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571319640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55abe44fad80 0x55abe44fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571319640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55abe44fad80 0x55abe44fd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48800/0 (socket says 172.21.15.99:48800) 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571b1a640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55abe4468600 0x55abe44f9660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43828/0 (socket says 172.21.15.99:43828) 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571319640 1 -- 172.21.15.99:0/2394555562 learned_addr learned my addr 172.21.15.99:0/2394555562 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff570b18640 1 -- 172.21.15.99:0/2394555562 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3677953702 0 0) 0x55abe43b3b30 con 0x55abe4468600 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff570b18640 1 -- 172.21.15.99:0/2394555562 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff55c001e10 con 0x55abe4468600 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571319640 1 -- 172.21.15.99:0/2394555562 >> v1:172.21.15.43:6789/0 conn(0x55abe4468600 legacy=0x55abe44f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.741+0000 7ff571319640 1 -- 172.21.15.99:0/2394555562 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe43bbe00 con 0x55abe44fad80 2024-09-13T23:25:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.743+0000 7ff571319640 1 --2- 172.21.15.99:0/2394555562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe44fad80 0x55abe44fd170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff56800a520 tx=0x7ff568045aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0814865cd98008 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.743+0000 7ff570b18640 1 -- 172.21.15.99:0/2394555562 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff568056020 con 0x55abe44fad80 2024-09-13T23:25:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.743+0000 7ff570b18640 1 -- 172.21.15.99:0/2394555562 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff568052550 con 0x55abe44fad80 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.743+0000 7ff570b18640 1 -- 172.21.15.99:0/2394555562 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff568052870 con 0x55abe44fad80 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 -- 172.21.15.99:0/2394555562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe44fad80 msgr2=0x55abe44fd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 --2- 172.21.15.99:0/2394555562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe44fad80 0x55abe44fd170 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff56800a520 tx=0x7ff568045aa0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 -- 172.21.15.99:0/2394555562 shutdown_connections 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 --2- 172.21.15.99:0/2394555562 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe44fad80 0x55abe44fd170 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 -- 172.21.15.99:0/2394555562 >> 172.21.15.99:0/2394555562 conn(0x55abe44eedd0 msgr2=0x55abe44f11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 -- 172.21.15.99:0/2394555562 shutdown_connections 2024-09-13T23:25:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.744+0000 7ff57640e800 1 -- 172.21.15.99:0/2394555562 wait complete. 2024-09-13T23:25:31.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff57640e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff57640e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe4440320 con 0x55abe4468600 2024-09-13T23:25:31.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff571b1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff571b1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48802/0 (socket says 172.21.15.99:48802) 2024-09-13T23:25:31.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.758+0000 7ff571b1a640 1 -- 172.21.15.99:0/191643214 learned_addr learned my addr 172.21.15.99:0/191643214 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.759+0000 7ff571b1a640 1 -- 172.21.15.99:0/191643214 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe438dbc0 con 0x55abe4468600 2024-09-13T23:25:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.759+0000 7ff571b1a640 1 --2- 172.21.15.99:0/191643214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff564001680 tx=0x7ff564001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be675f086f85a274 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.759+0000 7ff45fe07640 1 -- 172.21.15.99:0/191643214 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff564003450 con 0x55abe4468600 2024-09-13T23:25:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.759+0000 7ff45fe07640 1 -- 172.21.15.99:0/191643214 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5640035f0 con 0x55abe4468600 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.759+0000 7ff45fe07640 1 -- 172.21.15.99:0/191643214 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff564003950 con 0x55abe4468600 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- 172.21.15.99:0/191643214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 msgr2=0x55abe45e5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 --2- 172.21.15.99:0/191643214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff564001680 tx=0x7ff564001b40 comp rx=0 tx=0).stop 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- 172.21.15.99:0/191643214 shutdown_connections 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 --2- 172.21.15.99:0/191643214 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45e5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- 172.21.15.99:0/191643214 >> 172.21.15.99:0/191643214 conn(0x55abe44eedd0 msgr2=0x55abe45e1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- 172.21.15.99:0/191643214 shutdown_connections 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- 172.21.15.99:0/191643214 wait complete. 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff57640e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe44fd980 con 0x55abe4468600 2024-09-13T23:25:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff571b1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff571b1a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48812/0 (socket says 172.21.15.99:48812) 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.760+0000 7ff571b1a640 1 -- 172.21.15.99:0/200290308 learned_addr learned my addr 172.21.15.99:0/200290308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff571b1a640 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe43a1fe0 con 0x55abe4468600 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff571b1a640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff564002250 tx=0x7ff564001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff45e604640 1 -- 172.21.15.99:0/200290308 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff564022020 con 0x55abe4468600 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff45e604640 1 -- 172.21.15.99:0/200290308 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56401e790 con 0x55abe4468600 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abe45ed740 con 0x55abe4468600 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff45e604640 1 -- 172.21.15.99:0/200290308 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56401eab0 con 0x55abe4468600 2024-09-13T23:25:31.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.761+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe45edcc0 con 0x55abe4468600 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff45e604640 1 -- 172.21.15.99:0/200290308 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff564025020 con 0x55abe4468600 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff45e604640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 0x7ff458039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff45e604640 1 -- 172.21.15.99:0/200290308 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff56404ca30 con 0x55abe4468600 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff571319640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 0x7ff458039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 0x55abe45f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe45f4840 con 0x55abe44fad80 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff57231b640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 0x55abe45f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff571319640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 0x7ff458039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff568057000 tx=0x7ff568052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.762+0000 7ff57231b640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 0x55abe45f41d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff57231b640 1 -- 172.21.15.99:0/200290308 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff56c0083e0 con 0x55abe44fad80 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe45f1820 con 0x55abe44fad80 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff57231b640 1 -- 172.21.15.99:0/200290308 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff56c0083e0 con 0x55abe44fad80 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 0x55abe45f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe45f9630 con 0x55abe45f6b50 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff571b1a640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 0x55abe45f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.763+0000 7ff571b1a640 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 0x55abe45f8f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.764+0000 7ff571b1a640 1 -- 172.21.15.99:0/200290308 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff56400f070 con 0x55abe45f6b50 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.764+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe45f59f0 con 0x55abe44fad80 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.764+0000 7ff57231b640 1 -- 172.21.15.99:0/200290308 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff56c0083e0 con 0x55abe44fad80 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.764+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe45f5e90 con 0x55abe45f6b50 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.764+0000 7ff571b1a640 1 -- 172.21.15.99:0/200290308 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff56400f070 con 0x55abe45f6b50 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57640e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57640e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe438f580 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48822/0 (socket says 172.21.15.99:48822) 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57231b640 1 -- 172.21.15.99:0/376347614 learned_addr learned my addr 172.21.15.99:0/376347614 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.765+0000 7ff57231b640 1 -- 172.21.15.99:0/376347614 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe46088f0 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff57231b640 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55abe45ee420 tx=0x7ff56c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff4577fe640 1 -- 172.21.15.99:0/376347614 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c01c020 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff4577fe640 1 -- 172.21.15.99:0/376347614 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c007cf0 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abe4608b80 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff4577fe640 1 -- 172.21.15.99:0/376347614 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c018440 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe460b860 con 0x55abe4607f90 2024-09-13T23:25:31.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.766+0000 7ff4577fe640 1 -- 172.21.15.99:0/376347614 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff56c01f020 con 0x55abe4607f90 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff4577fe640 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 0x7ff44c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff4577fe640 1 -- 172.21.15.99:0/376347614 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff56c04e110 con 0x55abe4607f90 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff571b1a640 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 0x7ff44c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff571b1a640 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 0x7ff44c039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55abe45f5100 tx=0x7ff564010f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57640e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57640e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe45e5fc0 con 0x55abe4614c30 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48838/0 (socket says 172.21.15.99:48838) 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.767+0000 7ff57231b640 1 -- 172.21.15.99:0/3340040351 learned_addr learned my addr 172.21.15.99:0/3340040351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57231b640 1 -- 172.21.15.99:0/3340040351 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe4615600 con 0x55abe4614c30 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57231b640 1 --2- 172.21.15.99:0/3340040351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff56c04c5f0 tx=0x7ff56c016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1f5ae49696f8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff4557fa640 1 -- 172.21.15.99:0/3340040351 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c045070 con 0x55abe4614c30 2024-09-13T23:25:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff4557fa640 1 -- 172.21.15.99:0/3340040351 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c021400 con 0x55abe4614c30 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff4557fa640 1 -- 172.21.15.99:0/3340040351 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c018b40 con 0x55abe4614c30 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 -- 172.21.15.99:0/3340040351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 msgr2=0x55abe4615030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 --2- 172.21.15.99:0/3340040351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff56c04c5f0 tx=0x7ff56c016640 comp rx=0 tx=0).stop 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 -- 172.21.15.99:0/3340040351 shutdown_connections 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 --2- 172.21.15.99:0/3340040351 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe4615030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 -- 172.21.15.99:0/3340040351 >> 172.21.15.99:0/3340040351 conn(0x55abe4610fe0 msgr2=0x55abe460f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 -- 172.21.15.99:0/3340040351 shutdown_connections 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.768+0000 7ff57640e800 1 -- 172.21.15.99:0/3340040351 wait complete. 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57640e800 1 Processor -- start 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57640e800 1 -- start start 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57640e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe461c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57640e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55abe4615bd0 con 0x55abe4614c30 2024-09-13T23:25:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe461c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57231b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe461c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48854/0 (socket says 172.21.15.99:48854) 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 learned_addr learned my addr 172.21.15.99:0/585252906 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abe461c6a0 con 0x55abe4614c30 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff57231b640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe461c160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff56c04b510 tx=0x7ff56c04c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.769+0000 7ff4437fe640 1 -- 172.21.15.99:0/585252906 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c045030 con 0x55abe4614c30 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.770+0000 7ff4437fe640 1 -- 172.21.15.99:0/585252906 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff56c016d60 con 0x55abe4614c30 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.770+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abe461c930 con 0x55abe4614c30 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.770+0000 7ff4437fe640 1 -- 172.21.15.99:0/585252906 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff56c03f040 con 0x55abe4614c30 2024-09-13T23:25:31.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.770+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abe461f5e0 con 0x55abe4614c30 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.770+0000 7ff4437fe640 1 -- 172.21.15.99:0/585252906 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff56c016040 con 0x55abe4614c30 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff4437fe640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff43c036b90 0x7ff43c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff4437fe640 1 -- 172.21.15.99:0/585252906 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7ff56c046070 con 0x55abe4614c30 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff571b1a640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff43c036b90 0x7ff43c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe4627ba0 0x55abe462a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462a7b0 con 0x55abe4627ba0 2024-09-13T23:25:31.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff571319640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe4627ba0 0x55abe462a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff571b1a640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff43c036b90 0x7ff43c039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff564002090 tx=0x7ff564032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.771+0000 7ff571319640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe4627ba0 0x55abe462a060 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 realm 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462abe0 con 0x55abe4627ba0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462b4b0 con 0x55abe4627ba0 2024-09-13T23:25:31.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462b850 con 0x55abe4627ba0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe462c5b0 0x55abe462e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462eee0 con 0x55abe462c5b0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.772+0000 7ff57231b640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe462c5b0 0x55abe462e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57231b640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe462c5b0 0x55abe462e9a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57640e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:31.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57640e800 20 searching for the correct realm 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55abe4630f20 0x55abe46333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff571b1a640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55abe4630f20 0x55abe46333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.773+0000 7ff571b1a640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55abe4630f20 0x55abe46333e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff57231b640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff56c04f020 0x7ff56c048070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.774+0000 7ff571319640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff56c04f020 0x7ff56c048070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff56c04f020 0x7ff56c048070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.775+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.776+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.777+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.778+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.779+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.780+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4630f20 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x7ff56c04f020 2024-09-13T23:25:31.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe4627ba0 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.781+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55abe4633ab0 con 0x55abe462c5b0 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462f920 con 0x55abe4627ba0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe462f530 con 0x55abe4627ba0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4630290 con 0x55abe462c5b0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 zone default found 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 4 Realm: () 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:31.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 zonegroup default 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.782+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46343e0 con 0x7ff56c04f020 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46361f0 con 0x55abe4630f20 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4636640 con 0x55abe4630f20 2024-09-13T23:25:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 started sync module instance, tier type = 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.783+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4635600 con 0x55abe462c5b0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.784+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.784+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196759485216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4635600 con 0x55abe462c5b0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.784+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46371c0 con 0x55abe4627ba0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.785+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196759485216] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.785+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.785+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196759489680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4635600 con 0x55abe4627ba0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.785+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4637c70 con 0x55abe4630f20 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.786+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196759489680] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.786+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.787+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196759482704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4635570 con 0x55abe4630f20 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.787+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4638b30 con 0x55abe462c5b0 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.787+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196759482704] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.787+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.788+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196759496320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4638aa0 con 0x55abe462c5b0 2024-09-13T23:25:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.788+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46399f0 con 0x55abe4627ba0 2024-09-13T23:25:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.789+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.789+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196759500096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4639e10 con 0x55abe4627ba0 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.789+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463a930 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.789+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196759496320] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.789+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196759500096] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.790+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.790+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196759503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe4639960 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.790+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463b1d0 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.791+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.791+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196759506016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463b530 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.791+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463bd80 con 0x7ff56c04f020 2024-09-13T23:25:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196759503872] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196759508272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463be00 con 0x7ff56c04f020 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=0 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=1 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=2 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=3 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=4 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=5 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196759506016] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.792+0000 7ff57640e800 20 add_watcher() i=6 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196759508272] v31'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff57640e800 20 add_watcher() i=7 2024-09-13T23:25:31.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff57640e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe463ee30 con 0x55abe4627ba0 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.793+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196759509328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe463c220 con 0x55abe4627ba0 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196759509328] v31'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff4237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff57640e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff57640e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff57640e800 5 note: GC not initialized 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.794+0000 7ff4227fc640 20 reqs_thread_entry: start 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57640e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57640e800 20 Filter name: none 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff393fff640 20 reqs_thread_entry: start 2024-09-13T23:25:31.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672410 con 0x55abe4627ba0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672410 con 0x55abe462c5b0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.795+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672410 con 0x55abe4627ba0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46723d0 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672920 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672920 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672920 con 0x55abe4627ba0 2024-09-13T23:25:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.796+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe4672920 con 0x55abe4627ba0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.797+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe462c5b0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.798+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.799+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.800+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe462c5b0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.801+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.802+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.803+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.804+0000 7ff4237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.804+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196759509328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.805+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94196759509328] v31'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.805+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196759485216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe462c5b0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.806+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94196759485216] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.806+0000 7ff57640e800 20 remove_watcher() i=0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.806+0000 7ff57640e800 2 removed watcher, disabling cache 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.806+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196759489680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.807+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94196759489680] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.807+0000 7ff57640e800 20 remove_watcher() i=1 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.807+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196759482704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4630f20 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.808+0000 7ff571b1a640 1 -- 172.21.15.99:0/585252906 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94196759482704] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff564053040 con 0x55abe4630f20 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.808+0000 7ff57640e800 20 remove_watcher() i=2 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.808+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196759496320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe462c5b0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.809+0000 7ff57231b640 1 -- 172.21.15.99:0/585252906 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94196759496320] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff56c028070 con 0x55abe462c5b0 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.809+0000 7ff57640e800 20 remove_watcher() i=3 2024-09-13T23:25:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.809+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196759500096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x55abe4627ba0 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.810+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94196759500096] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x55abe4627ba0 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.810+0000 7ff57640e800 20 remove_watcher() i=4 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.810+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196759503872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.811+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94196759503872] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.811+0000 7ff57640e800 20 remove_watcher() i=5 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.811+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196759506016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.812+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94196759506016] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.812+0000 7ff57640e800 20 remove_watcher() i=6 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.812+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196759508272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55abe46728b0 con 0x7ff56c04f020 2024-09-13T23:25:31.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94196759508272] v31'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff568050050 con 0x7ff56c04f020 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 20 remove_watcher() i=7 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff56c04f020 msgr2=0x7ff56c048070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff56c04f020 0x7ff56c048070 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe4627ba0 msgr2=0x55abe462a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe4627ba0 0x55abe462a060 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe462c5b0 msgr2=0x55abe462e9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe462c5b0 0x55abe462e9a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55abe4630f20 msgr2=0x55abe46333e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55abe4630f20 0x55abe46333e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff43c036b90 msgr2=0x7ff43c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff43c036b90 0x7ff43c039050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff564002090 tx=0x7ff564032000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 msgr2=0x55abe461c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 --2- 172.21.15.99:0/585252906 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4614c30 0x55abe461c160 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff56c04b510 tx=0x7ff56c04c580 comp rx=0 tx=0).stop 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 reap_dead start 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff571319640 1 -- 172.21.15.99:0/585252906 reap_dead start 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 shutdown_connections 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.813+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 >> 172.21.15.99:0/585252906 conn(0x55abe4610fe0 msgr2=0x55abe4616340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 shutdown_connections 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/585252906 wait complete. 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 msgr2=0x7ff44c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 0x7ff44c039050 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55abe45f5100 tx=0x7ff564010f40 comp rx=0 tx=0).stop 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 msgr2=0x55abe46083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55abe45ee420 tx=0x7ff56c00beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 shutdown_connections 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff44c036b90 0x7ff44c039050 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/376347614 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4607f90 0x55abe46083b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 >> 172.21.15.99:0/376347614 conn(0x55abe45fcf20 msgr2=0x55abe45ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 shutdown_connections 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/376347614 wait complete. 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 msgr2=0x55abe45f41d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 0x55abe45f41d0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 msgr2=0x55abe45f8f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 0x55abe45f8f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 msgr2=0x7ff458039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 0x7ff458039050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff568057000 tx=0x7ff568052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 msgr2=0x55abe45ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff564002250 tx=0x7ff564001250 comp rx=0 tx=0).stop 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 shutdown_connections 2024-09-13T23:25:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55abe45f6b50 0x55abe45f8f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55abe44fad80 0x55abe45f41d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff458036b90 0x7ff458039050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 --2- 172.21.15.99:0/200290308 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55abe4468600 0x55abe45ed200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 >> 172.21.15.99:0/200290308 conn(0x55abe44eedd0 msgr2=0x55abe45dfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 shutdown_connections 2024-09-13T23:25:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.814+0000 7ff57640e800 1 -- 172.21.15.99:0/200290308 wait complete. 2024-09-13T23:25:31.828 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[],"summary":[]} 2024-09-13T23:25:31.828 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:25:31.828 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:31.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:31.828 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.911+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.911+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faae5351800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5592bcd8f9b0 0x5592bcd91da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faae5351800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592bcc4ab30 con 0x5592bccff5f0 2024-09-13T23:25:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faae5351800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5592bcc2c360 con 0x5592bcd8f9b0 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faada644640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5592bcd8f9b0 0x5592bcd91da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faada644640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5592bcd8f9b0 0x5592bcd91da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48866/0 (socket says 172.21.15.99:48866) 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faada644640 1 -- 172.21.15.99:0/892886814 learned_addr learned my addr 172.21.15.99:0/892886814 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faae2e45640 1 --1- 172.21.15.99:0/892886814 >> v1:172.21.15.43:6789/0 conn(0x5592bccff5f0 0x5592bcd8e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43844/0 (socket says 172.21.15.99:43844) 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faada644640 1 -- 172.21.15.99:0/892886814 >> v1:172.21.15.43:6789/0 conn(0x5592bccff5f0 legacy=0x5592bcd8e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faae2644640 1 -- 172.21.15.99:0/892886814 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927387869 0 0) 0x5592bcc4ab30 con 0x5592bccff5f0 2024-09-13T23:25:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.912+0000 7faada644640 1 -- 172.21.15.99:0/892886814 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bcc52e00 con 0x5592bcd8f9b0 2024-09-13T23:25:31.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.914+0000 7faada644640 1 --2- 172.21.15.99:0/892886814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcd8f9b0 0x5592bcd91da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a520 tx=0x7faacc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485cab59d679a531 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.914+0000 7faae2644640 1 -- 172.21.15.99:0/892886814 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc055070 con 0x5592bcd8f9b0 2024-09-13T23:25:31.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.914+0000 7faae2644640 1 -- 172.21.15.99:0/892886814 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faacc0515b0 con 0x5592bcd8f9b0 2024-09-13T23:25:31.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.914+0000 7faae2644640 1 -- 172.21.15.99:0/892886814 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faacc0518d0 con 0x5592bcd8f9b0 2024-09-13T23:25:31.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 -- 172.21.15.99:0/892886814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcd8f9b0 msgr2=0x5592bcd91da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 --2- 172.21.15.99:0/892886814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcd8f9b0 0x5592bcd91da0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7faacc00a520 tx=0x7faacc045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 -- 172.21.15.99:0/892886814 shutdown_connections 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 --2- 172.21.15.99:0/892886814 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcd8f9b0 0x5592bcd91da0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 -- 172.21.15.99:0/892886814 >> 172.21.15.99:0/892886814 conn(0x5592bcd85de0 msgr2=0x5592bcd88200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 -- 172.21.15.99:0/892886814 shutdown_connections 2024-09-13T23:25:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.915+0000 7faae5351800 1 -- 172.21.15.99:0/892886814 wait complete. 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.928+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae5351800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae5351800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5592bccd7330 con 0x5592bccff5f0 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae2e45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae2e45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48870/0 (socket says 172.21.15.99:48870) 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae2e45640 1 -- 172.21.15.99:0/568988809 learned_addr learned my addr 172.21.15.99:0/568988809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae2e45640 1 -- 172.21.15.99:0/568988809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bcc24bc0 con 0x5592bccff5f0 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.929+0000 7faae2e45640 1 --2- 172.21.15.99:0/568988809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faad400b240 tx=0x7faad400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb5a902b6018026 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7fa9d0e09640 1 -- 172.21.15.99:0/568988809 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad4008070 con 0x5592bccff5f0 2024-09-13T23:25:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7fa9d0e09640 1 -- 172.21.15.99:0/568988809 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad400d500 con 0x5592bccff5f0 2024-09-13T23:25:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7fa9d0e09640 1 -- 172.21.15.99:0/568988809 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad400d860 con 0x5592bccff5f0 2024-09-13T23:25:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 -- 172.21.15.99:0/568988809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 msgr2=0x5592bce7a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 --2- 172.21.15.99:0/568988809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faad400b240 tx=0x7faad400b700 comp rx=0 tx=0).stop 2024-09-13T23:25:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 -- 172.21.15.99:0/568988809 shutdown_connections 2024-09-13T23:25:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 --2- 172.21.15.99:0/568988809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce7a680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 -- 172.21.15.99:0/568988809 >> 172.21.15.99:0/568988809 conn(0x5592bcd85de0 msgr2=0x5592bce76040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 -- 172.21.15.99:0/568988809 shutdown_connections 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.930+0000 7faae5351800 1 -- 172.21.15.99:0/568988809 wait complete. 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae5351800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae5351800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5592bcd92670 con 0x5592bccff5f0 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae2e45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae2e45640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48884/0 (socket says 172.21.15.99:48884) 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae2e45640 1 -- 172.21.15.99:0/1800885330 learned_addr learned my addr 172.21.15.99:0/1800885330 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae2e45640 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bcc38fe0 con 0x5592bccff5f0 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7faae2e45640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5592bce7b4e0 tx=0x7faad4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.931+0000 7fa9cf606640 1 -- 172.21.15.99:0/1800885330 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad4019870 con 0x5592bccff5f0 2024-09-13T23:25:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.932+0000 7fa9cf606640 1 -- 172.21.15.99:0/1800885330 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad4019a10 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.932+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bce82620 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.932+0000 7fa9cf606640 1 -- 172.21.15.99:0/1800885330 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faad4019d30 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.932+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bce82b40 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.932+0000 7fa9cf606640 1 -- 172.21.15.99:0/1800885330 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faad4017040 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7fa9cf606640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 0x7fa9c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7fa9cf606640 1 -- 172.21.15.99:0/1800885330 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faad4015020 con 0x5592bccff5f0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faada644640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 0x7fa9c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 0x5592bce89150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bce89690 con 0x5592bcd8f9b0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae3646640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 0x5592bce89150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faada644640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 0x7fa9c8039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faacc057000 tx=0x7faacc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae3646640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 0x5592bce89150 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae3646640 1 -- 172.21.15.99:0/1800885330 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faadc00a4a0 con 0x5592bcd8f9b0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.933+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bce86720 con 0x5592bcd8f9b0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.934+0000 7faae3646640 1 -- 172.21.15.99:0/1800885330 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faadc00a4a0 con 0x5592bcd8f9b0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.934+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 0x5592bce8dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.934+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bce8e480 con 0x5592bce8b9a0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.934+0000 7faae2e45640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 0x5592bce8dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.934+0000 7faae2e45640 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 0x5592bce8dd90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae2e45640 1 -- 172.21.15.99:0/1800885330 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faad402d070 con 0x5592bce8b9a0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bce8a840 con 0x5592bcd8f9b0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae3646640 1 -- 172.21.15.99:0/1800885330 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faadc00a4a0 con 0x5592bcd8f9b0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bce8ad20 con 0x5592bce8b9a0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae2e45640 1 -- 172.21.15.99:0/1800885330 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faad402d070 con 0x5592bce8b9a0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.935+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae5351800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae5351800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5592bcc26580 con 0x5592bce9ce30 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48900/0 (socket says 172.21.15.99:48900) 2024-09-13T23:25:31.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae3646640 1 -- 172.21.15.99:0/2599552236 learned_addr learned my addr 172.21.15.99:0/2599552236 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae3646640 1 -- 172.21.15.99:0/2599552236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bce9d790 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.936+0000 7faae3646640 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5592bce89a50 tx=0x7faadc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 -- 172.21.15.99:0/2599552236 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc013450 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 -- 172.21.15.99:0/2599552236 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc0135f0 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bce9da20 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 -- 172.21.15.99:0/2599552236 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc0138d0 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bcea0700 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 -- 172.21.15.99:0/2599552236 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faadc011040 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.937+0000 7fa9cce01640 1 -- 172.21.15.99:0/2599552236 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faadc00e040 con 0x5592bce9ce30 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae2e45640 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae2e45640 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 0x7fa9bc039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5592bce89f50 tx=0x7faad401b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae5351800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae5351800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5592bce7ae30 con 0x5592bcea9b50 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48906/0 (socket says 172.21.15.99:48906) 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae3646640 1 -- 172.21.15.99:0/1194777874 learned_addr learned my addr 172.21.15.99:0/1194777874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.938+0000 7faae3646640 1 -- 172.21.15.99:0/1194777874 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bceaa520 con 0x5592bcea9b50 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae3646640 1 --2- 172.21.15.99:0/1194777874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faadc04cd90 tx=0x7faadc04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4909e3432c284be2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7fa9c67fc640 1 -- 172.21.15.99:0/1194777874 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc04a070 con 0x5592bcea9b50 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7fa9c67fc640 1 -- 172.21.15.99:0/1194777874 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc02a570 con 0x5592bcea9b50 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7fa9c67fc640 1 -- 172.21.15.99:0/1194777874 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc01f4c0 con 0x5592bcea9b50 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 -- 172.21.15.99:0/1194777874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 msgr2=0x5592bcea9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 --2- 172.21.15.99:0/1194777874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7faadc04cd90 tx=0x7faadc04cf90 comp rx=0 tx=0).stop 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 -- 172.21.15.99:0/1194777874 shutdown_connections 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 --2- 172.21.15.99:0/1194777874 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bcea9f50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 -- 172.21.15.99:0/1194777874 >> 172.21.15.99:0/1194777874 conn(0x5592bcea5f00 msgr2=0x5592bcea4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 -- 172.21.15.99:0/1194777874 shutdown_connections 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 -- 172.21.15.99:0/1194777874 wait complete. 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.939+0000 7faae5351800 1 Processor -- start 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae5351800 1 -- start start 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae5351800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bceb1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae5351800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5592bceaaaf0 con 0x5592bcea9b50 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bceb1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae3646640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bceb1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48920/0 (socket says 172.21.15.99:48920) 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 learned_addr learned my addr 172.21.15.99:0/4035580458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592bceb15c0 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae3646640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bceb1080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faadc02a040 tx=0x7faadc04cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7fa9c4ff9640 1 -- 172.21.15.99:0/4035580458 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc01f710 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7fa9c4ff9640 1 -- 172.21.15.99:0/4035580458 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc039070 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7fa9c4ff9640 1 -- 172.21.15.99:0/4035580458 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faadc01f9e0 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592bceb1850 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.940+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592bceb1850 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.941+0000 7fa9c4ff9640 1 -- 172.21.15.99:0/4035580458 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7faadc013a70 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.941+0000 7fa9c4ff9640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9ac036b40 0x7fa9ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.941+0000 7fa9c4ff9640 1 -- 172.21.15.99:0/4035580458 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7faadc041040 con 0x5592bcea9b50 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.941+0000 7faae2e45640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9ac036b40 0x7fa9ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcebc910 0x5592bcebedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcebf520 con 0x5592bcebc910 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae2e45640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9ac036b40 0x7fa9ac039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faad400e6d0 tx=0x7faad4031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faada644640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcebc910 0x5592bcebedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faada644640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcebc910 0x5592bcebedd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 20 realm 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.942+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcebf950 con 0x5592bcebc910 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec0220 con 0x5592bcebc910 2024-09-13T23:25:31.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec05c0 con 0x5592bcebc910 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bcec1320 0x5592bcec3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec3c50 con 0x5592bcec1320 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae3646640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bcec1320 0x5592bcec3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.943+0000 7faae3646640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bcec1320 0x5592bcec3710 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae5351800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae5351800 20 searching for the correct realm 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5592bcec5c90 0x5592bcec8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae2e45640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5592bcec5c90 0x5592bcec8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae2e45640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5592bcec5c90 0x5592bcec8150 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.944+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faae3646640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7faadc034070 0x7faadc03c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faada644640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7faadc034070 0x7faadc03c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faada644640 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7faadc034070 0x7faadc03c6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.945+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.946+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.947+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.948+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.949+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.950+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.951+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec5c90 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcebc910 2024-09-13T23:25:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec8820 con 0x5592bcec1320 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.952+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec46c0 con 0x5592bcebc910 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec42d0 con 0x5592bcebc910 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec5030 con 0x5592bcec1320 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 zone default found 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 4 Realm: () 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 zonegroup default 2024-09-13T23:25:31.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.953+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcec9150 con 0x7faadc034070 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecaf60 con 0x5592bcec5c90 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecb3b0 con 0x5592bcec5c90 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 started sync module instance, tier type = 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:31.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.954+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bceca370 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.955+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.955+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088723212128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecab80 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.955+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecc2e0 con 0x5592bcebc910 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.956+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088723212128] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.956+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.956+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088723217968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecc250 con 0x5592bcebc910 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.956+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecd1a0 con 0x5592bcec5c90 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.957+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088723217968] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.958+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.958+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088723221744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecd540 con 0x5592bcec5c90 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.958+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecdf60 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.959+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.959+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088723221744] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.959+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088723225168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcece830 con 0x5592bcec1320 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.959+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecc6d0 con 0x5592bcebc910 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.960+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.960+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088723220176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecf2a0 con 0x5592bcebc910 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.960+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecfd80 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.960+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088723225168] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.961+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088723220176] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.961+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.961+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088723232912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecedf0 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.961+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bced0620 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.962+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088723232912] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.962+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.962+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088723227520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcecedf0 con 0x7faadc034070 2024-09-13T23:25:31.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.962+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bced0c40 con 0x7faadc034070 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088723227520] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088723236752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bced1060 con 0x7faadc034070 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=0 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=1 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=2 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=3 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=4 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=5 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.963+0000 7faae5351800 20 add_watcher() i=6 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.964+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088723236752] v31'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.964+0000 7faae5351800 20 add_watcher() i=7 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.964+0000 7faae5351800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.964+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bced1060 con 0x5592bcebc910 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.965+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.965+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088723237808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bced1040 con 0x5592bcebc910 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088723237808] v31'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7fa9997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faae5351800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faae5351800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faae5351800 5 note: GC not initialized 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7fa913fff640 20 reqs_thread_entry: start 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faae5351800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.966+0000 7faae5351800 20 Filter name: none 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.967+0000 7fa911ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.967+0000 7faae5351800 20 rados->read ofs=0 len=0 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.967+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fe0 con 0x5592bcebc910 2024-09-13T23:25:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.967+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.967+0000 7faae5351800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:could not fetch user info: no user info saved 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.968+0000 7fa9997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.968+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088723237808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x5592bcebc910 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.969+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94088723237808] v31'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.969+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088723212128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf04d90 con 0x5592bcec1320 2024-09-13T23:25:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.970+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94088723212128] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.970+0000 7faae5351800 20 remove_watcher() i=0 2024-09-13T23:25:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.970+0000 7faae5351800 2 removed watcher, disabling cache 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.970+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088723217968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf04d90 con 0x5592bcebc910 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.971+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94088723217968] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.971+0000 7faae5351800 20 remove_watcher() i=1 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.971+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088723221744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf04d90 con 0x5592bcec5c90 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.972+0000 7faae2e45640 1 -- 172.21.15.99:0/4035580458 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94088723221744] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faad402d070 con 0x5592bcec5c90 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.972+0000 7faae5351800 20 remove_watcher() i=2 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.972+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088723225168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x5592bcec1320 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.973+0000 7faae3646640 1 -- 172.21.15.99:0/4035580458 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94088723225168] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faadc027020 con 0x5592bcec1320 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.973+0000 7faae5351800 20 remove_watcher() i=3 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.973+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088723220176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x5592bcebc910 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.974+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94088723220176] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x5592bcebc910 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.974+0000 7faae5351800 20 remove_watcher() i=4 2024-09-13T23:25:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.974+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088723232912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.975+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94088723232912] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.975+0000 7faae5351800 20 remove_watcher() i=5 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.975+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088723227520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.976+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94088723227520] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.976+0000 7faae5351800 20 remove_watcher() i=6 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.976+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088723236752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5592bcf06fa0 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94088723236752] v31'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faacc057030 con 0x7faadc034070 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 20 remove_watcher() i=7 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7faadc034070 msgr2=0x7faadc03c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7faadc034070 0x7faadc03c6f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcebc910 msgr2=0x5592bcebedd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcebc910 0x5592bcebedd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bcec1320 msgr2=0x5592bcec3710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bcec1320 0x5592bcec3710 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5592bcec5c90 msgr2=0x5592bcec8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5592bcec5c90 0x5592bcec8150 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9ac036b40 msgr2=0x7fa9ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9ac036b40 0x7fa9ac039000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faad400e6d0 tx=0x7faad4031000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 msgr2=0x5592bceb1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 --2- 172.21.15.99:0/4035580458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bcea9b50 0x5592bceb1080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faadc02a040 tx=0x7faadc04cd20 comp rx=0 tx=0).stop 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 reap_dead start 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faada644640 1 -- 172.21.15.99:0/4035580458 reap_dead start 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 shutdown_connections 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.977+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 >> 172.21.15.99:0/4035580458 conn(0x5592bcea5f00 msgr2=0x5592bceab260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 shutdown_connections 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/4035580458 wait complete. 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 msgr2=0x7fa9bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 0x7fa9bc039050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5592bce89f50 tx=0x7faad401b520 comp rx=0 tx=0).stop 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 msgr2=0x5592bce9d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x5592bce89a50 tx=0x7faadc0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 shutdown_connections 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9bc036b90 0x7fa9bc039050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/2599552236 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bce9ce30 0x5592bce9d250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 >> 172.21.15.99:0/2599552236 conn(0x5592bce91dc0 msgr2=0x5592bce94940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 shutdown_connections 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/2599552236 wait complete. 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 msgr2=0x5592bce89150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 0x5592bce89150 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 msgr2=0x5592bce8dd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 0x5592bce8dd90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 msgr2=0x7fa9c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 0x7fa9c8039050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faacc057000 tx=0x7faacc052000 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 msgr2=0x5592bce820e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x5592bce7b4e0 tx=0x7faad4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 shutdown_connections 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5592bce8b9a0 0x5592bce8dd90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5592bcd8f9b0 0x5592bce89150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9c8036b90 0x7fa9c8039050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 --2- 172.21.15.99:0/1800885330 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5592bccff5f0 0x5592bce820e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.978+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 >> 172.21.15.99:0/1800885330 conn(0x5592bcd85de0 msgr2=0x5592bce748b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.979+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 shutdown_connections 2024-09-13T23:25:31.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:31.979+0000 7faae5351800 1 -- 172.21.15.99:0/1800885330 wait complete. 2024-09-13T23:25:31.989 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:25:31.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:25:31.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T23:25:31.990 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T23:25:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.044 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.043+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.043+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.043+0000 7f0cc5830800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563fb31d5ee0 0x563fb3265190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.043+0000 7f0cc5830800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563fb3121b30 con 0x563fb32656d0 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.043+0000 7f0cc5830800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x563fb3103360 con 0x563fb31d5ee0 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cc0b4b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563fb31d5ee0 0x563fb3265190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cc0b4b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x563fb31d5ee0 0x563fb3265190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48936/0 (socket says 172.21.15.99:48936) 2024-09-13T23:25:32.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/2600312641 learned_addr learned my addr 172.21.15.99:0/2600312641 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/2600312641 >> v1:172.21.15.43:6789/0 conn(0x563fb32656d0 legacy=0x563fb3267ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/2600312641 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb3129e00 con 0x563fb31d5ee0 2024-09-13T23:25:32.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.044+0000 7f0cbb7fe640 1 -- 172.21.15.99:0/2600312641 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902053596 0 0) 0x563fb3121b30 con 0x563fb32656d0 2024-09-13T23:25:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/2600312641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3265190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a520 tx=0x7f0cb4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b082d8d97accbd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cbb7fe640 1 -- 172.21.15.99:0/2600312641 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4055070 con 0x563fb31d5ee0 2024-09-13T23:25:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cbb7fe640 1 -- 172.21.15.99:0/2600312641 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb40515b0 con 0x563fb31d5ee0 2024-09-13T23:25:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cbb7fe640 1 -- 172.21.15.99:0/2600312641 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb40518d0 con 0x563fb31d5ee0 2024-09-13T23:25:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 -- 172.21.15.99:0/2600312641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 msgr2=0x563fb3265190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 --2- 172.21.15.99:0/2600312641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3265190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a520 tx=0x7f0cb4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 -- 172.21.15.99:0/2600312641 shutdown_connections 2024-09-13T23:25:32.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 --2- 172.21.15.99:0/2600312641 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3265190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 -- 172.21.15.99:0/2600312641 >> 172.21.15.99:0/2600312641 conn(0x563fb325ce00 msgr2=0x563fb325f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 -- 172.21.15.99:0/2600312641 shutdown_connections 2024-09-13T23:25:32.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.046+0000 7f0cc5830800 1 -- 172.21.15.99:0/2600312641 wait complete. 2024-09-13T23:25:32.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc5830800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc5830800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563fb31ae450 con 0x563fb31d5ee0 2024-09-13T23:25:32.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc0b4b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc0b4b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48942/0 (socket says 172.21.15.99:48942) 2024-09-13T23:25:32.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/188929768 learned_addr learned my addr 172.21.15.99:0/188929768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/188929768 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb30fbbc0 con 0x563fb31d5ee0 2024-09-13T23:25:32.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.061+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/188929768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4000c00 tx=0x7f0cb4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bd1f4d4db1cb0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0baee05640 1 -- 172.21.15.99:0/188929768 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb40519d0 con 0x563fb31d5ee0 2024-09-13T23:25:32.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0baee05640 1 -- 172.21.15.99:0/188929768 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4051b70 con 0x563fb31d5ee0 2024-09-13T23:25:32.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0baee05640 1 -- 172.21.15.99:0/188929768 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4051e50 con 0x563fb31d5ee0 2024-09-13T23:25:32.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 -- 172.21.15.99:0/188929768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 msgr2=0x563fb33517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 --2- 172.21.15.99:0/188929768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4000c00 tx=0x7f0cb4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 -- 172.21.15.99:0/188929768 shutdown_connections 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 --2- 172.21.15.99:0/188929768 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb33517e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 -- 172.21.15.99:0/188929768 >> 172.21.15.99:0/188929768 conn(0x563fb325ce00 msgr2=0x563fb334d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 -- 172.21.15.99:0/188929768 shutdown_connections 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.062+0000 7f0cc5830800 1 -- 172.21.15.99:0/188929768 wait complete. 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc5830800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc5830800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563fb3269640 con 0x563fb31d5ee0 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc0b4b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc0b4b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48954/0 (socket says 172.21.15.99:48954) 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.063+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/953152603 learned_addr learned my addr 172.21.15.99:0/953152603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb310ffe0 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4005570 tx=0x7f0cb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0bad602640 1 -- 172.21.15.99:0/953152603 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4073070 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0bad602640 1 -- 172.21.15.99:0/953152603 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb405a580 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fb33595a0 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0bad602640 1 -- 172.21.15.99:0/953152603 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb405a8a0 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.064+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb3359b20 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0bad602640 1 -- 172.21.15.99:0/953152603 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cb4076070 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0bad602640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 0x7f0ba8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0bad602640 1 -- 172.21.15.99:0/953152603 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cb4062070 con 0x563fb31d5ee0 2024-09-13T23:25:32.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 0x7f0ba8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 0x563fb33600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33606f0 con 0x563fb32656d0 2024-09-13T23:25:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0cc134c640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 0x563fb33600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.065+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 0x7f0ba8039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f60 tx=0x7f0cac0013f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc134c640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 0x563fb33600d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc134c640 1 -- 172.21.15.99:0/953152603 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cbc00a4a0 con 0x563fb32656d0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb335d680 con 0x563fb32656d0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc134c640 1 -- 172.21.15.99:0/953152603 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cbc00a4a0 con 0x563fb32656d0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 0x563fb3364df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb3365490 con 0x563fb3362a00 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 0x563fb3364df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.066+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 0x563fb3364df0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.067+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/953152603 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb3362a00 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.067+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33618a0 con 0x563fb32656d0 2024-09-13T23:25:32.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.067+0000 7f0cc134c640 1 -- 172.21.15.99:0/953152603 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cbc00a4a0 con 0x563fb32656d0 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.067+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb3361d80 con 0x563fb3362a00 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.067+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/953152603 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb3362a00 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc5830800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc5830800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563fb30fd580 con 0x563fb3373e20 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48958/0 (socket says 172.21.15.99:48958) 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc134c640 1 -- 172.21.15.99:0/385771720 learned_addr learned my addr 172.21.15.99:0/385771720 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.068+0000 7f0cc134c640 1 -- 172.21.15.99:0/385771720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb3374780 con 0x563fb3373e20 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0cc134c640 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563fb335a110 tx=0x7f0cbc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0ba67fc640 1 -- 172.21.15.99:0/385771720 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc013640 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0ba67fc640 1 -- 172.21.15.99:0/385771720 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0137e0 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fb3374a10 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0ba67fc640 1 -- 172.21.15.99:0/385771720 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc013ae0 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb33776f0 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.069+0000 7f0ba67fc640 1 -- 172.21.15.99:0/385771720 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cbc011040 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0ba67fc640 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 0x7f0b98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0ba67fc640 1 -- 172.21.15.99:0/385771720 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cbc00e040 con 0x563fb3373e20 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 0x7f0b98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 0x7f0b98039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x563fb335d5c0 tx=0x7f0cb400a2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc5830800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc5830800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563fb3351ed0 con 0x563fb32623c0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48962/0 (socket says 172.21.15.99:48962) 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.070+0000 7f0cc134c640 1 -- 172.21.15.99:0/2064725975 learned_addr learned my addr 172.21.15.99:0/2064725975 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc134c640 1 -- 172.21.15.99:0/2064725975 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb3262d90 con 0x563fb32623c0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc134c640 1 --2- 172.21.15.99:0/2064725975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc04ce40 tx=0x7f0cbc01fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfad090c33d4cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0b97fff640 1 -- 172.21.15.99:0/2064725975 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc021960 con 0x563fb32623c0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0b97fff640 1 -- 172.21.15.99:0/2064725975 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc04a030 con 0x563fb32623c0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0b97fff640 1 -- 172.21.15.99:0/2064725975 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc021440 con 0x563fb32623c0 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 -- 172.21.15.99:0/2064725975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 msgr2=0x563fb32627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 --2- 172.21.15.99:0/2064725975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc04ce40 tx=0x7f0cbc01fed0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 -- 172.21.15.99:0/2064725975 shutdown_connections 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 --2- 172.21.15.99:0/2064725975 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb32627c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 -- 172.21.15.99:0/2064725975 >> 172.21.15.99:0/2064725975 conn(0x563fb337cef0 msgr2=0x563fb337aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 -- 172.21.15.99:0/2064725975 shutdown_connections 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.071+0000 7f0cc5830800 1 -- 172.21.15.99:0/2064725975 wait complete. 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc5830800 1 Processor -- start 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc5830800 1 -- start start 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc5830800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb338a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc5830800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563fb32610f0 con 0x563fb32623c0 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb338a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc134c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb338a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48966/0 (socket says 172.21.15.99:48966) 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 learned_addr learned my addr 172.21.15.99:0/157020736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb338a6d0 con 0x563fb32623c0 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0cc134c640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb338a190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc012e50 tx=0x7f0cbc04cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.072+0000 7f0b967fc640 1 -- 172.21.15.99:0/157020736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc039070 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0b967fc640 1 -- 172.21.15.99:0/157020736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc021a90 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0b967fc640 1 -- 172.21.15.99:0/157020736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc0215b0 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563fb338a960 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb338d610 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0b967fc640 1 -- 172.21.15.99:0/157020736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cbc0400e0 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.073+0000 7f0b967fc640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b8c036b40 0x7f0b8c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0b967fc640 1 -- 172.21.15.99:0/157020736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cbc031070 con 0x563fb32623c0 2024-09-13T23:25:32.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b8c036b40 0x7f0b8c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b8c036b40 0x7f0b8c039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563fb3360b40 tx=0x7f0cb4096000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb3395cc0 0x563fb3398180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33988d0 con 0x563fb3395cc0 2024-09-13T23:25:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.074+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb3395cc0 0x563fb3398180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb3395cc0 0x563fb3398180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cac0104c0 con 0x563fb3395cc0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 realm 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb3395110 con 0x563fb3395cc0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cac0104c0 con 0x563fb3395cc0 2024-09-13T23:25:32.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33993c0 con 0x563fb3395cc0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cac0104c0 con 0x563fb3395cc0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.075+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb3399c90 con 0x563fb3395cc0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cac0104c0 con 0x563fb3395cc0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb339a6b0 0x563fb339caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb339d1e0 con 0x563fb339a6b0 2024-09-13T23:25:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc134c640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb339a6b0 0x563fb339caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc134c640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb339a6b0 0x563fb339caa0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 20 searching for the correct realm 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563fb339f150 0x563fb33a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.076+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563fb339f150 0x563fb33a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc0b4b640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563fb339f150 0x563fb33a1610 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc134c640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cbc058040 0x7f0cbc04b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.077+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cbc058040 0x7f0cbc04b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cbc058040 0x7f0cbc04b280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac0104c0 con 0x7f0cbc058040 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac0104c0 con 0x563fb3395cc0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.078+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x7f0cbc058040 2024-09-13T23:25:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x7f0cbc058040 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.079+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x7f0cbc058040 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.080+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x7f0cbc058040 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.081+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x7f0cbc058040 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.082+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac02a040 con 0x563fb3395cc0 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.083+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339f150 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.084+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x7f0cbc058040 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb3395cc0 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a1ce0 con 0x563fb339a6b0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb339da30 con 0x563fb3395cc0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.085+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb339de20 con 0x563fb3395cc0 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a2160 con 0x563fb339a6b0 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 zone default found 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 4 Realm: () 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 zonegroup default 2024-09-13T23:25:32.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a29b0 con 0x7f0cbc058040 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a43c0 con 0x563fb339f150 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.086+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a4810 con 0x563fb339f150 2024-09-13T23:25:32.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 20 started sync module instance, tier type = 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.087+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3820 con 0x563fb339a6b0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.088+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.088+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94831589866816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3820 con 0x563fb339a6b0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.088+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a5320 con 0x563fb3395cc0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.089+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94831589866816] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.089+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.089+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94831589871120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3820 con 0x563fb3395cc0 2024-09-13T23:25:32.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.089+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a5d90 con 0x563fb339f150 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.090+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94831589871120] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.090+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.090+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94831589873792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a6130 con 0x563fb339f150 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.090+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a6c20 con 0x563fb339a6b0 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.091+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.091+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94831589877488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a74c0 con 0x563fb339a6b0 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.091+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a7fa0 con 0x563fb3395cc0 2024-09-13T23:25:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.091+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94831589873792] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.093+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.093+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94831589882544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a74c0 con 0x563fb3395cc0 2024-09-13T23:25:32.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.093+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a89f0 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.095+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94831589877488] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.095+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.095+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94831589885184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a74c0 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.095+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a9400 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.098+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94831589882544] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.098+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.098+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94831589885184] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.098+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94831589864304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a9400 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.098+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a7010 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94831589864304] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94831589879824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a9910 con 0x7f0cbc058040 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=0 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=1 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=2 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=3 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=4 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=5 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.101+0000 7f0cc5830800 20 add_watcher() i=6 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94831589879824] v31'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cc5830800 20 add_watcher() i=7 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cc5830800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33acdf0 con 0x563fb3395cc0 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.102+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94831589890320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33aa1e0 con 0x563fb3395cc0 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94831589890320] v31'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0b76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 5 note: GC not initialized 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0b75fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 20 Filter name: none 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0ae77fe640 20 reqs_thread_entry: start 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.104+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33e0120 con 0x563fb3395cc0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33de760 con 0x563fb3395cc0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33de760 con 0x7f0cbc058040 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:25:32.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.105+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33df120 con 0x563fb3395cc0 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.106+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.106+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.106+0000 7f0cc5830800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.106+0000 7f0cc5830800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.106+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94831590108112 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33e3bf0 con 0x563fb3395cc0 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== watch-notify(notify (1) cookie 94831589882544 notify 133143986176 ret 0) ==== 609+0+0 (crc 0 0 0) 0x563fb33df4c0 con 0x563fb3395cc0 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0b97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94831589882544 notifier 4297 bl.length()=567 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0b97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0b97fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0b97fff640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0b84003ea0 con 0x563fb3395cc0 2024-09-13T23:25:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(66 notify.4 [notify cookie 94831590108112 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94831590108112 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fb33dfd40 con 0x563fb3395cc0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.107+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33deb50 con 0x563fb3395cc0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc5830800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc5830800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94831590107984 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33e4020 con 0x563fb339a6b0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== watch-notify(notify (1) cookie 94831589877488 notify 133143986176 ret 0) ==== 211+0+0 (crc 0 0 0) 0x563fb338a960 con 0x563fb339a6b0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(69 notify.3 [notify cookie 94831590107984 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0b977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 94831589877488 notifier 4297 bl.length()=169 2024-09-13T23:25:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0b977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0b977fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.109+0000 7f0b977fe640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0af4003400 con 0x563fb339a6b0 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.110+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.110+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== watch-notify(notify_complete (2) cookie 94831590107984 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fb338a6d0 con 0x563fb339a6b0 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.110+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33e1d00 con 0x7f0cbc058040 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc5830800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc5830800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc5830800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94831590119072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x563fb33e44d0 con 0x563fb339a6b0 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== watch-notify(notify (1) cookie 94831589877488 notify 133143986177 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563fb338a6d0 con 0x563fb339a6b0 2024-09-13T23:25:32.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0b977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94831589877488 notifier 4297 bl.length()=177 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0b977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0b977fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0b977fe640 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f0af4003430 con 0x563fb339a6b0 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(72 notify.3 [notify cookie 94831590119072 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== watch-notify(notify_complete (2) cookie 94831590119072 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563fb3262d90 con 0x563fb339a6b0 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.111+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.122 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.112+0000 7f0b76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.112+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94831589890320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33dde00 con 0x563fb3395cc0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.113+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94831589890320] v31'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.113+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94831589866816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33dde00 con 0x563fb339a6b0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.114+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94831589866816] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.114+0000 7f0cc5830800 20 remove_watcher() i=0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.114+0000 7f0cc5830800 2 removed watcher, disabling cache 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.114+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94831589871120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33dde00 con 0x563fb3395cc0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.115+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94831589871120] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.115+0000 7f0cc5830800 20 remove_watcher() i=1 2024-09-13T23:25:32.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.115+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94831589873792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33dde00 con 0x563fb339f150 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.117+0000 7f0cc0b4b640 1 -- 172.21.15.99:0/157020736 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94831589873792] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb407f070 con 0x563fb339f150 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.117+0000 7f0cc5830800 20 remove_watcher() i=2 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.117+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94831589877488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3d40 con 0x563fb339a6b0 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.118+0000 7f0cc134c640 1 -- 172.21.15.99:0/157020736 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94831589877488] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc03b030 con 0x563fb339a6b0 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.118+0000 7f0cc5830800 20 remove_watcher() i=3 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.118+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94831589882544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3d40 con 0x563fb3395cc0 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.121+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94831589882544] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x563fb3395cc0 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.121+0000 7f0cc5830800 20 remove_watcher() i=4 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.121+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94831589885184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a7ab0 con 0x7f0cbc058040 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.122+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94831589885184] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.122+0000 7f0cc5830800 20 remove_watcher() i=5 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.122+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94831589864304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3d40 con 0x7f0cbc058040 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.123+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94831589864304] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.123+0000 7f0cc5830800 20 remove_watcher() i=6 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.123+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94831589879824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x563fb33a3370 con 0x7f0cbc058040 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94831589879824] v31'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cac03a040 con 0x7f0cbc058040 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 20 remove_watcher() i=7 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cbc058040 msgr2=0x7f0cbc04b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cbc058040 0x7f0cbc04b280 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb3395cc0 msgr2=0x563fb3398180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb3395cc0 0x563fb3398180 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb339a6b0 msgr2=0x563fb339caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb339a6b0 0x563fb339caa0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563fb339f150 msgr2=0x563fb33a1610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x563fb339f150 0x563fb33a1610 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b8c036b40 msgr2=0x7f0b8c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b8c036b40 0x7f0b8c039000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x563fb3360b40 tx=0x7f0cb4096000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 msgr2=0x563fb338a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/157020736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb32623c0 0x563fb338a190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc012e50 tx=0x7f0cbc04cda0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 reap_dead start 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cbbfff640 1 -- 172.21.15.99:0/157020736 reap_dead start 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 shutdown_connections 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 >> 172.21.15.99:0/157020736 conn(0x563fb337cef0 msgr2=0x563fb337afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 shutdown_connections 2024-09-13T23:25:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/157020736 wait complete. 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 msgr2=0x7f0b98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 0x7f0b98039000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x563fb335d5c0 tx=0x7f0cb400a2c0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 msgr2=0x563fb3374240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.124+0000 7f0cc5830800 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x563fb335a110 tx=0x7f0cbc0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 shutdown_connections 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b98036b40 0x7f0b98039000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/385771720 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb3373e20 0x563fb3374240 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 >> 172.21.15.99:0/385771720 conn(0x563fb3368db0 msgr2=0x563fb336b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 shutdown_connections 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/385771720 wait complete. 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 msgr2=0x563fb33600d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 0x563fb33600d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 msgr2=0x563fb3364df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 0x563fb3364df0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 msgr2=0x7f0ba8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 0x7f0ba8039050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f60 tx=0x7f0cac0013f0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 msgr2=0x563fb3359060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4005570 tx=0x7f0cb4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 shutdown_connections 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563fb3362a00 0x563fb3364df0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x563fb32656d0 0x563fb33600d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba8036b90 0x7f0ba8039050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 --2- 172.21.15.99:0/953152603 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x563fb31d5ee0 0x563fb3359060 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 >> 172.21.15.99:0/953152603 conn(0x563fb325ce00 msgr2=0x563fb334ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 shutdown_connections 2024-09-13T23:25:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.125+0000 7f0cc5830800 1 -- 172.21.15.99:0/953152603 wait complete. 2024-09-13T23:25:32.135 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.135 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:25:32.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T23:25:32.135 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T23:25:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.182+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.182+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd85c926800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d6bf400630 0x55d6bf48f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd85c926800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6bf34bb30 con 0x55d6bf48f7d0 2024-09-13T23:25:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd85c926800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d6bf32d360 con 0x55d6bf400630 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd8585e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d6bf400630 0x55d6bf48f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd857de2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55d6bf48f7d0 0x55d6bf491bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43854/0 (socket says 172.21.15.99:43854) 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd857de2640 1 -- 172.21.15.99:0/1419321774 learned_addr learned my addr 172.21.15.99:0/1419321774 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd8585e3640 1 -- 172.21.15.99:0/1419321774 >> v1:172.21.15.43:6789/0 conn(0x55d6bf48f7d0 legacy=0x55d6bf491bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd8585e3640 1 -- 172.21.15.99:0/1419321774 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf353e00 con 0x55d6bf400630 2024-09-13T23:25:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.183+0000 7fd8575e1640 1 -- 172.21.15.99:0/1419321774 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274417003 0 0) 0x55d6bf34bb30 con 0x55d6bf48f7d0 2024-09-13T23:25:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.185+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1419321774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf48f290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd84800a470 tx=0x7fd848045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8302c4104956b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.185+0000 7fd8575e1640 1 -- 172.21.15.99:0/1419321774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848053570 con 0x55d6bf400630 2024-09-13T23:25:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.185+0000 7fd8575e1640 1 -- 172.21.15.99:0/1419321774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848058070 con 0x55d6bf400630 2024-09-13T23:25:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.185+0000 7fd8575e1640 1 -- 172.21.15.99:0/1419321774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848053880 con 0x55d6bf400630 2024-09-13T23:25:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 -- 172.21.15.99:0/1419321774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 msgr2=0x55d6bf48f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 --2- 172.21.15.99:0/1419321774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf48f290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd84800a470 tx=0x7fd848045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 -- 172.21.15.99:0/1419321774 shutdown_connections 2024-09-13T23:25:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 --2- 172.21.15.99:0/1419321774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf48f290 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 -- 172.21.15.99:0/1419321774 >> 172.21.15.99:0/1419321774 conn(0x55d6bf486e00 msgr2=0x55d6bf489220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 -- 172.21.15.99:0/1419321774 shutdown_connections 2024-09-13T23:25:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.186+0000 7fd85c926800 1 -- 172.21.15.99:0/1419321774 wait complete. 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.199+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.199+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd85c926800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd85c926800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6bf3d8350 con 0x55d6bf400630 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd8585e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd8585e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48982/0 (socket says 172.21.15.99:48982) 2024-09-13T23:25:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd8585e3640 1 -- 172.21.15.99:0/1687155319 learned_addr learned my addr 172.21.15.99:0/1687155319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd8585e3640 1 -- 172.21.15.99:0/1687155319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf325bc0 con 0x55d6bf400630 2024-09-13T23:25:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1687155319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd848005870 tx=0x7fd848051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cf74ca34bc71ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd74660c640 1 -- 172.21.15.99:0/1687155319 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd84805c580 con 0x55d6bf400630 2024-09-13T23:25:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.200+0000 7fd74660c640 1 -- 172.21.15.99:0/1687155319 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848063030 con 0x55d6bf400630 2024-09-13T23:25:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd74660c640 1 -- 172.21.15.99:0/1687155319 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd84805c850 con 0x55d6bf400630 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 -- 172.21.15.99:0/1687155319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 msgr2=0x55d6bf57b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 --2- 172.21.15.99:0/1687155319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd848005870 tx=0x7fd848051000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 -- 172.21.15.99:0/1687155319 shutdown_connections 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 --2- 172.21.15.99:0/1687155319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf57b6d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 -- 172.21.15.99:0/1687155319 >> 172.21.15.99:0/1687155319 conn(0x55d6bf486e00 msgr2=0x55d6bf577090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 -- 172.21.15.99:0/1687155319 shutdown_connections 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 -- 172.21.15.99:0/1687155319 wait complete. 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.201+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd85c926800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd85c926800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6bf4936a0 con 0x55d6bf400630 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd8585e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd8585e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48990/0 (socket says 172.21.15.99:48990) 2024-09-13T23:25:32.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd8585e3640 1 -- 172.21.15.99:0/3399874372 learned_addr learned my addr 172.21.15.99:0/3399874372 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd8585e3640 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf339fe0 con 0x55d6bf400630 2024-09-13T23:25:32.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd8585e3640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd848045f50 tx=0x7fd848002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd744e09640 1 -- 172.21.15.99:0/3399874372 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848078070 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd744e09640 1 -- 172.21.15.99:0/3399874372 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd848054a70 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.202+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6bf583510 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.203+0000 7fd744e09640 1 -- 172.21.15.99:0/3399874372 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd848054d50 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.203+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6bf583a90 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.203+0000 7fd744e09640 1 -- 172.21.15.99:0/3399874372 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd84807b070 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.203+0000 7fd744e09640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 0x7fd740039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.203+0000 7fd744e09640 1 -- 172.21.15.99:0/3399874372 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd848070070 con 0x55d6bf400630 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd857de2640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 0x7fd740039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 0x55d6bf58a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf58a5d0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd858de4640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 0x55d6bf58a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd857de2640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 0x7fd740039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84c000c00 tx=0x7fd84c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd858de4640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 0x55d6bf58a040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd858de4640 1 -- 172.21.15.99:0/3399874372 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd85000a4a0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.204+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5875f0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd858de4640 1 -- 172.21.15.99:0/3399874372 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd85000a4a0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 0x55d6bf58ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf58f3e0 con 0x55d6bf58c900 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd8585e3640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 0x55d6bf58ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd8585e3640 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 0x55d6bf58ecf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd8585e3640 1 -- 172.21.15.99:0/3399874372 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd84807a030 con 0x55d6bf58c900 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.205+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf58b7a0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd858de4640 1 -- 172.21.15.99:0/3399874372 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd85000a4a0 con 0x55d6bf48f7d0 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf58bc80 con 0x55d6bf58c900 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd8585e3640 1 -- 172.21.15.99:0/3399874372 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd84807a030 con 0x55d6bf58c900 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd85c926800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.206+0000 7fd85c926800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6bf327580 con 0x55d6bf59dd70 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:48994/0 (socket says 172.21.15.99:48994) 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd858de4640 1 -- 172.21.15.99:0/23365254 learned_addr learned my addr 172.21.15.99:0/23365254 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd858de4640 1 -- 172.21.15.99:0/23365254 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf59e6d0 con 0x55d6bf59dd70 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd858de4640 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55d6bf58a9d0 tx=0x7fd8500163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd73dffb640 1 -- 172.21.15.99:0/23365254 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd850013450 con 0x55d6bf59dd70 2024-09-13T23:25:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd73dffb640 1 -- 172.21.15.99:0/23365254 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8500135f0 con 0x55d6bf59dd70 2024-09-13T23:25:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd73dffb640 1 -- 172.21.15.99:0/23365254 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8500138d0 con 0x55d6bf59dd70 2024-09-13T23:25:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6bf59e960 con 0x55d6bf59dd70 2024-09-13T23:25:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.207+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6bf5a1640 con 0x55d6bf59dd70 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd73dffb640 1 -- 172.21.15.99:0/23365254 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd850011040 con 0x55d6bf59dd70 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd73dffb640 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 0x7fd730039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd73dffb640 1 -- 172.21.15.99:0/23365254 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd85000e040 con 0x55d6bf59dd70 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd8585e3640 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 0x7fd730039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd8585e3640 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 0x7fd730039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55d6bf58aeb0 tx=0x7fd848054f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.208+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd85c926800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd85c926800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6bf57be20 con 0x55d6bf5aaac0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49006/0 (socket says 172.21.15.99:49006) 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd858de4640 1 -- 172.21.15.99:0/1930672746 learned_addr learned my addr 172.21.15.99:0/1930672746 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd858de4640 1 -- 172.21.15.99:0/1930672746 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf5ab490 con 0x55d6bf5aaac0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd858de4640 1 --2- 172.21.15.99:0/1930672746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd85004cd90 tx=0x7fd85004cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435117b17491f975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd72f7fe640 1 -- 172.21.15.99:0/1930672746 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85004a070 con 0x55d6bf5aaac0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd72f7fe640 1 -- 172.21.15.99:0/1930672746 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85002a570 con 0x55d6bf5aaac0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.209+0000 7fd72f7fe640 1 -- 172.21.15.99:0/1930672746 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85001f4c0 con 0x55d6bf5aaac0 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- 172.21.15.99:0/1930672746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 msgr2=0x55d6bf5aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 --2- 172.21.15.99:0/1930672746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd85004cd90 tx=0x7fd85004cf90 comp rx=0 tx=0).stop 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- 172.21.15.99:0/1930672746 shutdown_connections 2024-09-13T23:25:32.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 --2- 172.21.15.99:0/1930672746 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5aaec0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- 172.21.15.99:0/1930672746 >> 172.21.15.99:0/1930672746 conn(0x55d6bf5a6e20 msgr2=0x55d6bf5a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- 172.21.15.99:0/1930672746 shutdown_connections 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- 172.21.15.99:0/1930672746 wait complete. 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 Processor -- start 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- start start 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd85c926800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6bf5abb00 con 0x55d6bf5aaac0 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.210+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd858de4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49010/0 (socket says 172.21.15.99:49010) 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 learned_addr learned my addr 172.21.15.99:0/1537652070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6bf5b24d0 con 0x55d6bf5aaac0 2024-09-13T23:25:32.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd858de4640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5b1f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a040 tx=0x7fd85004cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd72dffb640 1 -- 172.21.15.99:0/1537652070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85001f710 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd72dffb640 1 -- 172.21.15.99:0/1537652070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd850039070 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6bf5b2760 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd72dffb640 1 -- 172.21.15.99:0/1537652070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85001f9e0 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.211+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6bf5b2760 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.212+0000 7fd72dffb640 1 -- 172.21.15.99:0/1537652070 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd850013a70 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.212+0000 7fd72dffb640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd720036af0 0x7fd720038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.212+0000 7fd72dffb640 1 -- 172.21.15.99:0/1537652070 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd850041040 con 0x55d6bf5aaac0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.212+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd720036af0 0x7fd720038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.212+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd720036af0 0x7fd720038fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd848009e60 tx=0x7fd848084000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf5bd8d0 0x55d6bf5bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c04e0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd857de2640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf5bd8d0 0x55d6bf5bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd857de2640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf5bd8d0 0x55d6bf5bfd90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 20 realm 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.213+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5bcd20 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c0fd0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c18a0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf5c22c0 0x55d6bf5c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c4e20 con 0x55d6bf5c22c0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd858de4640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf5c22c0 0x55d6bf5c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.214+0000 7fd858de4640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf5c22c0 0x55d6bf5c46b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd85c926800 20 searching for the correct realm 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6bf5c6db0 0x55d6bf5c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6bf5c6db0 0x55d6bf5c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd8585e3640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6bf5c6db0 0x55d6bf5c9270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.215+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd858de4640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd850034070 0x7fd85003c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd857de2640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd850034070 0x7fd85003c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd857de2640 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd850034070 0x7fd85003c6f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00f5f0 con 0x7fd850034070 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.216+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c00f5f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd850034070 2024-09-13T23:25:32.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd850034070 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.217+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd850034070 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.218+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.219+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd850034070 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.220+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x7fd850034070 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c02b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.221+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.222+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c6db0 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x7fd850034070 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9940 con 0x55d6bf5c22c0 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.223+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c5810 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c60b0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c9dc0 con 0x55d6bf5c22c0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 zone default found 2024-09-13T23:25:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 4 Realm: () 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 zonegroup default 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5c5ce0 con 0x7fd850034070 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.224+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cc070 con 0x55d6bf5c6db0 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cc410 con 0x55d6bf5c6db0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 20 started sync module instance, tier type = 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.225+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cb510 con 0x55d6bf5c22c0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.226+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.226+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94380821887280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cb170 con 0x55d6bf5c22c0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.226+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cd2f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.227+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94380821887280] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.227+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.227+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94380821891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cd2f0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.227+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cdd10 con 0x55d6bf5c6db0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.229+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.229+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94380821895168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5ce5a0 con 0x55d6bf5c6db0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.230+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cf0a0 con 0x55d6bf5c22c0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.230+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94380821891104] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.231+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94380821895168] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.231+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.231+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94380821900176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5ce0b0 con 0x55d6bf5c22c0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.231+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cfae0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.235+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94380821900176] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.235+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.235+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94380821892672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5cfae0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.235+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d04a0 con 0x7fd850034070 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.238+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94380821892672] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.238+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.238+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94380821903168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d04a0 con 0x7fd850034070 2024-09-13T23:25:32.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.238+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d0e60 con 0x7fd850034070 2024-09-13T23:25:32.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.239+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.239+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94380821907888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d1280 con 0x7fd850034070 2024-09-13T23:25:32.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.239+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d1ce0 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.239+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94380821903168] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94380821907888] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94380821905392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d0dd0 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=0 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=1 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=2 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=3 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=4 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=5 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.240+0000 7fd85c926800 20 add_watcher() i=6 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94380821905392] v31'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd85c926800 20 add_watcher() i=7 2024-09-13T23:25:32.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd85c926800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d0dd0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.241+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94380821911488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5d0dd0 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.242+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94380821911488] v31'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.242+0000 7fd70e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.242+0000 7fd85c926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.242+0000 7fd85c926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.242+0000 7fd85c926800 5 note: GC not initialized 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd70d7e2640 20 reqs_thread_entry: start 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 20 Filter name: none 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd67effd640 20 reqs_thread_entry: start 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:32.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf608010 con 0x7fd850034070 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.243+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf606650 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf606a40 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.244+0000 7fd85c926800 20 get_user_info_from_index found 0 xattrs 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.245+0000 7fd70e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.245+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94380821911488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf5b7240 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.246+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94380821911488] v31'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.246+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94380821887280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x55d6bf5c22c0 2024-09-13T23:25:32.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.247+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94380821887280] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.247+0000 7fd85c926800 20 remove_watcher() i=0 2024-09-13T23:25:32.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.247+0000 7fd85c926800 2 removed watcher, disabling cache 2024-09-13T23:25:32.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.247+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94380821891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.249+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94380821891104] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.249+0000 7fd85c926800 20 remove_watcher() i=1 2024-09-13T23:25:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.249+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94380821895168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x55d6bf5c6db0 2024-09-13T23:25:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.250+0000 7fd8585e3640 1 -- 172.21.15.99:0/1537652070 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94380821895168] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84808b050 con 0x55d6bf5c6db0 2024-09-13T23:25:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.250+0000 7fd85c926800 20 remove_watcher() i=2 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.250+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94380821900176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x55d6bf5c22c0 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.251+0000 7fd858de4640 1 -- 172.21.15.99:0/1537652070 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94380821900176] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd850027020 con 0x55d6bf5c22c0 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.251+0000 7fd85c926800 20 remove_watcher() i=3 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.251+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94380821892672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.252+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94380821892672] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x55d6bf5bd8d0 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.252+0000 7fd85c926800 20 remove_watcher() i=4 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.252+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94380821903168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x7fd850034070 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.253+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94380821903168] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.253+0000 7fd85c926800 20 remove_watcher() i=5 2024-09-13T23:25:32.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.253+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94380821907888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x7fd850034070 2024-09-13T23:25:32.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.255+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94380821907888] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.255+0000 7fd85c926800 20 remove_watcher() i=6 2024-09-13T23:25:32.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.255+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94380821905392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d6bf605d60 con 0x7fd850034070 2024-09-13T23:25:32.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94380821905392] v31'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd84c03b040 con 0x7fd850034070 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 20 remove_watcher() i=7 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd850034070 msgr2=0x7fd85003c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd850034070 0x7fd85003c6f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf5bd8d0 msgr2=0x55d6bf5bfd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf5bd8d0 0x55d6bf5bfd90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf5c22c0 msgr2=0x55d6bf5c46b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf5c22c0 0x55d6bf5c46b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6bf5c6db0 msgr2=0x55d6bf5c9270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6bf5c6db0 0x55d6bf5c9270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd720036af0 msgr2=0x7fd720038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd720036af0 0x7fd720038fb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd848009e60 tx=0x7fd848084000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 msgr2=0x55d6bf5b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 --2- 172.21.15.99:0/1537652070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf5aaac0 0x55d6bf5b1f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a040 tx=0x7fd85004cd20 comp rx=0 tx=0).stop 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 reap_dead start 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd857de2640 1 -- 172.21.15.99:0/1537652070 reap_dead start 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 shutdown_connections 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 >> 172.21.15.99:0/1537652070 conn(0x55d6bf5a6e20 msgr2=0x55d6bf5a4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 shutdown_connections 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.256+0000 7fd85c926800 1 -- 172.21.15.99:0/1537652070 wait complete. 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 msgr2=0x7fd730039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 0x7fd730039050 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55d6bf58aeb0 tx=0x7fd848054f70 comp rx=0 tx=0).stop 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 msgr2=0x55d6bf59e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55d6bf58a9d0 tx=0x7fd8500163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 shutdown_connections 2024-09-13T23:25:32.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd730036b90 0x7fd730039050 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/23365254 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf59dd70 0x55d6bf59e190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 >> 172.21.15.99:0/23365254 conn(0x55d6bf592d00 msgr2=0x55d6bf595880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 shutdown_connections 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/23365254 wait complete. 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 msgr2=0x55d6bf58a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 0x55d6bf58a040 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 msgr2=0x55d6bf58ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 0x55d6bf58ecf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 msgr2=0x7fd740039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 0x7fd740039050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84c000c00 tx=0x7fd84c0013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 msgr2=0x55d6bf582fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd848045f50 tx=0x7fd848002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 shutdown_connections 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6bf58c900 0x55d6bf58ecf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6bf48f7d0 0x55d6bf58a040 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd740036b90 0x7fd740039050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 --2- 172.21.15.99:0/3399874372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6bf400630 0x55d6bf582fd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 >> 172.21.15.99:0/3399874372 conn(0x55d6bf486e00 msgr2=0x55d6bf575900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 shutdown_connections 2024-09-13T23:25:32.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.257+0000 7fd85c926800 1 -- 172.21.15.99:0/3399874372 wait complete. 2024-09-13T23:25:32.266 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T23:25:32.267 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.267 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:32.311 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.311 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.310+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.310+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.310+0000 7f4e9bc36800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b2c393c6b0 0x55b2c39cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.310+0000 7f4e9bc36800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2c3887b30 con 0x55b2c39cb710 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.310+0000 7f4e9bc36800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b2c3869360 con 0x55b2c393c6b0 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96f52640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b2c393c6b0 0x55b2c39cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96f52640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b2c393c6b0 0x55b2c39cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49026/0 (socket says 172.21.15.99:49026) 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96f52640 1 -- 172.21.15.99:0/1465798970 learned_addr learned my addr 172.21.15.99:0/1465798970 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96751640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b2c39cb710 0x55b2c39cdb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43864/0 (socket says 172.21.15.99:43864) 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96f52640 1 -- 172.21.15.99:0/1465798970 >> v1:172.21.15.43:6789/0 conn(0x55b2c39cb710 legacy=0x55b2c39cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e96f52640 1 -- 172.21.15.99:0/1465798970 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c388fe00 con 0x55b2c393c6b0 2024-09-13T23:25:32.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.311+0000 7f4e95f50640 1 -- 172.21.15.99:0/1465798970 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605098974 0 0) 0x55b2c3887b30 con 0x55b2c39cb710 2024-09-13T23:25:32.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e96f52640 1 --2- 172.21.15.99:0/1465798970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39cb1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800a520 tx=0x7f4e88045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cafea4c2fbff33a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e95f50640 1 -- 172.21.15.99:0/1465798970 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e88055070 con 0x55b2c393c6b0 2024-09-13T23:25:32.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e95f50640 1 -- 172.21.15.99:0/1465798970 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e880515b0 con 0x55b2c393c6b0 2024-09-13T23:25:32.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e95f50640 1 -- 172.21.15.99:0/1465798970 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e880518d0 con 0x55b2c393c6b0 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1465798970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 msgr2=0x55b2c39cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1465798970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39cb1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800a520 tx=0x7f4e88045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1465798970 shutdown_connections 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1465798970 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39cb1d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1465798970 >> 172.21.15.99:0/1465798970 conn(0x55b2c39c2de0 msgr2=0x55b2c39c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1465798970 shutdown_connections 2024-09-13T23:25:32.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.313+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1465798970 wait complete. 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e9bc36800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e9bc36800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2c3914330 con 0x55b2c393c6b0 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e96f52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.327+0000 7f4e96f52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49034/0 (socket says 172.21.15.99:49034) 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4e96f52640 1 -- 172.21.15.99:0/1001513176 learned_addr learned my addr 172.21.15.99:0/1001513176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4e96f52640 1 -- 172.21.15.99:0/1001513176 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c3861bc0 con 0x55b2c393c6b0 2024-09-13T23:25:32.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4e96f52640 1 --2- 172.21.15.99:0/1001513176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000c00 tx=0x7f4e88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd940f7d30bcd47e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4d84e09640 1 -- 172.21.15.99:0/1001513176 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e880519d0 con 0x55b2c393c6b0 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4d84e09640 1 -- 172.21.15.99:0/1001513176 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e88051b70 con 0x55b2c393c6b0 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.328+0000 7f4d84e09640 1 -- 172.21.15.99:0/1001513176 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e88051e50 con 0x55b2c393c6b0 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1001513176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 msgr2=0x55b2c39c8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1001513176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000c00 tx=0x7f4e88051000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1001513176 shutdown_connections 2024-09-13T23:25:32.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1001513176 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c39c8b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1001513176 >> 172.21.15.99:0/1001513176 conn(0x55b2c39c2de0 msgr2=0x55b2c3ab30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1001513176 shutdown_connections 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1001513176 wait complete. 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.329+0000 7f4e9bc36800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2c39cf680 con 0x55b2c393c6b0 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e96f52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e96f52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49042/0 (socket says 172.21.15.99:49042) 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e96f52640 1 -- 172.21.15.99:0/1464015299 learned_addr learned my addr 172.21.15.99:0/1464015299 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e96f52640 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c3875fe0 con 0x55b2c393c6b0 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e96f52640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e88005570 tx=0x7f4e88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4d83606640 1 -- 172.21.15.99:0/1464015299 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e88073070 con 0x55b2c393c6b0 2024-09-13T23:25:32.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4d83606640 1 -- 172.21.15.99:0/1464015299 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8805a580 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4d83606640 1 -- 172.21.15.99:0/1464015299 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e8805a8a0 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2c3ac16d0 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.330+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c3ac1c50 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4d83606640 1 -- 172.21.15.99:0/1464015299 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e88076070 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4d83606640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 0x7f4d7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4d83606640 1 -- 172.21.15.99:0/1464015299 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4e88062070 con 0x55b2c393c6b0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4e96751640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 0x7f4d7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 0x55b2c3ac8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3ac8780 con 0x55b2c39cb710 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.331+0000 7f4e97753640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 0x55b2c3ac8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e96751640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 0x7f4d7c039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c000c00 tx=0x7f4e8c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e97753640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 0x55b2c3ac8200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e97753640 1 -- 172.21.15.99:0/1464015299 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e9000a4a0 con 0x55b2c39cb710 2024-09-13T23:25:32.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3ac57b0 con 0x55b2c39cb710 2024-09-13T23:25:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e97753640 1 -- 172.21.15.99:0/1464015299 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e9000a4a0 con 0x55b2c39cb710 2024-09-13T23:25:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 0x55b2c3acce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3acd520 con 0x55b2c3acaa90 2024-09-13T23:25:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.332+0000 7f4e96f52640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 0x55b2c3acce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.333+0000 7f4e96f52640 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 0x55b2c3acce80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.333+0000 7f4e96f52640 1 -- 172.21.15.99:0/1464015299 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3acaa90 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.333+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3ac9930 con 0x55b2c39cb710 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.333+0000 7f4e97753640 1 -- 172.21.15.99:0/1464015299 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e9000a4a0 con 0x55b2c39cb710 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3ac9e10 con 0x55b2c3acaa90 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e96f52640 1 -- 172.21.15.99:0/1464015299 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3acaa90 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e9bc36800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e9bc36800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2c3863580 con 0x55b2c3adbeb0 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49044/0 (socket says 172.21.15.99:49044) 2024-09-13T23:25:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.334+0000 7f4e97753640 1 -- 172.21.15.99:0/969388776 learned_addr learned my addr 172.21.15.99:0/969388776 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4e97753640 1 -- 172.21.15.99:0/969388776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c3adc810 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4e97753640 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b2c3ac2240 tx=0x7f4e900167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4d80e01640 1 -- 172.21.15.99:0/969388776 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e90013640 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4d80e01640 1 -- 172.21.15.99:0/969388776 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e900137e0 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2c3adcaa0 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4d80e01640 1 -- 172.21.15.99:0/969388776 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e90013ae0 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.335+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c3adf780 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4d80e01640 1 -- 172.21.15.99:0/969388776 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e90011040 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4d80e01640 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 0x7f4d70039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4d80e01640 1 -- 172.21.15.99:0/969388776 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4e9000e040 con 0x55b2c3adbeb0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4e96f52640 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 0x7f4d70039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.336+0000 7f4e96f52640 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 0x7f4d70039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b2c3ac56f0 tx=0x7f4e8800a2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e9bc36800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e9bc36800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2c39c70e0 con 0x55b2c3ae8b20 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49060/0 (socket says 172.21.15.99:49060) 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e97753640 1 -- 172.21.15.99:0/1334190781 learned_addr learned my addr 172.21.15.99:0/1334190781 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e97753640 1 -- 172.21.15.99:0/1334190781 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c3ae94f0 con 0x55b2c3ae8b20 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4e97753640 1 --2- 172.21.15.99:0/1334190781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000afb0 tx=0x7f4e9001fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e16dc444554d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4d7a7fc640 1 -- 172.21.15.99:0/1334190781 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e90021570 con 0x55b2c3ae8b20 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4d7a7fc640 1 -- 172.21.15.99:0/1334190781 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e9001f340 con 0x55b2c3ae8b20 2024-09-13T23:25:32.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.337+0000 7f4d7a7fc640 1 -- 172.21.15.99:0/1334190781 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e90014cc0 con 0x55b2c3ae8b20 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1334190781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 msgr2=0x55b2c3ae8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1334190781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000afb0 tx=0x7f4e9001fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1334190781 shutdown_connections 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1334190781 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3ae8f20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1334190781 >> 172.21.15.99:0/1334190781 conn(0x55b2c3ae4ed0 msgr2=0x55b2c3ae2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1334190781 shutdown_connections 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1334190781 wait complete. 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 Processor -- start 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- start start 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e9bc36800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b2c3ae9b00 con 0x55b2c3ae8b20 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e97753640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49062/0 (socket says 172.21.15.99:49062) 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.338+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 learned_addr learned my addr 172.21.15.99:0/3560336249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c3af0500 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4e97753640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e90048010 tx=0x7f4e9004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4d78ff9640 1 -- 172.21.15.99:0/3560336249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e90013e60 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4d78ff9640 1 -- 172.21.15.99:0/3560336249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90040360 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2c3af0790 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4d78ff9640 1 -- 172.21.15.99:0/3560336249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e9004e2b0 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.339+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c3af0790 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4d78ff9640 1 -- 172.21.15.99:0/3560336249 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4e9004e470 con 0x55b2c3ae8b20 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4d78ff9640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d60036b90 0x7f4d60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4d78ff9640 1 -- 172.21.15.99:0/3560336249 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4e90007050 con 0x55b2c3ae8b20 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4e96f52640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d60036b90 0x7f4d60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c3afb890 0x55b2c3afdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.340+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3afe4a0 con 0x55b2c3afb890 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e96751640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c3afb890 0x55b2c3afdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e96f52640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d60036b90 0x7f4d60039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e880514a0 tx=0x7f4e88096000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e96751640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c3afb890 0x55b2c3afdd50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x55b2c3afb890 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 20 realm 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3afad30 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.341+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3afef80 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3aff850 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x55b2c3afb890 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3b00150 0x55b2c3b02560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b02cc0 con 0x55b2c3b00150 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e97753640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3b00150 0x55b2c3b02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e97753640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3b00150 0x55b2c3b02560 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.342+0000 7f4e9bc36800 20 searching for the correct realm 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b2c3b04d70 0x55b2c3b07230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e96f52640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b2c3b04d70 0x55b2c3b07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e96f52640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b2c3b04d70 0x55b2c3b07230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e97753640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4e90044070 0x7f4e900205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.343+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4e90044070 0x7f4e900205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4e90044070 0x7f4e900205b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x7f4e90044070 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c00f5a0 con 0x55b2c3afb890 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.344+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x7f4e90044070 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x7f4e90044070 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.345+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x7f4e90044070 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.346+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x7f4e90044070 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.347+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.348+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x7f4e90044070 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c02b040 con 0x55b2c3afb890 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.349+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.350+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b04d70 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x7f4e90044070 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3afb890 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b07900 con 0x55b2c3b00150 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.351+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b03770 con 0x55b2c3afb890 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b03380 con 0x55b2c3afb890 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b04120 con 0x55b2c3b00150 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 zone default found 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 4 Realm: () 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 zonegroup default 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b08230 con 0x7f4e90044070 2024-09-13T23:25:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.352+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b09ca0 con 0x55b2c3b04d70 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0a100 con 0x55b2c3b04d70 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 20 started sync module instance, tier type = 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.353+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b090f0 con 0x55b2c3b00150 2024-09-13T23:25:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.354+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.354+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94226275669216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b09900 con 0x55b2c3b00150 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.354+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0b030 con 0x55b2c3afb890 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.357+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.357+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94226275675008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0b4b0 con 0x55b2c3afb890 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.357+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94226275669216] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.357+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0a5a0 con 0x55b2c3b04d70 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.358+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.358+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94226275678880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0c370 con 0x55b2c3b04d70 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.358+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0ce60 con 0x55b2c3b00150 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.359+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94226275678880] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.359+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94226275675008] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.362+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.362+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94226275676064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0bec0 con 0x55b2c3b00150 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.362+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0d740 con 0x55b2c3afb890 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.363+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.363+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94226275684944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0d6b0 con 0x55b2c3afb890 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.363+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0e670 con 0x7f4e90044070 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.363+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94226275676064] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.365+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94226275684944] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.365+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.365+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94226275688832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0e670 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.365+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0dc10 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.366+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.366+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94226275691152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0dc10 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.366+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0fa10 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.366+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94226275688832] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94226275691152] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94226275692208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0c930 con 0x7f4e90044070 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=0 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=1 2024-09-13T23:25:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=2 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=3 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=4 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=5 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.367+0000 7f4e9bc36800 20 add_watcher() i=6 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94226275692208] v31'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e9bc36800 20 add_watcher() i=7 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e9bc36800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b12a00 con 0x55b2c3afb890 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.368+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94226275693824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0fe80 con 0x55b2c3afb890 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.369+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94226275693824] v31'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.369+0000 7f4d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.369+0000 7f4e9bc36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.369+0000 7f4e9bc36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.369+0000 7f4e9bc36800 5 note: GC not initialized 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4cc7fff640 20 reqs_thread_entry: start 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e9bc36800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e9bc36800 20 Filter name: none 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4cc5ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e9bc36800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b45810 con 0x55b2c3afb890 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.370+0000 7f4e9bc36800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.378 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.371+0000 7f4d4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.371+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94226275693824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b44640 con 0x55b2c3afb890 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.372+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94226275693824] v31'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.372+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94226275669216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0f500 con 0x55b2c3b00150 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.373+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94226275669216] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.373+0000 7f4e9bc36800 20 remove_watcher() i=0 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.373+0000 7f4e9bc36800 2 removed watcher, disabling cache 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.373+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94226275675008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b094e0 con 0x55b2c3afb890 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.374+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94226275675008] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.374+0000 7f4e9bc36800 20 remove_watcher() i=1 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.374+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94226275678880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b094e0 con 0x55b2c3b04d70 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.375+0000 7f4e96f52640 1 -- 172.21.15.99:0/3560336249 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94226275678880] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8807f070 con 0x55b2c3b04d70 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.375+0000 7f4e9bc36800 20 remove_watcher() i=2 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.375+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94226275676064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0baa0 con 0x55b2c3b00150 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.376+0000 7f4e97753640 1 -- 172.21.15.99:0/3560336249 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94226275676064] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e90055070 con 0x55b2c3b00150 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.376+0000 7f4e9bc36800 20 remove_watcher() i=3 2024-09-13T23:25:32.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.376+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94226275684944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0baa0 con 0x55b2c3afb890 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.378+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94226275684944] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x55b2c3afb890 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.378+0000 7f4e9bc36800 20 remove_watcher() i=4 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.378+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94226275688832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0baa0 con 0x7f4e90044070 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.379+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94226275688832] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.379+0000 7f4e9bc36800 20 remove_watcher() i=5 2024-09-13T23:25:32.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.379+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94226275691152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0e180 con 0x7f4e90044070 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.380+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94226275691152] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.380+0000 7f4e9bc36800 20 remove_watcher() i=6 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.380+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94226275692208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b2c3b0ea90 con 0x7f4e90044070 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94226275692208] v31'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4e8c03b040 con 0x7f4e90044070 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 20 remove_watcher() i=7 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4e90044070 msgr2=0x7f4e900205b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4e90044070 0x7f4e900205b0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c3afb890 msgr2=0x55b2c3afdd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c3afb890 0x55b2c3afdd50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3b00150 msgr2=0x55b2c3b02560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3b00150 0x55b2c3b02560 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b2c3b04d70 msgr2=0x55b2c3b07230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b2c3b04d70 0x55b2c3b07230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d60036b90 msgr2=0x7f4d60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d60036b90 0x7f4d60039050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4e880514a0 tx=0x7f4e88096000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 msgr2=0x55b2c3aeffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4e90048010 tx=0x7f4e9004cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e96751640 1 -- 172.21.15.99:0/3560336249 reap_dead start 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 shutdown_connections 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/3560336249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3ae8b20 0x55b2c3aeffc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 >> 172.21.15.99:0/3560336249 conn(0x55b2c3ae4ed0 msgr2=0x55b2c3ae2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 shutdown_connections 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/3560336249 wait complete. 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 msgr2=0x7f4d70039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 0x7f4d70039050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b2c3ac56f0 tx=0x7f4e8800a2c0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 msgr2=0x55b2c3adc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55b2c3ac2240 tx=0x7f4e900167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 shutdown_connections 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d70036b90 0x7f4d70039050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/969388776 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c3adbeb0 0x55b2c3adc2d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 >> 172.21.15.99:0/969388776 conn(0x55b2c3ad0e40 msgr2=0x55b2c3ad39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 shutdown_connections 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.381+0000 7f4e9bc36800 1 -- 172.21.15.99:0/969388776 wait complete. 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 msgr2=0x55b2c3ac8200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 0x55b2c3ac8200 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 msgr2=0x55b2c3acce80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 0x55b2c3acce80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 msgr2=0x7f4d7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 0x7f4d7c039050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c000c00 tx=0x7f4e8c0013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 msgr2=0x55b2c3ac1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4e88005570 tx=0x7f4e88002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 shutdown_connections 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b2c3acaa90 0x55b2c3acce80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b2c39cb710 0x55b2c3ac8200 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4d7c036b90 0x7f4d7c039050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 --2- 172.21.15.99:0/1464015299 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b2c393c6b0 0x55b2c3ac1190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 >> 172.21.15.99:0/1464015299 conn(0x55b2c39c2de0 msgr2=0x55b2c39c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 shutdown_connections 2024-09-13T23:25:32.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.382+0000 7f4e9bc36800 1 -- 172.21.15.99:0/1464015299 wait complete. 2024-09-13T23:25:32.392 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:25:32.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:25:32.392 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:25:32.435 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.436 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.435+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.435+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.435+0000 7fe4c3726800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55de0973d550 0x55de0973d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.435+0000 7fe4c3726800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55de095fdb30 con 0x55de0973de90 2024-09-13T23:25:32.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.435+0000 7fe4c3726800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55de095df360 con 0x55de0973d550 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4bf3e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55de0973d550 0x55de0973d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4b7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55de0973de90 0x55de09742a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43872/0 (socket says 172.21.15.99:43872) 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4bf3e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55de0973d550 0x55de0973d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49072/0 (socket says 172.21.15.99:49072) 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1522247890 learned_addr learned my addr 172.21.15.99:0/1522247890 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1522247890 >> v1:172.21.15.43:6789/0 conn(0x55de0973de90 legacy=0x55de09742a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1522247890 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de09605e00 con 0x55de0973d550 2024-09-13T23:25:32.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.436+0000 7fe4bebe2640 1 -- 172.21.15.99:0/1522247890 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126421295 0 0) 0x55de095fdb30 con 0x55de0973de90 2024-09-13T23:25:32.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1522247890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0973d950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000a470 tx=0x7fe4b0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc6447a9c5d384c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4bebe2640 1 -- 172.21.15.99:0/1522247890 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0053570 con 0x55de0973d550 2024-09-13T23:25:32.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4bebe2640 1 -- 172.21.15.99:0/1522247890 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0058070 con 0x55de0973d550 2024-09-13T23:25:32.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4bebe2640 1 -- 172.21.15.99:0/1522247890 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0053880 con 0x55de0973d550 2024-09-13T23:25:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 -- 172.21.15.99:0/1522247890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 msgr2=0x55de0973d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1522247890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0973d950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000a470 tx=0x7fe4b0045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 -- 172.21.15.99:0/1522247890 shutdown_connections 2024-09-13T23:25:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1522247890 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0973d950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 -- 172.21.15.99:0/1522247890 >> 172.21.15.99:0/1522247890 conn(0x55de09738de0 msgr2=0x55de0973b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 -- 172.21.15.99:0/1522247890 shutdown_connections 2024-09-13T23:25:32.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.438+0000 7fe4c3726800 1 -- 172.21.15.99:0/1522247890 wait complete. 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4c3726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4c3726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de0968a330 con 0x55de0973d550 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4bf3e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4bf3e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49074/0 (socket says 172.21.15.99:49074) 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.452+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1750629178 learned_addr learned my addr 172.21.15.99:0/1750629178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.453+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1750629178 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de095d7bc0 con 0x55de0973d550 2024-09-13T23:25:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.453+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1750629178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0005870 tx=0x7fe4b0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcccdb47e7735f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.453+0000 7fe3ad60a640 1 -- 172.21.15.99:0/1750629178 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b005c580 con 0x55de0973d550 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.453+0000 7fe3ad60a640 1 -- 172.21.15.99:0/1750629178 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0063030 con 0x55de0973d550 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.453+0000 7fe3ad60a640 1 -- 172.21.15.99:0/1750629178 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b005c850 con 0x55de0973d550 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- 172.21.15.99:0/1750629178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 msgr2=0x55de0982c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1750629178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0005870 tx=0x7fe4b0051000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- 172.21.15.99:0/1750629178 shutdown_connections 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1750629178 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982c5c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- 172.21.15.99:0/1750629178 >> 172.21.15.99:0/1750629178 conn(0x55de09738de0 msgr2=0x55de09827f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- 172.21.15.99:0/1750629178 shutdown_connections 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- 172.21.15.99:0/1750629178 wait complete. 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4c3726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de09744570 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.454+0000 7fe4bf3e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4bf3e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49086/0 (socket says 172.21.15.99:49086) 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1664423596 learned_addr learned my addr 172.21.15.99:0/1664423596 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de095ebfe0 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0045f50 tx=0x7fe4b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe3abe07640 1 -- 172.21.15.99:0/1664423596 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0078070 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe3abe07640 1 -- 172.21.15.99:0/1664423596 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0054a70 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de098291e0 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe3abe07640 1 -- 172.21.15.99:0/1664423596 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0054d50 con 0x55de0973d550 2024-09-13T23:25:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.455+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de09829760 con 0x55de0973d550 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe3abe07640 1 -- 172.21.15.99:0/1664423596 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4b007b070 con 0x55de0973d550 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe3abe07640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe3abe07640 1 -- 172.21.15.99:0/1664423596 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe4b0070070 con 0x55de0973d550 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 0x55de0983e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0983e8d0 con 0x55de0973de90 2024-09-13T23:25:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.456+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 0x55de0983e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 0x7fe3a4039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000c00 tx=0x7fe4a80013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 0x55de0983e390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1664423596 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4b800a4a0 con 0x55de0973de90 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0983f1a0 con 0x55de0973de90 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1664423596 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4b800a4a0 con 0x55de0973de90 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 0x55de09843060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098437f0 con 0x55de09840bd0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.457+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 0x55de09843060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.458+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 0x55de09843060 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.458+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1664423596 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4b007a030 con 0x55de09840bd0 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.458+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0983f9f0 con 0x55de0973de90 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.458+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1664423596 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4b800a4a0 con 0x55de0973de90 2024-09-13T23:25:32.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.458+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0983fdd0 con 0x55de09840bd0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1664423596 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4b007a030 con 0x55de09840bd0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4c3726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4c3726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de0982b030 con 0x55de098521b0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49102/0 (socket says 172.21.15.99:49102) 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/4227413035 learned_addr learned my addr 172.21.15.99:0/4227413035 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.459+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/4227413035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de09852b10 con 0x55de098521b0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55de09829950 tx=0x7fe4b80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe3a9602640 1 -- 172.21.15.99:0/4227413035 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8013450 con 0x55de098521b0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe3a9602640 1 -- 172.21.15.99:0/4227413035 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b80135f0 con 0x55de098521b0 2024-09-13T23:25:32.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de09852da0 con 0x55de098521b0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe3a9602640 1 -- 172.21.15.99:0/4227413035 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8013910 con 0x55de098521b0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.460+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de09855a80 con 0x55de098521b0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe3a9602640 1 -- 172.21.15.99:0/4227413035 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4b8011040 con 0x55de098521b0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe3a9602640 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 0x7fe398039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe3a9602640 1 -- 172.21.15.99:0/4227413035 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe4b800e040 con 0x55de098521b0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 0x7fe398039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 0x7fe398039050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0090010 tx=0x7fe4b0054f70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4c3726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4c3726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de095d9580 con 0x55de0985ef00 2024-09-13T23:25:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49118/0 (socket says 172.21.15.99:49118) 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.461+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/205819804 learned_addr learned my addr 172.21.15.99:0/205819804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/205819804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de0985f8d0 con 0x55de0985ef00 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/205819804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804ce00 tx=0x7fe4b8029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550ce43dae8711c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe3a2ffd640 1 -- 172.21.15.99:0/205819804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8046120 con 0x55de0985ef00 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe3a2ffd640 1 -- 172.21.15.99:0/205819804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b801f390 con 0x55de0985ef00 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe3a2ffd640 1 -- 172.21.15.99:0/205819804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8012cb0 con 0x55de0985ef00 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 -- 172.21.15.99:0/205819804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 msgr2=0x55de0985f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 --2- 172.21.15.99:0/205819804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804ce00 tx=0x7fe4b8029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 -- 172.21.15.99:0/205819804 shutdown_connections 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 --2- 172.21.15.99:0/205819804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de0985f300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 -- 172.21.15.99:0/205819804 >> 172.21.15.99:0/205819804 conn(0x55de0985b260 msgr2=0x55de09859360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 -- 172.21.15.99:0/205819804 shutdown_connections 2024-09-13T23:25:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.462+0000 7fe4c3726800 1 -- 172.21.15.99:0/205819804 wait complete. 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4c3726800 1 Processor -- start 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4c3726800 1 -- start start 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4c3726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4c3726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55de0985fdc0 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4bfbe4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49130/0 (socket says 172.21.15.99:49130) 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 learned_addr learned my addr 172.21.15.99:0/1630982420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.463+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de09866770 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804bcd0 tx=0x7fe4b804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe3a17fa640 1 -- 172.21.15.99:0/1630982420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8038020 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe3a17fa640 1 -- 172.21.15.99:0/1630982420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8030040 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55de09866a00 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe3a17fa640 1 -- 172.21.15.99:0/1630982420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4b802f070 con 0x55de0985ef00 2024-09-13T23:25:32.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de098696b0 con 0x55de0985ef00 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.464+0000 7fe3a17fa640 1 -- 172.21.15.99:0/1630982420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe4b803b020 con 0x55de0985ef00 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe3a17fa640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe388036b90 0x7fe388039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe3a17fa640 1 -- 172.21.15.99:0/1630982420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe4b8041040 con 0x55de0985ef00 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe388036b90 0x7fe388039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe388036b90 0x7fe388039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4b007c730 tx=0x7fe4b0095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de09871ee0 0x55de098743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.465+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09874af0 con 0x55de09871ee0 2024-09-13T23:25:32.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de09871ee0 0x55de098743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de09871ee0 0x55de098743a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4a800f5f0 con 0x55de09871ee0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 realm 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09871330 con 0x55de09871ee0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4a800f5f0 con 0x55de09871ee0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098755e0 con 0x55de09871ee0 2024-09-13T23:25:32.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4a800f5f0 con 0x55de09871ee0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.466+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09875eb0 con 0x55de09871ee0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4a800f5f0 con 0x55de09871ee0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de098768d0 0x55de09878cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09879430 con 0x55de098768d0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de098768d0 0x55de09878cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de098768d0 0x55de09878cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 20 searching for the correct realm 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55de0987b3e0 0x55de0987d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.467+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55de0987b3e0 0x55de0987d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bf3e3640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55de0987b3e0 0x55de0987d8a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bfbe4640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe4b803d020 0x7fe4b8021440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.468+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe4b803d020 0x7fe4b8021440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe4b803d020 0x7fe4b8021440 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a800f5f0 con 0x7fe4b803d020 2024-09-13T23:25:32.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a800f5f0 con 0x55de09871ee0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.469+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x7fe4b803d020 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x7fe4b803d020 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.470+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x7fe4b803d020 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.471+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x7fe4b803d020 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.472+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x7fe4b803d020 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.473+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a802b040 con 0x55de09871ee0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.474+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de0987b3e0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.475+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x7fe4b803d020 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de09871ee0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55de0987df70 con 0x55de098768d0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09879e20 con 0x55de09871ee0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.476+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0987a6c0 con 0x55de09871ee0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0987e3f0 con 0x55de098768d0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 zone default found 2024-09-13T23:25:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 4 Realm: () 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 zonegroup default 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de0987a320 con 0x7fe4b803d020 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.477+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098806a0 con 0x55de0987b3e0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de09880a40 con 0x55de0987b3e0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 20 started sync module instance, tier type = 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.478+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de0987fb40 con 0x55de098768d0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.479+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.479+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94412131008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de0987fb40 con 0x55de098768d0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.479+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098814d0 con 0x55de09871ee0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.480+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94412131008608] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.480+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.480+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94412131012544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de0987fb40 con 0x55de09871ee0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.480+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09881f60 con 0x55de0987b3e0 2024-09-13T23:25:32.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.481+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94412131012544] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.481+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.481+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94412131006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de0987fab0 con 0x55de0987b3e0 2024-09-13T23:25:32.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.481+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09882e20 con 0x55de098768d0 2024-09-13T23:25:32.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.482+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94412131006096] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.482+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.482+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94412131019120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09882d90 con 0x55de098768d0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.482+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09883ce0 con 0x55de09871ee0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.483+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94412131019120] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.484+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.484+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94412131021328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09883ce0 con 0x55de09871ee0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.484+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098846a0 con 0x7fe4b803d020 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.485+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94412131021328] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.485+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.485+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94412131023376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098846a0 con 0x7fe4b803d020 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.485+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09885060 con 0x7fe4b803d020 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.486+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94412131023376] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.486+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.486+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94412131028368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098846a0 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.486+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09885a70 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94412131030464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de09885e90 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=0 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=1 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=2 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=3 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=4 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=5 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94412131028368] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.487+0000 7fe4c3726800 20 add_watcher() i=6 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94412131030464] v31'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4c3726800 20 add_watcher() i=7 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4c3726800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098841f0 con 0x55de09871ee0 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.488+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94412131031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098841f0 con 0x55de09871ee0 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.489+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94412131031520] v31'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.489+0000 7fe375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 5 note: GC not initialized 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe374fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 20 Filter name: none 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe2ee7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.490+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098bc270 con 0x55de09871ee0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098bed00 con 0x55de098768d0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.491+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098c2580 con 0x55de09871ee0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4c3726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4c3726800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4c3726800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94412131278624 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55de098bdcf0 con 0x55de09871ee0 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94412131021328 notify 133143986177 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fe4a8018040 con 0x55de09871ee0 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe3a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94412131021328 notifier 4318 bl.length()=567 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe3a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe3a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify cookie 94412131278624 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe3a2ffd640 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe384003ea0 con 0x55de09871ee0 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.492+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.493+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94412131278624 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe4a801db40 con 0x55de09871ee0 2024-09-13T23:25:32.505 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.493+0000 7fe375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.493+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94412131031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de09871ee0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.494+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94412131031520] v31'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.494+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94412131008608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de098768d0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.495+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94412131008608] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.495+0000 7fe4c3726800 20 remove_watcher() i=0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.495+0000 7fe4c3726800 2 removed watcher, disabling cache 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.495+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94412131012544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de09871ee0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.496+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94412131012544] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.496+0000 7fe4c3726800 20 remove_watcher() i=1 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.497+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94412131006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de0987b3e0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.497+0000 7fe4bf3e3640 1 -- 172.21.15.99:0/1630982420 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94412131006096] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b007a030 con 0x55de0987b3e0 2024-09-13T23:25:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.497+0000 7fe4c3726800 20 remove_watcher() i=2 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.498+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94412131019120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de098768d0 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.498+0000 7fe4bfbe4640 1 -- 172.21.15.99:0/1630982420 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94412131019120] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4b8032070 con 0x55de098768d0 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.499+0000 7fe4c3726800 20 remove_watcher() i=3 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.499+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94412131021328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x55de09871ee0 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.500+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94412131021328] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x55de09871ee0 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.500+0000 7fe4c3726800 20 remove_watcher() i=4 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.500+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94412131023376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x7fe4b803d020 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.501+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94412131023376] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.501+0000 7fe4c3726800 20 remove_watcher() i=5 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.501+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94412131028368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x7fe4b803d020 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.502+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94412131028368] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.502+0000 7fe4c3726800 20 remove_watcher() i=6 2024-09-13T23:25:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.502+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94412131030464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55de098b9fc0 con 0x7fe4b803d020 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94412131030464] v31'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4a803b040 con 0x7fe4b803d020 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 20 remove_watcher() i=7 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe4b803d020 msgr2=0x7fe4b8021440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe4b803d020 0x7fe4b8021440 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de09871ee0 msgr2=0x55de098743a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de09871ee0 0x55de098743a0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de098768d0 msgr2=0x55de09878cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de098768d0 0x55de09878cc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55de0987b3e0 msgr2=0x55de0987d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55de0987b3e0 0x55de0987d8a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe388036b90 msgr2=0x7fe388039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe388036b90 0x7fe388039050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4b007c730 tx=0x7fe4b0095000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 msgr2=0x55de09866230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4b7fff640 1 -- 172.21.15.99:0/1630982420 reap_dead start 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804bcd0 tx=0x7fe4b804cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 shutdown_connections 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1630982420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0985ef00 0x55de09866230 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 >> 172.21.15.99:0/1630982420 conn(0x55de0985b260 msgr2=0x55de09859330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 shutdown_connections 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.503+0000 7fe4c3726800 1 -- 172.21.15.99:0/1630982420 wait complete. 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 msgr2=0x7fe398039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 0x7fe398039050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0090010 tx=0x7fe4b0054f70 comp rx=0 tx=0).stop 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 msgr2=0x55de098525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55de09829950 tx=0x7fe4b80163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 shutdown_connections 2024-09-13T23:25:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe398036b90 0x7fe398039050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/4227413035 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de098521b0 0x55de098525d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 >> 172.21.15.99:0/4227413035 conn(0x55de09847140 msgr2=0x55de09849cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 shutdown_connections 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/4227413035 wait complete. 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 msgr2=0x55de0983e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 0x55de0983e390 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 msgr2=0x55de09843060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 0x55de09843060 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 msgr2=0x7fe3a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 0x7fe3a4039000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8000c00 tx=0x7fe4a80013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 msgr2=0x55de0982aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0045f50 tx=0x7fe4b0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 shutdown_connections 2024-09-13T23:25:32.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55de09840bd0 0x55de09843060 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55de0973de90 0x55de0983e390 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe3a4036b40 0x7fe3a4039000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 --2- 172.21.15.99:0/1664423596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55de0973d550 0x55de0982aaf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 >> 172.21.15.99:0/1664423596 conn(0x55de09738de0 msgr2=0x55de0982b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 shutdown_connections 2024-09-13T23:25:32.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.504+0000 7fe4c3726800 1 -- 172.21.15.99:0/1664423596 wait complete. 2024-09-13T23:25:32.516 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.516 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.559+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.559+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f7124339800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x558009bf8d90 0x558009bfb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f7124339800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558009ab1b30 con 0x558009b66610 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f7124339800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x558009a93360 con 0x558009bf8d90 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711f7d0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x558009bf8d90 0x558009bfb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711ffd1640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x558009b66610 0x558009bf7670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43888/0 (socket says 172.21.15.99:43888) 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711f7d0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x558009bf8d90 0x558009bfb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49134/0 (socket says 172.21.15.99:49134) 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711ffd1640 1 -- 172.21.15.99:0/3863425785 learned_addr learned my addr 172.21.15.99:0/3863425785 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711f7d0640 1 -- 172.21.15.99:0/3863425785 >> v1:172.21.15.43:6789/0 conn(0x558009b66610 legacy=0x558009bf7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.560+0000 7f711f7d0640 1 -- 172.21.15.99:0/3863425785 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009ab9e00 con 0x558009bf8d90 2024-09-13T23:25:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.562+0000 7f711f7d0640 1 --2- 172.21.15.99:0/3863425785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009bf8d90 0x558009bfb180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f711400a470 tx=0x7f7114045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9a0b492c515492 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.562+0000 7f711efcf640 1 -- 172.21.15.99:0/3863425785 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7114053570 con 0x558009bf8d90 2024-09-13T23:25:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.562+0000 7f711efcf640 1 -- 172.21.15.99:0/3863425785 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7114058070 con 0x558009bf8d90 2024-09-13T23:25:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.562+0000 7f711efcf640 1 -- 172.21.15.99:0/3863425785 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7114053880 con 0x558009bf8d90 2024-09-13T23:25:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 -- 172.21.15.99:0/3863425785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009bf8d90 msgr2=0x558009bfb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 --2- 172.21.15.99:0/3863425785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009bf8d90 0x558009bfb180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f711400a470 tx=0x7f7114045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 -- 172.21.15.99:0/3863425785 shutdown_connections 2024-09-13T23:25:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 --2- 172.21.15.99:0/3863425785 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009bf8d90 0x558009bfb180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 -- 172.21.15.99:0/3863425785 >> 172.21.15.99:0/3863425785 conn(0x558009becde0 msgr2=0x558009bef200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 -- 172.21.15.99:0/3863425785 shutdown_connections 2024-09-13T23:25:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.563+0000 7f7124339800 1 -- 172.21.15.99:0/3863425785 wait complete. 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.576+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.576+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f7124339800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f7124339800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558009b3e330 con 0x558009b66610 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f711ffd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f711ffd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49136/0 (socket says 172.21.15.99:49136) 2024-09-13T23:25:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f711ffd1640 1 -- 172.21.15.99:0/1112165118 learned_addr learned my addr 172.21.15.99:0/1112165118 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f711ffd1640 1 -- 172.21.15.99:0/1112165118 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009a8bbc0 con 0x558009b66610 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f711ffd1640 1 --2- 172.21.15.99:0/1112165118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7110001e10 tx=0x7f711000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b845dacb032f8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f700de0b640 1 -- 172.21.15.99:0/1112165118 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7110012020 con 0x558009b66610 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f700de0b640 1 -- 172.21.15.99:0/1112165118 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711000e5a0 con 0x558009b66610 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.577+0000 7f700de0b640 1 -- 172.21.15.99:0/1112165118 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711000e8e0 con 0x558009b66610 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 -- 172.21.15.99:0/1112165118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 msgr2=0x558009ce3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 --2- 172.21.15.99:0/1112165118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7110001e10 tx=0x7f711000b780 comp rx=0 tx=0).stop 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 -- 172.21.15.99:0/1112165118 shutdown_connections 2024-09-13T23:25:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 --2- 172.21.15.99:0/1112165118 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ce3a90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 -- 172.21.15.99:0/1112165118 >> 172.21.15.99:0/1112165118 conn(0x558009becde0 msgr2=0x558009cdf450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 -- 172.21.15.99:0/1112165118 shutdown_connections 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.578+0000 7f7124339800 1 -- 172.21.15.99:0/1112165118 wait complete. 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7124339800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7124339800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558009bfb990 con 0x558009b66610 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f711ffd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f711ffd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49138/0 (socket says 172.21.15.99:49138) 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f711ffd1640 1 -- 172.21.15.99:0/2166399987 learned_addr learned my addr 172.21.15.99:0/2166399987 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f711ffd1640 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009a9ffe0 con 0x558009b66610 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f711000b7c0 tx=0x7f7110000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7007fff640 1 -- 172.21.15.99:0/2166399987 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7110012030 con 0x558009b66610 2024-09-13T23:25:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.579+0000 7f7007fff640 1 -- 172.21.15.99:0/2166399987 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7110001470 con 0x558009b66610 2024-09-13T23:25:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558009ceb9e0 con 0x558009b66610 2024-09-13T23:25:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7007fff640 1 -- 172.21.15.99:0/2166399987 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711001a8d0 con 0x558009b66610 2024-09-13T23:25:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558009cebf00 con 0x558009b66610 2024-09-13T23:25:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7007fff640 1 -- 172.21.15.99:0/2166399987 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7110015020 con 0x558009b66610 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7007fff640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 0x7f7008039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.580+0000 7f7007fff640 1 -- 172.21.15.99:0/2166399987 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7110020030 con 0x558009b66610 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 0x7f7008039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 0x558009cf2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009cf2a90 con 0x558009bf8d90 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f71207d2640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 0x558009cf2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 0x7f7008039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7114057000 tx=0x7f7114052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f71207d2640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 0x558009cf2510 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f71207d2640 1 -- 172.21.15.99:0/2166399987 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009bf8d90 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.581+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009cefac0 con 0x558009bf8d90 2024-09-13T23:25:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f71207d2640 1 -- 172.21.15.99:0/2166399987 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f711800a4a0 con 0x558009bf8d90 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 0x558009cf7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009cf7830 con 0x558009cf4da0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 0x558009cf7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 0x558009cf7190 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f711ffd1640 1 -- 172.21.15.99:0/2166399987 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7110018950 con 0x558009cf4da0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009cf3c40 con 0x558009bf8d90 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.582+0000 7f71207d2640 1 -- 172.21.15.99:0/2166399987 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f711800a4a0 con 0x558009bf8d90 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009cf4120 con 0x558009cf4da0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f711ffd1640 1 -- 172.21.15.99:0/2166399987 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7110018950 con 0x558009cf4da0 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f7124339800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.583+0000 7f7124339800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558009a8d580 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49154/0 (socket says 172.21.15.99:49154) 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f71207d2640 1 -- 172.21.15.99:0/1913866508 learned_addr learned my addr 172.21.15.99:0/1913866508 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f71207d2640 1 -- 172.21.15.99:0/1913866508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009d06b40 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f71207d2640 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558009cec550 tx=0x7f71180167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f70057fa640 1 -- 172.21.15.99:0/1913866508 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118013640 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f70057fa640 1 -- 172.21.15.99:0/1913866508 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71180137e0 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558009d06dd0 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f70057fa640 1 -- 172.21.15.99:0/1913866508 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118013ae0 con 0x558009d061e0 2024-09-13T23:25:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.584+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558009d09ab0 con 0x558009d061e0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.585+0000 7f70057fa640 1 -- 172.21.15.99:0/1913866508 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7118011040 con 0x558009d061e0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.585+0000 7f70057fa640 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 0x7f6ff8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.585+0000 7f70057fa640 1 -- 172.21.15.99:0/1913866508 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f711800e040 con 0x558009d061e0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.585+0000 7f711ffd1640 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 0x7f6ff8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.585+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f711ffd1640 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 0x7f6ff8039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x558009cefa00 tx=0x7f7110024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f7124339800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f7124339800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558009ce4240 con 0x558009d12ec0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49162/0 (socket says 172.21.15.99:49162) 2024-09-13T23:25:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f71207d2640 1 -- 172.21.15.99:0/1894061690 learned_addr learned my addr 172.21.15.99:0/1894061690 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f71207d2640 1 -- 172.21.15.99:0/1894061690 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009d13890 con 0x558009d12ec0 2024-09-13T23:25:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f71207d2640 1 --2- 172.21.15.99:0/1894061690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f711800afb0 tx=0x7f711801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de57331ae46532f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f6ffeffd640 1 -- 172.21.15.99:0/1894061690 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118021570 con 0x558009d12ec0 2024-09-13T23:25:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f6ffeffd640 1 -- 172.21.15.99:0/1894061690 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711801f340 con 0x558009d12ec0 2024-09-13T23:25:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.586+0000 7f6ffeffd640 1 -- 172.21.15.99:0/1894061690 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118014cc0 con 0x558009d12ec0 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- 172.21.15.99:0/1894061690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 msgr2=0x558009d132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 --2- 172.21.15.99:0/1894061690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f711800afb0 tx=0x7f711801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- 172.21.15.99:0/1894061690 shutdown_connections 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 --2- 172.21.15.99:0/1894061690 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d132c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- 172.21.15.99:0/1894061690 >> 172.21.15.99:0/1894061690 conn(0x558009d0f1d0 msgr2=0x558009d0d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- 172.21.15.99:0/1894061690 shutdown_connections 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- 172.21.15.99:0/1894061690 wait complete. 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 Processor -- start 2024-09-13T23:25:32.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- start start 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.587+0000 7f7124339800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558009d13ea0 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f71207d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49172/0 (socket says 172.21.15.99:49172) 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 learned_addr learned my addr 172.21.15.99:0/2187230354 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558009d1a860 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f71207d2640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f711804cd60 tx=0x7f711804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f6ffd7fa640 1 -- 172.21.15.99:0/2187230354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7118040360 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f6ffd7fa640 1 -- 172.21.15.99:0/2187230354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f711804e2b0 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558009d1aaf0 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f6ffd7fa640 1 -- 172.21.15.99:0/2187230354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f711804e590 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.588+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558009d1d7a0 con 0x558009d12ec0 2024-09-13T23:25:32.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.589+0000 7f6ffd7fa640 1 -- 172.21.15.99:0/2187230354 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f711803b020 con 0x558009d12ec0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.589+0000 7f6ffd7fa640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fe8036b90 0x7f6fe8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.589+0000 7f6ffd7fa640 1 -- 172.21.15.99:0/2187230354 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7118039020 con 0x558009d12ec0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.589+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fe8036b90 0x7f6fe8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009d25dc0 0x558009d28280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d289d0 con 0x558009d25dc0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009d25dc0 0x558009d28280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fe8036b90 0x7f6fe8039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7110044480 tx=0x7f7110039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009d25dc0 0x558009d28280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 realm 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d28e00 con 0x558009d25dc0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.590+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d296d0 con 0x558009d25dc0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d29a70 con 0x558009d25dc0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009d2a7d0 0x558009d2cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d2d100 con 0x558009d2a7d0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f71207d2640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009d2a7d0 0x558009d2cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.591+0000 7f71207d2640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009d2a7d0 0x558009d2cbc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f7124339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f7124339800 20 searching for the correct realm 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558009d2f140 0x558009d31600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558009d2f140 0x558009d31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f711ffd1640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558009d2f140 0x558009d31600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.592+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f71207d2640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7118044070 0x7f7118044450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7118044070 0x7f7118044450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7118044070 0x7f7118044450 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.593+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.594+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.595+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.596+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.597+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.598+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.599+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2f140 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d25dc0 2024-09-13T23:25:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.600+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558009d31cd0 con 0x558009d2a7d0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d2db40 con 0x558009d25dc0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d2d750 con 0x558009d25dc0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d2e4b0 con 0x558009d2a7d0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 zone default found 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 4 Realm: () 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 zonegroup default 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.601+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d32600 con 0x7f7118044070 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d34410 con 0x558009d2f140 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d34860 con 0x558009d2f140 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 started sync module instance, tier type = 2024-09-13T23:25:32.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.602+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d33820 con 0x558009d2a7d0 2024-09-13T23:25:32.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.603+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.603+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94008409013264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d34030 con 0x558009d2a7d0 2024-09-13T23:25:32.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.603+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d35790 con 0x558009d25dc0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.604+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94008409013264] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.604+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.604+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94008409019104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d35bb0 con 0x558009d25dc0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.604+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d36570 con 0x558009d2f140 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.605+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94008409019104] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.606+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.606+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94008409020160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d35b20 con 0x558009d2f140 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.606+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d37430 con 0x558009d2a7d0 2024-09-13T23:25:32.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.607+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94008409020160] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.607+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.607+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94008409026432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d373a0 con 0x558009d2a7d0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.607+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d382f0 con 0x558009d25dc0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.608+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.608+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94008409030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d382a0 con 0x558009d25dc0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.608+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d39290 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.609+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94008409026432] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.609+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.609+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94008409030208] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.609+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94008409034080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d39250 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.609+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d386e0 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.610+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94008409034080] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.610+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.610+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94008409032416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d397f0 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.610+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d3a1b0 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94008409032416] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94008409038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d3a5d0 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=0 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=1 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=2 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=3 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=4 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=5 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.611+0000 7f7124339800 20 add_watcher() i=6 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94008409038080] v31'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f7124339800 20 add_watcher() i=7 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f7124339800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d3d600 con 0x558009d25dc0 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.612+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94008409039136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d3ab00 con 0x558009d25dc0 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.613+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94008409039136] v31'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.613+0000 7f6fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 5 note: GC not initialized 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f6fd4fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 20 Filter name: none 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f6f4e7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:32.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.614+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558009d70420 con 0x558009d25dc0 2024-09-13T23:25:32.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.615+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.615+0000 7f7124339800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.626 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.615+0000 7f6fd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.615+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94008409039136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d6f210 con 0x558009d25dc0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.616+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94008409039136] v31'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.616+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94008409013264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d3a120 con 0x558009d2a7d0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.617+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94008409013264] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.617+0000 7f7124339800 20 remove_watcher() i=0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.617+0000 7f7124339800 2 removed watcher, disabling cache 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.617+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94008409019104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d33c10 con 0x558009d25dc0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.619+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94008409019104] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.619+0000 7f7124339800 20 remove_watcher() i=1 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.619+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94008409020160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d33c10 con 0x558009d2f140 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.620+0000 7f711ffd1640 1 -- 172.21.15.99:0/2187230354 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94008409020160] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7110018950 con 0x558009d2f140 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.620+0000 7f7124339800 20 remove_watcher() i=2 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.620+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94008409026432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d3a120 con 0x558009d2a7d0 2024-09-13T23:25:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.621+0000 7f71207d2640 1 -- 172.21.15.99:0/2187230354 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94008409026432] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f711800a4a0 con 0x558009d2a7d0 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.621+0000 7f7124339800 20 remove_watcher() i=3 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.621+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94008409030208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d36f80 con 0x558009d25dc0 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.623+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94008409030208] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x558009d25dc0 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.623+0000 7f7124339800 20 remove_watcher() i=4 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.623+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94008409034080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d36f80 con 0x7f7118044070 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.624+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94008409034080] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.624+0000 7f7124339800 20 remove_watcher() i=5 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.624+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94008409032416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d38d60 con 0x7f7118044070 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.625+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94008409032416] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.625+0000 7f7124339800 20 remove_watcher() i=6 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.625+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94008409038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558009d38d60 con 0x7f7118044070 2024-09-13T23:25:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94008409038080] v31'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7114051070 con 0x7f7118044070 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 20 remove_watcher() i=7 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7118044070 msgr2=0x7f7118044450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7118044070 0x7f7118044450 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009d25dc0 msgr2=0x558009d28280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009d25dc0 0x558009d28280 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009d2a7d0 msgr2=0x558009d2cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009d2a7d0 0x558009d2cbc0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558009d2f140 msgr2=0x558009d31600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558009d2f140 0x558009d31600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fe8036b90 msgr2=0x7f6fe8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fe8036b90 0x7f6fe8039050 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7110044480 tx=0x7f7110039000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f711f7d0640 1 -- 172.21.15.99:0/2187230354 reap_dead start 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 msgr2=0x558009d1a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f711804cd60 tx=0x7f711804cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 shutdown_connections 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/2187230354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d12ec0 0x558009d1a320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 >> 172.21.15.99:0/2187230354 conn(0x558009d0f1d0 msgr2=0x558009d0d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 shutdown_connections 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/2187230354 wait complete. 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 msgr2=0x7f6ff8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 0x7f6ff8039050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x558009cefa00 tx=0x7f7110024ec0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 msgr2=0x558009d06600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x558009cec550 tx=0x7f71180167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 shutdown_connections 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ff8036b90 0x7f6ff8039050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 --2- 172.21.15.99:0/1913866508 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009d061e0 0x558009d06600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.626+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 >> 172.21.15.99:0/1913866508 conn(0x558009cfb170 msgr2=0x558009cfdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 shutdown_connections 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/1913866508 wait complete. 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 msgr2=0x558009cf2510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 0x558009cf2510 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 msgr2=0x558009cf7190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 0x558009cf7190 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 msgr2=0x7f7008039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 0x7f7008039050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7114057000 tx=0x7f7114052000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 msgr2=0x558009ceb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f711000b7c0 tx=0x7f7110000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 shutdown_connections 2024-09-13T23:25:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558009cf4da0 0x558009cf7190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558009bf8d90 0x558009cf2510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7008036b90 0x7f7008039050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 --2- 172.21.15.99:0/2166399987 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558009b66610 0x558009ceb4a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 >> 172.21.15.99:0/2166399987 conn(0x558009becde0 msgr2=0x558009cddcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 shutdown_connections 2024-09-13T23:25:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.627+0000 7f7124339800 1 -- 172.21.15.99:0/2166399987 wait complete. 2024-09-13T23:25:32.637 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.637 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:25:32.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:25:32.637 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:25:32.682 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.682 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.681+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.681+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.681+0000 7f5b8b526800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d0bffd2df0 0x55d0c00645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.681+0000 7f5b8b526800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d0bff1eb30 con 0x55d0c0064b20 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.681+0000 7f5b8b526800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d0bff00360 con 0x55d0bffd2df0 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b87113640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d0bffd2df0 0x55d0c00645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b87113640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d0bffd2df0 0x55d0c00645e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49184/0 (socket says 172.21.15.99:49184) 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b87113640 1 -- 172.21.15.99:0/2121829773 learned_addr learned my addr 172.21.15.99:0/2121829773 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b7ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55d0c0064b20 0x55d0c0066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43896/0 (socket says 172.21.15.99:43896) 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b87113640 1 -- 172.21.15.99:0/2121829773 >> v1:172.21.15.43:6789/0 conn(0x55d0c0064b20 legacy=0x55d0c0066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b87113640 1 -- 172.21.15.99:0/2121829773 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bff26e00 con 0x55d0bffd2df0 2024-09-13T23:25:32.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.682+0000 7f5b86912640 1 -- 172.21.15.99:0/2121829773 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343437375 0 0) 0x55d0bff1eb30 con 0x55d0c0064b20 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b87113640 1 --2- 172.21.15.99:0/2121829773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c00645e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800a520 tx=0x7f5b78045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b1c10f2f2ed211 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b86912640 1 -- 172.21.15.99:0/2121829773 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78055070 con 0x55d0bffd2df0 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b86912640 1 -- 172.21.15.99:0/2121829773 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b780515b0 con 0x55d0bffd2df0 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b86912640 1 -- 172.21.15.99:0/2121829773 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780518d0 con 0x55d0bffd2df0 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b8b526800 1 -- 172.21.15.99:0/2121829773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 msgr2=0x55d0c00645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2121829773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c00645e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800a520 tx=0x7f5b78045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b8b526800 1 -- 172.21.15.99:0/2121829773 shutdown_connections 2024-09-13T23:25:32.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2121829773 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c00645e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.684+0000 7f5b8b526800 1 -- 172.21.15.99:0/2121829773 >> 172.21.15.99:0/2121829773 conn(0x55d0c0059df0 msgr2=0x55d0c005c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.685+0000 7f5b8b526800 1 -- 172.21.15.99:0/2121829773 shutdown_connections 2024-09-13T23:25:32.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.685+0000 7f5b8b526800 1 -- 172.21.15.99:0/2121829773 wait complete. 2024-09-13T23:25:32.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.698+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.698+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.698+0000 7f5b8b526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.698+0000 7f5b8b526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0bffab330 con 0x55d0bffd2df0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.698+0000 7f5b87113640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5b87113640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49194/0 (socket says 172.21.15.99:49194) 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5b87113640 1 -- 172.21.15.99:0/4211985961 learned_addr learned my addr 172.21.15.99:0/4211985961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5b87113640 1 -- 172.21.15.99:0/4211985961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bfef8bc0 con 0x55d0bffd2df0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5b87113640 1 --2- 172.21.15.99:0/4211985961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6dbdef75ecd04b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5a7560a640 1 -- 172.21.15.99:0/4211985961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b780519d0 con 0x55d0bffd2df0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5a7560a640 1 -- 172.21.15.99:0/4211985961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b78051b70 con 0x55d0bffd2df0 2024-09-13T23:25:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.699+0000 7f5a7560a640 1 -- 172.21.15.99:0/4211985961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78051e50 con 0x55d0bffd2df0 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- 172.21.15.99:0/4211985961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 msgr2=0x55d0c0150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 --2- 172.21.15.99:0/4211985961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78051000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- 172.21.15.99:0/4211985961 shutdown_connections 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 --2- 172.21.15.99:0/4211985961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c0150870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- 172.21.15.99:0/4211985961 >> 172.21.15.99:0/4211985961 conn(0x55d0c0059df0 msgr2=0x55d0c014c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- 172.21.15.99:0/4211985961 shutdown_connections 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- 172.21.15.99:0/4211985961 wait complete. 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.700+0000 7f5b8b526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0c0068900 con 0x55d0bffd2df0 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b87113640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b87113640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49208/0 (socket says 172.21.15.99:49208) 2024-09-13T23:25:32.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b87113640 1 -- 172.21.15.99:0/3406571434 learned_addr learned my addr 172.21.15.99:0/3406571434 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b87113640 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0bff0cfe0 con 0x55d0bffd2df0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b87113640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b78005570 tx=0x7f5b78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5a73e07640 1 -- 172.21.15.99:0/3406571434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78073070 con 0x55d0bffd2df0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5a73e07640 1 -- 172.21.15.99:0/3406571434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7805a580 con 0x55d0bffd2df0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0c0158620 con 0x55d0bffd2df0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5a73e07640 1 -- 172.21.15.99:0/3406571434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7805a8a0 con 0x55d0bffd2df0 2024-09-13T23:25:32.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.701+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c0158ba0 con 0x55d0bffd2df0 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5a73e07640 1 -- 172.21.15.99:0/3406571434 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b78076070 con 0x55d0bffd2df0 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5a73e07640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 0x7f5a6c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5a73e07640 1 -- 172.21.15.99:0/3406571434 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5b78062070 con 0x55d0bffd2df0 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 0x7f5a6c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 0x55d0c015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.702+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c015f770 con 0x55d0c0064b20 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b87914640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 0x55d0c015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 0x7f5a6c039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b70000c00 tx=0x7f5b700013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b87914640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 0x55d0c015f150 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b87914640 1 -- 172.21.15.99:0/3406571434 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b8000a4a0 con 0x55d0c0064b20 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c015c700 con 0x55d0c0064b20 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b87914640 1 -- 172.21.15.99:0/3406571434 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b8000a4a0 con 0x55d0c0064b20 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 0x55d0c0163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.703+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01644f0 con 0x55d0c0161a60 2024-09-13T23:25:32.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b87113640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 0x55d0c0163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b87113640 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 0x55d0c0163e50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b87113640 1 -- 172.21.15.99:0/3406571434 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c0161a60 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c0160900 con 0x55d0c0064b20 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b87914640 1 -- 172.21.15.99:0/3406571434 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b8000a4a0 con 0x55d0c0064b20 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.704+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c0160de0 con 0x55d0c0161a60 2024-09-13T23:25:32.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.705+0000 7f5b87113640 1 -- 172.21.15.99:0/3406571434 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c0161a60 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.705+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.705+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.705+0000 7f5b8b526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.705+0000 7f5b8b526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0bfefa580 con 0x55d0c0172e80 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49216/0 (socket says 172.21.15.99:49216) 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b87914640 1 -- 172.21.15.99:0/2317032089 learned_addr learned my addr 172.21.15.99:0/2317032089 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b87914640 1 -- 172.21.15.99:0/2317032089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c01737e0 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b87914640 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d0c0159190 tx=0x7f5b800167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5a71602640 1 -- 172.21.15.99:0/2317032089 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80013640 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5a71602640 1 -- 172.21.15.99:0/2317032089 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b800137e0 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0c0173a70 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5a71602640 1 -- 172.21.15.99:0/2317032089 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80013ae0 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.706+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c0176750 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.707+0000 7f5a71602640 1 -- 172.21.15.99:0/2317032089 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b80011040 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.707+0000 7f5a71602640 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 0x7f5a60039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.707+0000 7f5a71602640 1 -- 172.21.15.99:0/2317032089 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5b8000e040 con 0x55d0c0172e80 2024-09-13T23:25:32.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.707+0000 7f5b87113640 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 0x7f5a60039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.707+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87113640 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 0x7f5a60039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55d0c015c640 tx=0x7f5b7800a2c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b8b526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b8b526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0c0150f60 con 0x55d0c017fba0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49222/0 (socket says 172.21.15.99:49222) 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87914640 1 -- 172.21.15.99:0/3364250889 learned_addr learned my addr 172.21.15.99:0/3364250889 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87914640 1 -- 172.21.15.99:0/3364250889 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c0180570 con 0x55d0c017fba0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5b87914640 1 --2- 172.21.15.99:0/3364250889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b8004cde0 tx=0x7f5b800203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1026277231370f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5a6affd640 1 -- 172.21.15.99:0/3364250889 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80012c00 con 0x55d0c017fba0 2024-09-13T23:25:32.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5a6affd640 1 -- 172.21.15.99:0/3364250889 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80021960 con 0x55d0c017fba0 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.708+0000 7f5a6affd640 1 -- 172.21.15.99:0/3364250889 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80021440 con 0x55d0c017fba0 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- 172.21.15.99:0/3364250889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 msgr2=0x55d0c017ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3364250889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5b8004cde0 tx=0x7f5b800203a0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- 172.21.15.99:0/3364250889 shutdown_connections 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3364250889 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c017ffa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- 172.21.15.99:0/3364250889 >> 172.21.15.99:0/3364250889 conn(0x55d0c017bf00 msgr2=0x55d0c017a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- 172.21.15.99:0/3364250889 shutdown_connections 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- 172.21.15.99:0/3364250889 wait complete. 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 Processor -- start 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- start start 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c0186fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.709+0000 7f5b8b526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d0c0180be0 con 0x55d0c017fba0 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c0186fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b87914640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c0186fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49232/0 (socket says 172.21.15.99:49232) 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 learned_addr learned my addr 172.21.15.99:0/1223396880 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c0187520 con 0x55d0c017fba0 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b87914640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c0186fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5b800203e0 tx=0x7f5b8000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5a697fa640 1 -- 172.21.15.99:0/1223396880 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80039070 con 0x55d0c017fba0 2024-09-13T23:25:32.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5a697fa640 1 -- 172.21.15.99:0/1223396880 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b8001f480 con 0x55d0c017fba0 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d0c01877b0 con 0x55d0c017fba0 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5a697fa640 1 -- 172.21.15.99:0/1223396880 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b80021570 con 0x55d0c017fba0 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.710+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c018a460 con 0x55d0c017fba0 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.711+0000 7f5a697fa640 1 -- 172.21.15.99:0/1223396880 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5b8001f6c0 con 0x55d0c017fba0 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.711+0000 7f5a697fa640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a50036af0 0x7f5a50038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.711+0000 7f5a697fa640 1 -- 172.21.15.99:0/1223396880 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f5b80031050 con 0x55d0c017fba0 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.711+0000 7f5b87113640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a50036af0 0x7f5a50038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b87113640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a50036af0 0x7f5a50038fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b780514a0 tx=0x7f5b78096000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0192bc0 0x55d0c0195080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01957d0 con 0x55d0c0192bc0 2024-09-13T23:25:32.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0192bc0 0x55d0c0195080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0192bc0 0x55d0c0195080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f5f0 con 0x55d0c0192bc0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 20 realm 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.712+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c0192010 con 0x55d0c0192bc0 2024-09-13T23:25:32.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f5f0 con 0x55d0c0192bc0 2024-09-13T23:25:32.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01962c0 con 0x55d0c0192bc0 2024-09-13T23:25:32.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7000f5f0 con 0x55d0c0192bc0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c0196b90 con 0x55d0c0192bc0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b7000f5f0 con 0x55d0c0192bc0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c01975b0 0x55d0c01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019a110 con 0x55d0c01975b0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b87914640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c01975b0 0x55d0c01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.713+0000 7f5b87914640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c01975b0 0x55d0c01999a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b8003b030 con 0x55d0c01975b0 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b8b526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b8b526800 20 searching for the correct realm 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d0c019c0c0 0x55d0c019e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b87113640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d0c019c0c0 0x55d0c019e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b87113640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d0c019c0c0 0x55d0c019e580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.714+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8003b030 con 0x55d0c01975b0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b87914640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5b80037bb0 0x7f5b80040670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5b80037bb0 0x7f5b80040670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.715+0000 7f5b7ffff640 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5b80037bb0 0x7f5b80040670 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7000f5f0 con 0x7f5b80037bb0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7000f5f0 con 0x55d0c0192bc0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.716+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b8003b030 con 0x55d0c01975b0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.717+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5b8003b030 con 0x55d0c01975b0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.718+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.719+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b8003b030 con 0x55d0c01975b0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7002b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.720+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c019c0c0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.721+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x7f5b80037bb0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c0192bc0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019ec50 con 0x55d0c01975b0 2024-09-13T23:25:32.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019aad0 con 0x55d0c0192bc0 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.722+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019b370 con 0x55d0c0192bc0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019a710 con 0x55d0c01975b0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 zone default found 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 4 Realm: () 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 zonegroup default 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019f580 con 0x7f5b80037bb0 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.723+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a11c0 con 0x55d0c019c0c0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a1630 con 0x55d0c019c0c0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 20 started sync module instance, tier type = 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.724+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a0090 con 0x55d0c01975b0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.725+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.725+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94355064489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c019fcf0 con 0x55d0c01975b0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.725+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a2560 con 0x55d0c0192bc0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.726+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94355064489088] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.726+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.726+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94355064494736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a2560 con 0x55d0c0192bc0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.726+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a2fb0 con 0x55d0c019c0c0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.727+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94355064494736] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.727+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.728+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94355064496304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a24d0 con 0x55d0c019c0c0 2024-09-13T23:25:32.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.728+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a3e70 con 0x55d0c01975b0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.729+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.729+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94355064496304] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.729+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94355064503200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a4710 con 0x55d0c01975b0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.729+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a33c0 con 0x55d0c0192bc0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.730+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.730+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94355064507600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a33c0 con 0x55d0c0192bc0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.730+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a5c00 con 0x7f5b80037bb0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.731+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.731+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94355064510224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a5b70 con 0x7f5b80037bb0 2024-09-13T23:25:32.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.731+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a6b60 con 0x7f5b80037bb0 2024-09-13T23:25:32.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.732+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94355064510224] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.732+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94355064503200] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.733+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.733+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94355064504928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a6640 con 0x7f5b80037bb0 2024-09-13T23:25:32.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.733+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a7010 con 0x7f5b80037bb0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.734+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94355064504928] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94355064507600] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94355064508656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a6b60 con 0x7f5b80037bb0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=0 2024-09-13T23:25:32.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=1 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=2 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=3 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=4 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=5 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.735+0000 7f5b8b526800 20 add_watcher() i=6 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.738+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94355064508656] v31'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.738+0000 7f5b8b526800 20 add_watcher() i=7 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.738+0000 7f5b8b526800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.738+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a6ff0 con 0x55d0c0192bc0 2024-09-13T23:25:32.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.739+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.739+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94355064512416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a74a0 con 0x55d0c0192bc0 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94355064512416] v31'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 5 note: GC not initialized 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5a3cfe1640 20 reqs_thread_entry: start 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 20 Filter name: none 2024-09-13T23:25:32.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f59b67fc640 20 reqs_thread_entry: start 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.741+0000 7f5b8b526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01dd2a0 con 0x55d0c0192bc0 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01dcd80 con 0x55d0c01975b0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.742+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01e35a0 con 0x55d0c0192bc0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v31'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b8b526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b8b526800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b8b526800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94355064762544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01e0280 con 0x55d0c0192bc0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94355064507600 notify 133143986178 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5b70018040 con 0x55d0c0192bc0 2024-09-13T23:25:32.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94355064507600 notifier 4332 bl.length()=567 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5a6affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5a6affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5a6affd640 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f5a4c003ea0 con 0x55d0c0192bc0 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify cookie 94355064762544 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94355064762544 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5b7001db00 con 0x55d0c0192bc0 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.744+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.766 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.745+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.745+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94355064512416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01daff0 con 0x55d0c0192bc0 2024-09-13T23:25:32.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.747+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94355064512416] v31'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.747+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94355064489088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01daff0 con 0x55d0c01975b0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.747+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94355064489088] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.748+0000 7f5b8b526800 20 remove_watcher() i=0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.748+0000 7f5b8b526800 2 removed watcher, disabling cache 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.748+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94355064494736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01daff0 con 0x55d0c0192bc0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.749+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94355064494736] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.749+0000 7f5b8b526800 20 remove_watcher() i=1 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.749+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94355064496304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01daff0 con 0x55d0c019c0c0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.750+0000 7f5b87113640 1 -- 172.21.15.99:0/1223396880 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94355064496304] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7807f070 con 0x55d0c019c0c0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.750+0000 7f5b8b526800 20 remove_watcher() i=2 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.750+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94355064503200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a20b0 con 0x55d0c01975b0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.751+0000 7f5b87914640 1 -- 172.21.15.99:0/1223396880 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94355064503200] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b80063040 con 0x55d0c01975b0 2024-09-13T23:25:32.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.751+0000 7f5b8b526800 20 remove_watcher() i=3 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.751+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94355064507600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a20b0 con 0x55d0c0192bc0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.752+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94355064507600] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x55d0c0192bc0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.752+0000 7f5b8b526800 20 remove_watcher() i=4 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.752+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94355064510224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a4cd0 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.753+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94355064510224] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.753+0000 7f5b8b526800 20 remove_watcher() i=5 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.753+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94355064504928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a20b0 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.754+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94355064504928] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.754+0000 7f5b8b526800 20 remove_watcher() i=6 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.754+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94355064508656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d0c01a4cd0 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94355064508656] v31'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b7003b040 con 0x7f5b80037bb0 2024-09-13T23:25:32.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 20 remove_watcher() i=7 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5b80037bb0 msgr2=0x7f5b80040670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5b80037bb0 0x7f5b80040670 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0192bc0 msgr2=0x55d0c0195080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0192bc0 0x55d0c0195080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c01975b0 msgr2=0x55d0c01999a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c01975b0 0x55d0c01999a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d0c019c0c0 msgr2=0x55d0c019e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d0c019c0c0 0x55d0c019e580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a50036af0 msgr2=0x7f5a50038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a50036af0 0x7f5a50038fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b780514a0 tx=0x7f5b78096000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 msgr2=0x55d0c0186fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 --2- 172.21.15.99:0/1223396880 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c017fba0 0x55d0c0186fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5b800203e0 tx=0x7f5b8000af70 comp rx=0 tx=0).stop 2024-09-13T23:25:32.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 reap_dead start 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b7ffff640 1 -- 172.21.15.99:0/1223396880 reap_dead start 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 shutdown_connections 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.755+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 >> 172.21.15.99:0/1223396880 conn(0x55d0c017bf00 msgr2=0x55d0c0179fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 shutdown_connections 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/1223396880 wait complete. 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 msgr2=0x7f5a60039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 0x7f5a60039050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55d0c015c640 tx=0x7f5b7800a2c0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 msgr2=0x55d0c01732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55d0c0159190 tx=0x7f5b800167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 shutdown_connections 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a60036b90 0x7f5a60039050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/2317032089 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0c0172e80 0x55d0c01732a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 >> 172.21.15.99:0/2317032089 conn(0x55d0c0167e10 msgr2=0x55d0c016a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 shutdown_connections 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/2317032089 wait complete. 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 msgr2=0x55d0c015f150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 0x55d0c015f150 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 msgr2=0x55d0c0163e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 0x55d0c0163e50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 msgr2=0x7f5a6c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 0x7f5a6c039050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b70000c00 tx=0x7f5b700013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 msgr2=0x55d0c01580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5b78005570 tx=0x7f5b78002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 shutdown_connections 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d0c0161a60 0x55d0c0163e50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d0c0064b20 0x55d0c015f150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5a6c036b90 0x7f5a6c039050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.756+0000 7f5b8b526800 1 --2- 172.21.15.99:0/3406571434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d0bffd2df0 0x55d0c01580e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.757+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 >> 172.21.15.99:0/3406571434 conn(0x55d0c0059df0 msgr2=0x55d0c014ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.757+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 shutdown_connections 2024-09-13T23:25:32.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.757+0000 7f5b8b526800 1 -- 172.21.15.99:0/3406571434 wait complete. 2024-09-13T23:25:32.778 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.778 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:32.779 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:32.856 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:32.856 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:32.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.855+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.855+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.855+0000 7f08fca10800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdbbd82a10 0x55fdbbd84e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.855+0000 7f08fca10800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fdbbc3db30 con 0x55fdbbcf2590 2024-09-13T23:25:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.855+0000 7f08fca10800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55fdbbc1f360 con 0x55fdbbd82a10 2024-09-13T23:25:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08ef8f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdbbd82a10 0x55fdbbd84e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08ef8f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdbbd82a10 0x55fdbbd84e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49248/0 (socket says 172.21.15.99:49248) 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08f80f7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55fdbbcf2590 0x55fdbbd812f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43908/0 (socket says 172.21.15.99:43908) 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08ef8f6640 1 -- 172.21.15.99:0/2610221830 learned_addr learned my addr 172.21.15.99:0/2610221830 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08ef8f6640 1 -- 172.21.15.99:0/2610221830 >> v1:172.21.15.43:6789/0 conn(0x55fdbbcf2590 legacy=0x55fdbbd812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08f78f6640 1 -- 172.21.15.99:0/2610221830 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931122437 0 0) 0x55fdbbc3db30 con 0x55fdbbcf2590 2024-09-13T23:25:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.856+0000 7f08ef8f6640 1 -- 172.21.15.99:0/2610221830 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbc45e00 con 0x55fdbbd82a10 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/2610221830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbd82a10 0x55fdbbd84e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f08e000a520 tx=0x7f08e0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f6be3c86ac9e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08f78f6640 1 -- 172.21.15.99:0/2610221830 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e0055070 con 0x55fdbbd82a10 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08f78f6640 1 -- 172.21.15.99:0/2610221830 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e00515b0 con 0x55fdbbd82a10 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08f78f6640 1 -- 172.21.15.99:0/2610221830 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e00518d0 con 0x55fdbbd82a10 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08fca10800 1 -- 172.21.15.99:0/2610221830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbd82a10 msgr2=0x55fdbbd84e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08fca10800 1 --2- 172.21.15.99:0/2610221830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbd82a10 0x55fdbbd84e00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f08e000a520 tx=0x7f08e0045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08fca10800 1 -- 172.21.15.99:0/2610221830 shutdown_connections 2024-09-13T23:25:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08fca10800 1 --2- 172.21.15.99:0/2610221830 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbd82a10 0x55fdbbd84e00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.858+0000 7f08fca10800 1 -- 172.21.15.99:0/2610221830 >> 172.21.15.99:0/2610221830 conn(0x55fdbbd78de0 msgr2=0x55fdbbd7b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.859+0000 7f08fca10800 1 -- 172.21.15.99:0/2610221830 shutdown_connections 2024-09-13T23:25:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.859+0000 7f08fca10800 1 -- 172.21.15.99:0/2610221830 wait complete. 2024-09-13T23:25:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.872+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08fca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08fca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdbbcca330 con 0x55fdbbcf2590 2024-09-13T23:25:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08f80f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08f80f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49262/0 (socket says 172.21.15.99:49262) 2024-09-13T23:25:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08f80f7640 1 -- 172.21.15.99:0/3416309941 learned_addr learned my addr 172.21.15.99:0/3416309941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.873+0000 7f08f80f7640 1 -- 172.21.15.99:0/3416309941 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbc17bc0 con 0x55fdbbcf2590 2024-09-13T23:25:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08f80f7640 1 --2- 172.21.15.99:0/3416309941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08e800b240 tx=0x7f08e800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45282f958df88f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f07e660c640 1 -- 172.21.15.99:0/3416309941 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e8008070 con 0x55fdbbcf2590 2024-09-13T23:25:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f07e660c640 1 -- 172.21.15.99:0/3416309941 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e800d500 con 0x55fdbbcf2590 2024-09-13T23:25:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f07e660c640 1 -- 172.21.15.99:0/3416309941 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e800d860 con 0x55fdbbcf2590 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 -- 172.21.15.99:0/3416309941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 msgr2=0x55fdbbe6d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 --2- 172.21.15.99:0/3416309941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f08e800b240 tx=0x7f08e800b700 comp rx=0 tx=0).stop 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 -- 172.21.15.99:0/3416309941 shutdown_connections 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 --2- 172.21.15.99:0/3416309941 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbe6d650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 -- 172.21.15.99:0/3416309941 >> 172.21.15.99:0/3416309941 conn(0x55fdbbd78de0 msgr2=0x55fdbbe69010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 -- 172.21.15.99:0/3416309941 shutdown_connections 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.874+0000 7f08fca10800 1 -- 172.21.15.99:0/3416309941 wait complete. 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08fca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08fca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdbbd856d0 con 0x55fdbbcf2590 2024-09-13T23:25:32.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08f80f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08f80f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49270/0 (socket says 172.21.15.99:49270) 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.875+0000 7f08f80f7640 1 -- 172.21.15.99:0/2954382194 learned_addr learned my addr 172.21.15.99:0/2954382194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f08f80f7640 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbc2bfe0 con 0x55fdbbcf2590 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f08f80f7640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55fdbbe6e4b0 tx=0x7f08e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f07e4e09640 1 -- 172.21.15.99:0/2954382194 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e8019870 con 0x55fdbbcf2590 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f07e4e09640 1 -- 172.21.15.99:0/2954382194 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e8019a10 con 0x55fdbbcf2590 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbbd7d310 con 0x55fdbbcf2590 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f07e4e09640 1 -- 172.21.15.99:0/2954382194 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e8019d30 con 0x55fdbbcf2590 2024-09-13T23:25:32.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.876+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbbd7d830 con 0x55fdbbcf2590 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f07e4e09640 1 -- 172.21.15.99:0/2954382194 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f08e8017040 con 0x55fdbbcf2590 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f07e4e09640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 0x7f07e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f07e4e09640 1 -- 172.21.15.99:0/2954382194 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f08e8015020 con 0x55fdbbcf2590 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 0x7f07e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 0x55fdbbe7e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbe7e9c0 con 0x55fdbbd82a10 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f08f88f8640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 0x55fdbbe7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.877+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 0x7f07e0039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08e000a520 tx=0x7f08e0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08f88f8640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 0x55fdbbe7e480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08f88f8640 1 -- 172.21.15.99:0/2954382194 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08f000a4a0 con 0x55fdbbd82a10 2024-09-13T23:25:32.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbe7f210 con 0x55fdbbd82a10 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08f88f8640 1 -- 172.21.15.99:0/2954382194 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08f000a4a0 con 0x55fdbbd82a10 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 0x55fdbbe83090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbe83820 con 0x55fdbbe80c40 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.878+0000 7f08f80f7640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 0x55fdbbe83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08f80f7640 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 0x55fdbbe83090 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08f80f7640 1 -- 172.21.15.99:0/2954382194 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbe80c40 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbe7fa60 con 0x55fdbbd82a10 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08f88f8640 1 -- 172.21.15.99:0/2954382194 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08f000a4a0 con 0x55fdbbd82a10 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbe7fe40 con 0x55fdbbe80c40 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.879+0000 7f08f80f7640 1 -- 172.21.15.99:0/2954382194 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbe80c40 2024-09-13T23:25:32.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08fca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08fca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdbbd7f160 con 0x55fdbbe921a0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49272/0 (socket says 172.21.15.99:49272) 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08f88f8640 1 -- 172.21.15.99:0/1111054989 learned_addr learned my addr 172.21.15.99:0/1111054989 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.880+0000 7f08f88f8640 1 -- 172.21.15.99:0/1111054989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbe92b00 con 0x55fdbbe921a0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f08f88f8640 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55fdbbd7e290 tx=0x7f08f00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f07ddffb640 1 -- 172.21.15.99:0/1111054989 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f0013450 con 0x55fdbbe921a0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f07ddffb640 1 -- 172.21.15.99:0/1111054989 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f00135f0 con 0x55fdbbe921a0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbbe92d90 con 0x55fdbbe921a0 2024-09-13T23:25:32.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f07ddffb640 1 -- 172.21.15.99:0/1111054989 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f00138d0 con 0x55fdbbe921a0 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.881+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbbe95a70 con 0x55fdbbe921a0 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f07ddffb640 1 -- 172.21.15.99:0/1111054989 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f08f0011040 con 0x55fdbbe921a0 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f07ddffb640 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 0x7f07d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f07ddffb640 1 -- 172.21.15.99:0/1111054989 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f08f000e040 con 0x55fdbbe921a0 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 0x7f07d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 0x7f07d0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55fdbbd7dc90 tx=0x7f08e801b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08fca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08fca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdbbc19580 con 0x55fdbbe9eec0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.882+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49286/0 (socket says 172.21.15.99:49286) 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08f88f8640 1 -- 172.21.15.99:0/3230322964 learned_addr learned my addr 172.21.15.99:0/3230322964 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08f88f8640 1 -- 172.21.15.99:0/3230322964 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbe9f890 con 0x55fdbbe9eec0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08f88f8640 1 --2- 172.21.15.99:0/3230322964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08f004cd90 tx=0x7f08f0014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0613d24be99171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f07d77fe640 1 -- 172.21.15.99:0/3230322964 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f001f390 con 0x55fdbbe9eec0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f07d77fe640 1 -- 172.21.15.99:0/3230322964 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f0012cb0 con 0x55fdbbe9eec0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f07d77fe640 1 -- 172.21.15.99:0/3230322964 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f001f530 con 0x55fdbbe9eec0 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08fca10800 1 -- 172.21.15.99:0/3230322964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 msgr2=0x55fdbbe9f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.883+0000 7f08fca10800 1 --2- 172.21.15.99:0/3230322964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f08f004cd90 tx=0x7f08f0014aa0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- 172.21.15.99:0/3230322964 shutdown_connections 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 --2- 172.21.15.99:0/3230322964 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbe9f2c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- 172.21.15.99:0/3230322964 >> 172.21.15.99:0/3230322964 conn(0x55fdbbe9b270 msgr2=0x55fdbbe99370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- 172.21.15.99:0/3230322964 shutdown_connections 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- 172.21.15.99:0/3230322964 wait complete. 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 Processor -- start 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- start start 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08fca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdbbe9fce0 con 0x55fdbbe9eec0 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08f88f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49298/0 (socket says 172.21.15.99:49298) 2024-09-13T23:25:32.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 learned_addr learned my addr 172.21.15.99:0/1065203602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.884+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdbbea67c0 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f08f88f8640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f08f002a040 tx=0x7f08f004cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f07d5ffb640 1 -- 172.21.15.99:0/1065203602 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f0038070 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f07d5ffb640 1 -- 172.21.15.99:0/1065203602 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f001f920 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdbbea6a50 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f07d5ffb640 1 -- 172.21.15.99:0/1065203602 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08f0013bc0 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdbbea9700 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.885+0000 7f07d5ffb640 1 -- 172.21.15.99:0/1065203602 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f08f003b070 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f07d5ffb640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07c8036b90 0x7f07c8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f07d5ffb640 1 -- 172.21.15.99:0/1065203602 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f08f0034b10 con 0x55fdbbe9eec0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07c8036b90 0x7f07c8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbeb1e60 0x55fdbbeb4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb4a70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbeb1e60 0x55fdbbeb4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.886+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07c8036b90 0x7f07c8039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08e800e6d0 tx=0x7f08e8027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbeb1e60 0x55fdbbeb4320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 realm 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb4ea0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:32.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb5770 con 0x55fdbbeb1e60 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.887+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb5b10 con 0x55fdbbeb1e60 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbeb6870 0x55fdbbeb8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb91a0 con 0x55fdbbeb6870 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08f88f8640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbeb6870 0x55fdbbeb8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08f88f8640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbeb6870 0x55fdbbeb8c60 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 20 searching for the correct realm 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdbbebb1e0 0x55fdbbebd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.888+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdbbebb1e0 0x55fdbbebd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f80f7640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdbbebb1e0 0x55fdbbebd6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f88f8640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f08f0045050 0x7f08f0040a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.889+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f08f0045050 0x7f08f0040a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:32.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f08f0045050 0x7f08f0040a50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.890+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.891+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.892+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.893+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.894+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.895+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbebb1e0 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.896+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x7f08f0045050 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebdd70 con 0x55fdbbeb6870 2024-09-13T23:25:32.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb9be0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.897+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeb97f0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbeba550 con 0x55fdbbeb6870 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 zone default found 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 4 Realm: () 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 zonegroup default 2024-09-13T23:25:32.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebe6a0 con 0x7f08f0045050 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec04b0 con 0x55fdbbebb1e0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.898+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec0900 con 0x55fdbbebb1e0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.899+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.899+0000 7f08fca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.899+0000 7f08fca10800 20 started sync module instance, tier type = 2024-09-13T23:25:32.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.899+0000 7f08fca10800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.899+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbebf8c0 con 0x55fdbbeb6870 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.900+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.900+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94548267891888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec00d0 con 0x55fdbbeb6870 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.900+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec1830 con 0x55fdbbeb1e60 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.901+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.901+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94548267898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec20d0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.901+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec2b80 con 0x55fdbbebb1e0 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.902+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.902+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94548267891888] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.902+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94548267902560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec3420 con 0x55fdbbebb1e0 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.903+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec0d60 con 0x55fdbbeb6870 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.903+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94548267898240] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.905+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94548267902560] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.905+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.905+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94548267904880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec3a10 con 0x55fdbbeb6870 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.905+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec4280 con 0x55fdbbeb1e60 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.908+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.908+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94548267907600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec3e70 con 0x55fdbbeb1e60 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.908+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec5230 con 0x7f08f0045050 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.909+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.909+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94548267912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec5670 con 0x7f08f0045050 2024-09-13T23:25:32.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.909+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6160 con 0x7f08f0045050 2024-09-13T23:25:32.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.912+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94548267904880] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.912+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94548267912512] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.914+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94548267907600] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.915+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.915+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94548267913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec4670 con 0x7f08f0045050 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.915+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6120 con 0x7f08f0045050 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.915+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94548267899936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec65d0 con 0x7f08f0045050 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=0 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=1 2024-09-13T23:25:32.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=2 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=3 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=4 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.916+0000 7f08fca10800 20 add_watcher() i=5 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94548267899936] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94548267913568] v31'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x7f08f0045050 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08fca10800 20 add_watcher() i=6 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08fca10800 20 add_watcher() i=7 2024-09-13T23:25:32.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08fca10800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec65d0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.917+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94548267917600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6540 con 0x55fdbbeb1e60 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.918+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94548267917600] v31'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.918+0000 7f07ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.918+0000 7f08fca10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.918+0000 7f08fca10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:32.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.918+0000 7f08fca10800 5 note: GC not initialized 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f07ad7e2640 20 reqs_thread_entry: start 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08fca10800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08fca10800 20 Filter name: none 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f071effd640 20 reqs_thread_entry: start 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08fca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbefc470 con 0x55fdbbeb1e60 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f08e0064070 con 0x55fdbbeb1e60 2024-09-13T23:25:32.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.919+0000 7f08fca10800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:32.929 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:32.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.920+0000 7f07ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.920+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94548267917600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbefb2a0 con 0x55fdbbeb1e60 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.921+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94548267917600] v31'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x55fdbbeb1e60 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.921+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94548267891888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6120 con 0x55fdbbeb6870 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.924+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94548267891888] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.924+0000 7f08fca10800 20 remove_watcher() i=0 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.924+0000 7f08fca10800 2 removed watcher, disabling cache 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.924+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94548267898240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6120 con 0x55fdbbeb1e60 2024-09-13T23:25:32.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.925+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94548267898240] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x55fdbbeb1e60 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.925+0000 7f08fca10800 20 remove_watcher() i=1 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.925+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94548267902560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6120 con 0x55fdbbebb1e0 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.926+0000 7f08f80f7640 1 -- 172.21.15.99:0/1065203602 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94548267902560] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e802d070 con 0x55fdbbebb1e0 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.926+0000 7f08fca10800 20 remove_watcher() i=2 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.926+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94548267904880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec2660 con 0x55fdbbeb6870 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.928+0000 7f08f88f8640 1 -- 172.21.15.99:0/1065203602 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94548267904880] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08f003a030 con 0x55fdbbeb6870 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.929+0000 7f08fca10800 20 remove_watcher() i=3 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.929+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94548267907600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec6120 con 0x55fdbbeb1e60 2024-09-13T23:25:32.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.930+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94548267907600] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x55fdbbeb1e60 2024-09-13T23:25:32.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.930+0000 7f08fca10800 20 remove_watcher() i=4 2024-09-13T23:25:32.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.930+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94548267912512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec2f70 con 0x7f08f0045050 2024-09-13T23:25:32.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.931+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94548267912512] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x7f08f0045050 2024-09-13T23:25:32.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.931+0000 7f08fca10800 20 remove_watcher() i=5 2024-09-13T23:25:32.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.931+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94548267913568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec2660 con 0x7f08f0045050 2024-09-13T23:25:32.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.934+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94548267913568] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x7f08f0045050 2024-09-13T23:25:32.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.934+0000 7f08fca10800 20 remove_watcher() i=6 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.934+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94548267899936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdbbec3a10 con 0x7f08f0045050 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.934+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94548267899936] v31'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08e0087040 con 0x7f08f0045050 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.934+0000 7f08fca10800 20 remove_watcher() i=7 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f08f0045050 msgr2=0x7f08f0040a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f08f0045050 0x7f08f0040a50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbeb1e60 msgr2=0x55fdbbeb4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbeb1e60 0x55fdbbeb4320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbeb6870 msgr2=0x55fdbbeb8c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbeb6870 0x55fdbbeb8c60 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdbbebb1e0 msgr2=0x55fdbbebd6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdbbebb1e0 0x55fdbbebd6a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07c8036b90 msgr2=0x7f07c8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07c8036b90 0x7f07c8039050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f08e800e6d0 tx=0x7f08e8027000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 msgr2=0x55fdbbea6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08ef8f6640 1 -- 172.21.15.99:0/1065203602 reap_dead start 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f08f002a040 tx=0x7f08f004cd20 comp rx=0 tx=0).stop 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 shutdown_connections 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1065203602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe9eec0 0x55fdbbea6280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 >> 172.21.15.99:0/1065203602 conn(0x55fdbbe9b270 msgr2=0x55fdbbe99340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 shutdown_connections 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1065203602 wait complete. 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 msgr2=0x7f07d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 0x7f07d0039050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55fdbbd7dc90 tx=0x7f08e801b520 comp rx=0 tx=0).stop 2024-09-13T23:25:32.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 msgr2=0x55fdbbe925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55fdbbd7e290 tx=0x7f08f00163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 shutdown_connections 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07d0036b90 0x7f07d0039050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 --2- 172.21.15.99:0/1111054989 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbe921a0 0x55fdbbe925c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 >> 172.21.15.99:0/1111054989 conn(0x55fdbbe87160 msgr2=0x55fdbbe89ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 shutdown_connections 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.935+0000 7f08fca10800 1 -- 172.21.15.99:0/1111054989 wait complete. 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 msgr2=0x55fdbbe7e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 0x55fdbbe7e480 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 msgr2=0x55fdbbe83090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 0x55fdbbe83090 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 msgr2=0x7f07e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 0x7f07e0039050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f08e000a520 tx=0x7f08e0052000 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 msgr2=0x55fdbbd7ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55fdbbe6e4b0 tx=0x7f08e8000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 shutdown_connections 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdbbe80c40 0x55fdbbe83090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdbbd82a10 0x55fdbbe7e480 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f07e0036b90 0x7f07e0039050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 --2- 172.21.15.99:0/2954382194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdbbcf2590 0x55fdbbd7ec20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 >> 172.21.15.99:0/2954382194 conn(0x55fdbbd78de0 msgr2=0x55fdbbe678e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 shutdown_connections 2024-09-13T23:25:32.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:32.936+0000 7f08fca10800 1 -- 172.21.15.99:0/2954382194 wait complete. 2024-09-13T23:25:32.945 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:32.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:25:32.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T23:25:32.946 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T23:25:33.036 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.037 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab4ca10800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x555691073a10 0x555691075e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab4ca10800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555690f2eb30 con 0x555690fe35d0 2024-09-13T23:25:33.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab4ca10800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x555690f10360 con 0x555691073a10 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab479c5640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x555691073a10 0x555691075e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab481c6640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x555690fe35d0 0x5556910722f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43918/0 (socket says 172.21.15.99:43918) 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab481c6640 1 -- 172.21.15.99:0/542040942 learned_addr learned my addr 172.21.15.99:0/542040942 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab479c5640 1 -- 172.21.15.99:0/542040942 >> v1:172.21.15.43:6789/0 conn(0x555690fe35d0 legacy=0x5556910722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab471c4640 1 -- 172.21.15.99:0/542040942 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113653488 0 0) 0x555690f2eb30 con 0x555690fe35d0 2024-09-13T23:25:33.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.036+0000 7fab479c5640 1 -- 172.21.15.99:0/542040942 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555690f36e00 con 0x555691073a10 2024-09-13T23:25:33.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.038+0000 7fab479c5640 1 --2- 172.21.15.99:0/542040942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555691073a10 0x555691075e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00a470 tx=0x7fab3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd0996648ccee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.038+0000 7fab471c4640 1 -- 172.21.15.99:0/542040942 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c053570 con 0x555691073a10 2024-09-13T23:25:33.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.038+0000 7fab471c4640 1 -- 172.21.15.99:0/542040942 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c058070 con 0x555691073a10 2024-09-13T23:25:33.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.038+0000 7fab471c4640 1 -- 172.21.15.99:0/542040942 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3c053880 con 0x555691073a10 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 -- 172.21.15.99:0/542040942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555691073a10 msgr2=0x555691075e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 --2- 172.21.15.99:0/542040942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555691073a10 0x555691075e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00a470 tx=0x7fab3c045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 -- 172.21.15.99:0/542040942 shutdown_connections 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 --2- 172.21.15.99:0/542040942 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555691073a10 0x555691075e00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 -- 172.21.15.99:0/542040942 >> 172.21.15.99:0/542040942 conn(0x555691069e00 msgr2=0x55569106c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 -- 172.21.15.99:0/542040942 shutdown_connections 2024-09-13T23:25:33.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.039+0000 7fab4ca10800 1 -- 172.21.15.99:0/542040942 wait complete. 2024-09-13T23:25:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.052+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.052+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab4ca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab4ca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555690fbb350 con 0x555690fe35d0 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab481c6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab481c6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49324/0 (socket says 172.21.15.99:49324) 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab481c6640 1 -- 172.21.15.99:0/942154147 learned_addr learned my addr 172.21.15.99:0/942154147 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab481c6640 1 -- 172.21.15.99:0/942154147 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555690f08bc0 con 0x555690fe35d0 2024-09-13T23:25:33.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.053+0000 7fab481c6640 1 --2- 172.21.15.99:0/942154147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab3800b240 tx=0x7fab3800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7b588c4df8d537 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7faa3660c640 1 -- 172.21.15.99:0/942154147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38008070 con 0x555690fe35d0 2024-09-13T23:25:33.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7faa3660c640 1 -- 172.21.15.99:0/942154147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3800d500 con 0x555690fe35d0 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7faa3660c640 1 -- 172.21.15.99:0/942154147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab3800d860 con 0x555690fe35d0 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 -- 172.21.15.99:0/942154147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 msgr2=0x55569115e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 --2- 172.21.15.99:0/942154147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fab3800b240 tx=0x7fab3800b700 comp rx=0 tx=0).stop 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 -- 172.21.15.99:0/942154147 shutdown_connections 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 --2- 172.21.15.99:0/942154147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x55569115e700 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 -- 172.21.15.99:0/942154147 >> 172.21.15.99:0/942154147 conn(0x555691069e00 msgr2=0x55569115a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 -- 172.21.15.99:0/942154147 shutdown_connections 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.054+0000 7fab4ca10800 1 -- 172.21.15.99:0/942154147 wait complete. 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab4ca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab4ca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556910766d0 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab481c6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab481c6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49330/0 (socket says 172.21.15.99:49330) 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab481c6640 1 -- 172.21.15.99:0/3247176616 learned_addr learned my addr 172.21.15.99:0/3247176616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab481c6640 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555690f1cfe0 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.055+0000 7fab481c6640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55569115f560 tx=0x7fab38000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7faa34e09640 1 -- 172.21.15.99:0/3247176616 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38019870 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7faa34e09640 1 -- 172.21.15.99:0/3247176616 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab38019a10 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7faa34e09640 1 -- 172.21.15.99:0/3247176616 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab38019d30 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556911666c0 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555691166be0 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7faa34e09640 1 -- 172.21.15.99:0/3247176616 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab38017040 con 0x555690fe35d0 2024-09-13T23:25:33.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.056+0000 7faa34e09640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 0x7faa30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7faa34e09640 1 -- 172.21.15.99:0/3247176616 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fab38015020 con 0x555690fe35d0 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab479c5640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 0x7faa30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 0x55569116d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55569116d730 con 0x555691073a10 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab489c7640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 0x55569116d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab479c5640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 0x7faa30039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab3c057000 tx=0x7fab3c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab489c7640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 0x55569116d1f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab489c7640 1 -- 172.21.15.99:0/3247176616 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab4000a4a0 con 0x555691073a10 2024-09-13T23:25:33.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.057+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55569116a7a0 con 0x555691073a10 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab489c7640 1 -- 172.21.15.99:0/3247176616 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab4000a4a0 con 0x555691073a10 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 0x555691171e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911724d0 con 0x55569116fa40 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab481c6640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 0x555691171e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab481c6640 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 0x555691171e30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab481c6640 1 -- 172.21.15.99:0/3247176616 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab3802d070 con 0x55569116fa40 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.058+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55569116e8e0 con 0x555691073a10 2024-09-13T23:25:33.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab489c7640 1 -- 172.21.15.99:0/3247176616 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab4000a4a0 con 0x555691073a10 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55569116edc0 con 0x55569116fa40 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab481c6640 1 -- 172.21.15.99:0/3247176616 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab3802d070 con 0x55569116fa40 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab4ca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.059+0000 7fab4ca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555690f0a580 con 0x55569106fca0 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49342/0 (socket says 172.21.15.99:49342) 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab489c7640 1 -- 172.21.15.99:0/1911350044 learned_addr learned my addr 172.21.15.99:0/1911350044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab489c7640 1 -- 172.21.15.99:0/1911350044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556910700c0 con 0x55569106fca0 2024-09-13T23:25:33.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab489c7640 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555691167230 tx=0x7fab400167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7faa2e7fc640 1 -- 172.21.15.99:0/1911350044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40013640 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7faa2e7fc640 1 -- 172.21.15.99:0/1911350044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab400137e0 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55569106e8f0 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7faa2e7fc640 1 -- 172.21.15.99:0/1911350044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40013ae0 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.060+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55569106edf0 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7faa2e7fc640 1 -- 172.21.15.99:0/1911350044 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab40011040 con 0x55569106fca0 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7faa2e7fc640 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 0x7faa20039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7faa2e7fc640 1 -- 172.21.15.99:0/1911350044 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fab4000e040 con 0x55569106fca0 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7fab481c6640 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 0x7faa20039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7fab481c6640 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 0x7faa20039050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55569116a6e0 tx=0x7fab3801b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.061+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab4ca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab4ca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55569115eeb0 con 0x55569118fd50 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49346/0 (socket says 172.21.15.99:49346) 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab489c7640 1 -- 172.21.15.99:0/98965347 learned_addr learned my addr 172.21.15.99:0/98965347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab489c7640 1 -- 172.21.15.99:0/98965347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555691190720 con 0x55569118fd50 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7fab489c7640 1 --2- 172.21.15.99:0/98965347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab4004cde0 tx=0x7fab400203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4e09469350d0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7faa277fe640 1 -- 172.21.15.99:0/98965347 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40012c00 con 0x55569118fd50 2024-09-13T23:25:33.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7faa277fe640 1 -- 172.21.15.99:0/98965347 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab40021960 con 0x55569118fd50 2024-09-13T23:25:33.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.062+0000 7faa277fe640 1 -- 172.21.15.99:0/98965347 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40021440 con 0x55569118fd50 2024-09-13T23:25:33.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- 172.21.15.99:0/98965347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 msgr2=0x555691190150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 --2- 172.21.15.99:0/98965347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab4004cde0 tx=0x7fab400203a0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- 172.21.15.99:0/98965347 shutdown_connections 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 --2- 172.21.15.99:0/98965347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x555691190150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- 172.21.15.99:0/98965347 >> 172.21.15.99:0/98965347 conn(0x55569118c100 msgr2=0x55569118a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- 172.21.15.99:0/98965347 shutdown_connections 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- 172.21.15.99:0/98965347 wait complete. 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 Processor -- start 2024-09-13T23:25:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- start start 2024-09-13T23:25:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab4ca10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555691190cf0 con 0x55569118fd50 2024-09-13T23:25:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab489c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49360/0 (socket says 172.21.15.99:49360) 2024-09-13T23:25:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.063+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 learned_addr learned my addr 172.21.15.99:0/703523715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556911976f0 con 0x55569118fd50 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7fab489c7640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab4004cd40 tx=0x7fab4000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7faa25ffb640 1 -- 172.21.15.99:0/703523715 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40039070 con 0x55569118fd50 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7faa25ffb640 1 -- 172.21.15.99:0/703523715 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4001f480 con 0x55569118fd50 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7faa25ffb640 1 -- 172.21.15.99:0/703523715 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab40021570 con 0x55569118fd50 2024-09-13T23:25:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555691197980 con 0x55569118fd50 2024-09-13T23:25:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.064+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55569119a630 con 0x55569118fd50 2024-09-13T23:25:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.065+0000 7faa25ffb640 1 -- 172.21.15.99:0/703523715 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab4001f6c0 con 0x55569118fd50 2024-09-13T23:25:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.065+0000 7faa25ffb640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa10036af0 0x7faa10038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.065+0000 7faa25ffb640 1 -- 172.21.15.99:0/703523715 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fab40031050 con 0x55569118fd50 2024-09-13T23:25:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.065+0000 7fab481c6640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa10036af0 0x7faa10038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.065+0000 7fab481c6640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa10036af0 0x7faa10038fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab3803ffd0 tx=0x7fab38031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556911a2cd0 0x5556911a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911a58e0 con 0x5556911a2cd0 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab479c5640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556911a2cd0 0x5556911a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab479c5640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556911a2cd0 0x5556911a5190 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 20 realm 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.066+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911a5d10 con 0x5556911a2cd0 2024-09-13T23:25:33.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911a65e0 con 0x5556911a2cd0 2024-09-13T23:25:33.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911a6980 con 0x5556911a2cd0 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556911a76e0 0x5556911a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911aa0e0 con 0x5556911a76e0 2024-09-13T23:25:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab489c7640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556911a76e0 0x5556911a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.067+0000 7fab489c7640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556911a76e0 0x5556911a9ad0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab4ca10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab4ca10800 20 searching for the correct realm 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556911ac050 0x5556911ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab481c6640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556911ac050 0x5556911ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab481c6640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556911ac050 0x5556911ae510 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.068+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab489c7640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab40035b40 0x7fab40040670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab479c5640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab40035b40 0x7fab40040670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab479c5640 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab40035b40 0x7fab40040670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.069+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.070+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.071+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.072+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.073+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.074+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911ac050 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.075+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x7fab40035b40 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a2cd0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5556911aebe0 con 0x5556911a76e0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.076+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911ab5c0 con 0x5556911a2cd0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911aae30 con 0x5556911a2cd0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911aa570 con 0x5556911a76e0 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 zone default found 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 4 Realm: () 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 zonegroup default 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911af510 con 0x7fab40035b40 2024-09-13T23:25:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.077+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911b17b0 con 0x5556911ac050 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911b1b50 con 0x5556911ac050 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 20 started sync module instance, tier type = 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.078+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b0bf0 con 0x5556911a76e0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.079+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.079+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93830290018320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b0850 con 0x5556911a76e0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.079+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b28d0 con 0x5556911a2cd0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.081+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.081+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93830290023328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b2890 con 0x5556911a2cd0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.081+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b38b0 con 0x5556911ac050 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.081+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93830290018320] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.082+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93830290023328] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.083+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.083+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93830290025664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b1ef0 con 0x5556911ac050 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.083+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b4190 con 0x5556911a76e0 2024-09-13T23:25:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.084+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93830290025664] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.085+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.085+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93830290027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b4580 con 0x5556911a76e0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.085+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b4fa0 con 0x5556911a2cd0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.088+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.088+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93830290033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b4f60 con 0x5556911a2cd0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.088+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b5f50 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.088+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93830290027456] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.089+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.089+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93830290037344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b5f50 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.089+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b6990 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.090+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93830290037344] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.091+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.091+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93830290029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b6990 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.091+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b7390 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.091+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93830290033296] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93830290035600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b7350 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=0 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=1 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=2 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=3 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=4 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=5 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93830290029728] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.092+0000 7fab4ca10800 20 add_watcher() i=6 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93830290035600] v31'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab4ca10800 20 add_watcher() i=7 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab4ca10800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911b64e0 con 0x5556911a2cd0 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.093+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93830290042528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911b64e0 con 0x5556911a2cd0 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.094+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93830290042528] v31'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.094+0000 7fa9fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 5 note: GC not initialized 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fa9fdfdb640 20 reqs_thread_entry: start 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 Filter name: none 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fa96f7fe640 20 reqs_thread_entry: start 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911ed6f0 con 0x5556911a2cd0 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fab3c051070 con 0x5556911a2cd0 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.095+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911ee160 con 0x7fab40035b40 2024-09-13T23:25:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fab3c051070 con 0x7fab40035b40 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab4ca10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab4ca10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab4ca10800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab4ca10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.096+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911f3bc0 con 0x5556911a2cd0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v31'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab4ca10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab4ca10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab4ca10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93830290290048 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911ef200 con 0x5556911a2cd0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 93830290033296 notify 133143986179 ret 0) ==== 720+0+0 (crc 0 0 0) 0x555690f36e00 con 0x5556911a2cd0 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7faa277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 93830290033296 notifier 4346 bl.length()=678 2024-09-13T23:25:33.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7faa277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7faa277fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify cookie 93830290290048 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7faa277fe640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7faa14003ea0 con 0x5556911a2cd0 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.097+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 93830290290048 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fab3c05fac0 con 0x5556911a2cd0 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.098+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911f3580 con 0x7fab40035b40 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x7fab40035b40 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab4ca10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab4ca10800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab4ca10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93830290290048 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5556911eed50 con 0x5556911ac050 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 93830290025664 notify 133143986176 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fab38057040 con 0x5556911ac050 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7faa26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986176 cookie 93830290025664 notifier 4346 bl.length()=177 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7faa26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:33.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7faa26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:33.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7faa26ffd640 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa97c003400 con 0x5556911ac050 2024-09-13T23:25:33.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [notify cookie 93830290290048 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.099+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== watch-notify(notify_complete (2) cookie 93830290290048 notify 133143986176 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555691166be0 con 0x5556911ac050 2024-09-13T23:25:33.120 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:25:33.097327Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.100+0000 7fa9fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.100+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93830290042528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911ef630 con 0x5556911a2cd0 2024-09-13T23:25:33.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.101+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93830290042528] v31'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.101+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93830290018320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x5556911a76e0 2024-09-13T23:25:33.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.102+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93830290018320] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.102+0000 7fab4ca10800 20 remove_watcher() i=0 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.102+0000 7fab4ca10800 2 removed watcher, disabling cache 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.102+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93830290023328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x5556911a2cd0 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.104+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93830290023328] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.104+0000 7fab4ca10800 20 remove_watcher() i=1 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.104+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93830290025664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x5556911ac050 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.105+0000 7fab481c6640 1 -- 172.21.15.99:0/703523715 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93830290025664] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab38044d70 con 0x5556911ac050 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.105+0000 7fab4ca10800 20 remove_watcher() i=2 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.105+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93830290027456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x5556911a76e0 2024-09-13T23:25:33.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.106+0000 7fab489c7640 1 -- 172.21.15.99:0/703523715 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93830290027456] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab4003b030 con 0x5556911a76e0 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.106+0000 7fab4ca10800 20 remove_watcher() i=3 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.106+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93830290033296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x5556911a2cd0 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.109+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93830290033296] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x5556911a2cd0 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.109+0000 7fab4ca10800 20 remove_watcher() i=4 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.109+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93830290037344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x7fab40035b40 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.110+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93830290037344] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x7fab40035b40 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.110+0000 7fab4ca10800 20 remove_watcher() i=5 2024-09-13T23:25:33.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.110+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93830290029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x7fab40035b40 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.111+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93830290029728] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x7fab40035b40 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.111+0000 7fab4ca10800 20 remove_watcher() i=6 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.111+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93830290035600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5556911eb3b0 con 0x7fab40035b40 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93830290035600] v31'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab3c07f040 con 0x7fab40035b40 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 20 remove_watcher() i=7 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab40035b40 msgr2=0x7fab40040670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab40035b40 0x7fab40040670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556911a2cd0 msgr2=0x5556911a5190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556911a2cd0 0x5556911a5190 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556911a76e0 msgr2=0x5556911a9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556911a76e0 0x5556911a9ad0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556911ac050 msgr2=0x5556911ae510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556911ac050 0x5556911ae510 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa10036af0 msgr2=0x7faa10038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa10036af0 0x7faa10038fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab3803ffd0 tx=0x7fab38031000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 msgr2=0x5556911971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab479c5640 1 -- 172.21.15.99:0/703523715 reap_dead start 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fab4004cd40 tx=0x7fab4000af70 comp rx=0 tx=0).stop 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 shutdown_connections 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 --2- 172.21.15.99:0/703523715 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569118fd50 0x5556911971b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.112+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 >> 172.21.15.99:0/703523715 conn(0x55569118c100 msgr2=0x555691191460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 shutdown_connections 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/703523715 wait complete. 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 msgr2=0x7faa20039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 0x7faa20039050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55569116a6e0 tx=0x7fab3801b540 comp rx=0 tx=0).stop 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 msgr2=0x55569106e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555691167230 tx=0x7fab400167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 shutdown_connections 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa20036b90 0x7faa20039050 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/1911350044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55569106fca0 0x55569106e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 >> 172.21.15.99:0/1911350044 conn(0x555691175df0 msgr2=0x555691178970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 shutdown_connections 2024-09-13T23:25:33.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/1911350044 wait complete. 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 msgr2=0x55569116d1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 0x55569116d1f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 msgr2=0x555691171e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 0x555691171e30 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 msgr2=0x7faa30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 0x7faa30039000 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fab3c057000 tx=0x7fab3c052000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 msgr2=0x555691166180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55569115f560 tx=0x7fab38000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 shutdown_connections 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55569116fa40 0x555691171e30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555691073a10 0x55569116d1f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faa30036b40 0x7faa30039000 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 --2- 172.21.15.99:0/3247176616 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555690fe35d0 0x555691166180 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 >> 172.21.15.99:0/3247176616 conn(0x555691069e00 msgr2=0x555691158970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.113+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 shutdown_connections 2024-09-13T23:25:33.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.114+0000 7fab4ca10800 1 -- 172.21.15.99:0/3247176616 wait complete. 2024-09-13T23:25:33.133 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:25:33.097327Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.133 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:33.177 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.177 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc842a0e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559ed74ab970 0x559ed74add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc842a0e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ed7366b30 con 0x559ed741b630 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc842a0e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x559ed7348360 con 0x559ed74ab970 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc83d974640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559ed74ab970 0x559ed74add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc83d974640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559ed74ab970 0x559ed74add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49368/0 (socket says 172.21.15.99:49368) 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc83d974640 1 -- 172.21.15.99:0/910579333 learned_addr learned my addr 172.21.15.99:0/910579333 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc83d974640 1 -- 172.21.15.99:0/910579333 >> v1:172.21.15.43:6789/0 conn(0x559ed741b630 legacy=0x559ed74aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.177+0000 7fc83d974640 1 -- 172.21.15.99:0/910579333 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed736ee00 con 0x559ed74ab970 2024-09-13T23:25:33.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.179+0000 7fc83d974640 1 --2- 172.21.15.99:0/910579333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed74ab970 0x559ed74add60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc82800a520 tx=0x7fc828045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f72f232892b94a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.179+0000 7fc83d173640 1 -- 172.21.15.99:0/910579333 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc828055070 con 0x559ed74ab970 2024-09-13T23:25:33.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.179+0000 7fc83d173640 1 -- 172.21.15.99:0/910579333 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8280515b0 con 0x559ed74ab970 2024-09-13T23:25:33.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.179+0000 7fc83d173640 1 -- 172.21.15.99:0/910579333 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8280518d0 con 0x559ed74ab970 2024-09-13T23:25:33.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 -- 172.21.15.99:0/910579333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed74ab970 msgr2=0x559ed74add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 --2- 172.21.15.99:0/910579333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed74ab970 0x559ed74add60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc82800a520 tx=0x7fc828045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 -- 172.21.15.99:0/910579333 shutdown_connections 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 --2- 172.21.15.99:0/910579333 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed74ab970 0x559ed74add60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 -- 172.21.15.99:0/910579333 >> 172.21.15.99:0/910579333 conn(0x559ed74a1de0 msgr2=0x559ed74a4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 -- 172.21.15.99:0/910579333 shutdown_connections 2024-09-13T23:25:33.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.180+0000 7fc842a0e800 1 -- 172.21.15.99:0/910579333 wait complete. 2024-09-13T23:25:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.193+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc842a0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc842a0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559ed73f3330 con 0x559ed741b630 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc83e175640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc83e175640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49384/0 (socket says 172.21.15.99:49384) 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc83e175640 1 -- 172.21.15.99:0/3258971463 learned_addr learned my addr 172.21.15.99:0/3258971463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc83e175640 1 -- 172.21.15.99:0/3258971463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed7340bc0 con 0x559ed741b630 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.194+0000 7fc83e175640 1 --2- 172.21.15.99:0/3258971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc838001620 tx=0x7fc838001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c8d3a4ba5cb0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc72c608640 1 -- 172.21.15.99:0/3258971463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc838016070 con 0x559ed741b630 2024-09-13T23:25:33.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc72c608640 1 -- 172.21.15.99:0/3258971463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83800f640 con 0x559ed741b630 2024-09-13T23:25:33.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc72c608640 1 -- 172.21.15.99:0/3258971463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83800f9a0 con 0x559ed741b630 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 -- 172.21.15.99:0/3258971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 msgr2=0x559ed7596870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3258971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc838001620 tx=0x7fc838001ae0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 -- 172.21.15.99:0/3258971463 shutdown_connections 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3258971463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed7596870 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 -- 172.21.15.99:0/3258971463 >> 172.21.15.99:0/3258971463 conn(0x559ed74a1de0 msgr2=0x559ed7592230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 -- 172.21.15.99:0/3258971463 shutdown_connections 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.195+0000 7fc842a0e800 1 -- 172.21.15.99:0/3258971463 wait complete. 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc842a0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc842a0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559ed74ae690 con 0x559ed741b630 2024-09-13T23:25:33.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc83e175640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc83e175640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49400/0 (socket says 172.21.15.99:49400) 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc83e175640 1 -- 172.21.15.99:0/3749633790 learned_addr learned my addr 172.21.15.99:0/3749633790 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc83e175640 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed7354fe0 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.196+0000 7fc83e175640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc83800f610 tx=0x7fc838001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc72ae05640 1 -- 172.21.15.99:0/3749633790 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc838021020 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc72ae05640 1 -- 172.21.15.99:0/3749633790 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8380117c0 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ed759e840 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc72ae05640 1 -- 172.21.15.99:0/3749633790 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc838016040 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed759ed60 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.197+0000 7fc72ae05640 1 -- 172.21.15.99:0/3749633790 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc838024020 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc72ae05640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 0x7fc724039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc72ae05640 1 -- 172.21.15.99:0/3749633790 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc83804c1a0 con 0x559ed741b630 2024-09-13T23:25:33.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc83d974640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 0x7fc724039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 0x559ed75a5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75a58b0 con 0x559ed74ab970 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc83e976640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 0x559ed75a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc83d974640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 0x7fc724039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc828057000 tx=0x7fc828052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc83e976640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 0x559ed75a5370 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc83e976640 1 -- 172.21.15.99:0/3749633790 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8300083e0 con 0x559ed74ab970 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.198+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75a2920 con 0x559ed74ab970 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc83e976640 1 -- 172.21.15.99:0/3749633790 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8300083e0 con 0x559ed74ab970 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 0x559ed75a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75aa6a0 con 0x559ed75a7bc0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc83e175640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 0x559ed75a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc83e175640 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 0x559ed75a9fb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc83e175640 1 -- 172.21.15.99:0/3749633790 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75a7bc0 2024-09-13T23:25:33.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.199+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75a6a60 con 0x559ed74ab970 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc83e976640 1 -- 172.21.15.99:0/3749633790 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8300083e0 con 0x559ed74ab970 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75a6f20 con 0x559ed75a7bc0 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc83e175640 1 -- 172.21.15.99:0/3749633790 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75a7bc0 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.200+0000 7fc842a0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc842a0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559ed7342580 con 0x559ed75b9070 2024-09-13T23:25:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49404/0 (socket says 172.21.15.99:49404) 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc83e976640 1 -- 172.21.15.99:0/1588101946 learned_addr learned my addr 172.21.15.99:0/1588101946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc83e976640 1 -- 172.21.15.99:0/1588101946 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed75b99d0 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc83e976640 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x559ed759f700 tx=0x7fc83000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc723fff640 1 -- 172.21.15.99:0/1588101946 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83001c020 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc723fff640 1 -- 172.21.15.99:0/1588101946 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc830007c30 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc723fff640 1 -- 172.21.15.99:0/1588101946 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830018440 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.201+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ed75b9c60 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.202+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed75bc940 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.202+0000 7fc723fff640 1 -- 172.21.15.99:0/1588101946 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc83001f020 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.202+0000 7fc723fff640 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 0x7fc718039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.202+0000 7fc723fff640 1 -- 172.21.15.99:0/1588101946 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc83004e0e0 con 0x559ed75b9070 2024-09-13T23:25:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.202+0000 7fc83e175640 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 0x7fc718039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e175640 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 0x7fc718039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559ed75a5d60 tx=0x7fc83804c0d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc842a0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc842a0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559ed7597020 con 0x559ed75c5d00 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49414/0 (socket says 172.21.15.99:49414) 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e976640 1 -- 172.21.15.99:0/64072416 learned_addr learned my addr 172.21.15.99:0/64072416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e976640 1 -- 172.21.15.99:0/64072416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed75c66d0 con 0x559ed75c5d00 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.203+0000 7fc83e976640 1 --2- 172.21.15.99:0/64072416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc83004c5c0 tx=0x7fc83004c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbb2c77f3deb213 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc721ffb640 1 -- 172.21.15.99:0/64072416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830045070 con 0x559ed75c5d00 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc721ffb640 1 -- 172.21.15.99:0/64072416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc830021400 con 0x559ed75c5d00 2024-09-13T23:25:33.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc721ffb640 1 -- 172.21.15.99:0/64072416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83003f070 con 0x559ed75c5d00 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- 172.21.15.99:0/64072416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 msgr2=0x559ed75c6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 --2- 172.21.15.99:0/64072416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc83004c5c0 tx=0x7fc83004c870 comp rx=0 tx=0).stop 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- 172.21.15.99:0/64072416 shutdown_connections 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 --2- 172.21.15.99:0/64072416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75c6100 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- 172.21.15.99:0/64072416 >> 172.21.15.99:0/64072416 conn(0x559ed75c2060 msgr2=0x559ed75c0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- 172.21.15.99:0/64072416 shutdown_connections 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- 172.21.15.99:0/64072416 wait complete. 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 Processor -- start 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.204+0000 7fc842a0e800 1 -- start start 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc842a0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc842a0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559ed75c6d40 con 0x559ed75c5d00 2024-09-13T23:25:33.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc83e976640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49418/0 (socket says 172.21.15.99:49418) 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 learned_addr learned my addr 172.21.15.99:0/3677834213 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ed75cd720 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc83e976640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75cd1e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc83004b4e0 tx=0x7fc83004c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc70ffff640 1 -- 172.21.15.99:0/3677834213 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc830045030 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc70ffff640 1 -- 172.21.15.99:0/3677834213 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc83003fe50 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ed75cd9b0 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc70ffff640 1 -- 172.21.15.99:0/3677834213 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc83004b210 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.205+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ed75d0660 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.206+0000 7fc70ffff640 1 -- 172.21.15.99:0/3677834213 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc830016040 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.206+0000 7fc70ffff640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc708036b40 0x7fc708039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.206+0000 7fc70ffff640 1 -- 172.21.15.99:0/3677834213 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc830046070 con 0x559ed75c5d00 2024-09-13T23:25:33.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.206+0000 7fc83e175640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc708036b40 0x7fc708039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.206+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed75d8cd0 0x559ed75db190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75db8e0 con 0x559ed75d8cd0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc83d974640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed75d8cd0 0x559ed75db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc83e175640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc708036b40 0x7fc708039000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc838002030 tx=0x7fc838035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc83d974640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed75d8cd0 0x559ed75db190 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 20 realm 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75dbd10 con 0x559ed75d8cd0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.207+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75dc5e0 con 0x559ed75d8cd0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75dc980 con 0x559ed75d8cd0 2024-09-13T23:25:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75dd6e0 0x559ed75dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e0010 con 0x559ed75dd6e0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc83e976640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75dd6e0 0x559ed75dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.208+0000 7fc83e976640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75dd6e0 0x559ed75dfad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc842a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc842a0e800 20 searching for the correct realm 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559ed75e2050 0x559ed75e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e175640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559ed75e2050 0x559ed75e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e175640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559ed75e2050 0x559ed75e4510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.209+0000 7fc83e976640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc8300203b0 0x7fc83001d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.210+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.210+0000 7fc83d974640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc8300203b0 0x7fc83001d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.210+0000 7fc83d974640 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc8300203b0 0x7fc83001d9b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.210+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.210+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.211+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.212+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.213+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.214+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.215+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.216+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75e2050 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x7fc8300203b0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75d8cd0 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e4be0 con 0x559ed75dd6e0 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.217+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e0a50 con 0x559ed75d8cd0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e0660 con 0x559ed75d8cd0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e13c0 con 0x559ed75dd6e0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 zone default found 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 4 Realm: () 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 zonegroup default 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.218+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e5510 con 0x7fc8300203b0 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e7320 con 0x559ed75e2050 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e7770 con 0x559ed75e2050 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 started sync module instance, tier type = 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.219+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e6730 con 0x559ed75dd6e0 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.220+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.220+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94140706483248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e6730 con 0x559ed75dd6e0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.220+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e8270 con 0x559ed75d8cd0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.221+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94140706483248] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.221+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.221+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94140706487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e6730 con 0x559ed75d8cd0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.221+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e8d00 con 0x559ed75e2050 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.224+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.224+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94140706490368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e95d0 con 0x559ed75e2050 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.224+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ea090 con 0x559ed75dd6e0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.224+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94140706487616] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.225+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94140706490368] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.225+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.225+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94140706492704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e6280 con 0x559ed75dd6e0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.225+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ea970 con 0x559ed75d8cd0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.227+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94140706492704] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.230+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.230+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94140706495328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ea930 con 0x559ed75d8cd0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.230+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75eb3d0 con 0x7fc8300203b0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.233+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.233+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94140706500352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75eb3d0 con 0x7fc8300203b0 2024-09-13T23:25:33.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.233+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ec320 con 0x7fc8300203b0 2024-09-13T23:25:33.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.236+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94140706495328] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.236+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94140706500352] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.236+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.236+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94140706504208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ec320 con 0x7fc8300203b0 2024-09-13T23:25:33.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.236+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ec790 con 0x7fc8300203b0 2024-09-13T23:25:33.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94140706506576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ec320 con 0x7fc8300203b0 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=0 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=1 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=2 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=3 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=4 2024-09-13T23:25:33.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.237+0000 7fc842a0e800 20 add_watcher() i=5 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94140706506576] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94140706504208] v31'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc842a0e800 20 add_watcher() i=6 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc842a0e800 20 add_watcher() i=7 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc842a0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ecb70 con 0x559ed75d8cd0 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.239+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94140706497664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75ecb70 con 0x559ed75d8cd0 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94140706497664] v31'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc6f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc842a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc842a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc842a0e800 5 note: GC not initialized 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.240+0000 7fc66f7fe640 20 reqs_thread_entry: start 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc842a0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc842a0e800 20 Filter name: none 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc66d7fa640 20 reqs_thread_entry: start 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc842a0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559ed7622b10 con 0x559ed75d8cd0 2024-09-13T23:25:33.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.241+0000 7fc842a0e800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T23:25:33.252 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:25:33.097327Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.242+0000 7fc6f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.242+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94140706497664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed7621560 con 0x559ed75d8cd0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.243+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94140706497664] v31'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.243+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94140706483248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed76208c0 con 0x559ed75dd6e0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.244+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94140706483248] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.244+0000 7fc842a0e800 20 remove_watcher() i=0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.244+0000 7fc842a0e800 2 removed watcher, disabling cache 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.244+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94140706487616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed76208c0 con 0x559ed75d8cd0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.245+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94140706487616] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.245+0000 7fc842a0e800 20 remove_watcher() i=1 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.245+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94140706490368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed76208c0 con 0x559ed75e2050 2024-09-13T23:25:33.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.246+0000 7fc83e175640 1 -- 172.21.15.99:0/3677834213 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94140706490368] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83800f070 con 0x559ed75e2050 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.246+0000 7fc842a0e800 20 remove_watcher() i=2 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.246+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94140706492704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e7d40 con 0x559ed75dd6e0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.247+0000 7fc83e976640 1 -- 172.21.15.99:0/3677834213 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94140706492704] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc83003b020 con 0x559ed75dd6e0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.247+0000 7fc842a0e800 20 remove_watcher() i=3 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.247+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94140706495328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e9120 con 0x559ed75d8cd0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.248+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94140706495328] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x559ed75d8cd0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.248+0000 7fc842a0e800 20 remove_watcher() i=4 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.248+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94140706500352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e7d40 con 0x7fc8300203b0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.250+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94140706500352] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.250+0000 7fc842a0e800 20 remove_watcher() i=5 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.250+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94140706504208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e9b60 con 0x7fc8300203b0 2024-09-13T23:25:33.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.253+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94140706504208] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.253+0000 7fc842a0e800 20 remove_watcher() i=6 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.253+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94140706506576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559ed75e9b60 con 0x7fc8300203b0 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94140706506576] v31'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc828057030 con 0x7fc8300203b0 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 20 remove_watcher() i=7 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc8300203b0 msgr2=0x7fc83001d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc8300203b0 0x7fc83001d9b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed75d8cd0 msgr2=0x559ed75db190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed75d8cd0 0x559ed75db190 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75dd6e0 msgr2=0x559ed75dfad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75dd6e0 0x559ed75dfad0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559ed75e2050 msgr2=0x559ed75e4510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559ed75e2050 0x559ed75e4510 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc708036b40 msgr2=0x7fc708039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc708036b40 0x7fc708039000 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc838002030 tx=0x7fc838035000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 msgr2=0x559ed75cd1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3677834213 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75c5d00 0x559ed75cd1e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc83004b4e0 tx=0x7fc83004c550 comp rx=0 tx=0).stop 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 reap_dead start 2024-09-13T23:25:33.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc83d974640 1 -- 172.21.15.99:0/3677834213 reap_dead start 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 shutdown_connections 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 >> 172.21.15.99:0/3677834213 conn(0x559ed75c2060 msgr2=0x559ed75c0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 shutdown_connections 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/3677834213 wait complete. 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 msgr2=0x7fc718039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 0x7fc718039050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x559ed75a5d60 tx=0x7fc83804c0d0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 msgr2=0x559ed75b9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.254+0000 7fc842a0e800 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x559ed759f700 tx=0x7fc83000beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 shutdown_connections 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc718036b90 0x7fc718039050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/1588101946 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed75b9070 0x559ed75b9490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 >> 172.21.15.99:0/1588101946 conn(0x559ed75ae000 msgr2=0x559ed75b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 shutdown_connections 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/1588101946 wait complete. 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 msgr2=0x559ed75a5370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 0x559ed75a5370 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 msgr2=0x559ed75a9fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 0x559ed75a9fb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 msgr2=0x7fc724039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 0x7fc724039050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc828057000 tx=0x7fc828052000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 msgr2=0x559ed759e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc83800f610 tx=0x7fc838001250 comp rx=0 tx=0).stop 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 shutdown_connections 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559ed75a7bc0 0x559ed75a9fb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559ed74ab970 0x559ed75a5370 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc724036b90 0x7fc724039050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 --2- 172.21.15.99:0/3749633790 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559ed741b630 0x559ed759e300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 >> 172.21.15.99:0/3749633790 conn(0x559ed74a1de0 msgr2=0x559ed7590aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 shutdown_connections 2024-09-13T23:25:33.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.255+0000 7fc842a0e800 1 -- 172.21.15.99:0/3749633790 wait complete. 2024-09-13T23:25:33.267 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:25:33.097327Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.267 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:25:33.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T23:25:33.268 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T23:25:33.314 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.314 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.313+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.313+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.313+0000 7fe46fe0e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56072bc4aa70 0x56072bc4ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46fe0e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56072bb0ab30 con 0x56072bc4d920 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46fe0e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x56072baec360 con 0x56072bc4aa70 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46b51a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56072bc4aa70 0x56072bc4ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46ad19640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x56072bc4d920 0x56072bc4fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43936/0 (socket says 172.21.15.99:43936) 2024-09-13T23:25:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46b51a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56072bc4aa70 0x56072bc4ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49422/0 (socket says 172.21.15.99:49422) 2024-09-13T23:25:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46ad19640 1 -- 172.21.15.99:0/872899208 learned_addr learned my addr 172.21.15.99:0/872899208 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46b51a640 1 -- 172.21.15.99:0/872899208 >> v1:172.21.15.43:6789/0 conn(0x56072bc4d920 legacy=0x56072bc4fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46b51a640 1 -- 172.21.15.99:0/872899208 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072bb12e00 con 0x56072bc4aa70 2024-09-13T23:25:33.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.314+0000 7fe46a518640 1 -- 172.21.15.99:0/872899208 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968102418 0 0) 0x56072bb0ab30 con 0x56072bc4d920 2024-09-13T23:25:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.316+0000 7fe46b51a640 1 --2- 172.21.15.99:0/872899208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4ae70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00a470 tx=0x7fe45c045ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3199151a2c0d1db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.316+0000 7fe46a518640 1 -- 172.21.15.99:0/872899208 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c056020 con 0x56072bc4aa70 2024-09-13T23:25:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.316+0000 7fe46a518640 1 -- 172.21.15.99:0/872899208 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c052590 con 0x56072bc4aa70 2024-09-13T23:25:33.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.316+0000 7fe46a518640 1 -- 172.21.15.99:0/872899208 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c0528b0 con 0x56072bc4aa70 2024-09-13T23:25:33.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 -- 172.21.15.99:0/872899208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 msgr2=0x56072bc4ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/872899208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4ae70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe45c00a470 tx=0x7fe45c045ae0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 -- 172.21.15.99:0/872899208 shutdown_connections 2024-09-13T23:25:33.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/872899208 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4ae70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 -- 172.21.15.99:0/872899208 >> 172.21.15.99:0/872899208 conn(0x56072bc45550 msgr2=0x56072bc47970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 -- 172.21.15.99:0/872899208 shutdown_connections 2024-09-13T23:25:33.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.317+0000 7fe46fe0e800 1 -- 172.21.15.99:0/872899208 wait complete. 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.330+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.330+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46fe0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46fe0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072bb97360 con 0x56072bc4aa70 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46b51a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46b51a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49426/0 (socket says 172.21.15.99:49426) 2024-09-13T23:25:33.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46b51a640 1 -- 172.21.15.99:0/3422921275 learned_addr learned my addr 172.21.15.99:0/3422921275 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46b51a640 1 -- 172.21.15.99:0/3422921275 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072bae4bc0 con 0x56072bc4aa70 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.331+0000 7fe46b51a640 1 --2- 172.21.15.99:0/3422921275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe45c025ce0 tx=0x7fe45c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c737db3f2b72985 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe35960a640 1 -- 172.21.15.99:0/3422921275 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c00a180 con 0x56072bc4aa70 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe35960a640 1 -- 172.21.15.99:0/3422921275 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c052aa0 con 0x56072bc4aa70 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe35960a640 1 -- 172.21.15.99:0/3422921275 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c052d80 con 0x56072bc4aa70 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3422921275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 msgr2=0x56072bd395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3422921275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe45c025ce0 tx=0x7fe45c051000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3422921275 shutdown_connections 2024-09-13T23:25:33.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3422921275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bd395a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3422921275 >> 172.21.15.99:0/3422921275 conn(0x56072bc45550 msgr2=0x56072bd34f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3422921275 shutdown_connections 2024-09-13T23:25:33.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.332+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3422921275 wait complete. 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46fe0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46fe0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072bc51640 con 0x56072bc4aa70 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46b51a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46b51a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49430/0 (socket says 172.21.15.99:49430) 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46b51a640 1 -- 172.21.15.99:0/3243836556 learned_addr learned my addr 172.21.15.99:0/3243836556 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.333+0000 7fe46b51a640 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072baf8fe0 con 0x56072bc4aa70 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe46b51a640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe45c05f040 tx=0x7fe45c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe357e07640 1 -- 172.21.15.99:0/3243836556 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c00a180 con 0x56072bc4aa70 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe357e07640 1 -- 172.21.15.99:0/3243836556 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45c067450 con 0x56072bc4aa70 2024-09-13T23:25:33.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072bd44c30 con 0x56072bc4aa70 2024-09-13T23:25:33.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe357e07640 1 -- 172.21.15.99:0/3243836556 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45c067770 con 0x56072bc4aa70 2024-09-13T23:25:33.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072bd451b0 con 0x56072bc4aa70 2024-09-13T23:25:33.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.334+0000 7fe357e07640 1 -- 172.21.15.99:0/3243836556 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe45c059020 con 0x56072bc4aa70 2024-09-13T23:25:33.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe357e07640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 0x7fe350039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe357e07640 1 -- 172.21.15.99:0/3243836556 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe45c06d050 con 0x56072bc4aa70 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46ad19640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 0x7fe350039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 0x56072bd48ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd49610 con 0x56072bc4d920 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 0x56072bd48ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46ad19640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 0x7fe350039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c00 tx=0x7fe4600013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 0x56072bd48ff0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.335+0000 7fe46bd1b640 1 -- 172.21.15.99:0/3243836556 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bc4d920 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd46580 con 0x56072bc4d920 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46bd1b640 1 -- 172.21.15.99:0/3243836556 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bc4d920 2024-09-13T23:25:33.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 0x56072bd4dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd4e390 con 0x56072bd4b900 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46b51a640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 0x56072bd4dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46b51a640 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 0x56072bd4dcf0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46b51a640 1 -- 172.21.15.99:0/3243836556 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd4b900 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.336+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd4a7a0 con 0x56072bc4d920 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46bd1b640 1 -- 172.21.15.99:0/3243836556 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bc4d920 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd4ac80 con 0x56072bd4b900 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46b51a640 1 -- 172.21.15.99:0/3243836556 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd4b900 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46fe0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.337+0000 7fe46fe0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072bae6580 con 0x56072bd425e0 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49436/0 (socket says 172.21.15.99:49436) 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe46bd1b640 1 -- 172.21.15.99:0/2050249435 learned_addr learned my addr 172.21.15.99:0/2050249435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe46bd1b640 1 -- 172.21.15.99:0/2050249435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072bd42a00 con 0x56072bd425e0 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56072bc49c30 tx=0x7fe4640167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.338+0000 7fe355602640 1 -- 172.21.15.99:0/2050249435 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464013640 con 0x56072bd425e0 2024-09-13T23:25:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe355602640 1 -- 172.21.15.99:0/2050249435 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4640137e0 con 0x56072bd425e0 2024-09-13T23:25:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe355602640 1 -- 172.21.15.99:0/2050249435 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464013ae0 con 0x56072bd425e0 2024-09-13T23:25:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072bd41230 con 0x56072bd425e0 2024-09-13T23:25:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072bd41730 con 0x56072bd425e0 2024-09-13T23:25:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe355602640 1 -- 172.21.15.99:0/2050249435 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe464011040 con 0x56072bd425e0 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe355602640 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 0x7fe344039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.339+0000 7fe355602640 1 -- 172.21.15.99:0/2050249435 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe46400e040 con 0x56072bd425e0 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46b51a640 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 0x7fe344039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46b51a640 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 0x7fe344039050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56072bd464c0 tx=0x7fe45c05cfa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46fe0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46fe0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072bd39c90 con 0x56072bd6bc10 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49444/0 (socket says 172.21.15.99:49444) 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46bd1b640 1 -- 172.21.15.99:0/631805543 learned_addr learned my addr 172.21.15.99:0/631805543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.340+0000 7fe46bd1b640 1 -- 172.21.15.99:0/631805543 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072bd6c5e0 con 0x56072bd6bc10 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/631805543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe46400afb0 tx=0x7fe46401fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e521da4e0e82c1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe34effd640 1 -- 172.21.15.99:0/631805543 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464021570 con 0x56072bd6bc10 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe34effd640 1 -- 172.21.15.99:0/631805543 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46401f340 con 0x56072bd6bc10 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe34effd640 1 -- 172.21.15.99:0/631805543 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464014cc0 con 0x56072bd6bc10 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 -- 172.21.15.99:0/631805543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 msgr2=0x56072bd6c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/631805543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe46400afb0 tx=0x7fe46401fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 -- 172.21.15.99:0/631805543 shutdown_connections 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/631805543 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd6c010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 -- 172.21.15.99:0/631805543 >> 172.21.15.99:0/631805543 conn(0x56072bd67f70 msgr2=0x56072bd66070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 -- 172.21.15.99:0/631805543 shutdown_connections 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 -- 172.21.15.99:0/631805543 wait complete. 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.341+0000 7fe46fe0e800 1 Processor -- start 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46fe0e800 1 -- start start 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46fe0e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46fe0e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072bd6cc50 con 0x56072bd6bc10 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46bd1b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49446/0 (socket says 172.21.15.99:49446) 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 learned_addr learned my addr 172.21.15.99:0/273841966 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072bd736e0 con 0x56072bd6bc10 2024-09-13T23:25:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe46404cd60 tx=0x7fe46404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe34d7fa640 1 -- 172.21.15.99:0/273841966 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe464040360 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe34d7fa640 1 -- 172.21.15.99:0/273841966 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46404e2b0 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072bd73970 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072bd76620 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.342+0000 7fe34d7fa640 1 -- 172.21.15.99:0/273841966 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe46404e590 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.343+0000 7fe34d7fa640 1 -- 172.21.15.99:0/273841966 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe46403b020 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.343+0000 7fe34d7fa640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe334036b90 0x7fe334039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.343+0000 7fe34d7fa640 1 -- 172.21.15.99:0/273841966 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe464039020 con 0x56072bd6bc10 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.343+0000 7fe46b51a640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe334036b90 0x7fe334039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46b51a640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe334036b90 0x7fe334039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe45c052810 tx=0x7fe45c08a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bd7eca0 0x56072bd81160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd818b0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46ad19640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bd7eca0 0x56072bd81160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.344+0000 7fe46ad19640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bd7eca0 0x56072bd81160 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000f5f0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 realm 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd7e0f0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000f5f0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd823a0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000f5f0 con 0x56072bd7eca0 2024-09-13T23:25:33.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd82c70 con 0x56072bd7eca0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe46000f5f0 con 0x56072bd7eca0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd83690 0x56072bd85a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd861f0 con 0x56072bd83690 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.345+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd83690 0x56072bd85a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd83690 0x56072bd85a80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46fe0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46fe0e800 20 searching for the correct realm 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56072bd881a0 0x56072bd8a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46b51a640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56072bd881a0 0x56072bd8a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.346+0000 7fe46b51a640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56072bd881a0 0x56072bd8a660 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46bd1b640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe464044070 0x7fe464012830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46ad19640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe464044070 0x7fe464012830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.347+0000 7fe46ad19640 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe464044070 0x7fe464012830 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000f5f0 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000f5f0 con 0x56072bd7eca0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.348+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x7fe464044070 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.349+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x7fe464044070 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.350+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x7fe464044070 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.351+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x7fe464044070 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.352+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46002b040 con 0x56072bd7eca0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.353+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd881a0 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x7fe464044070 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.354+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd7eca0 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8ad30 con 0x56072bd83690 2024-09-13T23:25:33.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd86b40 con 0x56072bd7eca0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd873e0 con 0x56072bd7eca0 2024-09-13T23:25:33.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.355+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8b1b0 con 0x56072bd83690 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 zone default found 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 4 Realm: () 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 zonegroup default 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8b550 con 0x7fe464044070 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8d320 con 0x56072bd881a0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.356+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8d6c0 con 0x56072bd881a0 2024-09-13T23:25:33.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.357+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.357+0000 7fe46fe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.357+0000 7fe46fe0e800 20 started sync module instance, tier type = 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.357+0000 7fe46fe0e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.357+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8c7c0 con 0x56072bd83690 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.358+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.358+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94588800388064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8c420 con 0x56072bd83690 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.358+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8e5a0 con 0x56072bd7eca0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.359+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94588800388064] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.359+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.359+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94588800391888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8e5a0 con 0x56072bd7eca0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.359+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8eff0 con 0x56072bd881a0 2024-09-13T23:25:33.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.360+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94588800391888] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.360+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.360+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94588800393456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8efb0 con 0x56072bd881a0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.360+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8fab0 con 0x56072bd83690 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.361+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.361+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94588800398752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd8fa70 con 0x56072bd83690 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.361+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94588800393456] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.361+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd90a90 con 0x56072bd7eca0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.362+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.362+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94588800396112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd90a90 con 0x56072bd7eca0 2024-09-13T23:25:33.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.362+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd914d0 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.363+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94588800398752] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.364+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.364+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94588800396112] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.364+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94588800405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd91490 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.364+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd905a0 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.365+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94588800405408] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.365+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.365+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94588800402848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd91a30 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.365+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd923f0 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94588800409408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd92810 con 0x7fe464044070 2024-09-13T23:25:33.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=0 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94588800402848] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=1 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=2 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=3 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=4 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=5 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.366+0000 7fe46fe0e800 20 add_watcher() i=6 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.367+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94588800409408] v31'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.367+0000 7fe46fe0e800 20 add_watcher() i=7 2024-09-13T23:25:33.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.367+0000 7fe46fe0e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.367+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bd92810 con 0x56072bd7eca0 2024-09-13T23:25:33.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.368+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.368+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94588800410464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bd927c0 con 0x56072bd7eca0 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94588800410464] v31'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 5 note: GC not initialized 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe320fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:33.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 20 Filter name: none 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe29a7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.369+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc8bb0 con 0x56072bd7eca0 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46fe0e800 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46fe0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46fe0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46fe0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.370+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdcf2b0 con 0x56072bd7eca0 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46fe0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46fe0e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46fe0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94588800658544 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bdca8f0 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94588800396112 notify 133143986180 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fe460018040 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe34effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94588800396112 notifier 4360 bl.length()=567 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(64 notify.4 [notify cookie 94588800658544 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe34effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe34effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.371+0000 7fe34effd640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe330003ea0 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.372+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.372+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94588800658544 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe46001db00 con 0x56072bd7eca0 2024-09-13T23:25:33.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.372+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdcec70 con 0x7fe464044070 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.373+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v31'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.373+0000 7fe46fe0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.373+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94588800658544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56072bdca440 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 94588800393456 notify 133143986177 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7fe45c0ae040 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe34effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986177 cookie 94588800393456 notifier 4360 bl.length()=170 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe34effd640 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe330003ea0 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 notify.2 [notify cookie 94588800658544 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.374+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== watch-notify(notify_complete (2) cookie 94588800658544 notify 133143986177 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56072bd451b0 con 0x56072bd881a0 2024-09-13T23:25:33.399 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.375+0000 7fe321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.375+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94588800410464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd7eca0 2024-09-13T23:25:33.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.376+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94588800410464] v31'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.376+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94588800388064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd83690 2024-09-13T23:25:33.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.378+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94588800388064] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.378+0000 7fe46fe0e800 20 remove_watcher() i=0 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.378+0000 7fe46fe0e800 2 removed watcher, disabling cache 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.378+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94588800391888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd7eca0 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.380+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94588800391888] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.380+0000 7fe46fe0e800 20 remove_watcher() i=1 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.380+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94588800393456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd881a0 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.381+0000 7fe46b51a640 1 -- 172.21.15.99:0/273841966 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94588800393456] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45c0703f0 con 0x56072bd881a0 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.381+0000 7fe46fe0e800 20 remove_watcher() i=2 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.381+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94588800398752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd83690 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.382+0000 7fe46bd1b640 1 -- 172.21.15.99:0/273841966 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94588800398752] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46400a4a0 con 0x56072bd83690 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.382+0000 7fe46fe0e800 20 remove_watcher() i=3 2024-09-13T23:25:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.382+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94588800396112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x56072bd7eca0 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.384+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94588800396112] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x56072bd7eca0 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.384+0000 7fe46fe0e800 20 remove_watcher() i=4 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.384+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94588800405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.385+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94588800405408] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.385+0000 7fe46fe0e800 20 remove_watcher() i=5 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.385+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94588800402848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.386+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94588800402848] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.386+0000 7fe46fe0e800 20 remove_watcher() i=6 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.386+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94588800409408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56072bdc68b0 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94588800409408] v31'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46003b040 con 0x7fe464044070 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 20 remove_watcher() i=7 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe464044070 msgr2=0x7fe464012830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe464044070 0x7fe464012830 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bd7eca0 msgr2=0x56072bd81160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bd7eca0 0x56072bd81160 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.387+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd83690 msgr2=0x56072bd85a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd83690 0x56072bd85a80 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56072bd881a0 msgr2=0x56072bd8a660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56072bd881a0 0x56072bd8a660 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe334036b90 msgr2=0x7fe334039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe334036b90 0x7fe334039050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe45c052810 tx=0x7fe45c08a000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 msgr2=0x56072bd731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46ad19640 1 -- 172.21.15.99:0/273841966 reap_dead start 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe46404cd60 tx=0x7fe46404cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 shutdown_connections 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/273841966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd6bc10 0x56072bd731a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 >> 172.21.15.99:0/273841966 conn(0x56072bd67f70 msgr2=0x56072bd66040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 shutdown_connections 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/273841966 wait complete. 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 msgr2=0x7fe344039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 0x7fe344039050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x56072bd464c0 tx=0x7fe45c05cfa0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 msgr2=0x56072bd40c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56072bc49c30 tx=0x7fe4640167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 shutdown_connections 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe344036b90 0x7fe344039050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/2050249435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bd425e0 0x56072bd40c30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 >> 172.21.15.99:0/2050249435 conn(0x56072bd51ce0 msgr2=0x56072bd54860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 shutdown_connections 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/2050249435 wait complete. 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.388+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 msgr2=0x56072bd48ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 0x56072bd48ff0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 msgr2=0x56072bd4dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 0x56072bd4dcf0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 msgr2=0x7fe350039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 0x7fe350039050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe460000c00 tx=0x7fe4600013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 msgr2=0x56072bc4a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe45c05f040 tx=0x7fe45c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 shutdown_connections 2024-09-13T23:25:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072bd4b900 0x56072bd4dcf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072bc4d920 0x56072bd48ff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe350036b90 0x7fe350039050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 --2- 172.21.15.99:0/3243836556 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072bc4aa70 0x56072bc4a240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 >> 172.21.15.99:0/3243836556 conn(0x56072bc45550 msgr2=0x56072bd33830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 shutdown_connections 2024-09-13T23:25:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.389+0000 7fe46fe0e800 1 -- 172.21.15.99:0/3243836556 wait complete. 2024-09-13T23:25:33.411 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:25:33.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T23:25:33.412 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T23:25:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.457+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.457+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1e4bb800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5653ca6994e0 0x5653ca6998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1e4bb800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653ca559b30 con 0x5653ca699e20 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1e4bb800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5653ca53b360 con 0x5653ca6994e0 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1bfaf640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5653ca6994e0 0x5653ca6998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f137ae640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5653ca699e20 0x5653ca69e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43942/0 (socket says 172.21.15.99:43942) 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f137ae640 1 -- 172.21.15.99:0/2478379402 learned_addr learned my addr 172.21.15.99:0/2478379402 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2478379402 >> v1:172.21.15.43:6789/0 conn(0x5653ca699e20 legacy=0x5653ca69e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.458+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2478379402 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca561e00 con 0x5653ca6994e0 2024-09-13T23:25:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.460+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2478379402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca6998e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00a470 tx=0x7f9f0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b77eed42fe3dfe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.460+0000 7f9f1b7ae640 1 -- 172.21.15.99:0/2478379402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c053570 con 0x5653ca6994e0 2024-09-13T23:25:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.460+0000 7f9f1b7ae640 1 -- 172.21.15.99:0/2478379402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c058070 con 0x5653ca6994e0 2024-09-13T23:25:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.460+0000 7f9f1b7ae640 1 -- 172.21.15.99:0/2478379402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c053880 con 0x5653ca6994e0 2024-09-13T23:25:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2478379402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 msgr2=0x5653ca6998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2478379402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca6998e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00a470 tx=0x7f9f0c045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2478379402 shutdown_connections 2024-09-13T23:25:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2478379402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca6998e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2478379402 >> 172.21.15.99:0/2478379402 conn(0x5653ca694dd0 msgr2=0x5653ca6971f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2478379402 shutdown_connections 2024-09-13T23:25:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.461+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2478379402 wait complete. 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.474+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1e4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1e4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653ca5e6360 con 0x5653ca6994e0 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1bfaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1bfaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49470/0 (socket says 172.21.15.99:49470) 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3011468664 learned_addr learned my addr 172.21.15.99:0/3011468664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.475+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3011468664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca533bc0 con 0x5653ca6994e0 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/3011468664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c025c20 tx=0x7f9f0c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60accf99e0313a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9e09e0b640 1 -- 172.21.15.99:0/3011468664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c053ba0 con 0x5653ca6994e0 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9e09e0b640 1 -- 172.21.15.99:0/3011468664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c063030 con 0x5653ca6994e0 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9e09e0b640 1 -- 172.21.15.99:0/3011468664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c053440 con 0x5653ca6994e0 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3011468664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 msgr2=0x5653ca60dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3011468664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c025c20 tx=0x7f9f0c051000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3011468664 shutdown_connections 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3011468664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca60dda0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3011468664 >> 172.21.15.99:0/3011468664 conn(0x5653ca694dd0 msgr2=0x5653ca784170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.476+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3011468664 shutdown_connections 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3011468664 wait complete. 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1e4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1e4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653ca6a0500 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1bfaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1bfaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49472/0 (socket says 172.21.15.99:49472) 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3357572974 learned_addr learned my addr 172.21.15.99:0/3357572974 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.477+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca547fe0 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5653ca60d4a0 tx=0x7f9f0c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9e03fff640 1 -- 172.21.15.99:0/3357572974 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c078070 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9e03fff640 1 -- 172.21.15.99:0/3357572974 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f0c053570 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653ca793920 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9e03fff640 1 -- 172.21.15.99:0/3357572974 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f0c053850 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ca793ea0 con 0x5653ca6994e0 2024-09-13T23:25:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.478+0000 7f9e03fff640 1 -- 172.21.15.99:0/3357572974 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f0c07b070 con 0x5653ca6994e0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9e03fff640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 0x7f9e04039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9e03fff640 1 -- 172.21.15.99:0/3357572974 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9f0c070070 con 0x5653ca6994e0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f137ae640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 0x7f9e04039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 0x5653ca79a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca79aa70 con 0x5653ca699e20 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 0x5653ca79a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f137ae640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 0x7f9e04039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000f60 tx=0x7f9f040012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.479+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 0x5653ca79a450 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/3357572974 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f1400a4a0 con 0x5653ca699e20 2024-09-13T23:25:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca797a20 con 0x5653ca699e20 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/3357572974 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f1400a4a0 con 0x5653ca699e20 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 0x5653ca79f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca79f8a0 con 0x5653ca79cdc0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 0x5653ca79f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.480+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 0x5653ca79f1b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.481+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3357572974 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca79cdc0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.481+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca79bba0 con 0x5653ca699e20 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.481+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/3357572974 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f1400a4a0 con 0x5653ca699e20 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.481+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca79c080 con 0x5653ca79cdc0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.481+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/3357572974 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca79cdc0 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1e4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1e4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653ca535580 con 0x5653ca7ae180 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49480/0 (socket says 172.21.15.99:49480) 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2698426382 learned_addr learned my addr 172.21.15.99:0/2698426382 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2698426382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca7aeae0 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.482+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5653ca79ae70 tx=0x7f9f140163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 -- 172.21.15.99:0/2698426382 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f14013450 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 -- 172.21.15.99:0/2698426382 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f140135f0 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653ca7aed70 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 -- 172.21.15.99:0/2698426382 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f140138d0 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ca7b1a50 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 -- 172.21.15.99:0/2698426382 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f14011040 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 0x7f9df4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.483+0000 7f9e017fa640 1 -- 172.21.15.99:0/2698426382 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9f1400e040 con 0x5653ca7ae180 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 0x7f9df4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 0x7f9df4039050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5653ca79b370 tx=0x7f9f0c08ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1e4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1e4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653ca78e9e0 con 0x5653ca7bae70 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49494/0 (socket says 172.21.15.99:49494) 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.484+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/1225316512 learned_addr learned my addr 172.21.15.99:0/1225316512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/1225316512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca7bb840 con 0x5653ca7bae70 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/1225316512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f1404cda0 tx=0x7f9f14014f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c8ebb8d4b4d6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9dfaffd640 1 -- 172.21.15.99:0/1225316512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f1404a070 con 0x5653ca7bae70 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9dfaffd640 1 -- 172.21.15.99:0/1225316512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f14014c00 con 0x5653ca7bae70 2024-09-13T23:25:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9dfaffd640 1 -- 172.21.15.99:0/1225316512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f1402a980 con 0x5653ca7bae70 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/1225316512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 msgr2=0x5653ca7bb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/1225316512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9f1404cda0 tx=0x7f9f14014f20 comp rx=0 tx=0).stop 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/1225316512 shutdown_connections 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/1225316512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7bb270 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/1225316512 >> 172.21.15.99:0/1225316512 conn(0x5653ca7b71d0 msgr2=0x5653ca7b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/1225316512 shutdown_connections 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.485+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/1225316512 wait complete. 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1e4bb800 1 Processor -- start 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1e4bb800 1 -- start start 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1e4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1e4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5653ca7bbeb0 con 0x5653ca7bae70 2024-09-13T23:25:33.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1c7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7c22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49500/0 (socket says 172.21.15.99:49500) 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 learned_addr learned my addr 172.21.15.99:0/2185676885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.486+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ca7c2810 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7c22d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f1404cd00 tx=0x7f9f1404cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9df97fa640 1 -- 172.21.15.99:0/2185676885 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f1402a980 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9df97fa640 1 -- 172.21.15.99:0/2185676885 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f14013a70 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653ca7c2aa0 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9df97fa640 1 -- 172.21.15.99:0/2185676885 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f1402ab20 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ca7c5750 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.487+0000 7f9df97fa640 1 -- 172.21.15.99:0/2185676885 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9f1404e220 con 0x5653ca7bae70 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.488+0000 7f9df97fa640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9de4036b40 0x7f9de4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.488+0000 7f9df97fa640 1 -- 172.21.15.99:0/2185676885 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9f14053850 con 0x5653ca7bae70 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.488+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9de4036b40 0x7f9de4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.488+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9de4036b40 0x7f9de4039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c07c730 tx=0x7f9f0c092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.488+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca7cde40 0x5653ca7d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d0a50 con 0x5653ca7cde40 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f137ae640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca7cde40 0x5653ca7d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f137ae640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca7cde40 0x5653ca7d0300 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f04009050 con 0x5653ca7cde40 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 20 realm 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7cd290 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f04009050 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.489+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d1540 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f04009050 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d1e10 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f04009050 con 0x5653ca7cde40 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca7d2750 0x5653ca7d4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d52d0 con 0x5653ca7d2750 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca7d2750 0x5653ca7d4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca7d2750 0x5653ca7d4b40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.490+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1e4bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1e4bb800 20 searching for the correct realm 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5653ca7d72a0 0x5653ca7d9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5653ca7d72a0 0x5653ca7d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1bfaf640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5653ca7d72a0 0x5653ca7d9760 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1c7b0640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9f14013070 0x7f9f140500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.491+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9f14013070 0x7f9f140500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9f14013070 0x7f9f140500c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04009050 con 0x7f9f14013070 2024-09-13T23:25:33.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04009050 con 0x5653ca7cde40 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.492+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.493+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.494+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.495+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.496+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.497+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d72a0 2024-09-13T23:25:33.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.498+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x7f9f14013070 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7cde40 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d9e30 con 0x5653ca7d2750 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d5cc0 con 0x5653ca7cde40 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.499+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d6560 con 0x5653ca7cde40 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7da2b0 con 0x5653ca7d2750 2024-09-13T23:25:33.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 zone default found 2024-09-13T23:25:33.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 4 Realm: () 2024-09-13T23:25:33.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 zonegroup default 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7d61c0 con 0x7f9f14013070 2024-09-13T23:25:33.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7dca30 con 0x5653ca7d72a0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.500+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7dcdd0 con 0x5653ca7d72a0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 20 started sync module instance, tier type = 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.501+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7dbe70 con 0x5653ca7d2750 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.502+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.502+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94917879513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7dc680 con 0x5653ca7d2750 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.502+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7ddb50 con 0x5653ca7cde40 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.503+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.503+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94917879518752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7de3f0 con 0x5653ca7cde40 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.503+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7deed0 con 0x5653ca7d72a0 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.505+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94917879513696] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.507+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94917879518752] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.507+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.507+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94917879517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7de3f0 con 0x5653ca7d72a0 2024-09-13T23:25:33.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.507+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7df7e0 con 0x5653ca7d2750 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.510+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94917879517552] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.510+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.510+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94917879521088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7dfbd0 con 0x5653ca7d2750 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.510+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e05d0 con 0x5653ca7cde40 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.513+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.513+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94917879529696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e0560 con 0x5653ca7cde40 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.513+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e1560 con 0x7f9f14013070 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.513+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94917879521088] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.516+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94917879529696] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.516+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.516+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94917879526128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e1070 con 0x7f9f14013070 2024-09-13T23:25:33.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.516+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e1e30 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.517+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94917879526128] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.518+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.518+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94917879531936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e1070 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.518+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e2450 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94917879537568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e2870 con 0x7f9f14013070 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=0 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=1 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=2 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=3 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=4 2024-09-13T23:25:33.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=5 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94917879531936] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f1e4bb800 20 add_watcher() i=6 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.519+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94917879537568] v31'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.520+0000 7f9f1e4bb800 20 add_watcher() i=7 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.520+0000 7f9f1e4bb800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.520+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e2870 con 0x5653ca7cde40 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.520+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.520+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94917879538624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca7e27e0 con 0x5653ca7cde40 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94917879538624] v31'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9dd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f1e4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f1e4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f1e4bb800 5 note: GC not initialized 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9dd0fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f1e4bb800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9f1e4bb800 20 Filter name: none 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.521+0000 7f9d4a7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca818d70 con 0x5653ca7cde40 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:33.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca8188a0 con 0x5653ca7cde40 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T23:25:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.522+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca81f1e0 con 0x5653ca7cde40 2024-09-13T23:25:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v31'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f1e4bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f1e4bb800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f1e4bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94917879786496 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca81bd00 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== watch-notify(notify (1) cookie 94917879529696 notify 133143986181 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5653ca559b30 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9dfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94917879529696 notifier 4367 bl.length()=732 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(65 notify.4 [notify cookie 94917879786496 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9dfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9dfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9dfaffd640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9de0003ea0 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94917879786496 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9f0402f650 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.524+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca81ec00 con 0x5653ca7cde40 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.525+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.525+0000 7f9f1e4bb800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.525+0000 7f9f1e4bb800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.525+0000 7f9f1e4bb800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.525+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94917879786496 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5653ca8197a0 con 0x5653ca7d2750 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== watch-notify(notify (1) cookie 94917879513696 notify 133143986178 ret 0) ==== 208+0+0 (crc 0 0 0) 0x5653ca7c2aa0 con 0x5653ca7d2750 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9dfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94917879513696 notifier 4367 bl.length()=166 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9dfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9dfaffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.0 [notify cookie 94917879786496 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9dfaffd640 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9de0003ea0 con 0x5653ca7d2750 2024-09-13T23:25:33.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== watch-notify(notify_complete (2) cookie 94917879786496 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653ca7c2810 con 0x5653ca7d2750 2024-09-13T23:25:33.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.526+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.542 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"eml8yuo9HC3k0u1vCqAxCwNfzegLCdwNBx7EV37s","active":true,"create_date":"2024-09-13T23:25:33.523850Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.527+0000 7f9dd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.527+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94917879538624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7cde40 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.528+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94917879538624] v31'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.528+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94917879513696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7d2750 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.529+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94917879513696] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.529+0000 7f9f1e4bb800 20 remove_watcher() i=0 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.529+0000 7f9f1e4bb800 2 removed watcher, disabling cache 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.529+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94917879518752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7cde40 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.530+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94917879518752] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.530+0000 7f9f1e4bb800 20 remove_watcher() i=1 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.530+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94917879517552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7d72a0 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.531+0000 7f9f1bfaf640 1 -- 172.21.15.99:0/2185676885 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94917879517552] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f0c07a030 con 0x5653ca7d72a0 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.531+0000 7f9f1e4bb800 20 remove_watcher() i=2 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.531+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94917879521088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7d2750 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.532+0000 7f9f1c7b0640 1 -- 172.21.15.99:0/2185676885 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94917879521088] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f14027020 con 0x5653ca7d2750 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.532+0000 7f9f1e4bb800 20 remove_watcher() i=3 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.532+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94917879529696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x5653ca7cde40 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.533+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94917879529696] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x5653ca7cde40 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.533+0000 7f9f1e4bb800 20 remove_watcher() i=4 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.533+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94917879526128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x7f9f14013070 2024-09-13T23:25:33.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.534+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94917879526128] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.534+0000 7f9f1e4bb800 20 remove_watcher() i=5 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.534+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94917879531936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x7f9f14013070 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.536+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94917879531936] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.536+0000 7f9f1e4bb800 20 remove_watcher() i=6 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.536+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94917879537568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5653ca816ac0 con 0x7f9f14013070 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94917879537568] v31'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f04029040 con 0x7f9f14013070 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 20 remove_watcher() i=7 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9f14013070 msgr2=0x7f9f140500c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9f14013070 0x7f9f140500c0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca7cde40 msgr2=0x5653ca7d0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca7cde40 0x5653ca7d0300 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca7d2750 msgr2=0x5653ca7d4b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca7d2750 0x5653ca7d4b40 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5653ca7d72a0 msgr2=0x5653ca7d9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5653ca7d72a0 0x5653ca7d9760 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9de4036b40 msgr2=0x7f9de4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9de4036b40 0x7f9de4039000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c07c730 tx=0x7f9f0c092000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 msgr2=0x5653ca7c22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2185676885 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7bae70 0x5653ca7c22d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9f1404cd00 tx=0x7f9f1404cd30 comp rx=0 tx=0).stop 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 reap_dead start 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f137ae640 1 -- 172.21.15.99:0/2185676885 reap_dead start 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 shutdown_connections 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 >> 172.21.15.99:0/2185676885 conn(0x5653ca7b71d0 msgr2=0x5653ca7b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 shutdown_connections 2024-09-13T23:25:33.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2185676885 wait complete. 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 msgr2=0x7f9df4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 0x7f9df4039050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5653ca79b370 tx=0x7f9f0c08ec10 comp rx=0 tx=0).stop 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 msgr2=0x5653ca7ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5653ca79ae70 tx=0x7f9f140163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 shutdown_connections 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9df4036b90 0x7f9df4039050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/2698426382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca7ae180 0x5653ca7ae5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 >> 172.21.15.99:0/2698426382 conn(0x5653ca7a3110 msgr2=0x5653ca7a5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 shutdown_connections 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.537+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/2698426382 wait complete. 2024-09-13T23:25:33.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 msgr2=0x5653ca79a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 0x5653ca79a450 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 msgr2=0x5653ca79f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 0x5653ca79f1b0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 msgr2=0x7f9e04039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 0x7f9e04039000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04000f60 tx=0x7f9f040012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 msgr2=0x5653ca7933e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5653ca60d4a0 tx=0x7f9f0c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 shutdown_connections 2024-09-13T23:25:33.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5653ca79cdc0 0x5653ca79f1b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5653ca699e20 0x5653ca79a450 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9e04036b40 0x7f9e04039000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 --2- 172.21.15.99:0/3357572974 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5653ca6994e0 0x5653ca7933e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 >> 172.21.15.99:0/3357572974 conn(0x5653ca694dd0 msgr2=0x5653ca7829e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 shutdown_connections 2024-09-13T23:25:33.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.538+0000 7f9f1e4bb800 1 -- 172.21.15.99:0/3357572974 wait complete. 2024-09-13T23:25:33.554 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'eml8yuo9HC3k0u1vCqAxCwNfzegLCdwNBx7EV37s', 'active': True, 'create_date': '2024-09-13T23:25:33.523850Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.554 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:25:33.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T23:25:33.555 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T23:25:33.603 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.603 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.602+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.602+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.602+0000 7f50e7526800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559f69ffb650 0x559f6a08a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.602+0000 7f50e7526800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f69f46b30 con 0x559f6a08a7b0 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.602+0000 7f50e7526800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x559f69f28360 con 0x559f69ffb650 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50e31e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559f69ffb650 0x559f6a08a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50da9e2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x559f6a08a7b0 0x559f6a08cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43948/0 (socket says 172.21.15.99:43948) 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50e31e3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559f69ffb650 0x559f6a08a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49508/0 (socket says 172.21.15.99:49508) 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50da9e2640 1 -- 172.21.15.99:0/2731110372 learned_addr learned my addr 172.21.15.99:0/2731110372 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50e31e3640 1 -- 172.21.15.99:0/2731110372 >> v1:172.21.15.43:6789/0 conn(0x559f6a08a7b0 legacy=0x559f6a08cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.603+0000 7f50e31e3640 1 -- 172.21.15.99:0/2731110372 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f69f4ee00 con 0x559f69ffb650 2024-09-13T23:25:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e31e3640 1 --2- 172.21.15.99:0/2731110372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a08a270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50d400a470 tx=0x7f50d4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a2eb8d37a507c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e29e2640 1 -- 172.21.15.99:0/2731110372 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4053570 con 0x559f69ffb650 2024-09-13T23:25:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e29e2640 1 -- 172.21.15.99:0/2731110372 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4058070 con 0x559f69ffb650 2024-09-13T23:25:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e29e2640 1 -- 172.21.15.99:0/2731110372 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4053880 con 0x559f69ffb650 2024-09-13T23:25:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e7526800 1 -- 172.21.15.99:0/2731110372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 msgr2=0x559f6a08a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.605+0000 7f50e7526800 1 --2- 172.21.15.99:0/2731110372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a08a270 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50d400a470 tx=0x7f50d4045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.606+0000 7f50e7526800 1 -- 172.21.15.99:0/2731110372 shutdown_connections 2024-09-13T23:25:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.606+0000 7f50e7526800 1 --2- 172.21.15.99:0/2731110372 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a08a270 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.606+0000 7f50e7526800 1 -- 172.21.15.99:0/2731110372 >> 172.21.15.99:0/2731110372 conn(0x559f6a081e00 msgr2=0x559f6a084220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.606+0000 7f50e7526800 1 -- 172.21.15.99:0/2731110372 shutdown_connections 2024-09-13T23:25:33.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.606+0000 7f50e7526800 1 -- 172.21.15.99:0/2731110372 wait complete. 2024-09-13T23:25:33.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.619+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.619+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e7526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e7526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f69fd3350 con 0x559f69ffb650 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e31e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e31e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49518/0 (socket says 172.21.15.99:49518) 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e31e3640 1 -- 172.21.15.99:0/3308014901 learned_addr learned my addr 172.21.15.99:0/3308014901 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e31e3640 1 -- 172.21.15.99:0/3308014901 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f69f20bc0 con 0x559f69ffb650 2024-09-13T23:25:33.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.620+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3308014901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50d4025c20 tx=0x7f50d4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43a5f9c17cfd0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f4fd160a640 1 -- 172.21.15.99:0/3308014901 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4053ba0 con 0x559f69ffb650 2024-09-13T23:25:33.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f4fd160a640 1 -- 172.21.15.99:0/3308014901 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4063030 con 0x559f69ffb650 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f4fd160a640 1 -- 172.21.15.99:0/3308014901 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4053440 con 0x559f69ffb650 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 -- 172.21.15.99:0/3308014901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 msgr2=0x559f6a176920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 --2- 172.21.15.99:0/3308014901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f50d4025c20 tx=0x7f50d4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 -- 172.21.15.99:0/3308014901 shutdown_connections 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 --2- 172.21.15.99:0/3308014901 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a176920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 -- 172.21.15.99:0/3308014901 >> 172.21.15.99:0/3308014901 conn(0x559f6a081e00 msgr2=0x559f6a1722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 -- 172.21.15.99:0/3308014901 shutdown_connections 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.621+0000 7f50e7526800 1 -- 172.21.15.99:0/3308014901 wait complete. 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e7526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e7526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f6a08e6b0 con 0x559f69ffb650 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e31e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e31e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49530/0 (socket says 172.21.15.99:49530) 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e31e3640 1 -- 172.21.15.99:0/2132433045 learned_addr learned my addr 172.21.15.99:0/2132433045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e31e3640 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f69f34fe0 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.622+0000 7f50e31e3640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559f6a177780 tx=0x7f50d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f4fcfe07640 1 -- 172.21.15.99:0/2132433045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4078070 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f4fcfe07640 1 -- 172.21.15.99:0/2132433045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4053570 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f4fcfe07640 1 -- 172.21.15.99:0/2132433045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d4053850 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6a17e7d0 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6a17ed50 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.623+0000 7f4fcfe07640 1 -- 172.21.15.99:0/2132433045 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50d407b070 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f4fcfe07640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 0x7f4fc8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f4fcfe07640 1 -- 172.21.15.99:0/2132433045 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f50d4070070 con 0x559f69ffb650 2024-09-13T23:25:33.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50da9e2640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 0x7f4fc8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 0x559f6a185300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1858d0 con 0x559f6a08a7b0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e39e4640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 0x559f6a185300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50da9e2640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 0x7f4fc8039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000f60 tx=0x7f50cc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e39e4640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 0x559f6a185300 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e39e4640 1 -- 172.21.15.99:0/2132433045 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50dc00a4a0 con 0x559f6a08a7b0 2024-09-13T23:25:33.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.624+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1828d0 con 0x559f6a08a7b0 2024-09-13T23:25:33.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e39e4640 1 -- 172.21.15.99:0/2132433045 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50dc00a4a0 con 0x559f6a08a7b0 2024-09-13T23:25:33.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 0x559f6a18a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a18a710 con 0x559f6a187c30 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e31e3640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 0x559f6a18a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e31e3640 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 0x559f6a18a020 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e31e3640 1 -- 172.21.15.99:0/2132433045 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a187c30 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.625+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1869e0 con 0x559f6a08a7b0 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e39e4640 1 -- 172.21.15.99:0/2132433045 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50dc00a4a0 con 0x559f6a08a7b0 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a186ec0 con 0x559f6a187c30 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e31e3640 1 -- 172.21.15.99:0/2132433045 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a187c30 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e7526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.626+0000 7f50e7526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f69f22580 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49532/0 (socket says 172.21.15.99:49532) 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e39e4640 1 -- 172.21.15.99:0/3109741608 learned_addr learned my addr 172.21.15.99:0/3109741608 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e39e4640 1 -- 172.21.15.99:0/3109741608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6a199930 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e39e4640 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559f6a17ef40 tx=0x7f50dc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f4fcd602640 1 -- 172.21.15.99:0/3109741608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc013450 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f4fcd602640 1 -- 172.21.15.99:0/3109741608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc0135f0 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6a199bc0 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f4fcd602640 1 -- 172.21.15.99:0/3109741608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc013910 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.627+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6a19c8a0 con 0x559f6a198fd0 2024-09-13T23:25:33.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.628+0000 7f4fcd602640 1 -- 172.21.15.99:0/3109741608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50dc011040 con 0x559f6a198fd0 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.628+0000 7f4fcd602640 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 0x7f4fbc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.628+0000 7f4fcd602640 1 -- 172.21.15.99:0/3109741608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f50dc00e040 con 0x559f6a198fd0 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.628+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 0x7f4fbc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 0x7f4fbc039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x559f6a1861e0 tx=0x7f50d408ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e7526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e7526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f6a177070 con 0x559f6a1a5d20 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49542/0 (socket says 172.21.15.99:49542) 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e39e4640 1 -- 172.21.15.99:0/2459441402 learned_addr learned my addr 172.21.15.99:0/2459441402 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.629+0000 7f50e39e4640 1 -- 172.21.15.99:0/2459441402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6a1a66f0 con 0x559f6a1a5d20 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e39e4640 1 --2- 172.21.15.99:0/2459441402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04cdc0 tx=0x7f50dc04cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eea50ac97426a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f4fc6ffd640 1 -- 172.21.15.99:0/2459441402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc02a440 con 0x559f6a1a5d20 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f4fc6ffd640 1 -- 172.21.15.99:0/2459441402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc01f390 con 0x559f6a1a5d20 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f4fc6ffd640 1 -- 172.21.15.99:0/2459441402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc02a5e0 con 0x559f6a1a5d20 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 -- 172.21.15.99:0/2459441402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 msgr2=0x559f6a1a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 --2- 172.21.15.99:0/2459441402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04cdc0 tx=0x7f50dc04cfc0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 -- 172.21.15.99:0/2459441402 shutdown_connections 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 --2- 172.21.15.99:0/2459441402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a1a6120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 -- 172.21.15.99:0/2459441402 >> 172.21.15.99:0/2459441402 conn(0x559f6a1a2080 msgr2=0x559f6a1a0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 -- 172.21.15.99:0/2459441402 shutdown_connections 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 -- 172.21.15.99:0/2459441402 wait complete. 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.630+0000 7f50e7526800 1 Processor -- start 2024-09-13T23:25:33.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e7526800 1 -- start start 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e7526800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e7526800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559f6a1a6d60 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e39e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49550/0 (socket says 172.21.15.99:49550) 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 learned_addr learned my addr 172.21.15.99:0/3135782927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6a086290 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e39e4640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04cd20 tx=0x7f50dc04cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f4fc57fa640 1 -- 172.21.15.99:0/3135782927 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc039070 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f6a086520 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.631+0000 7f4fc57fa640 1 -- 172.21.15.99:0/3135782927 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc01f710 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.632+0000 7f4fc57fa640 1 -- 172.21.15.99:0/3135782927 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc01f8c0 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.632+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6a086a20 con 0x559f6a1a5d20 2024-09-13T23:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.632+0000 7f4fc57fa640 1 -- 172.21.15.99:0/3135782927 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50dc03c070 con 0x559f6a1a5d20 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f4fc57fa640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fac036b40 0x7f4fac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f4fc57fa640 1 -- 172.21.15.99:0/3135782927 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f50dc04e050 con 0x559f6a1a5d20 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fac036b40 0x7f4fac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fac036b40 0x7f4fac039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50d4062fb0 tx=0x7f50d4092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a1baf40 0x559f6a1bd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1bdb50 con 0x559f6a1baf40 2024-09-13T23:25:33.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.633+0000 7f50da9e2640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a1baf40 0x559f6a1bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50da9e2640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a1baf40 0x559f6a1bd400 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50cc009050 con 0x559f6a1baf40 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 realm 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ba390 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50cc009050 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1be640 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50cc009050 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.634+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1bef10 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50cc009050 con 0x559f6a1baf40 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a1bf850 0x559f6a1c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c23d0 con 0x559f6a1bf850 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e39e4640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a1bf850 0x559f6a1c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e39e4640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a1bf850 0x559f6a1c1c40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 20 searching for the correct realm 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559f6a1c43a0 0x559f6a1c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.635+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559f6a1c43a0 0x559f6a1c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e31e3640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559f6a1c43a0 0x559f6a1c6860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e39e4640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f50dc03e070 0x7f50dc012550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.636+0000 7f50da9e2640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f50dc03e070 0x7f50dc012550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f50dc03e070 0x7f50dc012550 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc009050 con 0x7f50dc03e070 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc009050 con 0x559f6a1baf40 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.637+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.638+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.639+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.640+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.641+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.642+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1c43a0 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.643+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1baf40 2024-09-13T23:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c6f30 con 0x559f6a1bf850 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c2df0 con 0x559f6a1baf40 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.644+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c3690 con 0x559f6a1baf40 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c73b0 con 0x559f6a1bf850 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 zone default found 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 4 Realm: () 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 zonegroup default 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c7c00 con 0x7f50dc03e070 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c9980 con 0x559f6a1c43a0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.645+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c9e10 con 0x559f6a1c43a0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.646+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.646+0000 7f50e7526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.646+0000 7f50e7526800 20 started sync module instance, tier type = 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.646+0000 7f50e7526800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.646+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c8e20 con 0x559f6a1bf850 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.647+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.647+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143168418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1c8a80 con 0x559f6a1bf850 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.647+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cad40 con 0x559f6a1baf40 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.648+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94143168418320] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.648+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.648+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143168422512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cad40 con 0x559f6a1baf40 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.648+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cb760 con 0x559f6a1c43a0 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.649+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.649+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94143168426576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cc000 con 0x559f6a1c43a0 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.649+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ccb00 con 0x559f6a1bf850 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.649+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94143168422512] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.650+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94143168426576] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.651+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.651+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94143168428880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ca890 con 0x559f6a1bf850 2024-09-13T23:25:33.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.651+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cd510 con 0x559f6a1baf40 2024-09-13T23:25:33.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.652+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.652+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143168434272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cd930 con 0x559f6a1baf40 2024-09-13T23:25:33.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.652+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ce380 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.653+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94143168428880] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.653+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.653+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94143168437872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ce340 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.653+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ced90 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.653+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94143168434272] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.656+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94143168437872] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.659+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.659+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94143168431600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ce8e0 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.659+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cf660 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94143168442800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1ce8e0 con 0x7f50dc03e070 2024-09-13T23:25:33.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94143168431600] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=0 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=1 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=2 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=3 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=4 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=5 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.661+0000 7f50e7526800 20 add_watcher() i=6 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94143168442800] v31'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50e7526800 20 add_watcher() i=7 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50e7526800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cd540 con 0x559f6a1baf40 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.664+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94143168443856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a1cfea0 con 0x559f6a1baf40 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.665+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94143168443856] v31'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.665+0000 7f4f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.665+0000 7f50e7526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.665+0000 7f50e7526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.665+0000 7f50e7526800 5 note: GC not initialized 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f4f98fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 20 Filter name: none 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f4f127fc640 20 reqs_thread_entry: start 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a205b00 con 0x559f6a1baf40 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.666+0000 7f50e7526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:33.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.667+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a20c320 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50e7526800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50e7526800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50e7526800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94143168691424 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x559f6a207940 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94143168434272 notify 133143986182 ret 0) ==== 774+0+0 (crc 0 0 0) 0x559f69f46b30 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f4fc6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94143168434272 notifier 4374 bl.length()=732 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f4fc6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f4fc6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f4fc6ffd640 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4fa8003ea0 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(64 notify.4 [notify cookie 94143168691424 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.668+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94143168691424 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f50cc02f5a0 con 0x559f6a1baf40 2024-09-13T23:25:33.674 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.669+0000 7f4f99fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.669+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94143168443856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a207d70 con 0x559f6a1baf40 2024-09-13T23:25:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.670+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94143168443856] v31'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.670+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94143168418320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x559f6a1bf850 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.671+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94143168418320] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.671+0000 7f50e7526800 20 remove_watcher() i=0 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.671+0000 7f50e7526800 2 removed watcher, disabling cache 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.671+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94143168422512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x559f6a1baf40 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.673+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94143168422512] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.673+0000 7f50e7526800 20 remove_watcher() i=1 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.673+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94143168426576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x559f6a1c43a0 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.674+0000 7f50e31e3640 1 -- 172.21.15.99:0/3135782927 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94143168426576] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d407a030 con 0x559f6a1c43a0 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.674+0000 7f50e7526800 20 remove_watcher() i=2 2024-09-13T23:25:33.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.674+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94143168428880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x559f6a1bf850 2024-09-13T23:25:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.676+0000 7f50e39e4640 1 -- 172.21.15.99:0/3135782927 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94143168428880] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc03b030 con 0x559f6a1bf850 2024-09-13T23:25:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.676+0000 7f50e7526800 20 remove_watcher() i=3 2024-09-13T23:25:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.676+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94143168434272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x559f6a1baf40 2024-09-13T23:25:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.679+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94143168434272] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x559f6a1baf40 2024-09-13T23:25:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.679+0000 7f50e7526800 20 remove_watcher() i=4 2024-09-13T23:25:33.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.679+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94143168437872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x7f50dc03e070 2024-09-13T23:25:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.680+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94143168437872] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.680+0000 7f50e7526800 20 remove_watcher() i=5 2024-09-13T23:25:33.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.680+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94143168431600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x7f50dc03e070 2024-09-13T23:25:33.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.681+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94143168431600] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.681+0000 7f50e7526800 20 remove_watcher() i=6 2024-09-13T23:25:33.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.681+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94143168442800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x559f6a203810 con 0x7f50dc03e070 2024-09-13T23:25:33.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94143168442800] v31'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50cc029040 con 0x7f50dc03e070 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 20 remove_watcher() i=7 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f50dc03e070 msgr2=0x7f50dc012550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f50dc03e070 0x7f50dc012550 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a1baf40 msgr2=0x559f6a1bd400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a1baf40 0x559f6a1bd400 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a1bf850 msgr2=0x559f6a1c1c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a1bf850 0x559f6a1c1c40 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559f6a1c43a0 msgr2=0x559f6a1c6860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559f6a1c43a0 0x559f6a1c6860 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fac036b40 msgr2=0x7f4fac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fac036b40 0x7f4fac039000 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50d4062fb0 tx=0x7f50d4092000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 msgr2=0x559f6a087ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50da9e2640 1 -- 172.21.15.99:0/3135782927 reap_dead start 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04cd20 tx=0x7f50dc04cd50 comp rx=0 tx=0).stop 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 shutdown_connections 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 --2- 172.21.15.99:0/3135782927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a1a5d20 0x559f6a087ba0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 >> 172.21.15.99:0/3135782927 conn(0x559f6a1a2080 msgr2=0x559f6a1a0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.682+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 shutdown_connections 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3135782927 wait complete. 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 msgr2=0x7f4fbc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 0x7f4fbc039050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x559f6a1861e0 tx=0x7f50d408ec10 comp rx=0 tx=0).stop 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 msgr2=0x559f6a1993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x559f6a17ef40 tx=0x7f50dc0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 shutdown_connections 2024-09-13T23:25:33.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fbc036b90 0x7f4fbc039050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/3109741608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f6a198fd0 0x559f6a1993f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 >> 172.21.15.99:0/3109741608 conn(0x559f6a18df60 msgr2=0x559f6a190ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 shutdown_connections 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/3109741608 wait complete. 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 msgr2=0x559f6a185300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 0x559f6a185300 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 msgr2=0x559f6a18a020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 0x559f6a18a020 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 msgr2=0x7f4fc8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 0x7f4fc8039050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000f60 tx=0x7f50cc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 msgr2=0x559f6a17e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x559f6a177780 tx=0x7f50d4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 shutdown_connections 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559f6a187c30 0x559f6a18a020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559f6a08a7b0 0x559f6a185300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4fc8036b90 0x7f4fc8039050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 --2- 172.21.15.99:0/2132433045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559f69ffb650 0x559f6a17e290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 >> 172.21.15.99:0/2132433045 conn(0x559f6a081e00 msgr2=0x559f6a170b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 shutdown_connections 2024-09-13T23:25:33.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.683+0000 7f50e7526800 1 -- 172.21.15.99:0/2132433045 wait complete. 2024-09-13T23:25:33.693 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.694 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0ccea32800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bd13e92990 0x55bd13e94d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0ccea32800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bd13d4eb30 con 0x55bd13e8e550 2024-09-13T23:25:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0ccea32800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55bd13d30360 con 0x55bd13e92990 2024-09-13T23:25:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.737+0000 7f0cc3fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bd13e92990 0x55bd13e94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.738+0000 7f0cc3fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bd13e92990 0x55bd13e94d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49554/0 (socket says 172.21.15.99:49554) 2024-09-13T23:25:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.738+0000 7f0cc3fff640 1 -- 172.21.15.99:0/2393398826 learned_addr learned my addr 172.21.15.99:0/2393398826 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.738+0000 7f0cc9dd6640 1 --1- 172.21.15.99:0/2393398826 >> v1:172.21.15.43:6789/0 conn(0x55bd13e8e550 0x55bd13e8e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43964/0 (socket says 172.21.15.99:43964) 2024-09-13T23:25:33.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.738+0000 7f0cc3fff640 1 -- 172.21.15.99:0/2393398826 >> v1:172.21.15.43:6789/0 conn(0x55bd13e8e550 legacy=0x55bd13e8e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.738+0000 7f0cc3fff640 1 -- 172.21.15.99:0/2393398826 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13d56e00 con 0x55bd13e92990 2024-09-13T23:25:33.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/2393398826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e92990 0x55bd13e94d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a6b0 tx=0x7f0cb4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edd515b4c9c0a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0cc95d5640 1 -- 172.21.15.99:0/2393398826 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb400a200 con 0x55bd13e92990 2024-09-13T23:25:33.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0cc95d5640 1 -- 172.21.15.99:0/2393398826 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb400a3a0 con 0x55bd13e92990 2024-09-13T23:25:33.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0cc95d5640 1 -- 172.21.15.99:0/2393398826 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cb4008700 con 0x55bd13e92990 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 -- 172.21.15.99:0/2393398826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e92990 msgr2=0x55bd13e94d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2393398826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e92990 0x55bd13e94d80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400a6b0 tx=0x7f0cb4047e30 comp rx=0 tx=0).stop 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 -- 172.21.15.99:0/2393398826 shutdown_connections 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2393398826 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e92990 0x55bd13e94d80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 -- 172.21.15.99:0/2393398826 >> 172.21.15.99:0/2393398826 conn(0x55bd13e89de0 msgr2=0x55bd13e8c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 -- 172.21.15.99:0/2393398826 shutdown_connections 2024-09-13T23:25:33.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.740+0000 7f0ccea32800 1 -- 172.21.15.99:0/2393398826 wait complete. 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.754+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.754+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.754+0000 7f0ccea32800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.754+0000 7f0ccea32800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bd13ddb330 con 0x55bd13e8e550 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0cc9dd6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0cc9dd6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49566/0 (socket says 172.21.15.99:49566) 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/98614689 learned_addr learned my addr 172.21.15.99:0/98614689 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/98614689 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13d28bc0 con 0x55bd13e8e550 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/98614689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b230 tx=0x7f0cbc00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a5114b67910576 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0bb7e07640 1 -- 172.21.15.99:0/98614689 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc00e5c0 con 0x55bd13e8e550 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0bb7e07640 1 -- 172.21.15.99:0/98614689 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc006070 con 0x55bd13e8e550 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.755+0000 7f0bb7e07640 1 -- 172.21.15.99:0/98614689 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc00e890 con 0x55bd13e8e550 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- 172.21.15.99:0/98614689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 msgr2=0x55bd13f7c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 --2- 172.21.15.99:0/98614689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00b230 tx=0x7f0cbc00b6f0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- 172.21.15.99:0/98614689 shutdown_connections 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 --2- 172.21.15.99:0/98614689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f7c600 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- 172.21.15.99:0/98614689 >> 172.21.15.99:0/98614689 conn(0x55bd13e89de0 msgr2=0x55bd13f77fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- 172.21.15.99:0/98614689 shutdown_connections 2024-09-13T23:25:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- 172.21.15.99:0/98614689 wait complete. 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.756+0000 7f0ccea32800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bd13e95560 con 0x55bd13e8e550 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0cc9dd6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0cc9dd6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49582/0 (socket says 172.21.15.99:49582) 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/2837633504 learned_addr learned my addr 172.21.15.99:0/2837633504 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13d3cfe0 con 0x55bd13e8e550 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000fd0 tx=0x7f0cbc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0bb6604640 1 -- 172.21.15.99:0/2837633504 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc00f8d0 con 0x55bd13e8e550 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0bb6604640 1 -- 172.21.15.99:0/2837633504 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00fa90 con 0x55bd13e8e550 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0bb6604640 1 -- 172.21.15.99:0/2837633504 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cbc00fdb0 con 0x55bd13e8e550 2024-09-13T23:25:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.757+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd13f84570 con 0x55bd13e8e550 2024-09-13T23:25:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.758+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd13f84a90 con 0x55bd13e8e550 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.758+0000 7f0bb6604640 1 -- 172.21.15.99:0/2837633504 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cbc017070 con 0x55bd13e8e550 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.758+0000 7f0bb6604640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 0x7f0bb0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.758+0000 7f0bb6604640 1 -- 172.21.15.99:0/2837633504 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cbc015020 con 0x55bd13e8e550 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 0x7f0bb0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 0x55bd13f8b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13f8b620 con 0x55bd13e92990 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 0x55bd13f8b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 0x7f0bb0039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4058000 tx=0x7f0cb4053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 0x55bd13f8b0a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0cca5d7640 1 -- 172.21.15.99:0/2837633504 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55bd13e92990 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.759+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13f88670 con 0x55bd13e92990 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0cca5d7640 1 -- 172.21.15.99:0/2837633504 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55bd13e92990 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 0x55bd13f8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13f903e0 con 0x55bd13f8d950 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 0x55bd13f8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 0x55bd13f8fd40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/2837633504 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0cbc02e070 con 0x55bd13f8d950 2024-09-13T23:25:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13f8c7f0 con 0x55bd13e92990 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.760+0000 7f0cca5d7640 1 -- 172.21.15.99:0/2837633504 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cc400a4a0 con 0x55bd13e92990 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13f8ccd0 con 0x55bd13f8d950 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/2837633504 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cbc02e070 con 0x55bd13f8d950 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0ccea32800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.761+0000 7f0ccea32800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bd13d2a580 con 0x55bd13fa31a0 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49588/0 (socket says 172.21.15.99:49588) 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3757414704 learned_addr learned my addr 172.21.15.99:0/3757414704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3757414704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13fa3b00 con 0x55bd13fa31a0 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55bd13f8ba00 tx=0x7f0cc40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0baf7fe640 1 -- 172.21.15.99:0/3757414704 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4013640 con 0x55bd13fa31a0 2024-09-13T23:25:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0baf7fe640 1 -- 172.21.15.99:0/3757414704 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc40137e0 con 0x55bd13fa31a0 2024-09-13T23:25:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0baf7fe640 1 -- 172.21.15.99:0/3757414704 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4013ae0 con 0x55bd13fa31a0 2024-09-13T23:25:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd13fa3d90 con 0x55bd13fa31a0 2024-09-13T23:25:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.762+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd13fa6a70 con 0x55bd13fa31a0 2024-09-13T23:25:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.763+0000 7f0baf7fe640 1 -- 172.21.15.99:0/3757414704 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cc4011040 con 0x55bd13fa31a0 2024-09-13T23:25:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.763+0000 7f0baf7fe640 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 0x7f0ba4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.763+0000 7f0baf7fe640 1 -- 172.21.15.99:0/3757414704 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cc400e040 con 0x55bd13fa31a0 2024-09-13T23:25:33.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 0x7f0ba4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 0x7f0ba4039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc04b7a0 tx=0x7f0cbc01d450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0ccea32800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0ccea32800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bd13f7cdb0 con 0x55bd13fafdd0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49596/0 (socket says 172.21.15.99:49596) 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.764+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3868700226 learned_addr learned my addr 172.21.15.99:0/3868700226 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3868700226 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13fb07a0 con 0x55bd13fafdd0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3868700226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400a100 tx=0x7f0cc4020ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d38217cab9b13b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0bad7fa640 1 -- 172.21.15.99:0/3868700226 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4014c70 con 0x55bd13fafdd0 2024-09-13T23:25:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0bad7fa640 1 -- 172.21.15.99:0/3868700226 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc404a020 con 0x55bd13fafdd0 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0bad7fa640 1 -- 172.21.15.99:0/3868700226 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc402aa60 con 0x55bd13fafdd0 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 -- 172.21.15.99:0/3868700226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 msgr2=0x55bd13fb01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3868700226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400a100 tx=0x7f0cc4020ea0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 -- 172.21.15.99:0/3868700226 shutdown_connections 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3868700226 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb01d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 -- 172.21.15.99:0/3868700226 >> 172.21.15.99:0/3868700226 conn(0x55bd13fac130 msgr2=0x55bd13faa280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 -- 172.21.15.99:0/3868700226 shutdown_connections 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.765+0000 7f0ccea32800 1 -- 172.21.15.99:0/3868700226 wait complete. 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0ccea32800 1 Processor -- start 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0ccea32800 1 -- start start 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0ccea32800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0ccea32800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bd13fb0d70 con 0x55bd13fafdd0 2024-09-13T23:25:33.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0cca5d7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49610/0 (socket says 172.21.15.99:49610) 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 learned_addr learned my addr 172.21.15.99:0/3694330242 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd13fb77c0 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.766+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0cc404ccd0 tx=0x7f0cc404cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0b9b7fe640 1 -- 172.21.15.99:0/3694330242 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4038070 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0b9b7fe640 1 -- 172.21.15.99:0/3694330242 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc404e050 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bd13fb7a50 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0b9b7fe640 1 -- 172.21.15.99:0/3694330242 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cc401c1f0 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd13fba700 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.767+0000 7f0b9b7fe640 1 -- 172.21.15.99:0/3694330242 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0cc403b070 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0b9b7fe640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b94036b40 0x7f0b94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0b9b7fe640 1 -- 172.21.15.99:0/3694330242 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f0cc404b030 con 0x55bd13fafdd0 2024-09-13T23:25:33.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b94036b40 0x7f0b94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13fc2d10 0x55bd13fc51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fc5920 con 0x55bd13fc2d10 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13fc2d10 0x55bd13fc51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b94036b40 0x7f0b94039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00ff70 tx=0x7f0cbc032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.768+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13fc2d10 0x55bd13fc51d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 realm 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fc5d50 con 0x55bd13fc2d10 2024-09-13T23:25:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fc6620 con 0x55bd13fc2d10 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fc69c0 con 0x55bd13fc2d10 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13fc7720 0x55bd13fc9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fca050 con 0x55bd13fc7720 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.769+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13fc7720 0x55bd13fc9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13fc7720 0x55bd13fc9b10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0ccea32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0ccea32800 20 searching for the correct realm 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bd13fcc090 0x55bd13fce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bd13fcc090 0x55bd13fce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.770+0000 7f0cc9dd6640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bd13fcc090 0x55bd13fce550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cca5d7640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cc401c580 0x7f0cc40480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cc401c580 0x7f0cc40480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.771+0000 7f0cc3fff640 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cc401c580 0x7f0cc40480e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.772+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.773+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.774+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.775+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.776+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.777+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fcc090 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x7f0cc401c580 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc2d10 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.778+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcec20 con 0x55bd13fc7720 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcaa90 con 0x55bd13fc2d10 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fca6a0 con 0x55bd13fc2d10 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcb400 con 0x55bd13fc7720 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 zone default found 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 4 Realm: () 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 zonegroup default 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.779+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fcf550 con 0x7f0cc401c580 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd1360 con 0x55bd13fcc090 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd17f0 con 0x55bd13fcc090 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 started sync module instance, tier type = 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.780+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd0770 con 0x55bd13fc7720 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.781+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.781+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94270572530832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd0770 con 0x55bd13fc7720 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.781+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd2370 con 0x55bd13fc2d10 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.782+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94270572530832] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.782+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.783+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94270572535360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd0770 con 0x55bd13fc2d10 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.783+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd2dc0 con 0x55bd13fcc090 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.783+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94270572535360] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.784+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.784+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94270572528320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd3160 con 0x55bd13fcc090 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.784+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd3bc0 con 0x55bd13fc7720 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.785+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94270572528320] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.785+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.785+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94270572538064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd3fe0 con 0x55bd13fc7720 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.785+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd4a00 con 0x55bd13fc2d10 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.786+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.786+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94270572545264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd49c0 con 0x55bd13fc2d10 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.786+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd59c0 con 0x7f0cc401c580 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.786+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94270572538064] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.787+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.787+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94270572545264] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.787+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94270572541648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd59c0 con 0x7f0cc401c580 2024-09-13T23:25:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.787+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd4dc0 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.788+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94270572541648] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.789+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.789+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94270572547520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd5f20 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.789+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd6810 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94270572547520] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94270572551968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd6ea0 con 0x7f0cc401c580 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=0 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=1 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=2 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=3 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=4 2024-09-13T23:25:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=5 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.790+0000 7f0ccea32800 20 add_watcher() i=6 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94270572551968] v31'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x7f0cc401c580 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0ccea32800 20 add_watcher() i=7 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0ccea32800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd9dc0 con 0x55bd13fc2d10 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.791+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94270572554464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd71b0 con 0x55bd13fc2d10 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94270572554464] v31'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0b7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0ccea32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0ccea32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0ccea32800 5 note: GC not initialized 2024-09-13T23:25:33.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.792+0000 7f0b7a7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0ccea32800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0ccea32800 20 Filter name: none 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0aebfff640 20 reqs_thread_entry: start 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0ccea32800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bd1400cbe0 con 0x55bd13fc2d10 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0cb404f780 con 0x55bd13fc2d10 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.793+0000 7f0ccea32800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:25:33.804 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.794+0000 7f0b7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.794+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94270572554464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd1400b650 con 0x55bd13fc2d10 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.795+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94270572554464] v31'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x55bd13fc2d10 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.795+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94270572530832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd68e0 con 0x55bd13fc7720 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.796+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94270572530832] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.796+0000 7f0ccea32800 20 remove_watcher() i=0 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.796+0000 7f0ccea32800 2 removed watcher, disabling cache 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.796+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94270572535360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd68e0 con 0x55bd13fc2d10 2024-09-13T23:25:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.797+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94270572535360] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x55bd13fc2d10 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.797+0000 7f0ccea32800 20 remove_watcher() i=1 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.797+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94270572528320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd68e0 con 0x55bd13fcc090 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.798+0000 7f0cc9dd6640 1 -- 172.21.15.99:0/3694330242 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94270572528320] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cbc044d70 con 0x55bd13fcc090 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.798+0000 7f0ccea32800 20 remove_watcher() i=2 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.798+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94270572538064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd02c0 con 0x55bd13fc7720 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.799+0000 7f0cca5d7640 1 -- 172.21.15.99:0/3694330242 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94270572538064] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cc403a030 con 0x55bd13fc7720 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.799+0000 7f0ccea32800 20 remove_watcher() i=3 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.800+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94270572545264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd28d0 con 0x55bd13fc2d10 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.801+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94270572545264] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x55bd13fc2d10 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.801+0000 7f0ccea32800 20 remove_watcher() i=4 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.801+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94270572541648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd02c0 con 0x7f0cc401c580 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.804+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94270572541648] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x7f0cc401c580 2024-09-13T23:25:33.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.804+0000 7f0ccea32800 20 remove_watcher() i=5 2024-09-13T23:25:33.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.804+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94270572547520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd28d0 con 0x7f0cc401c580 2024-09-13T23:25:33.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.805+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94270572547520] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x7f0cc401c580 2024-09-13T23:25:33.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.805+0000 7f0ccea32800 20 remove_watcher() i=6 2024-09-13T23:25:33.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.805+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94270572551968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bd13fd36d0 con 0x7f0cc401c580 2024-09-13T23:25:33.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94270572551968] v31'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cb4080040 con 0x7f0cc401c580 2024-09-13T23:25:33.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 20 remove_watcher() i=7 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cc401c580 msgr2=0x7f0cc40480e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0cc401c580 0x7f0cc40480e0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13fc2d10 msgr2=0x55bd13fc51d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13fc2d10 0x55bd13fc51d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13fc7720 msgr2=0x55bd13fc9b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13fc7720 0x55bd13fc9b10 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bd13fcc090 msgr2=0x55bd13fce550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bd13fcc090 0x55bd13fce550 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b94036b40 msgr2=0x7f0b94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b94036b40 0x7f0b94039000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00ff70 tx=0x7f0cbc032000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 msgr2=0x55bd13fb7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0cc3fff640 1 -- 172.21.15.99:0/3694330242 reap_dead start 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0cc404ccd0 tx=0x7f0cc404cd00 comp rx=0 tx=0).stop 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 shutdown_connections 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3694330242 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fafdd0 0x55bd13fb7280 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 >> 172.21.15.99:0/3694330242 conn(0x55bd13fac130 msgr2=0x55bd13faa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.806+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 shutdown_connections 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3694330242 wait complete. 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 msgr2=0x7f0ba4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 0x7f0ba4039050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc04b7a0 tx=0x7f0cbc01d450 comp rx=0 tx=0).stop 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 msgr2=0x55bd13fa35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55bd13f8ba00 tx=0x7f0cc40167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 shutdown_connections 2024-09-13T23:25:33.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ba4036b90 0x7f0ba4039050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/3757414704 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13fa31a0 0x55bd13fa35c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 >> 172.21.15.99:0/3757414704 conn(0x55bd13f93d20 msgr2=0x55bd13f968a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 shutdown_connections 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/3757414704 wait complete. 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 msgr2=0x55bd13f8b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 0x55bd13f8b0a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 msgr2=0x55bd13f8fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 0x55bd13f8fd40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 msgr2=0x7f0bb0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 0x7f0bb0039000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4058000 tx=0x7f0cb4053000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 msgr2=0x55bd13f84030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000fd0 tx=0x7f0cbc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 shutdown_connections 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bd13f8d950 0x55bd13f8fd40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bd13e92990 0x55bd13f8b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0bb0036b40 0x7f0bb0039000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 --2- 172.21.15.99:0/2837633504 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bd13e8e550 0x55bd13f84030 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 >> 172.21.15.99:0/2837633504 conn(0x55bd13e89de0 msgr2=0x55bd13f76830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 shutdown_connections 2024-09-13T23:25:33.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.807+0000 7f0ccea32800 1 -- 172.21.15.99:0/2837633504 wait complete. 2024-09-13T23:25:33.817 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:33.817 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:33.862 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:33.862 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.861+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.861+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.861+0000 7fe0b4d2d800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5651a0f1b550 0x5651a0f1b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.861+0000 7fe0b4d2d800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651a0ddbb30 con 0x5651a0f1be90 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.861+0000 7fe0b4d2d800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5651a0dbd360 con 0x5651a0f1b550 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0b0a80640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5651a0f1b550 0x5651a0f1b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0abfff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5651a0f1be90 0x5651a0f20a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43966/0 (socket says 172.21.15.99:43966) 2024-09-13T23:25:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0b0a80640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5651a0f1b550 0x5651a0f1b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49612/0 (socket says 172.21.15.99:49612) 2024-09-13T23:25:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0abfff640 1 -- 172.21.15.99:0/885798774 learned_addr learned my addr 172.21.15.99:0/885798774 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0b0a80640 1 -- 172.21.15.99:0/885798774 >> v1:172.21.15.43:6789/0 conn(0x5651a0f1be90 legacy=0x5651a0f20a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0b0a80640 1 -- 172.21.15.99:0/885798774 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a0de3e00 con 0x5651a0f1b550 2024-09-13T23:25:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.862+0000 7fe0ab7fe640 1 -- 172.21.15.99:0/885798774 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867432818 0 0) 0x5651a0ddbb30 con 0x5651a0f1be90 2024-09-13T23:25:33.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/885798774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a0f1b950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400a470 tx=0x7fe0a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767d68c9ece16a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0ab7fe640 1 -- 172.21.15.99:0/885798774 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4053570 con 0x5651a0f1b550 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0ab7fe640 1 -- 172.21.15.99:0/885798774 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a4058070 con 0x5651a0f1b550 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0ab7fe640 1 -- 172.21.15.99:0/885798774 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4053880 con 0x5651a0f1b550 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/885798774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 msgr2=0x5651a0f1b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/885798774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a0f1b950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400a470 tx=0x7fe0a4045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/885798774 shutdown_connections 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/885798774 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a0f1b950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/885798774 >> 172.21.15.99:0/885798774 conn(0x5651a0f16de0 msgr2=0x5651a0f19200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/885798774 shutdown_connections 2024-09-13T23:25:33.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.864+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/885798774 wait complete. 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.878+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.878+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.878+0000 7fe0b4d2d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.878+0000 7fe0b4d2d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651a0e68330 con 0x5651a0f1b550 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fe0b0a80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fe0b0a80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49628/0 (socket says 172.21.15.99:49628) 2024-09-13T23:25:33.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fe0b0a80640 1 -- 172.21.15.99:0/3638171429 learned_addr learned my addr 172.21.15.99:0/3638171429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fe0b0a80640 1 -- 172.21.15.99:0/3638171429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a0db5bc0 con 0x5651a0f1b550 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/3638171429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4045f50 tx=0x7fe0a4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f4cc12253392d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fdf9ee05640 1 -- 172.21.15.99:0/3638171429 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4053c20 con 0x5651a0f1b550 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fdf9ee05640 1 -- 172.21.15.99:0/3638171429 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a4063030 con 0x5651a0f1b550 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.879+0000 7fdf9ee05640 1 -- 172.21.15.99:0/3638171429 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4053440 con 0x5651a0f1b550 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3638171429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 msgr2=0x5651a100a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/3638171429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4045f50 tx=0x7fe0a4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3638171429 shutdown_connections 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/3638171429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a100a560 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3638171429 >> 172.21.15.99:0/3638171429 conn(0x5651a0f16de0 msgr2=0x5651a1005f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3638171429 shutdown_connections 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3638171429 wait complete. 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.880+0000 7fe0b4d2d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651a0f22570 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b0a80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b0a80640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49634/0 (socket says 172.21.15.99:49634) 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1118994026 learned_addr learned my addr 172.21.15.99:0/1118994026 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a0dc9fe0 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4045f20 tx=0x7fe0a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fdf9d602640 1 -- 172.21.15.99:0/1118994026 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4053570 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fdf9d602640 1 -- 172.21.15.99:0/1118994026 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a4053710 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fdf9d602640 1 -- 172.21.15.99:0/1118994026 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4068420 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651a1015720 con 0x5651a0f1b550 2024-09-13T23:25:33.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.881+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a1015bc0 con 0x5651a0f1b550 2024-09-13T23:25:33.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fdf9d602640 1 -- 172.21.15.99:0/1118994026 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0a4068610 con 0x5651a0f1b550 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fdf9d602640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 0x7fdf98039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fdf9d602640 1 -- 172.21.15.99:0/1118994026 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe0a4070070 con 0x5651a0f1b550 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 0x7fdf98039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 0x5651a101c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a101c790 con 0x5651a0f1be90 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.882+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 0x5651a101c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 0x7fdf98039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c0013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 0x5651a101c250 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b1281640 1 -- 172.21.15.99:0/1118994026 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0ac00a4a0 con 0x5651a0f1be90 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a101cbc0 con 0x5651a0f1be90 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b1281640 1 -- 172.21.15.99:0/1118994026 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0ac00a4a0 con 0x5651a0f1be90 2024-09-13T23:25:33.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 0x5651a1020dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1021460 con 0x5651a101e9d0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.883+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 0x5651a1020dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 0x5651a1020dc0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1118994026 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a101e9d0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a101d7b0 con 0x5651a0f1be90 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b1281640 1 -- 172.21.15.99:0/1118994026 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0ac00a4a0 con 0x5651a0f1be90 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a101dc90 con 0x5651a101e9d0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.884+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1118994026 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a101e9d0 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b4d2d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b4d2d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651a0db7580 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49648/0 (socket says 172.21.15.99:49648) 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b1281640 1 -- 172.21.15.99:0/675253354 learned_addr learned my addr 172.21.15.99:0/675253354 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b1281640 1 -- 172.21.15.99:0/675253354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a1030680 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.885+0000 7fe0b1281640 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5651a1016290 tx=0x7fe0ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fdf967fc640 1 -- 172.21.15.99:0/675253354 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac013640 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fdf967fc640 1 -- 172.21.15.99:0/675253354 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0137e0 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651a1030910 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fdf967fc640 1 -- 172.21.15.99:0/675253354 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac013ae0 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a10335f0 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fdf967fc640 1 -- 172.21.15.99:0/675253354 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0ac011040 con 0x5651a102fd20 2024-09-13T23:25:33.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.886+0000 7fdf967fc640 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 0x7fdf88039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fdf967fc640 1 -- 172.21.15.99:0/675253354 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe0ac00e040 con 0x5651a102fd20 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 0x7fdf88039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 0x7fdf88039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4067b50 tx=0x7fe0a408f0e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b4d2d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b4d2d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651a100acb0 con 0x5651a103c990 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49658/0 (socket says 172.21.15.99:49658) 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b1281640 1 -- 172.21.15.99:0/3438628536 learned_addr learned my addr 172.21.15.99:0/3438628536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.887+0000 7fe0b1281640 1 -- 172.21.15.99:0/3438628536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a103d360 con 0x5651a103c990 2024-09-13T23:25:33.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b1281640 1 --2- 172.21.15.99:0/3438628536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00afb0 tx=0x7fe0ac01fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993e8aca4d1c26c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fdf87fff640 1 -- 172.21.15.99:0/3438628536 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac021ae0 con 0x5651a103c990 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fdf87fff640 1 -- 172.21.15.99:0/3438628536 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac01f340 con 0x5651a103c990 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fdf87fff640 1 -- 172.21.15.99:0/3438628536 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac014cc0 con 0x5651a103c990 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3438628536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 msgr2=0x5651a103cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/3438628536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00afb0 tx=0x7fe0ac01fce0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3438628536 shutdown_connections 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/3438628536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a103cd90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3438628536 >> 172.21.15.99:0/3438628536 conn(0x5651a1038d40 msgr2=0x5651a1036e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3438628536 shutdown_connections 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.888+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/3438628536 wait complete. 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 Processor -- start 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 -- start start 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a1043ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651a103d970 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a1043ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b1281640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a1043ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49662/0 (socket says 172.21.15.99:49662) 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 learned_addr learned my addr 172.21.15.99:0/1115049927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a1044400 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a1043ec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac03d040 tx=0x7fe0ac00a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fdf867fc640 1 -- 172.21.15.99:0/1115049927 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac039070 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fdf867fc640 1 -- 172.21.15.99:0/1115049927 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac021ae0 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651a1044690 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fdf867fc640 1 -- 172.21.15.99:0/1115049927 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0ac040480 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.889+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a1047340 con 0x5651a103c990 2024-09-13T23:25:33.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.890+0000 7fdf867fc640 1 -- 172.21.15.99:0/1115049927 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe0ac04e980 con 0x5651a103c990 2024-09-13T23:25:33.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.890+0000 7fdf867fc640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c036b90 0x7fdf7c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.890+0000 7fdf867fc640 1 -- 172.21.15.99:0/1115049927 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe0ac035ad0 con 0x5651a103c990 2024-09-13T23:25:33.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.890+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c036b90 0x7fdf7c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a104f8e0 0x5651a1051da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a10524f0 con 0x5651a104f8e0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c036b90 0x7fdf7c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40843f0 tx=0x7fe0a408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a104f8e0 0x5651a1051da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a104f8e0 0x5651a1051da0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe09c00f5f0 con 0x5651a104f8e0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 20 realm 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.891+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a104ed30 con 0x5651a104f8e0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe09c00f5f0 con 0x5651a104f8e0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1052fd0 con 0x5651a104f8e0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe09c00f5f0 con 0x5651a104f8e0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a10538a0 con 0x5651a104f8e0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe09c00f5f0 con 0x5651a104f8e0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a10541a0 0x5651a10565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1056d10 con 0x5651a10541a0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a10541a0 0x5651a10565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.892+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a10541a0 0x5651a10565b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0ac03b030 con 0x5651a10541a0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b4d2d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b4d2d800 20 searching for the correct realm 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651a1058dc0 0x5651a105b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651a1058dc0 0x5651a105b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b0a80640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651a1058dc0 0x5651a105b280 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.893+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.894+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ac03b030 con 0x5651a10541a0 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.894+0000 7fe0b1281640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe0ac04b710 0x7fe0ac002c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:33.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.894+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.894+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe0ac04b710 0x7fe0ac002c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.894+0000 7fe0abfff640 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe0ac04b710 0x7fe0ac002c80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c00f5f0 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c00f5f0 con 0x5651a104f8e0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.895+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0ac03b030 con 0x5651a10541a0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.896+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe0ac03b030 con 0x5651a10541a0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.897+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.898+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ac03b030 con 0x5651a10541a0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c02b040 con 0x5651a104f8e0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.899+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a1058dc0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.900+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x7fe0ac04b710 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a104f8e0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5651a105b950 con 0x5651a10541a0 2024-09-13T23:25:33.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a10577c0 con 0x5651a104f8e0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.901+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1057c40 con 0x5651a104f8e0 2024-09-13T23:25:33.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1058120 con 0x5651a10541a0 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 zone default found 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 4 Realm: () 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 zonegroup default 2024-09-13T23:25:33.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a105c280 con 0x7fe0ac04b710 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.902+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a105dc90 con 0x5651a1058dc0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a105e0e0 con 0x5651a1058dc0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 20 started sync module instance, tier type = 2024-09-13T23:25:33.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.903+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105d0f0 con 0x5651a10541a0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.904+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.904+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94908593853664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105e9d0 con 0x5651a10541a0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.904+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105f220 con 0x5651a104f8e0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.905+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.905+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94908593859024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105f480 con 0x5651a104f8e0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.905+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105ffa0 con 0x5651a1058dc0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.906+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94908593859024] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.906+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94908593853664] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.909+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.909+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94908593857824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105eed0 con 0x5651a1058dc0 2024-09-13T23:25:33.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.909+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10609b0 con 0x5651a10541a0 2024-09-13T23:25:33.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.910+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94908593857824] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.910+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.910+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94908593863280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10609b0 con 0x5651a10541a0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.910+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1061370 con 0x5651a104f8e0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.912+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.912+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94908593868480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1061790 con 0x5651a104f8e0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.912+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10622b0 con 0x7fe0ac04b710 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.912+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94908593863280] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.913+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.913+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94908593868480] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.913+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94908593872256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1062270 con 0x7fe0ac04b710 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.913+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10612e0 con 0x7fe0ac04b710 2024-09-13T23:25:33.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.914+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94908593872256] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.914+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.914+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94908593865984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10612e0 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.914+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1063170 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94908593876160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1063590 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=0 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=1 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=2 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=3 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=4 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.915+0000 7fe0b4d2d800 20 add_watcher() i=5 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94908593876160] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94908593865984] v31'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0b4d2d800 20 add_watcher() i=6 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0b4d2d800 20 add_watcher() i=7 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0b4d2d800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a1063590 con 0x5651a104f8e0 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.917+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94908593877216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1063500 con 0x5651a104f8e0 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.918+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94908593877216] v31'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.918+0000 7fdf66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.918+0000 7fe0b4d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.918+0000 7fe0b4d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.918+0000 7fe0b4d2d800 5 note: GC not initialized 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fdf65fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:33.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0b4d2d800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0b4d2d800 20 Filter name: none 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fded77fe640 20 reqs_thread_entry: start 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0b4d2d800 20 rados->read ofs=0 len=0 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5651a10995a0 con 0x5651a104f8e0 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.919+0000 7fe0b4d2d800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:25:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:33.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.920+0000 7fdf66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:33.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.920+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94908593877216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1098030 con 0x5651a104f8e0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.921+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94908593877216] v31'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.921+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94908593853664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10630e0 con 0x5651a10541a0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.922+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94908593853664] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.922+0000 7fe0b4d2d800 20 remove_watcher() i=0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.922+0000 7fe0b4d2d800 2 removed watcher, disabling cache 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.922+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94908593859024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10630e0 con 0x5651a104f8e0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.924+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94908593859024] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.924+0000 7fe0b4d2d800 20 remove_watcher() i=1 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.924+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94908593857824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10630e0 con 0x5651a1058dc0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.925+0000 7fe0b0a80640 1 -- 172.21.15.99:0/1115049927 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94908593857824] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0a4051070 con 0x5651a1058dc0 2024-09-13T23:25:33.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.925+0000 7fe0b4d2d800 20 remove_watcher() i=2 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.925+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94908593863280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105e520 con 0x5651a10541a0 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.926+0000 7fe0b1281640 1 -- 172.21.15.99:0/1115049927 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94908593863280] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0ac062040 con 0x5651a10541a0 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.926+0000 7fe0b4d2d800 20 remove_watcher() i=3 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.926+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94908593868480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a10630e0 con 0x5651a104f8e0 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.927+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94908593868480] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x5651a104f8e0 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.927+0000 7fe0b4d2d800 20 remove_watcher() i=4 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.927+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94908593872256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105fa70 con 0x7fe0ac04b710 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.928+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94908593872256] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.928+0000 7fe0b4d2d800 20 remove_watcher() i=5 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.928+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94908593865984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a105e520 con 0x7fe0ac04b710 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.928+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94908593865984] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.929+0000 7fe0b4d2d800 20 remove_watcher() i=6 2024-09-13T23:25:33.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.929+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94908593876160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5651a1060ec0 con 0x7fe0ac04b710 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.929+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94908593876160] v31'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe09c03b040 con 0x7fe0ac04b710 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.929+0000 7fe0b4d2d800 20 remove_watcher() i=7 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe0ac04b710 msgr2=0x7fe0ac002c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe0ac04b710 0x7fe0ac002c80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a104f8e0 msgr2=0x5651a1051da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a104f8e0 0x5651a1051da0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a10541a0 msgr2=0x5651a10565b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a10541a0 0x5651a10565b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651a1058dc0 msgr2=0x5651a105b280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651a1058dc0 0x5651a105b280 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c036b90 msgr2=0x7fdf7c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf7c036b90 0x7fdf7c039050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40843f0 tx=0x7fe0a408a000 comp rx=0 tx=0).stop 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 msgr2=0x5651a1043ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1115049927 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a103c990 0x5651a1043ec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac03d040 tx=0x7fe0ac00a7e0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 reap_dead start 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0abfff640 1 -- 172.21.15.99:0/1115049927 reap_dead start 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 shutdown_connections 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 >> 172.21.15.99:0/1115049927 conn(0x5651a1038d40 msgr2=0x5651a103e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 shutdown_connections 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1115049927 wait complete. 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 msgr2=0x7fdf88039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 0x7fdf88039050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4067b50 tx=0x7fe0a408f0e0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 msgr2=0x5651a1030140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5651a1016290 tx=0x7fe0ac0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 shutdown_connections 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf88036b90 0x7fdf88039050 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/675253354 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a102fd20 0x5651a1030140 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 >> 172.21.15.99:0/675253354 conn(0x5651a1024cb0 msgr2=0x5651a1027830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 shutdown_connections 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/675253354 wait complete. 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 msgr2=0x5651a101c250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 0x5651a101c250 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 msgr2=0x5651a1020dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.930+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 0x5651a1020dc0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 msgr2=0x7fdf98039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 0x7fdf98039000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c0013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 msgr2=0x5651a10151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4045f20 tx=0x7fe0a4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 shutdown_connections 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651a101e9d0 0x5651a1020dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651a0f1be90 0x5651a101c250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdf98036b40 0x7fdf98039000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 --2- 172.21.15.99:0/1118994026 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651a0f1b550 0x5651a10151e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 >> 172.21.15.99:0/1118994026 conn(0x5651a0f16de0 msgr2=0x5651a1004790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 shutdown_connections 2024-09-13T23:25:33.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:33.931+0000 7fe0b4d2d800 1 -- 172.21.15.99:0/1118994026 wait complete. 2024-09-13T23:25:33.941 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:33.941 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:25:33.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T23:25:33.942 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T23:25:34.029 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.029 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe891810800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c02db18900 0x55c02db1acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe891810800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c02d9d3b30 con 0x55c02da87e30 2024-09-13T23:25:34.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe891810800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55c02d9b5360 con 0x55c02db18900 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe8846f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c02db18900 0x55c02db1acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe88cef7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55c02da87e30 0x55c02db171e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43980/0 (socket says 172.21.15.99:43980) 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe8846f6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c02db18900 0x55c02db1acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49676/0 (socket says 172.21.15.99:49676) 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.029+0000 7fe88cef7640 1 -- 172.21.15.99:0/2600000697 learned_addr learned my addr 172.21.15.99:0/2600000697 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.030+0000 7fe8846f6640 1 -- 172.21.15.99:0/2600000697 >> v1:172.21.15.43:6789/0 conn(0x55c02da87e30 legacy=0x55c02db171e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.030+0000 7fe8846f6640 1 -- 172.21.15.99:0/2600000697 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02d9dbe00 con 0x55c02db18900 2024-09-13T23:25:34.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.030+0000 7fe887fff640 1 -- 172.21.15.99:0/2600000697 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2025421203 0 0) 0x55c02d9d3b30 con 0x55c02da87e30 2024-09-13T23:25:34.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.031+0000 7fe8846f6640 1 --2- 172.21.15.99:0/2600000697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db18900 0x55c02db1acf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe87400a470 tx=0x7fe874045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2525ee7a260006ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.031+0000 7fe887fff640 1 -- 172.21.15.99:0/2600000697 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe874053570 con 0x55c02db18900 2024-09-13T23:25:34.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.031+0000 7fe887fff640 1 -- 172.21.15.99:0/2600000697 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe874058070 con 0x55c02db18900 2024-09-13T23:25:34.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.031+0000 7fe887fff640 1 -- 172.21.15.99:0/2600000697 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe874053880 con 0x55c02db18900 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 -- 172.21.15.99:0/2600000697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db18900 msgr2=0x55c02db1acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 --2- 172.21.15.99:0/2600000697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db18900 0x55c02db1acf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe87400a470 tx=0x7fe874045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 -- 172.21.15.99:0/2600000697 shutdown_connections 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 --2- 172.21.15.99:0/2600000697 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db18900 0x55c02db1acf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 -- 172.21.15.99:0/2600000697 >> 172.21.15.99:0/2600000697 conn(0x55c02db0ee10 msgr2=0x55c02db11230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 -- 172.21.15.99:0/2600000697 shutdown_connections 2024-09-13T23:25:34.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.032+0000 7fe891810800 1 -- 172.21.15.99:0/2600000697 wait complete. 2024-09-13T23:25:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe891810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe891810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c02da60350 con 0x55c02da87e30 2024-09-13T23:25:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe88cef7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe88cef7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49678/0 (socket says 172.21.15.99:49678) 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.046+0000 7fe88cef7640 1 -- 172.21.15.99:0/589077982 learned_addr learned my addr 172.21.15.99:0/589077982 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.047+0000 7fe88cef7640 1 -- 172.21.15.99:0/589077982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02d9adbc0 con 0x55c02da87e30 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.047+0000 7fe88cef7640 1 --2- 172.21.15.99:0/589077982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b240 tx=0x7fe87c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db3411890215ed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.047+0000 7fe77ae0d640 1 -- 172.21.15.99:0/589077982 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe87c008070 con 0x55c02da87e30 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.047+0000 7fe77ae0d640 1 -- 172.21.15.99:0/589077982 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87c00d500 con 0x55c02da87e30 2024-09-13T23:25:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.047+0000 7fe77ae0d640 1 -- 172.21.15.99:0/589077982 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe87c00d860 con 0x55c02da87e30 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- 172.21.15.99:0/589077982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 msgr2=0x55c02dc036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 --2- 172.21.15.99:0/589077982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00b240 tx=0x7fe87c00b700 comp rx=0 tx=0).stop 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- 172.21.15.99:0/589077982 shutdown_connections 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 --2- 172.21.15.99:0/589077982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc036f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- 172.21.15.99:0/589077982 >> 172.21.15.99:0/589077982 conn(0x55c02db0ee10 msgr2=0x55c02dbff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- 172.21.15.99:0/589077982 shutdown_connections 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- 172.21.15.99:0/589077982 wait complete. 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.048+0000 7fe891810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c02db1b620 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe88cef7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe88cef7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49690/0 (socket says 172.21.15.99:49690) 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe88cef7640 1 -- 172.21.15.99:0/1211697887 learned_addr learned my addr 172.21.15.99:0/1211697887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe88cef7640 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02d9c1fe0 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe88cef7640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c02dc04550 tx=0x7fe87c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe77960a640 1 -- 172.21.15.99:0/1211697887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe87c019870 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe77960a640 1 -- 172.21.15.99:0/1211697887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe87c019a10 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02dc0b660 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe77960a640 1 -- 172.21.15.99:0/1211697887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe87c019d30 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.049+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02dc0bb80 con 0x55c02da87e30 2024-09-13T23:25:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe77960a640 1 -- 172.21.15.99:0/1211697887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe87c017040 con 0x55c02da87e30 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe77960a640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 0x7fe7740390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe77960a640 1 -- 172.21.15.99:0/1211697887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe87c015020 con 0x55c02da87e30 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe8846f6640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 0x7fe7740390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 0x55c02dc12190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc12710 con 0x55c02db18900 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.050+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 0x55c02dc12190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe8846f6640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 0x7fe7740390a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe874057000 tx=0x7fe874052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 0x55c02dc12190 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe88d6f8640 1 -- 172.21.15.99:0/1211697887 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe88800a4a0 con 0x55c02db18900 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc0f760 con 0x55c02db18900 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe88d6f8640 1 -- 172.21.15.99:0/1211697887 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe88800a4a0 con 0x55c02db18900 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 0x55c02dc16e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc174d0 con 0x55c02dc14a40 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.051+0000 7fe88cef7640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 0x55c02dc16e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.052+0000 7fe88cef7640 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 0x55c02dc16e30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.052+0000 7fe88cef7640 1 -- 172.21.15.99:0/1211697887 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc14a40 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.052+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc138e0 con 0x55c02db18900 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.052+0000 7fe88d6f8640 1 -- 172.21.15.99:0/1211697887 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe88800a4a0 con 0x55c02db18900 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.052+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc13dc0 con 0x55c02dc14a40 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe88cef7640 1 -- 172.21.15.99:0/1211697887 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc14a40 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe891810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe891810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c02d9af580 con 0x55c02dc25e50 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49694/0 (socket says 172.21.15.99:49694) 2024-09-13T23:25:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.053+0000 7fe88d6f8640 1 -- 172.21.15.99:0/1666541866 learned_addr learned my addr 172.21.15.99:0/1666541866 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe88d6f8640 1 -- 172.21.15.99:0/1666541866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02dc267b0 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55c02dc0c1d0 tx=0x7fe8880167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe7727fc640 1 -- 172.21.15.99:0/1666541866 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888013640 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe7727fc640 1 -- 172.21.15.99:0/1666541866 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8880137e0 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02dc26a40 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe7727fc640 1 -- 172.21.15.99:0/1666541866 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888013ae0 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.054+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02dc29720 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe7727fc640 1 -- 172.21.15.99:0/1666541866 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe888011040 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe7727fc640 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 0x7fe764039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe7727fc640 1 -- 172.21.15.99:0/1666541866 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe88800e040 con 0x55c02dc25e50 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe88cef7640 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 0x7fe764039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.055+0000 7fe88cef7640 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 0x7fe764039070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe87c018540 tx=0x7fe87c01b4a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe891810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe891810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c02dc03ea0 con 0x55c02db14410 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49696/0 (socket says 172.21.15.99:49696) 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe88d6f8640 1 -- 172.21.15.99:0/213097483 learned_addr learned my addr 172.21.15.99:0/213097483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe88d6f8640 1 -- 172.21.15.99:0/213097483 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02db14de0 con 0x55c02db14410 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/213097483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe88804ce40 tx=0x7fe8880204e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61ffa34424a9cce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe763fff640 1 -- 172.21.15.99:0/213097483 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888021960 con 0x55c02db14410 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe763fff640 1 -- 172.21.15.99:0/213097483 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe88804a030 con 0x55c02db14410 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.056+0000 7fe763fff640 1 -- 172.21.15.99:0/213097483 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888021440 con 0x55c02db14410 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- 172.21.15.99:0/213097483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 msgr2=0x55c02db14810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 --2- 172.21.15.99:0/213097483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe88804ce40 tx=0x7fe8880204e0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- 172.21.15.99:0/213097483 shutdown_connections 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 --2- 172.21.15.99:0/213097483 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02db14810 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- 172.21.15.99:0/213097483 >> 172.21.15.99:0/213097483 conn(0x55c02dc2ef20 msgr2=0x55c02dc2d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- 172.21.15.99:0/213097483 shutdown_connections 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- 172.21.15.99:0/213097483 wait complete. 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 Processor -- start 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- start start 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe891810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c02db13140 con 0x55c02db14410 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe88d6f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49706/0 (socket says 172.21.15.99:49706) 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.057+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 learned_addr learned my addr 172.21.15.99:0/3270916115 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02dc3c7a0 con 0x55c02db14410 2024-09-13T23:25:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe88804bc90 tx=0x7fe88804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe7627fc640 1 -- 172.21.15.99:0/3270916115 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888039070 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe7627fc640 1 -- 172.21.15.99:0/3270916115 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe888021a90 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02dc3ca30 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe7627fc640 1 -- 172.21.15.99:0/3270916115 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe888021570 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.058+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02dc3f6e0 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.059+0000 7fe7627fc640 1 -- 172.21.15.99:0/3270916115 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe8880400e0 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.059+0000 7fe7627fc640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe758036b40 0x7fe758039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.059+0000 7fe7627fc640 1 -- 172.21.15.99:0/3270916115 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fe888031070 con 0x55c02db14410 2024-09-13T23:25:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.059+0000 7fe88cef7640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe758036b40 0x7fe758039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.059+0000 7fe88cef7640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe758036b40 0x7fe758039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00ffd0 tx=0x7fe87c033000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02dc47dc0 0x55c02dc4a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4a9d0 con 0x55c02dc47dc0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe8846f6640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02dc47dc0 0x55c02dc4a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe8846f6640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02dc47dc0 0x55c02dc4a280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 20 realm 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4ae00 con 0x55c02dc47dc0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.060+0000 7fe891810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4b6d0 con 0x55c02dc47dc0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4ba70 con 0x55c02dc47dc0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc4c7d0 0x55c02dc4ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4f1d0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc4c7d0 0x55c02dc4ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.061+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc4c7d0 0x55c02dc4ebc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe891810800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe891810800 20 searching for the correct realm 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c02dc51160 0x55c02dc53620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88cef7640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c02dc51160 0x55c02dc53620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88cef7640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c02dc51160 0x55c02dc53620 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88d6f8640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe8880406a0 0x7fe88804ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.062+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.063+0000 7fe8846f6640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe8880406a0 0x7fe88804ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.063+0000 7fe8846f6640 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe8880406a0 0x7fe88804ea50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.063+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.063+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.063+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.064+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.065+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.066+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.067+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.068+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc51160 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.069+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x7fe8880406a0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc47dc0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc53cf0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4fa20 con 0x55c02dc47dc0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.070+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc4fe10 con 0x55c02dc47dc0 2024-09-13T23:25:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc54170 con 0x55c02dc4c7d0 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 zone default found 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 4 Realm: () 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 zonegroup default 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc549c0 con 0x7fe8880406a0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc56740 con 0x55c02dc51160 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.071+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc56bc0 con 0x55c02dc51160 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.072+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.072+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.072+0000 7fe891810800 20 started sync module instance, tier type = 2024-09-13T23:25:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.072+0000 7fe891810800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.072+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc55be0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.073+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.073+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283889991904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc55be0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.073+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc576e0 con 0x55c02dc47dc0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.074+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283889991904] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.074+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.074+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283889996224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc55be0 con 0x55c02dc47dc0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.074+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc58150 con 0x55c02dc51160 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.075+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.075+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283889998912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc589e0 con 0x55c02dc51160 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.075+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc59500 con 0x55c02dc4c7d0 2024-09-13T23:25:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.075+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283889996224] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.076+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283889998912] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.076+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.076+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283890003920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc584f0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.076+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc59f10 con 0x55c02dc47dc0 2024-09-13T23:25:34.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.077+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.077+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283890006624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5a330 con 0x55c02dc47dc0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.077+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5adb0 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.077+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283890003920] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.078+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.078+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283890010272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5ad70 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.078+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5b7c0 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.078+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283890006624] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.079+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283890010272] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.079+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.079+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283889989424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5b310 con 0x7fe8880406a0 2024-09-13T23:25:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.079+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5bcd0 con 0x7fe8880406a0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283889989424] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283890007680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5bcd0 con 0x7fe8880406a0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=1 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=2 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=3 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=4 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=5 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.080+0000 7fe891810800 20 add_watcher() i=6 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.081+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283890007680] v31'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.081+0000 7fe891810800 20 add_watcher() i=7 2024-09-13T23:25:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.081+0000 7fe891810800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.081+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5ef90 con 0x55c02dc47dc0 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.082+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.082+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283890014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc5c260 con 0x55c02dc47dc0 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.082+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283890014608] v31'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe742fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 5 note: GC not initialized 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe741fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 20 Filter name: none 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe6b37fe640 20 reqs_thread_entry: start 2024-09-13T23:25:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.083+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc92410 con 0x55c02dc47dc0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc931a0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.084+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc98fb0 con 0x55c02dc47dc0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v31'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe891810800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe891810800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe891810800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94283890264464 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc95a90 con 0x55c02dc47dc0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94283890006624 notify 133143986183 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7fe874082040 con 0x55c02dc47dc0 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe763fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94283890006624 notifier 4395 bl.length()=849 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe763fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe763fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify cookie 94283890264464 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe763fff640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe750003ea0 con 0x55c02dc47dc0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.085+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.086+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94283890264464 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c02d9dbe00 con 0x55c02dc47dc0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.086+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc98990 con 0x55c02dc4c7d0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.087+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v31'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.087+0000 7fe891810800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.087+0000 7fe891810800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.087+0000 7fe891810800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.087+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94283890264464 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc95a90 con 0x55c02dc4c7d0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== watch-notify(notify (1) cookie 94283889991904 notify 133143986179 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55c02dc3ca30 con 0x55c02dc4c7d0 2024-09-13T23:25:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe7637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94283889991904 notifier 4395 bl.length()=166 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe7637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe7637fe640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe7637fe640 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fe6c0003400 con 0x55c02dc4c7d0 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(68 notify.0 [notify cookie 94283890264464 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.088+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== watch-notify(notify_complete (2) cookie 94283890264464 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c02dc3c7a0 con 0x55c02dc4c7d0 2024-09-13T23:25:34.102 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:25:34.085401Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.089+0000 7fe742fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.089+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283890014608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc47dc0 2024-09-13T23:25:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.090+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94283890014608] v31'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.090+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283889991904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc4c7d0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.091+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94283889991904] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.091+0000 7fe891810800 20 remove_watcher() i=0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.091+0000 7fe891810800 2 removed watcher, disabling cache 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.091+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283889996224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc47dc0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.092+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94283889996224] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.092+0000 7fe891810800 20 remove_watcher() i=1 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.092+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283889998912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc51160 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.093+0000 7fe88cef7640 1 -- 172.21.15.99:0/3270916115 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94283889998912] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe87c02d070 con 0x55c02dc51160 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.093+0000 7fe891810800 20 remove_watcher() i=2 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.093+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283890003920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc4c7d0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.094+0000 7fe88d6f8640 1 -- 172.21.15.99:0/3270916115 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94283890003920] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe88803b030 con 0x55c02dc4c7d0 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.094+0000 7fe891810800 20 remove_watcher() i=3 2024-09-13T23:25:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.094+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283890006624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x55c02dc47dc0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.095+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94283890006624] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x55c02dc47dc0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.095+0000 7fe891810800 20 remove_watcher() i=4 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.095+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283890010272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94283890010272] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe891810800 20 remove_watcher() i=5 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283889989424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94283889989424] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe891810800 20 remove_watcher() i=6 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.096+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283890007680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c02dc90120 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.097+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94283890007680] v31'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe874051070 con 0x7fe8880406a0 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.097+0000 7fe891810800 20 remove_watcher() i=7 2024-09-13T23:25:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe8880406a0 msgr2=0x7fe88804ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe8880406a0 0x7fe88804ea50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02dc47dc0 msgr2=0x55c02dc4a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02dc47dc0 0x55c02dc4a280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc4c7d0 msgr2=0x55c02dc4ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc4c7d0 0x55c02dc4ebc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c02dc51160 msgr2=0x55c02dc53620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c02dc51160 0x55c02dc53620 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe758036b40 msgr2=0x7fe758039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe758036b40 0x7fe758039000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00ffd0 tx=0x7fe87c033000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 msgr2=0x55c02dc3c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe8846f6640 1 -- 172.21.15.99:0/3270916115 reap_dead start 2024-09-13T23:25:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe88804bc90 tx=0x7fe88804cda0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 shutdown_connections 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/3270916115 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02db14410 0x55c02dc3c260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 >> 172.21.15.99:0/3270916115 conn(0x55c02dc2ef20 msgr2=0x55c02dc2cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 shutdown_connections 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/3270916115 wait complete. 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 msgr2=0x7fe764039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 0x7fe764039070 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe87c018540 tx=0x7fe87c01b4a0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 msgr2=0x55c02dc26270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55c02dc0c1d0 tx=0x7fe8880167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 shutdown_connections 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe764036bb0 0x7fe764039070 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 --2- 172.21.15.99:0/1666541866 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02dc25e50 0x55c02dc26270 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 >> 172.21.15.99:0/1666541866 conn(0x55c02dc1ade0 msgr2=0x55c02dc1d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 shutdown_connections 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.098+0000 7fe891810800 1 -- 172.21.15.99:0/1666541866 wait complete. 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 msgr2=0x55c02dc12190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 0x55c02dc12190 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 msgr2=0x55c02dc16e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 0x55c02dc16e30 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 msgr2=0x7fe7740390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 0x7fe7740390a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe874057000 tx=0x7fe874052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 msgr2=0x55c02dc0b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55c02dc04550 tx=0x7fe87c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 shutdown_connections 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c02dc14a40 0x55c02dc16e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c02db18900 0x55c02dc12190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe774036be0 0x7fe7740390a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 --2- 172.21.15.99:0/1211697887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c02da87e30 0x55c02dc0b120 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 >> 172.21.15.99:0/1211697887 conn(0x55c02db0ee10 msgr2=0x55c02dbfda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 shutdown_connections 2024-09-13T23:25:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.099+0000 7fe891810800 1 -- 172.21.15.99:0/1211697887 wait complete. 2024-09-13T23:25:34.114 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:25:34.085401Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:34.114 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:25:34.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:25:34.114 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:25:34.158 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.158 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.157+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.157+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b20726800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5614ad8ca900 0x5614ad8cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b20726800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5614ad786b30 con 0x5614ad8c64c0 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b20726800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5614ad768360 con 0x5614ad8ca900 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1bbbe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5614ad8ca900 0x5614ad8cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1c3bf640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5614ad8c64c0 0x5614ad8c68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:43996/0 (socket says 172.21.15.99:43996) 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/3248243059 learned_addr learned my addr 172.21.15.99:0/3248243059 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/3248243059 >> v1:172.21.15.43:6789/0 conn(0x5614ad8c64c0 legacy=0x5614ad8c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1b3bd640 1 -- 172.21.15.99:0/3248243059 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366959705 0 0) 0x5614ad786b30 con 0x5614ad8c64c0 2024-09-13T23:25:34.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.158+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/3248243059 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad78ee00 con 0x5614ad8ca900 2024-09-13T23:25:34.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.160+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/3248243059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8ca900 0x5614ad8cccf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000a470 tx=0x7f9b10045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dafe85978e4752 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.160+0000 7f9b1b3bd640 1 -- 172.21.15.99:0/3248243059 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10053570 con 0x5614ad8ca900 2024-09-13T23:25:34.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.160+0000 7f9b1b3bd640 1 -- 172.21.15.99:0/3248243059 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b10058070 con 0x5614ad8ca900 2024-09-13T23:25:34.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.160+0000 7f9b1b3bd640 1 -- 172.21.15.99:0/3248243059 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10053880 con 0x5614ad8ca900 2024-09-13T23:25:34.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 -- 172.21.15.99:0/3248243059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8ca900 msgr2=0x5614ad8cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 --2- 172.21.15.99:0/3248243059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8ca900 0x5614ad8cccf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000a470 tx=0x7f9b10045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 -- 172.21.15.99:0/3248243059 shutdown_connections 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 --2- 172.21.15.99:0/3248243059 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8ca900 0x5614ad8cccf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 -- 172.21.15.99:0/3248243059 >> 172.21.15.99:0/3248243059 conn(0x5614ad8c1df0 msgr2=0x5614ad8c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 -- 172.21.15.99:0/3248243059 shutdown_connections 2024-09-13T23:25:34.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.161+0000 7f9b20726800 1 -- 172.21.15.99:0/3248243059 wait complete. 2024-09-13T23:25:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.174+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b20726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b20726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5614ad813330 con 0x5614ad8c64c0 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b1c3bf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b1c3bf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49724/0 (socket says 172.21.15.99:49724) 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/3703434117 learned_addr learned my addr 172.21.15.99:0/3703434117 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/3703434117 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad760bc0 con 0x5614ad8c64c0 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.175+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/3703434117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00b240 tx=0x7f9b0c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995eba914edccb6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9a0a60c640 1 -- 172.21.15.99:0/3703434117 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c008070 con 0x5614ad8c64c0 2024-09-13T23:25:34.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9a0a60c640 1 -- 172.21.15.99:0/3703434117 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c00d500 con 0x5614ad8c64c0 2024-09-13T23:25:34.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9a0a60c640 1 -- 172.21.15.99:0/3703434117 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c00d860 con 0x5614ad8c64c0 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 -- 172.21.15.99:0/3703434117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 msgr2=0x5614ad83ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 --2- 172.21.15.99:0/3703434117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00b240 tx=0x7f9b0c00b700 comp rx=0 tx=0).stop 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 -- 172.21.15.99:0/3703434117 shutdown_connections 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 --2- 172.21.15.99:0/3703434117 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad83ad80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 -- 172.21.15.99:0/3703434117 >> 172.21.15.99:0/3703434117 conn(0x5614ad8c1df0 msgr2=0x5614ad9b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 -- 172.21.15.99:0/3703434117 shutdown_connections 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.176+0000 7f9b20726800 1 -- 172.21.15.99:0/3703434117 wait complete. 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b20726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b20726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5614ad8cd530 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b1c3bf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b1c3bf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49740/0 (socket says 172.21.15.99:49740) 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/293345231 learned_addr learned my addr 172.21.15.99:0/293345231 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad774fe0 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.177+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5614ad83a480 tx=0x7f9b0c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9a08e09640 1 -- 172.21.15.99:0/293345231 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c019870 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9a08e09640 1 -- 172.21.15.99:0/293345231 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b0c019a10 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614ad9c07d0 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9a08e09640 1 -- 172.21.15.99:0/293345231 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b0c019d30 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ad9c0cf0 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.178+0000 7f9a08e09640 1 -- 172.21.15.99:0/293345231 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b0c017040 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9a08e09640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 0x7f9a04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9a08e09640 1 -- 172.21.15.99:0/293345231 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b0c015020 con 0x5614ad8c64c0 2024-09-13T23:25:34.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 0x7f9a04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 0x5614ad9c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9c7880 con 0x5614ad8ca900 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 0x5614ad9c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 0x7f9a04039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b10057000 tx=0x7f9b10052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.179+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 0x5614ad9c7300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/293345231 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1400a4a0 con 0x5614ad8ca900 2024-09-13T23:25:34.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9c48d0 con 0x5614ad8ca900 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/293345231 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b1400a4a0 con 0x5614ad8ca900 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 0x5614ad9cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9cc640 con 0x5614ad9c9bb0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 0x5614ad9cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.180+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 0x5614ad9cbfa0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/293345231 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ad9c9bb0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9c8a50 con 0x5614ad8ca900 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/293345231 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b1400a4a0 con 0x5614ad8ca900 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9c8f30 con 0x5614ad9c9bb0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/293345231 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ad9c9bb0 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.181+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b20726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b20726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5614ad762580 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49754/0 (socket says 172.21.15.99:49754) 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/3282379538 learned_addr learned my addr 172.21.15.99:0/3282379538 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.182+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/3282379538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad9db950 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5614ad9c1340 tx=0x7f9b140167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9a01ffb640 1 -- 172.21.15.99:0/3282379538 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14013640 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9a01ffb640 1 -- 172.21.15.99:0/3282379538 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b140137e0 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614ad9dbbe0 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9a01ffb640 1 -- 172.21.15.99:0/3282379538 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14013ae0 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ad9de8c0 con 0x5614ad9daff0 2024-09-13T23:25:34.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.183+0000 7f9a01ffb640 1 -- 172.21.15.99:0/3282379538 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b14011040 con 0x5614ad9daff0 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9a01ffb640 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9a01ffb640 1 -- 172.21.15.99:0/3282379538 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b1400e040 con 0x5614ad9daff0 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5614ad9c47f0 tx=0x7f9b0c01b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b20726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b20726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5614ad9bb740 con 0x5614ad9e7d30 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49764/0 (socket says 172.21.15.99:49764) 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.184+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/4006482228 learned_addr learned my addr 172.21.15.99:0/4006482228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/4006482228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad9e8700 con 0x5614ad9e7d30 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/4006482228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b1404ce40 tx=0x7f9b1401fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8116bdbef3ada485 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f99fb7fe640 1 -- 172.21.15.99:0/4006482228 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14021960 con 0x5614ad9e7d30 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f99fb7fe640 1 -- 172.21.15.99:0/4006482228 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1404a030 con 0x5614ad9e7d30 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f99fb7fe640 1 -- 172.21.15.99:0/4006482228 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14021440 con 0x5614ad9e7d30 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 -- 172.21.15.99:0/4006482228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 msgr2=0x5614ad9e8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 --2- 172.21.15.99:0/4006482228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9b1404ce40 tx=0x7f9b1401fed0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 -- 172.21.15.99:0/4006482228 shutdown_connections 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 --2- 172.21.15.99:0/4006482228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9e8130 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 -- 172.21.15.99:0/4006482228 >> 172.21.15.99:0/4006482228 conn(0x5614ad9e40e0 msgr2=0x5614ad9e21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 -- 172.21.15.99:0/4006482228 shutdown_connections 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.185+0000 7f9b20726800 1 -- 172.21.15.99:0/4006482228 wait complete. 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b20726800 1 Processor -- start 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b20726800 1 -- start start 2024-09-13T23:25:34.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b20726800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b20726800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5614ad9e8cd0 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b1cbc0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:49768/0 (socket says 172.21.15.99:49768) 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 learned_addr learned my addr 172.21.15.99:0/907386458 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ad9ef6c0 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b1401ff70 tx=0x7f9b1404cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.186+0000 7f99f9ffb640 1 -- 172.21.15.99:0/907386458 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14039070 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f99f9ffb640 1 -- 172.21.15.99:0/907386458 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14021960 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614ad9ef950 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f99f9ffb640 1 -- 172.21.15.99:0/907386458 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b14021440 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ad9f2600 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f99f9ffb640 1 -- 172.21.15.99:0/907386458 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b140400e0 con 0x5614ad9e7d30 2024-09-13T23:25:34.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f99f9ffb640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99ec036b40 0x7f99ec039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.187+0000 7f99f9ffb640 1 -- 172.21.15.99:0/907386458 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b14031070 con 0x5614ad9e7d30 2024-09-13T23:25:34.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99ec036b40 0x7f99ec039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99ec036b40 0x7f99ec039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e6d0 tx=0x7f9b0c027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad9fac20 0x5614ad9fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9fd830 con 0x5614ad9fac20 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad9fac20 0x5614ad9fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.188+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad9fac20 0x5614ad9fd0e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 realm 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9fdc60 con 0x5614ad9fac20 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9fe530 con 0x5614ad9fac20 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ad9fe8d0 con 0x5614ad9fac20 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9ff630 0x5614ada01a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada01f60 con 0x5614ad9ff630 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.189+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9ff630 0x5614ada01a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9ff630 0x5614ada01a20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b20726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b20726800 20 searching for the correct realm 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5614ada03fa0 0x5614ada06460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5614ada03fa0 0x5614ada06460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.190+0000 7f9b1c3bf640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5614ada03fa0 0x5614ada06460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1cbc0640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b14055bb0 0x7f9b14040880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b14055bb0 0x7f9b14040880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.191+0000 7f9b1bbbe640 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b14055bb0 0x7f9b14040880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.192+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.193+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.194+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.195+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.196+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.197+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ada03fa0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x7f9b14055bb0 2024-09-13T23:25:34.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9fac20 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.198+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06b30 con 0x5614ad9ff630 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada029a0 con 0x5614ad9fac20 2024-09-13T23:25:34.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada025b0 con 0x5614ad9fac20 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada03310 con 0x5614ad9ff630 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 zone default found 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 4 Realm: () 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 zonegroup default 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.199+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada06fb0 con 0x7f9b14055bb0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08e40 con 0x5614ada03fa0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada091e0 con 0x5614ada03fa0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 started sync module instance, tier type = 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.200+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08280 con 0x5614ad9ff630 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.201+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.201+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94646812313200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08280 con 0x5614ad9ff630 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.201+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada09a90 con 0x5614ad9fac20 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.202+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94646812313200] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.202+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.202+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94646812317056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08280 con 0x5614ad9fac20 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.202+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0a540 con 0x5614ada03fa0 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.204+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94646812317056] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.204+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.204+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94646812310992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada081f0 con 0x5614ada03fa0 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.204+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0b430 con 0x5614ad9ff630 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.205+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94646812310992] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.205+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.205+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94646812323712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0b850 con 0x5614ad9ff630 2024-09-13T23:25:34.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.205+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0c210 con 0x5614ad9fac20 2024-09-13T23:25:34.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.206+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.206+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94646812327264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0c630 con 0x5614ad9fac20 2024-09-13T23:25:34.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.206+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0d110 con 0x7f9b14055bb0 2024-09-13T23:25:34.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.206+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94646812323712] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.207+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.207+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94646812331040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0d110 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.207+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0db20 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.207+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94646812327264] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.208+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94646812331040] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.208+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.208+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94646812324768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0d670 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.208+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0e3c0 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94646812324768] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94646812335376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0e5e0 con 0x7f9b14055bb0 2024-09-13T23:25:34.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=0 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=1 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=2 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=3 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=4 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=5 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.209+0000 7f9b20726800 20 add_watcher() i=6 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94646812335376] v31'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x7f9b14055bb0 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b20726800 20 add_watcher() i=7 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b20726800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada11610 con 0x5614ad9fac20 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.210+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94646812336432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0ea00 con 0x5614ad9fac20 2024-09-13T23:25:34.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94646812336432] v31'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f99d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f9b20726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f9b20726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f9b20726800 5 note: GC not initialized 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.211+0000 7f99d17e2640 20 reqs_thread_entry: start 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b20726800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b20726800 20 Filter name: none 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9942ffd640 20 reqs_thread_entry: start 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b20726800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5614ada44300 con 0x5614ad9fac20 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.212+0000 7f9b20726800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T23:25:34.225 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:25:34.085401Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.213+0000 7f99d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.213+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94646812336432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada44840 con 0x5614ad9fac20 2024-09-13T23:25:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.214+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94646812336432] v31'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b10051070 con 0x5614ad9fac20 2024-09-13T23:25:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.214+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94646812313200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada44840 con 0x5614ad9ff630 2024-09-13T23:25:34.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.215+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94646812313200] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.215+0000 7f9b20726800 20 remove_watcher() i=0 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.215+0000 7f9b20726800 2 removed watcher, disabling cache 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.215+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94646812317056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08670 con 0x5614ad9fac20 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.216+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94646812317056] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1007f040 con 0x5614ad9fac20 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.216+0000 7f9b20726800 20 remove_watcher() i=1 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.216+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94646812310992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08670 con 0x5614ada03fa0 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.217+0000 7f9b1c3bf640 1 -- 172.21.15.99:0/907386458 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94646812310992] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b0c02d070 con 0x5614ada03fa0 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.217+0000 7f9b20726800 20 remove_watcher() i=2 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.217+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94646812323712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada07dd0 con 0x5614ad9ff630 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.218+0000 7f9b1cbc0640 1 -- 172.21.15.99:0/907386458 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94646812323712] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1403b030 con 0x5614ad9ff630 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.218+0000 7f9b20726800 20 remove_watcher() i=3 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.218+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94646812327264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada08670 con 0x5614ad9fac20 2024-09-13T23:25:34.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.219+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94646812327264] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1007f040 con 0x5614ad9fac20 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.219+0000 7f9b20726800 20 remove_watcher() i=4 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.219+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94646812331040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0af80 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.220+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94646812331040] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1007f040 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.220+0000 7f9b20726800 20 remove_watcher() i=5 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.220+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94646812324768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada07dd0 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.221+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94646812324768] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1007f040 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.221+0000 7f9b20726800 20 remove_watcher() i=6 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.221+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94646812335376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5614ada0bd60 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94646812335376] v31'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1007f040 con 0x7f9b14055bb0 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 20 remove_watcher() i=7 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b14055bb0 msgr2=0x7f9b14040880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b14055bb0 0x7f9b14040880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad9fac20 msgr2=0x5614ad9fd0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad9fac20 0x5614ad9fd0e0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9ff630 msgr2=0x5614ada01a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9ff630 0x5614ada01a20 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5614ada03fa0 msgr2=0x5614ada06460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5614ada03fa0 0x5614ada06460 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99ec036b40 msgr2=0x7f99ec039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99ec036b40 0x7f99ec039000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c00e6d0 tx=0x7f9b0c027000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 msgr2=0x5614ad9ef180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b1bbbe640 1 -- 172.21.15.99:0/907386458 reap_dead start 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.222+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9b1401ff70 tx=0x7f9b1404cda0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 shutdown_connections 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/907386458 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9e7d30 0x5614ad9ef180 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 >> 172.21.15.99:0/907386458 conn(0x5614ad9e40e0 msgr2=0x5614ad9e9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 shutdown_connections 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/907386458 wait complete. 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 msgr2=0x7f99f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5614ad9c47f0 tx=0x7f9b0c01b520 comp rx=0 tx=0).stop 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 msgr2=0x5614ad9db410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5614ad9c1340 tx=0x7f9b140167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 shutdown_connections 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/3282379538 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad9daff0 0x5614ad9db410 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 >> 172.21.15.99:0/3282379538 conn(0x5614ad9cff80 msgr2=0x5614ad9d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 shutdown_connections 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/3282379538 wait complete. 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 msgr2=0x5614ad9c7300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 0x5614ad9c7300 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 msgr2=0x5614ad9cbfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 0x5614ad9cbfa0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 msgr2=0x7f9a04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 0x7f9a04039050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b10057000 tx=0x7f9b10052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 msgr2=0x5614ad9c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.223+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5614ad83a480 tx=0x7f9b0c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 shutdown_connections 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5614ad9c9bb0 0x5614ad9cbfa0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5614ad8ca900 0x5614ad9c7300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b90 0x7f9a04039050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 --2- 172.21.15.99:0/293345231 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5614ad8c64c0 0x5614ad9c0290 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 >> 172.21.15.99:0/293345231 conn(0x5614ad8c1df0 msgr2=0x5614ad9af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 shutdown_connections 2024-09-13T23:25:34.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.224+0000 7f9b20726800 1 -- 172.21.15.99:0/293345231 wait complete. 2024-09-13T23:25:34.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:25:34.085401Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:34.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:25:34.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T23:25:34.237 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T23:25:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.283 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2fe87800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d08b722920 0x55d08b724d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2fe87800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d08b5deb30 con 0x55d08b71e4e0 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2fe87800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d08b5c0360 con 0x55d08b722920 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d17a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d08b722920 0x55d08b724d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d17a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d08b722920 0x55d08b724d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55866/0 (socket says 172.21.15.99:55866) 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d17a640 1 -- 172.21.15.99:0/1342126388 learned_addr learned my addr 172.21.15.99:0/1342126388 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d97b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55d08b71e4e0 0x55d08b71e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41854/0 (socket says 172.21.15.99:41854) 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d17a640 1 -- 172.21.15.99:0/1342126388 >> v1:172.21.15.43:6789/0 conn(0x55d08b71e4e0 legacy=0x55d08b71e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.283+0000 7f3f2d17a640 1 -- 172.21.15.99:0/1342126388 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b5e6e00 con 0x55d08b722920 2024-09-13T23:25:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.285+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/1342126388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b722920 0x55d08b724d10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a520 tx=0x7f3f24045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1477bc4aaff72554 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.285+0000 7f3f2c979640 1 -- 172.21.15.99:0/1342126388 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f24055070 con 0x55d08b722920 2024-09-13T23:25:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.285+0000 7f3f2c979640 1 -- 172.21.15.99:0/1342126388 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f240515b0 con 0x55d08b722920 2024-09-13T23:25:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.285+0000 7f3f2c979640 1 -- 172.21.15.99:0/1342126388 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f240518d0 con 0x55d08b722920 2024-09-13T23:25:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1342126388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b722920 msgr2=0x55d08b724d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/1342126388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b722920 0x55d08b724d10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400a520 tx=0x7f3f24045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1342126388 shutdown_connections 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/1342126388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b722920 0x55d08b724d10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1342126388 >> 172.21.15.99:0/1342126388 conn(0x55d08b719dd0 msgr2=0x55d08b71c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1342126388 shutdown_connections 2024-09-13T23:25:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.286+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1342126388 wait complete. 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.300+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.300+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.300+0000 7f3f2fe87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.300+0000 7f3f2fe87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d08b66b360 con 0x55d08b71e4e0 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3f2d97b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3f2d97b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55868/0 (socket says 172.21.15.99:55868) 2024-09-13T23:25:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3f2d97b640 1 -- 172.21.15.99:0/1211997282 learned_addr learned my addr 172.21.15.99:0/1211997282 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3f2d97b640 1 -- 172.21.15.99:0/1211997282 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b5b8bc0 con 0x55d08b71e4e0 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/1211997282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f20001e40 tx=0x7f3f20001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546d63bfe1ab72b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3e1be07640 1 -- 172.21.15.99:0/1211997282 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2000b690 con 0x55d08b71e4e0 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3e1be07640 1 -- 172.21.15.99:0/1211997282 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f20006070 con 0x55d08b71e4e0 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.301+0000 7f3e1be07640 1 -- 172.21.15.99:0/1211997282 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2000b9e0 con 0x55d08b71e4e0 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1211997282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 msgr2=0x55d08b80d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/1211997282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f20001e40 tx=0x7f3f20001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1211997282 shutdown_connections 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/1211997282 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b80d770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1211997282 >> 172.21.15.99:0/1211997282 conn(0x55d08b719dd0 msgr2=0x55d08b809130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1211997282 shutdown_connections 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- 172.21.15.99:0/1211997282 wait complete. 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.302+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2fe87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2fe87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d08b725550 con 0x55d08b71e4e0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2d97b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2d97b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55876/0 (socket says 172.21.15.99:55876) 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2d97b640 1 -- 172.21.15.99:0/2596439435 learned_addr learned my addr 172.21.15.99:0/2596439435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2d97b640 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b5ccfe0 con 0x55d08b71e4e0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f20000f60 tx=0x7f3f20000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3e1a604640 1 -- 172.21.15.99:0/2596439435 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f20025020 con 0x55d08b71e4e0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3e1a604640 1 -- 172.21.15.99:0/2596439435 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2001c040 con 0x55d08b71e4e0 2024-09-13T23:25:34.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08b8145d0 con 0x55d08b71e4e0 2024-09-13T23:25:34.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3e1a604640 1 -- 172.21.15.99:0/2596439435 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f20017b10 con 0x55d08b71e4e0 2024-09-13T23:25:34.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.303+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08b814b50 con 0x55d08b71e4e0 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.304+0000 7f3e1a604640 1 -- 172.21.15.99:0/2596439435 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3f20028020 con 0x55d08b71e4e0 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.304+0000 7f3e1a604640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 0x7f3e14039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.304+0000 7f3e1a604640 1 -- 172.21.15.99:0/2596439435 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3f2004e9e0 con 0x55d08b71e4e0 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.304+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 0x7f3e14039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 0x55d08b81aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b81b660 con 0x55d08b722920 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 0x55d08b81aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 0x7f3e14039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f24057000 tx=0x7f3f24052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 0x55d08b81aff0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2e17c640 1 -- 172.21.15.99:0/2596439435 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f2800a4a0 con 0x55d08b722920 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.305+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8186d0 con 0x55d08b722920 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2e17c640 1 -- 172.21.15.99:0/2596439435 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f2800a4a0 con 0x55d08b722920 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 0x55d08b81fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b820490 con 0x55d08b81d9b0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 0x55d08b81fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 0x55d08b81fda0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2d97b640 1 -- 172.21.15.99:0/2596439435 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b81d9b0 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.306+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b81c850 con 0x55d08b722920 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2e17c640 1 -- 172.21.15.99:0/2596439435 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f2800a4a0 con 0x55d08b722920 2024-09-13T23:25:34.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b81cd30 con 0x55d08b81d9b0 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2d97b640 1 -- 172.21.15.99:0/2596439435 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b81d9b0 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2fe87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.307+0000 7f3f2fe87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d08b5ba580 con 0x55d08b82ee40 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55878/0 (socket says 172.21.15.99:55878) 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2e17c640 1 -- 172.21.15.99:0/4083343419 learned_addr learned my addr 172.21.15.99:0/4083343419 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2e17c640 1 -- 172.21.15.99:0/4083343419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b82f7a0 con 0x55d08b82ee40 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d08b81ba60 tx=0x7f3f280163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3e137fe640 1 -- 172.21.15.99:0/4083343419 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f28013450 con 0x55d08b82ee40 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3e137fe640 1 -- 172.21.15.99:0/4083343419 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f280135f0 con 0x55d08b82ee40 2024-09-13T23:25:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08b82fa30 con 0x55d08b82ee40 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3e137fe640 1 -- 172.21.15.99:0/4083343419 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f280138d0 con 0x55d08b82ee40 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.308+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08b832710 con 0x55d08b82ee40 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.309+0000 7f3e137fe640 1 -- 172.21.15.99:0/4083343419 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3f28011040 con 0x55d08b82ee40 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.309+0000 7f3e137fe640 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 0x7f3e08039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.309+0000 7f3e137fe640 1 -- 172.21.15.99:0/4083343419 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3f2800e040 con 0x55d08b82ee40 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.309+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 0x7f3e08039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 0x7f3e08039000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55d08b81bf60 tx=0x7f3f2004cf10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2fe87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2fe87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d08b80df20 con 0x55d08b83bb60 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55894/0 (socket says 172.21.15.99:55894) 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3467590879 learned_addr learned my addr 172.21.15.99:0/3467590879 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.310+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3467590879 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b83c530 con 0x55d08b83bb60 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/3467590879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f2804cdd0 tx=0x7f3f28029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b841635f38c3624c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3e117fa640 1 -- 172.21.15.99:0/3467590879 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2804a020 con 0x55d08b83bb60 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3e117fa640 1 -- 172.21.15.99:0/3467590879 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2802a570 con 0x55d08b83bb60 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3e117fa640 1 -- 172.21.15.99:0/3467590879 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2801f500 con 0x55d08b83bb60 2024-09-13T23:25:34.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3467590879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 msgr2=0x55d08b83bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3467590879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f2804cdd0 tx=0x7f3f28029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3467590879 shutdown_connections 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3467590879 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b83bf60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3467590879 >> 172.21.15.99:0/3467590879 conn(0x55d08b837f10 msgr2=0x55d08b836010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3467590879 shutdown_connections 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.311+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3467590879 wait complete. 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2fe87800 1 Processor -- start 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2fe87800 1 -- start start 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2fe87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2fe87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d08b83cb00 con 0x55d08b83bb60 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2e17c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55900/0 (socket says 172.21.15.99:55900) 2024-09-13T23:25:34.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 learned_addr learned my addr 172.21.15.99:0/3623360482 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d08b8434e0 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.312+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f28014fd0 tx=0x7f3f2804cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3dff7fe640 1 -- 172.21.15.99:0/3623360482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2803a070 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3dff7fe640 1 -- 172.21.15.99:0/3623360482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2801f710 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d08b843770 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3dff7fe640 1 -- 172.21.15.99:0/3623360482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f2801fa30 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d08b846420 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.313+0000 7f3dff7fe640 1 -- 172.21.15.99:0/3623360482 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3f2803d070 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3dff7fe640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3df8036ce0 0x7f3df80391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3dff7fe640 1 -- 172.21.15.99:0/3623360482 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f3f28035030 con 0x55d08b83bb60 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3df8036ce0 0x7f3df80391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3df8036ce0 0x7f3df80391a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55d08b81bb00 tx=0x7f3f20037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b84ea80 0x55d08b850f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b851690 con 0x55d08b84ea80 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.314+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b84ea80 0x55d08b850f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b84ea80 0x55d08b850f40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 realm 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b851a60 con 0x55d08b84ea80 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b852300 con 0x55d08b84ea80 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.315+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8526a0 con 0x55d08b84ea80 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b853400 0x55d08b8557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b855dc0 con 0x55d08b853400 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b853400 0x55d08b8557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b853400 0x55d08b8557f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 20 searching for the correct realm 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d08b857dc0 0x55d08b85a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b857dc0 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.316+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d08b857dc0 0x55d08b85a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2d97b640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d08b857dc0 0x55d08b85a280 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b853400 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2e17c640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3f28058040 0x7f3f28040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.317+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3f28058040 0x7f3f28040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3f28058040 0x7f3f28040660 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b84ea80 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.318+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b84ea80 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b853400 2024-09-13T23:25:34.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.319+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b857dc0 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b84ea80 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x7f3f28058040 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b84ea80 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.320+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b853400 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85a950 con 0x55d08b857dc0 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x7f3f28058040 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.321+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b84ea80 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b84ea80 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.322+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x7f3f28058040 2024-09-13T23:25:34.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b853400 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b84ea80 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.323+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x7f3f28058040 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x7f3f28058040 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b853400 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.324+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b857dc0 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x7f3f28058040 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b84ea80 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f3f2005c040 con 0x55d08b853400 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.325+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b857310 con 0x55d08b84ea80 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b856b80 con 0x55d08b84ea80 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85add0 con 0x55d08b853400 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 zone default found 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 4 Realm: () 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 zonegroup default 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.326+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85b620 con 0x7f3f28058040 2024-09-13T23:25:34.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85d3a0 con 0x55d08b857dc0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85d7c0 con 0x55d08b857dc0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 started sync module instance, tier type = 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.327+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85c840 con 0x55d08b853400 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.328+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.328+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94354182360384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85c840 con 0x55d08b853400 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.328+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85e2c0 con 0x55d08b84ea80 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.329+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94354182360384] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.330+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.330+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94354182357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85c7b0 con 0x55d08b84ea80 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.330+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85f180 con 0x55d08b857dc0 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.331+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.331+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94354182368464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85f9d0 con 0x55d08b857dc0 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.331+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8604d0 con 0x55d08b853400 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.331+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94354182357904] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.331+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94354182368464] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.332+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.332+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94354182370592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b85e6b0 con 0x55d08b853400 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.332+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b860f10 con 0x55d08b84ea80 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.333+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94354182370592] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.333+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.333+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94354182373312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b860f10 con 0x55d08b84ea80 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.333+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8618d0 con 0x7f3f28058040 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.334+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.334+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94354182378528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b861cf0 con 0x7f3f28058040 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.334+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b862810 con 0x7f3f28058040 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.334+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94354182373312] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.335+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94354182378528] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.335+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.335+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94354182382304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b861840 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.335+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b862ea0 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94354182384112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8632c0 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=0 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=1 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=2 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=3 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=4 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=5 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94354182382304] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.336+0000 7f3f2fe87800 20 add_watcher() i=6 2024-09-13T23:25:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94354182384112] v31'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2fe87800 20 add_watcher() i=7 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2fe87800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8662f0 con 0x55d08b84ea80 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.337+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94354182385168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8636e0 con 0x55d08b84ea80 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94354182385168] v31'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2fe87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2fe87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2fe87800 5 note: GC not initialized 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3dd67fc640 20 reqs_thread_entry: start 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2fe87800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.338+0000 7f3f2fe87800 20 Filter name: none 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3d4ffff640 20 reqs_thread_entry: start 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8994c0 con 0x55d08b84ea80 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.339+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b8a0140 con 0x55d08b84ea80 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v31'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2fe87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2fe87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2fe87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94354182634240 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b89b800 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94354182373312 notify 133143986184 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55d08b5e6e00 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3e117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94354182373312 notifier 4409 bl.length()=758 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3e117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3e117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3e117fa640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3df0003ea0 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.340+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(64 notify.4 [notify cookie 94354182634240 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.341+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.341+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94354182634240 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3f2405ba10 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.341+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b89fb00 con 0x55d08b84ea80 2024-09-13T23:25:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(66 foo:foo1 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2fe87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94354182634240 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55d08b89b350 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== watch-notify(notify (1) cookie 94354182360384 notify 133143986180 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55d08b843770 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3e10ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94354182360384 notifier 4409 bl.length()=159 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.0 [notify cookie 94354182634240 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3e10ff9640 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3d580032c0 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== watch-notify(notify_complete (2) cookie 94354182634240 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d08b8434e0 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.342+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.355 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:25:34.085401Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.343+0000 7f3dd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.343+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94354182385168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b89b350 con 0x55d08b84ea80 2024-09-13T23:25:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.344+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94354182385168] v31'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.344+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94354182360384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x55d08b853400 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.345+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94354182360384] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.345+0000 7f3f2fe87800 20 remove_watcher() i=0 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.345+0000 7f3f2fe87800 2 removed watcher, disabling cache 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.345+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94354182357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x55d08b84ea80 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.346+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94354182357904] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.346+0000 7f3f2fe87800 20 remove_watcher() i=1 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.346+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94354182368464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x55d08b857dc0 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.347+0000 7f3f2d97b640 1 -- 172.21.15.99:0/3623360482 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94354182368464] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f20046d70 con 0x55d08b857dc0 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.347+0000 7f3f2fe87800 20 remove_watcher() i=2 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.347+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94354182370592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x55d08b853400 2024-09-13T23:25:34.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.348+0000 7f3f2e17c640 1 -- 172.21.15.99:0/3623360482 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94354182370592] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f2803c030 con 0x55d08b853400 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.348+0000 7f3f2fe87800 20 remove_watcher() i=3 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.348+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94354182373312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x55d08b84ea80 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.349+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94354182373312] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x55d08b84ea80 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.349+0000 7f3f2fe87800 20 remove_watcher() i=4 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.349+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94354182378528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x7f3f28058040 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.350+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94354182378528] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.350+0000 7f3f2fe87800 20 remove_watcher() i=5 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.350+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94354182382304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x7f3f28058040 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.351+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94354182382304] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.351+0000 7f3f2fe87800 20 remove_watcher() i=6 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.351+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94354182384112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55d08b897210 con 0x7f3f28058040 2024-09-13T23:25:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94354182384112] v31'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3f24057030 con 0x7f3f28058040 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 20 remove_watcher() i=7 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3f28058040 msgr2=0x7f3f28040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3f28058040 0x7f3f28040660 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b84ea80 msgr2=0x55d08b850f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b84ea80 0x55d08b850f40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b853400 msgr2=0x55d08b8557f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b853400 0x55d08b8557f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d08b857dc0 msgr2=0x55d08b85a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d08b857dc0 0x55d08b85a280 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3df8036ce0 msgr2=0x7f3df80391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3df8036ce0 0x7f3df80391a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55d08b81bb00 tx=0x7f3f20037000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 msgr2=0x55d08b842fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2d17a640 1 -- 172.21.15.99:0/3623360482 reap_dead start 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3f28014fd0 tx=0x7f3f2804cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 shutdown_connections 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/3623360482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b83bb60 0x55d08b842fa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.352+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 >> 172.21.15.99:0/3623360482 conn(0x55d08b837f10 msgr2=0x55d08b83d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 shutdown_connections 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/3623360482 wait complete. 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 msgr2=0x7f3e08039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 0x7f3e08039000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55d08b81bf60 tx=0x7f3f2004cf10 comp rx=0 tx=0).stop 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 msgr2=0x55d08b82f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55d08b81ba60 tx=0x7f3f280163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 shutdown_connections 2024-09-13T23:25:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e08036b40 0x7f3e08039000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/4083343419 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b82ee40 0x55d08b82f260 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 >> 172.21.15.99:0/4083343419 conn(0x55d08b823dd0 msgr2=0x55d08b826950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 shutdown_connections 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/4083343419 wait complete. 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 msgr2=0x55d08b81aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 0x55d08b81aff0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 msgr2=0x55d08b81fda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 0x55d08b81fda0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 msgr2=0x7f3e14039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 0x7f3e14039000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f24057000 tx=0x7f3f24052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 msgr2=0x55d08b814090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f20000f60 tx=0x7f3f20000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 shutdown_connections 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d08b81d9b0 0x55d08b81fda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d08b722920 0x55d08b81aff0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3e14036b40 0x7f3e14039000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 --2- 172.21.15.99:0/2596439435 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d08b71e4e0 0x55d08b814090 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 >> 172.21.15.99:0/2596439435 conn(0x55d08b719dd0 msgr2=0x55d08b807a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 shutdown_connections 2024-09-13T23:25:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.353+0000 7f3f2fe87800 1 -- 172.21.15.99:0/2596439435 wait complete. 2024-09-13T23:25:34.367 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:25:34.085401Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:34.367 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:25:34.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T23:25:34.367 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T23:25:34.411 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.412 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c7742800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c164eea590 0x55c164ee8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c7742800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c164e33b30 con 0x55c164eea990 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c7742800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55c164e15360 con 0x55c164eea590 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.411+0000 7f36c3490640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c164eea590 0x55c164ee8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.412+0000 7f36c3490640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55c164eea590 0x55c164ee8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55912/0 (socket says 172.21.15.99:55912) 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.412+0000 7f36c2c8f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55c164eea990 0x55c164ee9380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41860/0 (socket says 172.21.15.99:41860) 2024-09-13T23:25:34.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.412+0000 7f36c3490640 1 -- 172.21.15.99:0/2808012113 learned_addr learned my addr 172.21.15.99:0/2808012113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.412+0000 7f36c3490640 1 -- 172.21.15.99:0/2808012113 >> v1:172.21.15.43:6789/0 conn(0x55c164eea990 legacy=0x55c164ee9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.412+0000 7f36c3490640 1 -- 172.21.15.99:0/2808012113 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c164e3be00 con 0x55c164eea590 2024-09-13T23:25:34.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c3490640 1 --2- 172.21.15.99:0/2808012113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c164ee8d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36b400a520 tx=0x7f36b4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d002176cb29ab0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c248e640 1 -- 172.21.15.99:0/2808012113 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b4055070 con 0x55c164eea590 2024-09-13T23:25:34.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c248e640 1 -- 172.21.15.99:0/2808012113 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b40515b0 con 0x55c164eea590 2024-09-13T23:25:34.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c248e640 1 -- 172.21.15.99:0/2808012113 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b40518d0 con 0x55c164eea590 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 -- 172.21.15.99:0/2808012113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 msgr2=0x55c164ee8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 --2- 172.21.15.99:0/2808012113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c164ee8d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f36b400a520 tx=0x7f36b4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 -- 172.21.15.99:0/2808012113 shutdown_connections 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 --2- 172.21.15.99:0/2808012113 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c164ee8d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 -- 172.21.15.99:0/2808012113 >> 172.21.15.99:0/2808012113 conn(0x55c164f6fff0 msgr2=0x55c164f72410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 -- 172.21.15.99:0/2808012113 shutdown_connections 2024-09-13T23:25:34.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.414+0000 7f36c7742800 1 -- 172.21.15.99:0/2808012113 wait complete. 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c7742800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c7742800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c164ec0330 con 0x55c164eea590 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c3490640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c3490640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55914/0 (socket says 172.21.15.99:55914) 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.428+0000 7f36c3490640 1 -- 172.21.15.99:0/1749915338 learned_addr learned my addr 172.21.15.99:0/1749915338 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.429+0000 7f36c3490640 1 -- 172.21.15.99:0/1749915338 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c164e0dbc0 con 0x55c164eea590 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.429+0000 7f36c3490640 1 --2- 172.21.15.99:0/1749915338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36b4025da0 tx=0x7f36b4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd90676e547a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.429+0000 7f35b160a640 1 -- 172.21.15.99:0/1749915338 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b4051890 con 0x55c164eea590 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.429+0000 7f35b160a640 1 -- 172.21.15.99:0/1749915338 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b4051ac0 con 0x55c164eea590 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.429+0000 7f35b160a640 1 -- 172.21.15.99:0/1749915338 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b4051da0 con 0x55c164eea590 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- 172.21.15.99:0/1749915338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 msgr2=0x55c165065aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 --2- 172.21.15.99:0/1749915338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f36b4025da0 tx=0x7f36b4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- 172.21.15.99:0/1749915338 shutdown_connections 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 --2- 172.21.15.99:0/1749915338 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c165065aa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- 172.21.15.99:0/1749915338 >> 172.21.15.99:0/1749915338 conn(0x55c164f6fff0 msgr2=0x55c165061460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- 172.21.15.99:0/1749915338 shutdown_connections 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- 172.21.15.99:0/1749915338 wait complete. 2024-09-13T23:25:34.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.430+0000 7f36c7742800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c164f7d9a0 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c3490640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c3490640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55922/0 (socket says 172.21.15.99:55922) 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c3490640 1 -- 172.21.15.99:0/571032817 learned_addr learned my addr 172.21.15.99:0/571032817 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c3490640 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c164e21fe0 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c3490640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f35afe07640 1 -- 172.21.15.99:0/571032817 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b4073070 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f35afe07640 1 -- 172.21.15.99:0/571032817 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b405a450 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c16506d850 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f35afe07640 1 -- 172.21.15.99:0/571032817 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36b405a730 con 0x55c164eea590 2024-09-13T23:25:34.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.431+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16506ddd0 con 0x55c164eea590 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f35afe07640 1 -- 172.21.15.99:0/571032817 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f36b4076070 con 0x55c164eea590 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f35afe07640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 0x7f35a8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f35afe07640 1 -- 172.21.15.99:0/571032817 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f36b4062070 con 0x55c164eea590 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 0x7f35a8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 0x55c165074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.432+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c165074d80 con 0x55c165072370 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c3c91640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 0x55c165074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 0x7f35a8039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f36b8000f60 tx=0x7f36b8001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c3c91640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 0x55c165074760 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c3c91640 1 -- 172.21.15.99:0/571032817 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36bc00a4a0 con 0x55c165072370 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c165071950 con 0x55c165072370 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c3c91640 1 -- 172.21.15.99:0/571032817 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36bc00a4a0 con 0x55c165072370 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 0x55c1650794f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.433+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c165079be0 con 0x55c165077100 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.434+0000 7f36c3490640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 0x55c1650794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.434+0000 7f36c3490640 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 0x55c1650794f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.434+0000 7f36c3490640 1 -- 172.21.15.99:0/571032817 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36b407f070 con 0x55c165077100 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.434+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c165075fa0 con 0x55c165072370 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c3c91640 1 -- 172.21.15.99:0/571032817 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36bc00a4a0 con 0x55c165072370 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c165076480 con 0x55c165077100 2024-09-13T23:25:34.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c3490640 1 -- 172.21.15.99:0/571032817 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36b407f070 con 0x55c165077100 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c7742800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.435+0000 7f36c7742800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c164e0f580 con 0x55c1650885a0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55932/0 (socket says 172.21.15.99:55932) 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c3c91640 1 -- 172.21.15.99:0/2399102645 learned_addr learned my addr 172.21.15.99:0/2399102645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c3c91640 1 -- 172.21.15.99:0/2399102645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c165088f00 con 0x55c1650885a0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c3c91640 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55c165075160 tx=0x7f36bc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f35ad602640 1 -- 172.21.15.99:0/2399102645 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc013450 con 0x55c1650885a0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f35ad602640 1 -- 172.21.15.99:0/2399102645 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc0135f0 con 0x55c1650885a0 2024-09-13T23:25:34.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c165089190 con 0x55c1650885a0 2024-09-13T23:25:34.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f35ad602640 1 -- 172.21.15.99:0/2399102645 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc0138d0 con 0x55c1650885a0 2024-09-13T23:25:34.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.436+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16508be70 con 0x55c1650885a0 2024-09-13T23:25:34.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.437+0000 7f35ad602640 1 -- 172.21.15.99:0/2399102645 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f36bc011040 con 0x55c1650885a0 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.437+0000 7f35ad602640 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 0x7f359c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.437+0000 7f35ad602640 1 -- 172.21.15.99:0/2399102645 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f36bc00e040 con 0x55c1650885a0 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.437+0000 7f36c3490640 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 0x7f359c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3490640 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 0x7f359c039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55c1650756b0 tx=0x7f36b406f420 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c7742800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c7742800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c165066190 con 0x55c165095290 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55934/0 (socket says 172.21.15.99:55934) 2024-09-13T23:25:34.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3c91640 1 -- 172.21.15.99:0/3965492681 learned_addr learned my addr 172.21.15.99:0/3965492681 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3c91640 1 -- 172.21.15.99:0/3965492681 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c165095c60 con 0x55c165095290 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.438+0000 7f36c3c91640 1 --2- 172.21.15.99:0/3965492681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36bc016fd0 tx=0x7f36bc014ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39b4c1322d52009 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f35a6ffd640 1 -- 172.21.15.99:0/3965492681 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc04a070 con 0x55c165095290 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f35a6ffd640 1 -- 172.21.15.99:0/3965492681 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc014bd0 con 0x55c165095290 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f35a6ffd640 1 -- 172.21.15.99:0/3965492681 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc02a980 con 0x55c165095290 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- 172.21.15.99:0/3965492681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 msgr2=0x55c165095690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 --2- 172.21.15.99:0/3965492681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36bc016fd0 tx=0x7f36bc014ef0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- 172.21.15.99:0/3965492681 shutdown_connections 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 --2- 172.21.15.99:0/3965492681 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c165095690 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- 172.21.15.99:0/3965492681 >> 172.21.15.99:0/3965492681 conn(0x55c1650915f0 msgr2=0x55c16508f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- 172.21.15.99:0/3965492681 shutdown_connections 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- 172.21.15.99:0/3965492681 wait complete. 2024-09-13T23:25:34.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 Processor -- start 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.439+0000 7f36c7742800 1 -- start start 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c7742800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c7742800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55c1650962d0 con 0x55c165095290 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c3c91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55936/0 (socket says 172.21.15.99:55936) 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 learned_addr learned my addr 172.21.15.99:0/1716625341 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16509cbd0 con 0x55c165095290 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c3c91640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f36bc016fd0 tx=0x7f36bc04cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f35a57fa640 1 -- 172.21.15.99:0/1716625341 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc02aab0 con 0x55c165095290 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f35a57fa640 1 -- 172.21.15.99:0/1716625341 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36bc04e270 con 0x55c165095290 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c16509ce60 con 0x55c165095290 2024-09-13T23:25:34.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f35a57fa640 1 -- 172.21.15.99:0/1716625341 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36bc04e570 con 0x55c165095290 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.440+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16509fb10 con 0x55c165095290 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.441+0000 7f35a57fa640 1 -- 172.21.15.99:0/1716625341 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f36bc03b060 con 0x55c165095290 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.441+0000 7f35a57fa640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f358c036b40 0x7f358c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.441+0000 7f35a57fa640 1 -- 172.21.15.99:0/1716625341 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f36bc035ae0 con 0x55c165095290 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.441+0000 7f36c3490640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f358c036b40 0x7f358c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c3490640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f358c036b40 0x7f358c039000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55c165075280 tx=0x7f36b408a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c1650a8220 0x55c1650aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650aae30 con 0x55c1650a8220 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c1650a8220 0x55c1650aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c1650a8220 0x55c1650aa6e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.442+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36b800f610 con 0x55c1650a8220 2024-09-13T23:25:34.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 realm 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650a7670 con 0x55c1650a8220 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36b800f610 con 0x55c1650a8220 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650ab920 con 0x55c1650a8220 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36b800f610 con 0x55c1650a8220 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650ac1f0 con 0x55c1650a8220 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36b800f610 con 0x55c1650a8220 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c1650acc10 0x55c1650af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650af6f0 con 0x55c1650acc10 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.443+0000 7f36c3c91640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c1650acc10 0x55c1650af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3c91640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c1650acc10 0x55c1650af000 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c7742800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c7742800 20 searching for the correct realm 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c1650b16c0 0x55c1650b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3490640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c1650b16c0 0x55c1650b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3490640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c1650b16c0 0x55c1650b3b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.444+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.445+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.445+0000 7f36c3c91640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f36bc013070 0x7f36bc03c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.445+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.445+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f36bc013070 0x7f36bc03c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.445+0000 7f36c2c8f640 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f36bc013070 0x7f36bc03c560 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b800f610 con 0x7f36bc013070 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b800f610 con 0x55c1650a8220 2024-09-13T23:25:34.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x7f36bc013070 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.446+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x7f36bc013070 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.447+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x7f36bc013070 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.448+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x7f36bc013070 2024-09-13T23:25:34.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.449+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x7f36bc013070 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.450+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b802b040 con 0x55c1650a8220 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.451+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650b16c0 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x7f36bc013070 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.452+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650a8220 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4250 con 0x55c1650acc10 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b00e0 con 0x55c1650a8220 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b0980 con 0x55c1650a8220 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.453+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b46d0 con 0x55c1650acc10 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 zone default found 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 4 Realm: () 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 zonegroup default 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b4f20 con 0x7f36bc013070 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b6900 con 0x55c1650b16c0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.454+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b6d40 con 0x55c1650b16c0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.455+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.455+0000 7f36c7742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.455+0000 7f36c7742800 20 started sync module instance, tier type = 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.455+0000 7f36c7742800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.455+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b5d90 con 0x55c1650acc10 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.456+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.456+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94289112293760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b59f0 con 0x55c1650acc10 2024-09-13T23:25:34.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.456+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b59f0 con 0x55c1650a8220 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.457+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94289112293760] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.457+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.457+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94289112297888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b7c70 con 0x55c1650a8220 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.457+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b8670 con 0x55c1650b16c0 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.458+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.458+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94289112301952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b8f40 con 0x55c1650b16c0 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.458+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b9a50 con 0x55c1650acc10 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.458+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94289112297888] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.459+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.459+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94289112301952] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.459+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94289112306944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b77c0 con 0x55c1650acc10 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.459+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650ba330 con 0x55c1650a8220 2024-09-13T23:25:34.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.460+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94289112306944] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.460+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.460+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94289112304272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650ba2f0 con 0x55c1650a8220 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.460+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bad40 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.461+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.461+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94289112311952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bacb0 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.461+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94289112304272] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.461+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bbca0 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.462+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.462+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94289112309312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bbca0 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.462+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bc6a0 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.462+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94289112311952] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94289112309312] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94289112314128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bc1b0 con 0x7f36bc013070 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=0 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=1 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=2 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=3 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=4 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=5 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.463+0000 7f36c7742800 20 add_watcher() i=6 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94289112314128] v31'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c7742800 20 add_watcher() i=7 2024-09-13T23:25:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c7742800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bc1b0 con 0x55c1650a8220 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.464+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94289112315776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650bcd40 con 0x55c1650a8220 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.465+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94289112315776] v31'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.465+0000 7f3579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 5 note: GC not initialized 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f3578fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 20 Filter name: none 2024-09-13T23:25:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f34f27fc640 20 reqs_thread_entry: start 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.466+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f29c0 con 0x55c1650a8220 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c7742800 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c7742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c7742800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c7742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.467+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f9010 con 0x55c1650a8220 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v31'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c7742800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c7742800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c7742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94289112566224 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f4920 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94289112304272 notify 133143986185 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f36b8018040 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f35a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94289112304272 notifier 4416 bl.length()=732 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f35a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f35a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f35a6ffd640 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3588003ea0 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(64 notify.4 [notify cookie 94289112566224 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.468+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.469+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94289112566224 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f36b8009050 con 0x55c1650a8220 2024-09-13T23:25:34.482 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T23:25:34.085401Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.469+0000 7f3579fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.469+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94289112315776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f0710 con 0x55c1650a8220 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.470+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94289112315776] v31'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.470+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94289112293760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f0710 con 0x55c1650acc10 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.471+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94289112293760] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.471+0000 7f36c7742800 20 remove_watcher() i=0 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.471+0000 7f36c7742800 2 removed watcher, disabling cache 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.471+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94289112297888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f0710 con 0x55c1650a8220 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.472+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94289112297888] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.472+0000 7f36c7742800 20 remove_watcher() i=1 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.472+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94289112301952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650f0710 con 0x55c1650b16c0 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.473+0000 7f36c3490640 1 -- 172.21.15.99:0/1716625341 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94289112301952] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b407f070 con 0x55c1650b16c0 2024-09-13T23:25:34.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.473+0000 7f36c7742800 20 remove_watcher() i=2 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.473+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94289112306944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b6180 con 0x55c1650acc10 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.474+0000 7f36c3c91640 1 -- 172.21.15.99:0/1716625341 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94289112306944] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36bc027020 con 0x55c1650acc10 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.474+0000 7f36c7742800 20 remove_watcher() i=3 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.474+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94289112304272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b6180 con 0x55c1650a8220 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.475+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94289112304272] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x55c1650a8220 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.475+0000 7f36c7742800 20 remove_watcher() i=4 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.475+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94289112311952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b8a90 con 0x7f36bc013070 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.477+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94289112311952] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.477+0000 7f36c7742800 20 remove_watcher() i=5 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.477+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94289112309312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650b6180 con 0x7f36bc013070 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.478+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94289112309312] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.478+0000 7f36c7742800 20 remove_watcher() i=6 2024-09-13T23:25:34.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.478+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94289112314128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55c1650ba890 con 0x7f36bc013070 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94289112314128] v31'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36b803b040 con 0x7f36bc013070 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 20 remove_watcher() i=7 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f36bc013070 msgr2=0x7f36bc03c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f36bc013070 0x7f36bc03c560 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c1650a8220 msgr2=0x55c1650aa6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c1650a8220 0x55c1650aa6e0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c1650acc10 msgr2=0x55c1650af000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c1650acc10 0x55c1650af000 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c1650b16c0 msgr2=0x55c1650b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55c1650b16c0 0x55c1650b3b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f358c036b40 msgr2=0x7f358c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f358c036b40 0x7f358c039000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55c165075280 tx=0x7f36b408a000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 msgr2=0x55c16509c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c2c8f640 1 -- 172.21.15.99:0/1716625341 reap_dead start 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f36bc016fd0 tx=0x7f36bc04cd80 comp rx=0 tx=0).stop 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 shutdown_connections 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 --2- 172.21.15.99:0/1716625341 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c165095290 0x55c16509c690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 >> 172.21.15.99:0/1716625341 conn(0x55c1650915f0 msgr2=0x55c16508f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 shutdown_connections 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.479+0000 7f36c7742800 1 -- 172.21.15.99:0/1716625341 wait complete. 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 msgr2=0x7f359c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 0x7f359c039000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55c1650756b0 tx=0x7f36b406f420 comp rx=0 tx=0).stop 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 msgr2=0x55c1650889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55c165075160 tx=0x7f36bc0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 shutdown_connections 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f359c036b40 0x7f359c039000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/2399102645 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c1650885a0 0x55c1650889c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 >> 172.21.15.99:0/2399102645 conn(0x55c16507d530 msgr2=0x55c1650800b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 shutdown_connections 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/2399102645 wait complete. 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 msgr2=0x55c165074760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 0x55c165074760 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 msgr2=0x55c1650794f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 0x55c1650794f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 msgr2=0x7f35a8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 0x7f35a8039000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f36b8000f60 tx=0x7f36b8001370 comp rx=0 tx=0).stop 2024-09-13T23:25:34.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 msgr2=0x55c16506d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f36b4000c00 tx=0x7f36b4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 shutdown_connections 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55c165077100 0x55c1650794f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55c165072370 0x55c165074760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f35a8036b40 0x7f35a8039000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 --2- 172.21.15.99:0/571032817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55c164eea590 0x55c16506d310 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 >> 172.21.15.99:0/571032817 conn(0x55c164f6fff0 msgr2=0x55c16505fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 shutdown_connections 2024-09-13T23:25:34.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.480+0000 7f36c7742800 1 -- 172.21.15.99:0/571032817 wait complete. 2024-09-13T23:25:34.494 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T23:25:34.085401Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:34.494 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:25:34.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T23:25:34.495 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T23:25:34.541 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.542 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e9636800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560b2c1d1920 0x560b2c1d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e9636800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b2c08db30 con 0x560b2c1cd4e0 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e9636800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x560b2c06f360 con 0x560b2c1d1920 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5dc151640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560b2c1d1920 0x560b2c1d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e4952640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x560b2c1cd4e0 0x560b2c1cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41872/0 (socket says 172.21.15.99:41872) 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5dc151640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560b2c1d1920 0x560b2c1d3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55948/0 (socket says 172.21.15.99:55948) 2024-09-13T23:25:34.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.541+0000 7fc5e4952640 1 -- 172.21.15.99:0/1191661896 learned_addr learned my addr 172.21.15.99:0/1191661896 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:34.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.542+0000 7fc5dc151640 1 -- 172.21.15.99:0/1191661896 >> v1:172.21.15.43:6789/0 conn(0x560b2c1cd4e0 legacy=0x560b2c1cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.542+0000 7fc5dc151640 1 -- 172.21.15.99:0/1191661896 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c095e00 con 0x560b2c1d1920 2024-09-13T23:25:34.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.543+0000 7fc5dc151640 1 --2- 172.21.15.99:0/1191661896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1d1920 0x560b2c1d3d10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00a470 tx=0x7fc5cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905881aa03f1d8bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5dffff640 1 -- 172.21.15.99:0/1191661896 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc053570 con 0x560b2c1d1920 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5dffff640 1 -- 172.21.15.99:0/1191661896 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5cc058070 con 0x560b2c1d1920 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5dffff640 1 -- 172.21.15.99:0/1191661896 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5cc053880 con 0x560b2c1d1920 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 -- 172.21.15.99:0/1191661896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1d1920 msgr2=0x560b2c1d3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1191661896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1d1920 0x560b2c1d3d10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00a470 tx=0x7fc5cc045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 -- 172.21.15.99:0/1191661896 shutdown_connections 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1191661896 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1d1920 0x560b2c1d3d10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 -- 172.21.15.99:0/1191661896 >> 172.21.15.99:0/1191661896 conn(0x560b2c1c8e10 msgr2=0x560b2c1cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 -- 172.21.15.99:0/1191661896 shutdown_connections 2024-09-13T23:25:34.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.544+0000 7fc5e9636800 1 -- 172.21.15.99:0/1191661896 wait complete. 2024-09-13T23:25:34.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.558+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.558+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.558+0000 7fc5e9636800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.558+0000 7fc5e9636800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b2c11a350 con 0x560b2c1cd4e0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc5e4952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc5e4952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55950/0 (socket says 172.21.15.99:55950) 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc5e4952640 1 -- 172.21.15.99:0/2783460228 learned_addr learned my addr 172.21.15.99:0/2783460228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc5e4952640 1 -- 172.21.15.99:0/2783460228 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c067bc0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc5e4952640 1 --2- 172.21.15.99:0/2783460228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001e10 tx=0x7fc5d400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b719bc3018bfbee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc4d2e0d640 1 -- 172.21.15.99:0/2783460228 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d4012020 con 0x560b2c1cd4e0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc4d2e0d640 1 -- 172.21.15.99:0/2783460228 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d400e5a0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.559+0000 7fc4d2e0d640 1 -- 172.21.15.99:0/2783460228 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d400e8e0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- 172.21.15.99:0/2783460228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 msgr2=0x560b2c2bc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2783460228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001e10 tx=0x7fc5d400b780 comp rx=0 tx=0).stop 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- 172.21.15.99:0/2783460228 shutdown_connections 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2783460228 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2bc770 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- 172.21.15.99:0/2783460228 >> 172.21.15.99:0/2783460228 conn(0x560b2c1c8e10 msgr2=0x560b2c2b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- 172.21.15.99:0/2783460228 shutdown_connections 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- 172.21.15.99:0/2783460228 wait complete. 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.560+0000 7fc5e9636800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b2c1d4550 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e4952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e4952640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55954/0 (socket says 172.21.15.99:55954) 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e4952640 1 -- 172.21.15.99:0/2278310110 learned_addr learned my addr 172.21.15.99:0/2278310110 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e4952640 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c07bfe0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e4952640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001e10 tx=0x7fc5d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc4d160a640 1 -- 172.21.15.99:0/2278310110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d4012030 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc4d160a640 1 -- 172.21.15.99:0/2278310110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d401c320 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc4d160a640 1 -- 172.21.15.99:0/2278310110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5d401c9b0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b2c2c4690 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.561+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b2c2c4bb0 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc4d160a640 1 -- 172.21.15.99:0/2278310110 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc5d4015020 con 0x560b2c1cd4e0 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc4d160a640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 0x7fc4cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc4d160a640 1 -- 172.21.15.99:0/2278310110 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc5d4022030 con 0x560b2c1cd4e0 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc5dc151640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 0x7fc4cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 0x560b2c2ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.562+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c2ca650 con 0x560b2c1d1920 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e5153640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 0x560b2c2ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5dc151640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 0x7fc4cc039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc057000 tx=0x7fc5cc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e5153640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 0x560b2c2ca110 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e5153640 1 -- 172.21.15.99:0/2278310110 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5e000a4a0 con 0x560b2c1d1920 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c2c76a0 con 0x560b2c1d1920 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e5153640 1 -- 172.21.15.99:0/2278310110 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5e000a4a0 con 0x560b2c1d1920 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 0x560b2c2ced10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.563+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c2cf3e0 con 0x560b2c2cc920 2024-09-13T23:25:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e4952640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 0x560b2c2ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e4952640 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 0x560b2c2ced10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e4952640 1 -- 172.21.15.99:0/2278310110 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc5d401cd30 con 0x560b2c2cc920 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c2cb7c0 con 0x560b2c1d1920 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e5153640 1 -- 172.21.15.99:0/2278310110 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5e000a4a0 con 0x560b2c1d1920 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.564+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c2cbc30 con 0x560b2c2cc920 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.565+0000 7fc5e4952640 1 -- 172.21.15.99:0/2278310110 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc5d401cd30 con 0x560b2c2cc920 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.565+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.565+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.565+0000 7fc5e9636800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.565+0000 7fc5e9636800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b2c069580 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55960/0 (socket says 172.21.15.99:55960) 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e5153640 1 -- 172.21.15.99:0/3038889197 learned_addr learned my addr 172.21.15.99:0/3038889197 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e5153640 1 -- 172.21.15.99:0/3038889197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c2de700 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e5153640 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560b2c2c5550 tx=0x7fc5e00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc4caffd640 1 -- 172.21.15.99:0/3038889197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0013640 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc4caffd640 1 -- 172.21.15.99:0/3038889197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e00137e0 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b2c2de990 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc4caffd640 1 -- 172.21.15.99:0/3038889197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0013ae0 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.566+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b2c2e1670 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.567+0000 7fc4caffd640 1 -- 172.21.15.99:0/3038889197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc5e0011040 con 0x560b2c2ddda0 2024-09-13T23:25:34.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.567+0000 7fc4caffd640 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 0x7fc4bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.567+0000 7fc4caffd640 1 -- 172.21.15.99:0/3038889197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc5e000e040 con 0x560b2c2ddda0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.567+0000 7fc5e4952640 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 0x7fc4bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e4952640 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 0x7fc4bc039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x560b2c2caed0 tx=0x7fc5d400def0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e9636800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e9636800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b2c2bcf20 con 0x560b2c2eaad0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55964/0 (socket says 172.21.15.99:55964) 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e5153640 1 -- 172.21.15.99:0/1031030456 learned_addr learned my addr 172.21.15.99:0/1031030456 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.568+0000 7fc5e5153640 1 -- 172.21.15.99:0/1031030456 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c2eb4a0 con 0x560b2c2eaad0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e5153640 1 --2- 172.21.15.99:0/1031030456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000b010 tx=0x7fc5e004d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f8ae4cb9179ac7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc4c8ff9640 1 -- 172.21.15.99:0/1031030456 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e002aa40 con 0x560b2c2eaad0 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc4c8ff9640 1 -- 172.21.15.99:0/1031030456 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e004a020 con 0x560b2c2eaad0 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc4c8ff9640 1 -- 172.21.15.99:0/1031030456 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e002a520 con 0x560b2c2eaad0 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 -- 172.21.15.99:0/1031030456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 msgr2=0x560b2c2eaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1031030456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000b010 tx=0x7fc5e004d000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 -- 172.21.15.99:0/1031030456 shutdown_connections 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1031030456 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2eaed0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 -- 172.21.15.99:0/1031030456 >> 172.21.15.99:0/1031030456 conn(0x560b2c2e6e30 msgr2=0x560b2c2e4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 -- 172.21.15.99:0/1031030456 shutdown_connections 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.569+0000 7fc5e9636800 1 -- 172.21.15.99:0/1031030456 wait complete. 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e9636800 1 Processor -- start 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e9636800 1 -- start start 2024-09-13T23:25:34.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e9636800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e9636800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560b2c2ebb10 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e5153640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55966/0 (socket says 172.21.15.99:55966) 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 learned_addr learned my addr 172.21.15.99:0/1357115319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b2c2f2480 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc5e5153640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2f1f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc5e004cd60 tx=0x7fc5e004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.570+0000 7fc4c27fc640 1 -- 172.21.15.99:0/1357115319 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e0029ca0 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.571+0000 7fc4c27fc640 1 -- 172.21.15.99:0/1357115319 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e0029e40 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.571+0000 7fc4c27fc640 1 -- 172.21.15.99:0/1357115319 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5e001f7f0 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.571+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b2c2f2710 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.571+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b2c2f2710 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.571+0000 7fc4c27fc640 1 -- 172.21.15.99:0/1357115319 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc5e0040140 con 0x560b2c2eaad0 2024-09-13T23:25:34.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc4c27fc640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4ac036b40 0x7fc4ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc4c27fc640 1 -- 172.21.15.99:0/1357115319 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc5e004b030 con 0x560b2c2eaad0 2024-09-13T23:25:34.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5e4952640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4ac036b40 0x7fc4ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5e4952640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4ac036b40 0x7fc4ac039000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001620 tx=0x7fc5d4027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c2fd7f0 0x560b2c2ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c300400 con 0x560b2c2fd7f0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.572+0000 7fc5dc151640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c2fd7f0 0x560b2c2ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5dc151640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c2fd7f0 0x560b2c2ffcb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 realm 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c300830 con 0x560b2c2fd7f0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c301100 con 0x560b2c2fd7f0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.573+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c3014a0 con 0x560b2c2fd7f0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c302200 0x560b2c3045f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c304c00 con 0x560b2c302200 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e5153640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c302200 0x560b2c3045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e5153640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c302200 0x560b2c3045f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc5e0038020 con 0x560b2c302200 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 20 searching for the correct realm 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560b2c306b90 0x560b2c309050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.574+0000 7fc5e4952640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560b2c306b90 0x560b2c309050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e4952640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560b2c306b90 0x560b2c309050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0038020 con 0x560b2c302200 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e5153640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc5e003fb60 0x7fc5e003b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.575+0000 7fc5dc151640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc5e003fb60 0x7fc5e003b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.576+0000 7fc5dc151640 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc5e003fb60 0x7fc5e003b810 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.576+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.576+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.576+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.576+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc5e0038020 con 0x560b2c302200 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.577+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc5e0038020 con 0x560b2c302200 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.578+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.579+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.580+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0038020 con 0x560b2c302200 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.581+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c306b90 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x7fc5e003fb60 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.582+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c2fd7f0 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309720 con 0x560b2c302200 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c3060e0 con 0x560b2c2fd7f0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c305950 con 0x560b2c2fd7f0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.583+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c309ba0 con 0x560b2c302200 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 zone default found 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 4 Realm: () 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 zonegroup default 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c305580 con 0x7fc5e003fb60 2024-09-13T23:25:34.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30c300 con 0x560b2c306b90 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.584+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30c6a0 con 0x560b2c306b90 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 20 started sync module instance, tier type = 2024-09-13T23:25:34.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.585+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30b790 con 0x560b2c302200 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.586+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.586+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94605986020272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30b3f0 con 0x560b2c302200 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.586+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30d420 con 0x560b2c2fd7f0 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.587+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94605986020272] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.587+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.587+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94605986024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30d810 con 0x560b2c2fd7f0 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.587+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30e250 con 0x560b2c306b90 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.588+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.588+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94605986028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30eaf0 con 0x560b2c306b90 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.588+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30f5b0 con 0x560b2c302200 2024-09-13T23:25:34.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.588+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94605986024000] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.589+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94605986028832] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.589+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.589+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94605986031168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30ce60 con 0x560b2c302200 2024-09-13T23:25:34.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.589+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30fe80 con 0x560b2c2fd7f0 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.590+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.590+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94605986036176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c30fe30 con 0x560b2c2fd7f0 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.590+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c310e30 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.590+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94605986031168] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.591+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.591+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94605986033888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c310df0 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.591+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c311840 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.591+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94605986036176] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.592+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.592+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94605986038384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c311840 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.592+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c312200 con 0x7fc5e003fb60 2024-09-13T23:25:34.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.592+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94605986033888] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94605986038384] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94605986042768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c3117b0 con 0x7fc5e003fb60 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=0 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=1 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=2 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=3 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=4 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=5 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.593+0000 7fc5e9636800 20 add_watcher() i=6 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94605986042768] v31'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5e9636800 20 add_watcher() i=7 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5e9636800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c315230 con 0x560b2c2fd7f0 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.594+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94605986045264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c312620 con 0x560b2c2fd7f0 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.595+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94605986045264] v31'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc49b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 5 note: GC not initialized 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc49a7dc640 20 reqs_thread_entry: start 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 20 Filter name: none 2024-09-13T23:25:34.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc40bfff640 20 reqs_thread_entry: start 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.596+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c348420 con 0x560b2c2fd7f0 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5e9636800 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5e9636800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5e9636800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5e9636800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.597+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c34ec10 con 0x560b2c2fd7f0 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v31'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5e9636800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5e9636800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5e9636800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94605986293232 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c34a2f0 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94605986036176 notify 133143986186 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fc5cc083040 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc4c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94605986036176 notifier 4423 bl.length()=567 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(64 notify.4 [notify cookie 94605986293232 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc4c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc4c8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.598+0000 7fc4c8ff9640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc4b0003ea0 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.599+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94605986293232 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b2c095e00 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.599+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.599+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c34e5f0 con 0x560b2c302200 2024-09-13T23:25:34.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 foo:foo2 [delete] v31'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e9636800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94605986293232 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x560b2c349e40 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== watch-notify(notify (1) cookie 94605986020272 notify 133143986181 ret 0) ==== 201+0+0 (crc 0 0 0) 0x560b2c2f2480 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc4c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94605986020272 notifier 4423 bl.length()=159 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc4c8ff9640 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc4b0003ea0 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(67 notify.0 [notify cookie 94605986293232 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== watch-notify(notify_complete (2) cookie 94605986293232 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b2c2eb4a0 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.600+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.613 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:34.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.601+0000 7fc49b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.601+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94605986045264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c2fd7f0 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.602+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94605986045264] v31'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.602+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94605986020272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c302200 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.603+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94605986020272] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.603+0000 7fc5e9636800 20 remove_watcher() i=0 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.603+0000 7fc5e9636800 2 removed watcher, disabling cache 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.603+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94605986024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c2fd7f0 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.604+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94605986024000] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.604+0000 7fc5e9636800 20 remove_watcher() i=1 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.604+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94605986028832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c306b90 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.605+0000 7fc5e4952640 1 -- 172.21.15.99:0/1357115319 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94605986028832] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5d4036070 con 0x560b2c306b90 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.605+0000 7fc5e9636800 20 remove_watcher() i=2 2024-09-13T23:25:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.605+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94605986031168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c302200 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.606+0000 7fc5e5153640 1 -- 172.21.15.99:0/1357115319 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94605986031168] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5e0061040 con 0x560b2c302200 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.606+0000 7fc5e9636800 20 remove_watcher() i=3 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.606+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94605986036176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x560b2c2fd7f0 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.607+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94605986036176] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x560b2c2fd7f0 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.607+0000 7fc5e9636800 20 remove_watcher() i=4 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.607+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94605986033888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x7fc5e003fb60 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.608+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94605986033888] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.608+0000 7fc5e9636800 20 remove_watcher() i=5 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.608+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94605986038384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x7fc5e003fb60 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.609+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94605986038384] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.609+0000 7fc5e9636800 20 remove_watcher() i=6 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.609+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94605986042768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x560b2c346190 con 0x7fc5e003fb60 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94605986042768] v31'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc5cc051070 con 0x7fc5e003fb60 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 20 remove_watcher() i=7 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc5e003fb60 msgr2=0x7fc5e003b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc5e003fb60 0x7fc5e003b810 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c2fd7f0 msgr2=0x560b2c2ffcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c2fd7f0 0x560b2c2ffcb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c302200 msgr2=0x560b2c3045f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c302200 0x560b2c3045f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560b2c306b90 msgr2=0x560b2c309050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.610+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560b2c306b90 0x560b2c309050 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4ac036b40 msgr2=0x7fc4ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4ac036b40 0x7fc4ac039000 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001620 tx=0x7fc5d4027000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 msgr2=0x560b2c2f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/1357115319 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2eaad0 0x560b2c2f1f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc5e004cd60 tx=0x7fc5e004cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 reap_dead start 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5dc151640 1 -- 172.21.15.99:0/1357115319 reap_dead start 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 shutdown_connections 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 >> 172.21.15.99:0/1357115319 conn(0x560b2c2e6e30 msgr2=0x560b2c2e4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 shutdown_connections 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/1357115319 wait complete. 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 msgr2=0x7fc4bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 0x7fc4bc039000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x560b2c2caed0 tx=0x7fc5d400def0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 msgr2=0x560b2c2de1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x560b2c2c5550 tx=0x7fc5e00167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 shutdown_connections 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4bc036b40 0x7fc4bc039000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/3038889197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c2ddda0 0x560b2c2de1c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 >> 172.21.15.99:0/3038889197 conn(0x560b2c2d2d30 msgr2=0x560b2c2d58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 shutdown_connections 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/3038889197 wait complete. 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 msgr2=0x560b2c2ca110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 0x560b2c2ca110 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 msgr2=0x560b2c2ced10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 0x560b2c2ced10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 msgr2=0x7fc4cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 0x7fc4cc039050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc057000 tx=0x7fc5cc052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 msgr2=0x560b2c2c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.611+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4001e10 tx=0x7fc5d4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 shutdown_connections 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560b2c2cc920 0x560b2c2ced10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560b2c1d1920 0x560b2c2ca110 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc4cc036b90 0x7fc4cc039050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 --2- 172.21.15.99:0/2278310110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560b2c1cd4e0 0x560b2c2c4150 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 >> 172.21.15.99:0/2278310110 conn(0x560b2c1c8e10 msgr2=0x560b2c2b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 shutdown_connections 2024-09-13T23:25:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.612+0000 7fc5e9636800 1 -- 172.21.15.99:0/2278310110 wait complete. 2024-09-13T23:25:34.625 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:34.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:25:34.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:25:34.625 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:25:34.669 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.670 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8e1920800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556752e37d90 0x556752e3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8e1920800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556752cf0b30 con 0x556752da5610 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8e1920800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x556752cd2360 con 0x556752e37d90 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8dcdb7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556752e37d90 0x556752e3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.669+0000 7fd8dcdb7640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556752e37d90 0x556752e3a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55974/0 (socket says 172.21.15.99:55974) 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.670+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/1901223797 learned_addr learned my addr 172.21.15.99:0/1901223797 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.670+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/1901223797 >> v1:172.21.15.43:6789/0 conn(0x556752da5610 legacy=0x556752e36670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.670+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/1901223797 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752cf8e00 con 0x556752e37d90 2024-09-13T23:25:34.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/1901223797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752e37d90 0x556752e3a180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400a520 tx=0x7fd8d4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8955857bf6096242 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8cffff640 1 -- 172.21.15.99:0/1901223797 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d4055070 con 0x556752e37d90 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8cffff640 1 -- 172.21.15.99:0/1901223797 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d40515b0 con 0x556752e37d90 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8cffff640 1 -- 172.21.15.99:0/1901223797 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d40518d0 con 0x556752e37d90 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 -- 172.21.15.99:0/1901223797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752e37d90 msgr2=0x556752e3a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 --2- 172.21.15.99:0/1901223797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752e37d90 0x556752e3a180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400a520 tx=0x7fd8d4045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 -- 172.21.15.99:0/1901223797 shutdown_connections 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 --2- 172.21.15.99:0/1901223797 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752e37d90 0x556752e3a180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 -- 172.21.15.99:0/1901223797 >> 172.21.15.99:0/1901223797 conn(0x556752e2bde0 msgr2=0x556752e2e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 -- 172.21.15.99:0/1901223797 shutdown_connections 2024-09-13T23:25:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.672+0000 7fd8e1920800 1 -- 172.21.15.99:0/1901223797 wait complete. 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.686+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.686+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.686+0000 7fd8e1920800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.686+0000 7fd8e1920800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556752d7d330 con 0x556752da5610 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd8dd5b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd8dd5b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55984/0 (socket says 172.21.15.99:55984) 2024-09-13T23:25:34.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/645521044 learned_addr learned my addr 172.21.15.99:0/645521044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/645521044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752ccabc0 con 0x556752da5610 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/645521044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0001d50 tx=0x7fd8d000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eeba3190495a06e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd7cb606640 1 -- 172.21.15.99:0/645521044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d000f400 con 0x556752da5610 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd7cb606640 1 -- 172.21.15.99:0/645521044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d000f5a0 con 0x556752da5610 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.687+0000 7fd7cb606640 1 -- 172.21.15.99:0/645521044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d000f7d0 con 0x556752da5610 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- 172.21.15.99:0/645521044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 msgr2=0x556752f22a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 --2- 172.21.15.99:0/645521044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0001d50 tx=0x7fd8d000b5b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- 172.21.15.99:0/645521044 shutdown_connections 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 --2- 172.21.15.99:0/645521044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f22a90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- 172.21.15.99:0/645521044 >> 172.21.15.99:0/645521044 conn(0x556752e2bde0 msgr2=0x556752f1e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- 172.21.15.99:0/645521044 shutdown_connections 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- 172.21.15.99:0/645521044 wait complete. 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.688+0000 7fd8e1920800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556752e3a990 con 0x556752da5610 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8dd5b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8dd5b8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:55992/0 (socket says 172.21.15.99:55992) 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2376611377 learned_addr learned my addr 172.21.15.99:0/2376611377 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752cdefe0 con 0x556752da5610 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000b5f0 tx=0x7fd8d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd7c9e03640 1 -- 172.21.15.99:0/2376611377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d001a7c0 con 0x556752da5610 2024-09-13T23:25:34.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd7c9e03640 1 -- 172.21.15.99:0/2376611377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d001a960 con 0x556752da5610 2024-09-13T23:25:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556752f2aa00 con 0x556752da5610 2024-09-13T23:25:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd7c9e03640 1 -- 172.21.15.99:0/2376611377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d001ac40 con 0x556752da5610 2024-09-13T23:25:34.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.689+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556752f2af80 con 0x556752da5610 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.690+0000 7fd7c9e03640 1 -- 172.21.15.99:0/2376611377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8d0017070 con 0x556752da5610 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.690+0000 7fd7c9e03640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 0x7fd7c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd7c9e03640 1 -- 172.21.15.99:0/2376611377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd8d0015020 con 0x556752da5610 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 0x7fd7c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 0x556752f31590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f31ad0 con 0x556752e37d90 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 0x556752f31590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 0x7fd7c4039000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4057000 tx=0x7fd8d4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 0x556752f31590 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2376611377 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752e37d90 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.691+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f2eb40 con 0x556752e37d90 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2376611377 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752e37d90 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 0x556752f361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f36870 con 0x556752f33de0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 0x556752f361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 0x556752f361d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2376611377 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f33de0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.692+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f32c80 con 0x556752e37d90 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2376611377 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752e37d90 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f33160 con 0x556752f33de0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2376611377 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f33de0 2024-09-13T23:25:34.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8e1920800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.693+0000 7fd8e1920800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556752ccc580 con 0x556752f45220 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56002/0 (socket says 172.21.15.99:56002) 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8dddb9640 1 -- 172.21.15.99:0/3638724995 learned_addr learned my addr 172.21.15.99:0/3638724995 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8dddb9640 1 -- 172.21.15.99:0/3638724995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752f45b80 con 0x556752f45220 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x556752f2b570 tx=0x7fd8d80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd7c2ffd640 1 -- 172.21.15.99:0/3638724995 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8013640 con 0x556752f45220 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd7c2ffd640 1 -- 172.21.15.99:0/3638724995 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d80137e0 con 0x556752f45220 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556752f45e10 con 0x556752f45220 2024-09-13T23:25:34.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd7c2ffd640 1 -- 172.21.15.99:0/3638724995 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8013ac0 con 0x556752f45220 2024-09-13T23:25:34.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.694+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556752f48af0 con 0x556752f45220 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.695+0000 7fd7c2ffd640 1 -- 172.21.15.99:0/3638724995 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8d8011040 con 0x556752f45220 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.695+0000 7fd7c2ffd640 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 0x7fd7b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.695+0000 7fd7c2ffd640 1 -- 172.21.15.99:0/3638724995 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd8d800e040 con 0x556752f45220 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.695+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 0x7fd7b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.695+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 0x7fd7b4039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556752f2ea80 tx=0x7fd8d0013f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8e1920800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8e1920800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556752f23240 con 0x556752f51f70 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56016/0 (socket says 172.21.15.99:56016) 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2440423005 learned_addr learned my addr 172.21.15.99:0/2440423005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2440423005 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752f52940 con 0x556752f51f70 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2440423005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005a10 tx=0x7fd8d8020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98d65c85df8c729 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd7c0ff9640 1 -- 172.21.15.99:0/2440423005 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d8021440 con 0x556752f51f70 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd7c0ff9640 1 -- 172.21.15.99:0/2440423005 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d801f340 con 0x556752f51f70 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.696+0000 7fd7c0ff9640 1 -- 172.21.15.99:0/2440423005 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d80215e0 con 0x556752f51f70 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- 172.21.15.99:0/2440423005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 msgr2=0x556752f52370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2440423005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8005a10 tx=0x7fd8d8020e60 comp rx=0 tx=0).stop 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- 172.21.15.99:0/2440423005 shutdown_connections 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2440423005 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f52370 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- 172.21.15.99:0/2440423005 >> 172.21.15.99:0/2440423005 conn(0x556752f4e2d0 msgr2=0x556752f4c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- 172.21.15.99:0/2440423005 shutdown_connections 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- 172.21.15.99:0/2440423005 wait complete. 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 Processor -- start 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- start start 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.697+0000 7fd8e1920800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556752f52fb0 con 0x556752f51f70 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8dddb9640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f593e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56032/0 (socket says 172.21.15.99:56032) 2024-09-13T23:25:34.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 learned_addr learned my addr 172.21.15.99:0/2477631736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556752f59920 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f593e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8012fd0 tx=0x7fd8d804cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd7b2ffd640 1 -- 172.21.15.99:0/2477631736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d803a070 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd7b2ffd640 1 -- 172.21.15.99:0/2477631736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d80400d0 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556752f59bb0 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd7b2ffd640 1 -- 172.21.15.99:0/2477631736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d80403b0 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.698+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556752f5c860 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.699+0000 7fd7b2ffd640 1 -- 172.21.15.99:0/2477631736 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd8d804e1c0 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.699+0000 7fd7b2ffd640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7a8036b90 0x7fd7a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.699+0000 7fd7b2ffd640 1 -- 172.21.15.99:0/2477631736 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fd8d8036b30 con 0x556752f51f70 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.699+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7a8036b90 0x7fd7a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752f64e00 0x556752f672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f67a10 con 0x556752f64e00 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752f64e00 0x556752f672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7a8036b90 0x7fd7a8039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8d001dfd0 tx=0x7fd8d0042000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752f64e00 0x556752f672c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 20 realm 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f67e40 con 0x556752f64e00 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.700+0000 7fd8e1920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f68710 con 0x556752f64e00 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f68ab0 con 0x556752f64e00 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f69810 0x556752f6bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f6c140 con 0x556752f69810 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f69810 0x556752f6bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.701+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f69810 0x556752f6bc00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8e1920800 20 searching for the correct realm 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556752f6e1c0 0x556752f70680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556752f6e1c0 0x556752f70680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8dd5b8640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556752f6e1c0 0x556752f70680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.702+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dddb9640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd8d80123d0 0x7fd8d80205b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd8d80123d0 0x7fd8d80205b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dcdb7640 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd8d80123d0 0x7fd8d80205b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.703+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.704+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.705+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.706+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.707+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.708+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f6e1c0 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.709+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x7fd8d80123d0 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f64e00 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x556752f70d50 con 0x556752f69810 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.710+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f6cc20 con 0x556752f64e00 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f6c830 con 0x556752f64e00 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f6d590 con 0x556752f69810 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 zone default found 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 4 Realm: () 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 zonegroup default 2024-09-13T23:25:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f71680 con 0x7fd8d80123d0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.711+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f73490 con 0x556752f6e1c0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f73920 con 0x556752f6e1c0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 20 started sync module instance, tier type = 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.712+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f728a0 con 0x556752f69810 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.713+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.713+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93902261922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f730b0 con 0x556752f69810 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.713+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f74850 con 0x556752f64e00 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.714+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93902261922960] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.714+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.714+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93902261928864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f747c0 con 0x556752f64e00 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.714+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f75710 con 0x556752f6e1c0 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.716+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.716+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93902261928864] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.716+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93902261932640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f75fb0 con 0x556752f6e1c0 2024-09-13T23:25:34.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.716+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f74c40 con 0x556752f69810 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.717+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93902261932640] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.717+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.717+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93902261934848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f76a20 con 0x556752f69810 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.717+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f773e0 con 0x556752f64e00 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.718+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.718+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93902261940016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f77800 con 0x556752f64e00 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.718+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f78300 con 0x7fd8d80123d0 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.718+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93902261934848] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.719+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.719+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93902261943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f782c0 con 0x7fd8d80123d0 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.719+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f78d40 con 0x7fd8d80123d0 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.719+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93902261940016] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.720+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93902261943792] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.720+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.720+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93902261937520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f78890 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.720+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f795e0 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93902261937520] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93902261948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f78890 con 0x7fd8d80123d0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=0 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=1 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=2 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=3 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=4 2024-09-13T23:25:34.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=5 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.721+0000 7fd8e1920800 20 add_watcher() i=6 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93902261948720] v31'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x7fd8d80123d0 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8e1920800 20 add_watcher() i=7 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8e1920800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752f7c5e0 con 0x556752f64e00 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.722+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93902261941072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f79aa0 con 0x556752f64e00 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.723+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93902261941072] v31'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd7937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 5 note: GC not initialized 2024-09-13T23:25:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd7927e4640 20 reqs_thread_entry: start 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 20 Filter name: none 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd703fff640 20 reqs_thread_entry: start 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.724+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752faf460 con 0x556752f64e00 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8e1920800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752fafe50 con 0x556752f64e00 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8e1920800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x556752fb0e60 con 0x556752f69810 2024-09-13T23:25:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.725+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.726+0000 7fd7937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.726+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93902261941072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752fad250 con 0x556752f64e00 2024-09-13T23:25:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.727+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93902261941072] v31'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd8d4057030 con 0x556752f64e00 2024-09-13T23:25:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.727+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93902261922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752fad250 con 0x556752f69810 2024-09-13T23:25:34.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.728+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93902261922960] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.728+0000 7fd8e1920800 20 remove_watcher() i=0 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.728+0000 7fd8e1920800 2 removed watcher, disabling cache 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.728+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93902261928864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752fad250 con 0x556752f64e00 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.729+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93902261928864] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4089040 con 0x556752f64e00 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.729+0000 7fd8e1920800 20 remove_watcher() i=1 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.729+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93902261932640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752fad250 con 0x556752f6e1c0 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.730+0000 7fd8dd5b8640 1 -- 172.21.15.99:0/2477631736 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93902261932640] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d002e070 con 0x556752f6e1c0 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.730+0000 7fd8e1920800 20 remove_watcher() i=2 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.730+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93902261934848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f72c90 con 0x556752f69810 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.731+0000 7fd8dddb9640 1 -- 172.21.15.99:0/2477631736 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93902261934848] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d800a4a0 con 0x556752f69810 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.731+0000 7fd8e1920800 20 remove_watcher() i=3 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.731+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93902261940016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f743a0 con 0x556752f64e00 2024-09-13T23:25:34.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.733+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93902261940016] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4089040 con 0x556752f64e00 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.733+0000 7fd8e1920800 20 remove_watcher() i=4 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.733+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93902261943792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f75260 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.734+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93902261943792] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4089040 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.734+0000 7fd8e1920800 20 remove_watcher() i=5 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.734+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93902261937520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f743a0 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.735+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93902261937520] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4089040 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.735+0000 7fd8e1920800 20 remove_watcher() i=6 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.735+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93902261948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x556752f77df0 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93902261948720] v31'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd8d4089040 con 0x7fd8d80123d0 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 20 remove_watcher() i=7 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd8d80123d0 msgr2=0x7fd8d80205b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd8d80123d0 0x7fd8d80205b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752f64e00 msgr2=0x556752f672c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752f64e00 0x556752f672c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f69810 msgr2=0x556752f6bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f69810 0x556752f6bc00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556752f6e1c0 msgr2=0x556752f70680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556752f6e1c0 0x556752f70680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7a8036b90 msgr2=0x7fd7a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7a8036b90 0x7fd7a8039050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd8d001dfd0 tx=0x7fd8d0042000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 msgr2=0x556752f593e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2477631736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f51f70 0x556752f593e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8012fd0 tx=0x7fd8d804cd10 comp rx=0 tx=0).stop 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 reap_dead start 2024-09-13T23:25:34.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8dcdb7640 1 -- 172.21.15.99:0/2477631736 reap_dead start 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 shutdown_connections 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 >> 172.21.15.99:0/2477631736 conn(0x556752f4e2d0 msgr2=0x556752f4c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 shutdown_connections 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/2477631736 wait complete. 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 msgr2=0x7fd7b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 0x7fd7b4039000 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x556752f2ea80 tx=0x7fd8d0013f00 comp rx=0 tx=0).stop 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 msgr2=0x556752f45640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x556752f2b570 tx=0x7fd8d80167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 shutdown_connections 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7b4036b40 0x7fd7b4039000 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 --2- 172.21.15.99:0/3638724995 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752f45220 0x556752f45640 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 >> 172.21.15.99:0/3638724995 conn(0x556752f3a1b0 msgr2=0x556752f3cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 shutdown_connections 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.736+0000 7fd8e1920800 1 -- 172.21.15.99:0/3638724995 wait complete. 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 msgr2=0x556752f31590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 0x556752f31590 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 msgr2=0x556752f361d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 0x556752f361d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 msgr2=0x7fd7c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 0x7fd7c4039000 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4057000 tx=0x7fd8d4052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 msgr2=0x556752f2a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000b5f0 tx=0x7fd8d0000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 shutdown_connections 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556752f33de0 0x556752f361d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556752e37d90 0x556752f31590 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd7c4036b40 0x7fd7c4039000 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 --2- 172.21.15.99:0/2376611377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556752da5610 0x556752f2a4c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 >> 172.21.15.99:0/2376611377 conn(0x556752e2bde0 msgr2=0x556752f1ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 shutdown_connections 2024-09-13T23:25:34.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.737+0000 7fd8e1920800 1 -- 172.21.15.99:0/2376611377 wait complete. 2024-09-13T23:25:34.749 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-13T23:25:34.749 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:25:34.749 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:25:34.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:25:34.749 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:25:34.793 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.793 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.792+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5fbaf800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5639f42b5990 0x5639f42b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5fbaf800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5639f4171b30 con 0x5639f42b1550 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5fbaf800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5639f4153360 con 0x5639f42b5990 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba54ea2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5639f42b5990 0x5639f42b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5d6a3640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5639f42b1550 0x5639f42b1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41888/0 (socket says 172.21.15.99:41888) 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba5d6a3640 1 -- 172.21.15.99:0/76394850 learned_addr learned my addr 172.21.15.99:0/76394850 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba54ea2640 1 -- 172.21.15.99:0/76394850 >> v1:172.21.15.43:6789/0 conn(0x5639f42b1550 legacy=0x5639f42b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.793+0000 7fba54ea2640 1 -- 172.21.15.99:0/76394850 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f4179e00 con 0x5639f42b5990 2024-09-13T23:25:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.795+0000 7fba54ea2640 1 --2- 172.21.15.99:0/76394850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b5990 0x5639f42b7d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a470 tx=0x7fba48045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71d3557a0c09eef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.795+0000 7fba5cea2640 1 -- 172.21.15.99:0/76394850 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48053570 con 0x5639f42b5990 2024-09-13T23:25:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.795+0000 7fba5cea2640 1 -- 172.21.15.99:0/76394850 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba48058070 con 0x5639f42b5990 2024-09-13T23:25:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.795+0000 7fba5cea2640 1 -- 172.21.15.99:0/76394850 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba48053880 con 0x5639f42b5990 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 -- 172.21.15.99:0/76394850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b5990 msgr2=0x5639f42b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/76394850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b5990 0x5639f42b7d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fba4800a470 tx=0x7fba48045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 -- 172.21.15.99:0/76394850 shutdown_connections 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/76394850 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b5990 0x5639f42b7d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 -- 172.21.15.99:0/76394850 >> 172.21.15.99:0/76394850 conn(0x5639f42acde0 msgr2=0x5639f42af200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 -- 172.21.15.99:0/76394850 shutdown_connections 2024-09-13T23:25:34.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.796+0000 7fba5fbaf800 1 -- 172.21.15.99:0/76394850 wait complete. 2024-09-13T23:25:34.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.809+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5fbaf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5fbaf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5639f41fe330 con 0x5639f42b1550 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5d6a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5d6a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56050/0 (socket says 172.21.15.99:56050) 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2708069157 learned_addr learned my addr 172.21.15.99:0/2708069157 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.810+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2708069157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f414bbc0 con 0x5639f42b1550 2024-09-13T23:25:34.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2708069157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fba50001d80 tx=0x7fba50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e251fa8162929 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fb94b606640 1 -- 172.21.15.99:0/2708069157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba50013030 con 0x5639f42b1550 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fb94b606640 1 -- 172.21.15.99:0/2708069157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5000e470 con 0x5639f42b1550 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fb94b606640 1 -- 172.21.15.99:0/2708069157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5000e810 con 0x5639f42b1550 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2708069157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 msgr2=0x5639f439d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2708069157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fba50001d80 tx=0x7fba50001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2708069157 shutdown_connections 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2708069157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f439d640 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2708069157 >> 172.21.15.99:0/2708069157 conn(0x5639f42acde0 msgr2=0x5639f439fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2708069157 shutdown_connections 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.811+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2708069157 wait complete. 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5fbaf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5fbaf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5639f42b85c0 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5d6a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5d6a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56056/0 (socket says 172.21.15.99:56056) 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5d6a3640 1 -- 172.21.15.99:0/924400423 learned_addr learned my addr 172.21.15.99:0/924400423 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.812+0000 7fba5d6a3640 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f415ffe0 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba50004000 tx=0x7fba50000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fb949e03640 1 -- 172.21.15.99:0/924400423 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba50027070 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fb949e03640 1 -- 172.21.15.99:0/924400423 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba50019900 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f43ab9d0 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fb949e03640 1 -- 172.21.15.99:0/924400423 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba50019c60 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f43abf50 con 0x5639f42b1550 2024-09-13T23:25:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.813+0000 7fb949e03640 1 -- 172.21.15.99:0/924400423 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba5002a070 con 0x5639f42b1550 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fb949e03640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 0x7fb944039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fb949e03640 1 -- 172.21.15.99:0/924400423 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fba5001f070 con 0x5639f42b1550 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba54ea2640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 0x7fb944039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 0x5639f43b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43b2a80 con 0x5639f42b5990 2024-09-13T23:25:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba5dea4640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 0x5639f43b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba54ea2640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 0x7fb944039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba48057000 tx=0x7fba48052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.814+0000 7fba5dea4640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 0x5639f43b24a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5dea4640 1 -- 172.21.15.99:0/924400423 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba5800a4a0 con 0x5639f42b5990 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43afa70 con 0x5639f42b5990 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5dea4640 1 -- 172.21.15.99:0/924400423 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba5800a4a0 con 0x5639f42b5990 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 0x5639f43b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43b78b0 con 0x5639f43b4dd0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 0x5639f43b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.815+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 0x5639f43b71c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.816+0000 7fba5d6a3640 1 -- 172.21.15.99:0/924400423 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba50029030 con 0x5639f43b4dd0 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.816+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43b3c70 con 0x5639f42b5990 2024-09-13T23:25:34.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.816+0000 7fba5dea4640 1 -- 172.21.15.99:0/924400423 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba5800a4a0 con 0x5639f42b5990 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.816+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43b4110 con 0x5639f43b4dd0 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.816+0000 7fba5d6a3640 1 -- 172.21.15.99:0/924400423 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba50029030 con 0x5639f43b4dd0 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5fbaf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5fbaf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5639f414d580 con 0x5639f43c6240 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56064/0 (socket says 172.21.15.99:56064) 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5dea4640 1 -- 172.21.15.99:0/2510199539 learned_addr learned my addr 172.21.15.99:0/2510199539 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.817+0000 7fba5dea4640 1 -- 172.21.15.99:0/2510199539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f43c6ba0 con 0x5639f43c6240 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fba5dea4640 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5639f43ac830 tx=0x7fba580167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fb942ffd640 1 -- 172.21.15.99:0/2510199539 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58013640 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fb942ffd640 1 -- 172.21.15.99:0/2510199539 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba580137e0 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f43c6e30 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fb942ffd640 1 -- 172.21.15.99:0/2510199539 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58013ae0 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f43c9b10 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.818+0000 7fb942ffd640 1 -- 172.21.15.99:0/2510199539 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba58011040 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fb942ffd640 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 0x7fb934039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fb942ffd640 1 -- 172.21.15.99:0/2510199539 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fba5800e040 con 0x5639f43c6240 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 0x7fb934039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 0x7fb934039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5639f43b3c40 tx=0x7fba5000ef30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5fbaf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5fbaf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5639f439bd40 con 0x5639f43d2f90 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56080/0 (socket says 172.21.15.99:56080) 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.819+0000 7fba5dea4640 1 -- 172.21.15.99:0/4141869397 learned_addr learned my addr 172.21.15.99:0/4141869397 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5dea4640 1 -- 172.21.15.99:0/4141869397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f43d3960 con 0x5639f43d2f90 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5dea4640 1 --2- 172.21.15.99:0/4141869397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba5800b010 tx=0x7fba5804d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42d8ea0452ad670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fb940ff9640 1 -- 172.21.15.99:0/4141869397 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5802aa40 con 0x5639f43d2f90 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fb940ff9640 1 -- 172.21.15.99:0/4141869397 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5804a020 con 0x5639f43d2f90 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fb940ff9640 1 -- 172.21.15.99:0/4141869397 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5802a520 con 0x5639f43d2f90 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 -- 172.21.15.99:0/4141869397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 msgr2=0x5639f43d3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/4141869397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fba5800b010 tx=0x7fba5804d000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 -- 172.21.15.99:0/4141869397 shutdown_connections 2024-09-13T23:25:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/4141869397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43d3390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 -- 172.21.15.99:0/4141869397 >> 172.21.15.99:0/4141869397 conn(0x5639f43cf2f0 msgr2=0x5639f43cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 -- 172.21.15.99:0/4141869397 shutdown_connections 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.820+0000 7fba5fbaf800 1 -- 172.21.15.99:0/4141869397 wait complete. 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5fbaf800 1 Processor -- start 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5fbaf800 1 -- start start 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5fbaf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43da460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5fbaf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5639f43d3fd0 con 0x5639f43d2f90 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5dea4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43da460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56088/0 (socket says 172.21.15.99:56088) 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 learned_addr learned my addr 172.21.15.99:0/2453863269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639f43da9a0 con 0x5639f43d2f90 2024-09-13T23:25:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.821+0000 7fba5dea4640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43da460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba5804cd60 tx=0x7fba5804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fb932ffd640 1 -- 172.21.15.99:0/2453863269 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba58029ca0 con 0x5639f43d2f90 2024-09-13T23:25:34.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fb932ffd640 1 -- 172.21.15.99:0/2453863269 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba58029e40 con 0x5639f43d2f90 2024-09-13T23:25:34.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fb932ffd640 1 -- 172.21.15.99:0/2453863269 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba5801f7f0 con 0x5639f43d2f90 2024-09-13T23:25:34.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5639f43dac30 con 0x5639f43d2f90 2024-09-13T23:25:34.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639f43dac30 con 0x5639f43d2f90 2024-09-13T23:25:34.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fb932ffd640 1 -- 172.21.15.99:0/2453863269 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fba58040140 con 0x5639f43d2f90 2024-09-13T23:25:34.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.822+0000 7fb932ffd640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb928036be0 0x7fb9280390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fb932ffd640 1 -- 172.21.15.99:0/2453863269 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fba5804b030 con 0x5639f43d2f90 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb928036be0 0x7fb9280390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb928036be0 0x7fb9280390a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba50046010 tx=0x7fba50040000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f43e5c70 0x5639f43e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43e8880 con 0x5639f43e5c70 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.823+0000 7fba54ea2640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f43e5c70 0x5639f43e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba54ea2640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f43e5c70 0x5639f43e8130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 realm 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43e8cb0 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43e9580 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43e9920 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.824+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43ea680 0x5639f43eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43ecfb0 con 0x5639f43ea680 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5dea4640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43ea680 0x5639f43eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5dea4640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43ea680 0x5639f43eca70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba58038020 con 0x5639f43ea680 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 20 searching for the correct realm 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5639f43ef030 0x5639f43f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.825+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5639f43ef030 0x5639f43f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5d6a3640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5639f43ef030 0x5639f43f14f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba58038020 con 0x5639f43ea680 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5dea4640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fba5803f0d0 0x7fba580460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.826+0000 7fba54ea2640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fba5803f0d0 0x7fba580460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.827+0000 7fba54ea2640 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fba5803f0d0 0x7fba580460e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.827+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.827+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.827+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.827+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba58038020 con 0x5639f43ea680 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.828+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.829+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fba58038020 con 0x5639f43ea680 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.830+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.831+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba58038020 con 0x5639f43ea680 2024-09-13T23:25:34.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.832+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ef030 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.833+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x7fba5803f0d0 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43e5c70 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f1bc0 con 0x5639f43ea680 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:34.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43eda30 con 0x5639f43e5c70 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.834+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43ed640 con 0x5639f43e5c70 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43ee3a0 con 0x5639f43ea680 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 zone default found 2024-09-13T23:25:34.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 4 Realm: () 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 zonegroup default 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f24f0 con 0x7fba5803f0d0 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f42d0 con 0x5639f43ef030 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.835+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f4780 con 0x5639f43ef030 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 20 started sync module instance, tier type = 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.836+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f3710 con 0x5639f43ea680 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.837+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.837+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94806910909184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f5090 con 0x5639f43ea680 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.837+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f58e0 con 0x5639f43e5c70 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.838+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94806910909184] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.838+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.838+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94806910913504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f55f0 con 0x5639f43e5c70 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.838+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f60b0 con 0x5639f43ef030 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.839+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.839+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94806910917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f6950 con 0x5639f43ef030 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.839+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f7430 con 0x5639f43ea680 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.839+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94806910913504] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.840+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.840+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94806910917504] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.840+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94806910919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f6f40 con 0x5639f43ea680 2024-09-13T23:25:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.840+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f79a0 con 0x5639f43e5c70 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.841+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.841+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94806910923904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f79a0 con 0x5639f43e5c70 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.841+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f8920 con 0x7fba5803f0d0 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.841+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94806910919840] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.842+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.842+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94806910927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f88e0 con 0x7fba5803f0d0 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.842+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f9330 con 0x7fba5803f0d0 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.842+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94806910923904] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.843+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94806910927888] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.843+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.843+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94806910914624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f8e80 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.843+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f9840 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94806910914624] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94806910926128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f9840 con 0x7fba5803f0d0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=0 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=1 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=2 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=3 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=4 2024-09-13T23:25:34.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=5 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.844+0000 7fba5fbaf800 20 add_watcher() i=6 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.845+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94806910926128] v31'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.845+0000 7fba5fbaf800 20 add_watcher() i=7 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.845+0000 7fba5fbaf800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.845+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f43fcb60 con 0x5639f43e5c70 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.845+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.846+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94806910932224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f43f9dd0 con 0x5639f43e5c70 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.846+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94806910932224] v31'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fb9137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 5 note: GC not initialized 2024-09-13T23:25:34.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fb9127e4640 20 reqs_thread_entry: start 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 20 Filter name: none 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fb883fff640 20 reqs_thread_entry: start 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.847+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f442faa0 con 0x5639f43e5c70 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5fbaf800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f4430490 con 0x5639f43e5c70 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5fbaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:34.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5639f44314a0 con 0x5639f43ea680 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.848+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.849+0000 7fb9137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.849+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94806910932224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43e5c70 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.850+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94806910932224] v31'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.850+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94806910909184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43ea680 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.851+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94806910909184] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.851+0000 7fba5fbaf800 20 remove_watcher() i=0 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.851+0000 7fba5fbaf800 2 removed watcher, disabling cache 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.851+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94806910913504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43e5c70 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.852+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94806910913504] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.852+0000 7fba5fbaf800 20 remove_watcher() i=1 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.852+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94806910917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43ef030 2024-09-13T23:25:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.853+0000 7fba5d6a3640 1 -- 172.21.15.99:0/2453863269 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94806910917504] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba50029030 con 0x5639f43ef030 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.853+0000 7fba5fbaf800 20 remove_watcher() i=2 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.853+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94806910919840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43ea680 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.854+0000 7fba5dea4640 1 -- 172.21.15.99:0/2453863269 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94806910919840] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba58061040 con 0x5639f43ea680 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.854+0000 7fba5fbaf800 20 remove_watcher() i=3 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.854+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94806910923904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x5639f43e5c70 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.855+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94806910923904] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x5639f43e5c70 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.855+0000 7fba5fbaf800 20 remove_watcher() i=4 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.855+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94806910927888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x7fba5803f0d0 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.856+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94806910927888] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.856+0000 7fba5fbaf800 20 remove_watcher() i=5 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.856+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94806910914624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x7fba5803f0d0 2024-09-13T23:25:34.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.857+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94806910914624] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.857+0000 7fba5fbaf800 20 remove_watcher() i=6 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.857+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94806910926128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5639f442d890 con 0x7fba5803f0d0 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.858+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94806910926128] v31'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba48051070 con 0x7fba5803f0d0 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.858+0000 7fba5fbaf800 20 remove_watcher() i=7 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fba5803f0d0 msgr2=0x7fba580460e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fba5803f0d0 0x7fba580460e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f43e5c70 msgr2=0x5639f43e8130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f43e5c70 0x5639f43e8130 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43ea680 msgr2=0x5639f43eca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43ea680 0x5639f43eca70 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5639f43ef030 msgr2=0x5639f43f14f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5639f43ef030 0x5639f43f14f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb928036be0 msgr2=0x7fb9280390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb928036be0 0x7fb9280390a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba50046010 tx=0x7fba50040000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 msgr2=0x5639f43da460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2453863269 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43d2f90 0x5639f43da460 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fba5804cd60 tx=0x7fba5804cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba54ea2640 1 -- 172.21.15.99:0/2453863269 reap_dead start 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 shutdown_connections 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 >> 172.21.15.99:0/2453863269 conn(0x5639f43cf2f0 msgr2=0x5639f43cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 shutdown_connections 2024-09-13T23:25:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2453863269 wait complete. 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 msgr2=0x7fb934039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 0x7fb934039000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5639f43b3c40 tx=0x7fba5000ef30 comp rx=0 tx=0).stop 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 msgr2=0x5639f43c6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x5639f43ac830 tx=0x7fba580167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 shutdown_connections 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb934036b40 0x7fb934039000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/2510199539 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f43c6240 0x5639f43c6660 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 >> 172.21.15.99:0/2510199539 conn(0x5639f43bb1d0 msgr2=0x5639f43bdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 shutdown_connections 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/2510199539 wait complete. 2024-09-13T23:25:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 msgr2=0x5639f43b24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 0x5639f43b24a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 msgr2=0x5639f43b71c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.859+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 0x5639f43b71c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 msgr2=0x7fb944039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 0x7fb944039000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba48057000 tx=0x7fba48052000 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 msgr2=0x5639f43ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fba50004000 tx=0x7fba50000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 shutdown_connections 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5639f43b4dd0 0x5639f43b71c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5639f42b5990 0x5639f43b24a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb944036b40 0x7fb944039000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 --2- 172.21.15.99:0/924400423 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5639f42b1550 0x5639f43ab430 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 >> 172.21.15.99:0/924400423 conn(0x5639f42acde0 msgr2=0x5639f439a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 shutdown_connections 2024-09-13T23:25:34.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.860+0000 7fba5fbaf800 1 -- 172.21.15.99:0/924400423 wait complete. 2024-09-13T23:25:34.876 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-13T23:25:34.876 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:25:34.901 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:34.901 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T23:25:34.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T23:25:34.901 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T23:25:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.945+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.945+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.945+0000 7fc575811800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56330f963970 0x56330f965d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.945+0000 7fc575811800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56330f81eb30 con 0x56330f8d3630 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.945+0000 7fc575811800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x56330f800360 con 0x56330f963970 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc56873c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56330f963970 0x56330f965d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc56873c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56330f963970 0x56330f965d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56102/0 (socket says 172.21.15.99:56102) 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc570f3d640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x56330f8d3630 0x56330f962250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41894/0 (socket says 172.21.15.99:41894) 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc56873c640 1 -- 172.21.15.99:0/3697057924 learned_addr learned my addr 172.21.15.99:0/3697057924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc56873c640 1 -- 172.21.15.99:0/3697057924 >> v1:172.21.15.43:6789/0 conn(0x56330f8d3630 legacy=0x56330f962250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.946+0000 7fc56873c640 1 -- 172.21.15.99:0/3697057924 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330f826e00 con 0x56330f963970 2024-09-13T23:25:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc56873c640 1 --2- 172.21.15.99:0/3697057924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f963970 0x56330f965d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc55800a520 tx=0x7fc558045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2c3f11e913f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc56bfff640 1 -- 172.21.15.99:0/3697057924 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc558055070 con 0x56330f963970 2024-09-13T23:25:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc56bfff640 1 -- 172.21.15.99:0/3697057924 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5580515b0 con 0x56330f963970 2024-09-13T23:25:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc56bfff640 1 -- 172.21.15.99:0/3697057924 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5580518d0 con 0x56330f963970 2024-09-13T23:25:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 -- 172.21.15.99:0/3697057924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f963970 msgr2=0x56330f965d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 --2- 172.21.15.99:0/3697057924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f963970 0x56330f965d60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc55800a520 tx=0x7fc558045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 -- 172.21.15.99:0/3697057924 shutdown_connections 2024-09-13T23:25:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 --2- 172.21.15.99:0/3697057924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f963970 0x56330f965d60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 -- 172.21.15.99:0/3697057924 >> 172.21.15.99:0/3697057924 conn(0x56330f959de0 msgr2=0x56330f95c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.948+0000 7fc575811800 1 -- 172.21.15.99:0/3697057924 shutdown_connections 2024-09-13T23:25:34.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.949+0000 7fc575811800 1 -- 172.21.15.99:0/3697057924 wait complete. 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.962+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.962+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc575811800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc575811800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56330f8ab330 con 0x56330f8d3630 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc570f3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc570f3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56104/0 (socket says 172.21.15.99:56104) 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc570f3d640 1 -- 172.21.15.99:0/3373492167 learned_addr learned my addr 172.21.15.99:0/3373492167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc570f3d640 1 -- 172.21.15.99:0/3373492167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330f7f8bc0 con 0x56330f8d3630 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc570f3d640 1 --2- 172.21.15.99:0/3373492167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc560001e40 tx=0x7fc560001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3313de9aeea8617f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc45ee0d640 1 -- 172.21.15.99:0/3373492167 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000e5c0 con 0x56330f8d3630 2024-09-13T23:25:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc45ee0d640 1 -- 172.21.15.99:0/3373492167 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc560006070 con 0x56330f8d3630 2024-09-13T23:25:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.963+0000 7fc45ee0d640 1 -- 172.21.15.99:0/3373492167 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000e910 con 0x56330f8d3630 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 -- 172.21.15.99:0/3373492167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 msgr2=0x56330fa4e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 --2- 172.21.15.99:0/3373492167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc560001e40 tx=0x7fc560001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 -- 172.21.15.99:0/3373492167 shutdown_connections 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 --2- 172.21.15.99:0/3373492167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa4e870 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 -- 172.21.15.99:0/3373492167 >> 172.21.15.99:0/3373492167 conn(0x56330f959de0 msgr2=0x56330fa4a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 -- 172.21.15.99:0/3373492167 shutdown_connections 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.964+0000 7fc575811800 1 -- 172.21.15.99:0/3373492167 wait complete. 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc575811800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc575811800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56330f966690 con 0x56330f8d3630 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc570f3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc570f3d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56116/0 (socket says 172.21.15.99:56116) 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc570f3d640 1 -- 172.21.15.99:0/407981808 learned_addr learned my addr 172.21.15.99:0/407981808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc570f3d640 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330f80cfe0 con 0x56330f8d3630 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc570f3d640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc560000f60 tx=0x7fc560000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc45d60a640 1 -- 172.21.15.99:0/407981808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000f8d0 con 0x56330f8d3630 2024-09-13T23:25:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc45d60a640 1 -- 172.21.15.99:0/407981808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56000fa70 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.965+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56330fa567e0 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.966+0000 7fc45d60a640 1 -- 172.21.15.99:0/407981808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56000fd90 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.966+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330fa56d00 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.966+0000 7fc45d60a640 1 -- 172.21.15.99:0/407981808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc560017070 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.966+0000 7fc45d60a640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 0x7fc458038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc45d60a640 1 -- 172.21.15.99:0/407981808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc560015020 con 0x56330f8d3630 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc56873c640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 0x7fc458038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 0x56330fa5d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa5d8e0 con 0x56330f963970 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc57173e640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 0x56330fa5d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc56873c640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 0x7fc458038fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc558057000 tx=0x7fc558052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc57173e640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 0x56330fa5d310 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc57173e640 1 -- 172.21.15.99:0/407981808 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc56c00a4a0 con 0x56330f963970 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.967+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa5a8c0 con 0x56330f963970 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc57173e640 1 -- 172.21.15.99:0/407981808 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc56c00a4a0 con 0x56330f963970 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 0x56330fa61fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa62680 con 0x56330fa5fbf0 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc570f3d640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 0x56330fa61fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc570f3d640 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 0x56330fa61fe0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc570f3d640 1 -- 172.21.15.99:0/407981808 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa5fbf0 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.968+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa5ea90 con 0x56330f963970 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc57173e640 1 -- 172.21.15.99:0/407981808 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc56c00a4a0 con 0x56330f963970 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa5ef70 con 0x56330fa5fbf0 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc570f3d640 1 -- 172.21.15.99:0/407981808 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa5fbf0 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc575811800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.969+0000 7fc575811800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56330f7fa580 con 0x56330f95fc00 2024-09-13T23:25:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56124/0 (socket says 172.21.15.99:56124) 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc57173e640 1 -- 172.21.15.99:0/652492982 learned_addr learned my addr 172.21.15.99:0/652492982 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc57173e640 1 -- 172.21.15.99:0/652492982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330f960020 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc57173e640 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x56330fa57350 tx=0x7fc56c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc4567fc640 1 -- 172.21.15.99:0/652492982 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c013640 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc4567fc640 1 -- 172.21.15.99:0/652492982 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c0137e0 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc4567fc640 1 -- 172.21.15.99:0/652492982 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c013ac0 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56330f95e850 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.970+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330f95ed50 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.971+0000 7fc4567fc640 1 -- 172.21.15.99:0/652492982 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc56c011040 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.971+0000 7fc4567fc640 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 0x7fc448039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.971+0000 7fc4567fc640 1 -- 172.21.15.99:0/652492982 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc56c00e040 con 0x56330f95fc00 2024-09-13T23:25:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.971+0000 7fc570f3d640 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 0x7fc448039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.971+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc570f3d640 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 0x7fc448039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc56004b890 tx=0x7fc56004b760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc575811800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc575811800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56330fa4f020 con 0x56330fa7ff00 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56138/0 (socket says 172.21.15.99:56138) 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc57173e640 1 -- 172.21.15.99:0/2300467878 learned_addr learned my addr 172.21.15.99:0/2300467878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc57173e640 1 -- 172.21.15.99:0/2300467878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330fa808d0 con 0x56330fa7ff00 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc57173e640 1 --2- 172.21.15.99:0/2300467878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc56c04cdb0 tx=0x7fc56c01fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacb851603f176be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc447fff640 1 -- 172.21.15.99:0/2300467878 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c021440 con 0x56330fa7ff00 2024-09-13T23:25:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc447fff640 1 -- 172.21.15.99:0/2300467878 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c04a030 con 0x56330fa7ff00 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.972+0000 7fc447fff640 1 -- 172.21.15.99:0/2300467878 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c01f340 con 0x56330fa7ff00 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- 172.21.15.99:0/2300467878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 msgr2=0x56330fa80300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 --2- 172.21.15.99:0/2300467878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc56c04cdb0 tx=0x7fc56c01fee0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- 172.21.15.99:0/2300467878 shutdown_connections 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 --2- 172.21.15.99:0/2300467878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa80300 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- 172.21.15.99:0/2300467878 >> 172.21.15.99:0/2300467878 conn(0x56330fa7c260 msgr2=0x56330fa7a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- 172.21.15.99:0/2300467878 shutdown_connections 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- 172.21.15.99:0/2300467878 wait complete. 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 Processor -- start 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- start start 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.973+0000 7fc575811800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56330fa80ea0 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc57173e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56142/0 (socket says 172.21.15.99:56142) 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 learned_addr learned my addr 172.21.15.99:0/3562146701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330fa87910 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc57173e640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc56c01ff20 tx=0x7fc56c04cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc4467fc640 1 -- 172.21.15.99:0/3562146701 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c0400e0 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc4467fc640 1 -- 172.21.15.99:0/3562146701 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c040280 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56330fa87ba0 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc4467fc640 1 -- 172.21.15.99:0/3562146701 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc56c04e200 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.974+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330fa8a850 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.975+0000 7fc4467fc640 1 -- 172.21.15.99:0/3562146701 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc56c039020 con 0x56330fa7ff00 2024-09-13T23:25:34.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.975+0000 7fc4467fc640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc43c036b40 0x7fc43c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.975+0000 7fc4467fc640 1 -- 172.21.15.99:0/3562146701 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc56c037020 con 0x56330fa7ff00 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.975+0000 7fc570f3d640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc43c036b40 0x7fc43c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330fa92db0 0x56330fa95270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa959c0 con 0x56330fa92db0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc570f3d640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc43c036b40 0x7fc43c039000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc56001cfd0 tx=0x7fc560032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc56873c640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330fa92db0 0x56330fa95270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc56873c640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330fa92db0 0x56330fa95270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 20 realm 2024-09-13T23:25:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.976+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa95df0 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa966c0 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa96a60 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:34.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa977c0 0x56330fa99bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9a0f0 con 0x56330fa977c0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc57173e640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa977c0 0x56330fa99bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.977+0000 7fc57173e640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa977c0 0x56330fa99bb0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc575811800 20 searching for the correct realm 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56330fa9c1d0 0x56330fa9e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc570f3d640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56330fa9c1d0 0x56330fa9e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc570f3d640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56330fa9c1d0 0x56330fa9e690 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.978+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.979+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.979+0000 7fc57173e640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc56c02cc90 0x7fc56c0123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.979+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.979+0000 7fc56873c640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc56c02cc90 0x7fc56c0123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.979+0000 7fc56873c640 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc56c02cc90 0x7fc56c0123d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.980+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.981+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.982+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.983+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.984+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa9c1d0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.985+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x7fc56c02cc90 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa92db0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9ed60 con 0x56330fa977c0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9b6f0 con 0x56330fa92db0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.986+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9a670 con 0x56330fa92db0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9b070 con 0x56330fa977c0 2024-09-13T23:25:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 zone default found 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 4 Realm: () 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 zonegroup default 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fa9f1e0 con 0x7fc56c02cc90 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.987+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330faa1410 con 0x56330fa9c1d0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330faa17b0 con 0x56330fa9c1d0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 20 started sync module instance, tier type = 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.988+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa0850 con 0x56330fa977c0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.989+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.989+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777306123680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa0850 con 0x56330fa977c0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.989+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa2170 con 0x56330fa92db0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.990+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777306123680] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.990+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.990+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777306121120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa07c0 con 0x56330fa92db0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.990+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa2fe0 con 0x56330fa9c1d0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.991+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.991+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777306131248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa3830 con 0x56330fa9c1d0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.991+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa4280 con 0x56330fa977c0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.991+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777306121120] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.992+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777306131248] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.992+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.992+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777306133376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa2510 con 0x56330fa977c0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.992+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa4b60 con 0x56330fa92db0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.993+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777306133376] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.993+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.993+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777306135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa4b20 con 0x56330fa92db0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.993+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa5590 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.994+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.994+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777306135920] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.994+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777306140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa5590 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.994+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa46b0 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.995+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.995+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777306138224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa6480 con 0x7fc56c02cc90 2024-09-13T23:25:35.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.995+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa6ec0 con 0x7fc56c02cc90 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777306140864] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777306138224] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777306147216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa6e80 con 0x7fc56c02cc90 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=0 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=1 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=2 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=3 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=4 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=5 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.996+0000 7fc575811800 20 add_watcher() i=6 2024-09-13T23:25:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.997+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777306147216] v31'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558057030 con 0x7fc56c02cc90 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.997+0000 7fc575811800 20 add_watcher() i=7 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.997+0000 7fc575811800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.997+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330faa9eb0 con 0x56330fa92db0 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.998+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.998+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777306143072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa7330 con 0x56330fa92db0 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777306143072] v31'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc426fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 5 note: GC not initialized 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc425fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 20 Filter name: none 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc3977fe640 20 reqs_thread_entry: start 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:34.999+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fadcca0 con 0x56330fa92db0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc575811800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fadd690 con 0x56330fa92db0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc558057030 con 0x56330fa92db0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc575811800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56330fade6a0 con 0x56330fa977c0 2024-09-13T23:25:35.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.000+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.001+0000 7fc426fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.001+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777306143072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330fadaa50 con 0x56330fa92db0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.002+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94777306143072] v31'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc558089040 con 0x56330fa92db0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.002+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777306123680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330fadaa50 con 0x56330fa977c0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.003+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94777306123680] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.003+0000 7fc575811800 20 remove_watcher() i=0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.003+0000 7fc575811800 2 removed watcher, disabling cache 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.003+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777306121120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330fadaa50 con 0x56330fa92db0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.004+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94777306121120] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558089040 con 0x56330fa92db0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.004+0000 7fc575811800 20 remove_watcher() i=1 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.004+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777306131248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330fadaa50 con 0x56330fa9c1d0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.005+0000 7fc570f3d640 1 -- 172.21.15.99:0/3562146701 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94777306131248] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56002e070 con 0x56330fa9c1d0 2024-09-13T23:25:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.005+0000 7fc575811800 20 remove_watcher() i=2 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.005+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777306133376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa03a0 con 0x56330fa977c0 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.006+0000 7fc57173e640 1 -- 172.21.15.99:0/3562146701 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94777306133376] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc56c030050 con 0x56330fa977c0 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.006+0000 7fc575811800 20 remove_watcher() i=3 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.006+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777306135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa2b30 con 0x56330fa92db0 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.007+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94777306135920] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558089040 con 0x56330fa92db0 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.007+0000 7fc575811800 20 remove_watcher() i=4 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.007+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777306140864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa03a0 con 0x7fc56c02cc90 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.008+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94777306140864] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558089040 con 0x7fc56c02cc90 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.008+0000 7fc575811800 20 remove_watcher() i=5 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.008+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777306138224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa3d70 con 0x7fc56c02cc90 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.009+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94777306138224] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558089040 con 0x7fc56c02cc90 2024-09-13T23:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.009+0000 7fc575811800 20 remove_watcher() i=6 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.009+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777306147216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56330faa03a0 con 0x7fc56c02cc90 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94777306147216] v31'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc558089040 con 0x7fc56c02cc90 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 20 remove_watcher() i=7 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc56c02cc90 msgr2=0x7fc56c0123d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc56c02cc90 0x7fc56c0123d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330fa92db0 msgr2=0x56330fa95270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330fa92db0 0x56330fa95270 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa977c0 msgr2=0x56330fa99bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa977c0 0x56330fa99bb0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56330fa9c1d0 msgr2=0x56330fa9e690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56330fa9c1d0 0x56330fa9e690 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc43c036b40 msgr2=0x7fc43c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc43c036b40 0x7fc43c039000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc56001cfd0 tx=0x7fc560032000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 msgr2=0x56330fa873d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc56c01ff20 tx=0x7fc56c04cd10 comp rx=0 tx=0).stop 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc56873c640 1 -- 172.21.15.99:0/3562146701 reap_dead start 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 shutdown_connections 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/3562146701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330fa7ff00 0x56330fa873d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 >> 172.21.15.99:0/3562146701 conn(0x56330fa7c260 msgr2=0x56330fa7a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 shutdown_connections 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/3562146701 wait complete. 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 msgr2=0x7fc448039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 0x7fc448039000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc56004b890 tx=0x7fc56004b760 comp rx=0 tx=0).stop 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 msgr2=0x56330f95e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.010+0000 7fc575811800 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x56330fa57350 tx=0x7fc56c0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 shutdown_connections 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc448036b40 0x7fc448039000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/652492982 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f95fc00 0x56330f95e250 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 >> 172.21.15.99:0/652492982 conn(0x56330fa65f90 msgr2=0x56330fa68b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 shutdown_connections 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/652492982 wait complete. 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 msgr2=0x56330fa5d310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 0x56330fa5d310 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 msgr2=0x56330fa61fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 0x56330fa61fe0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 msgr2=0x7fc458038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 0x7fc458038fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc558057000 tx=0x7fc558052000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 msgr2=0x56330fa562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc560000f60 tx=0x7fc560000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 shutdown_connections 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56330fa5fbf0 0x56330fa61fe0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56330f963970 0x56330fa5d310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc458036af0 0x7fc458038fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 --2- 172.21.15.99:0/407981808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56330f8d3630 0x56330fa562a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 >> 172.21.15.99:0/407981808 conn(0x56330f959de0 msgr2=0x56330fa48aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 shutdown_connections 2024-09-13T23:25:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.011+0000 7fc575811800 1 -- 172.21.15.99:0/407981808 wait complete. 2024-09-13T23:25:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:["myfoo"] 2024-09-13T23:25:35.026 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:25:35.029 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.029 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T23:25:35.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T23:25:35.030 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T23:25:35.071 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.071 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f7228cb7800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x562a03b76600 0x562a03c07660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f7228cb7800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a03ac1b30 con 0x562a03c07ba0 2024-09-13T23:25:35.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f7228cb7800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x562a03aa3360 con 0x562a03b76600 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.071+0000 7f72267ab640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x562a03b76600 0x562a03c07660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f72267ab640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x562a03b76600 0x562a03c07660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56154/0 (socket says 172.21.15.99:56154) 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f72267ab640 1 -- 172.21.15.99:0/808252499 learned_addr learned my addr 172.21.15.99:0/808252499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f721ffff640 1 --1- 172.21.15.99:0/808252499 >> v1:172.21.15.43:6789/0 conn(0x562a03c07ba0 0x562a03c09f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41896/0 (socket says 172.21.15.99:41896) 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f7225faa640 1 -- 172.21.15.99:0/808252499 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240172213 0 0) 0x562a03ac1b30 con 0x562a03c07ba0 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f72267ab640 1 -- 172.21.15.99:0/808252499 >> v1:172.21.15.43:6789/0 conn(0x562a03c07ba0 legacy=0x562a03c09f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.072+0000 7f72267ab640 1 -- 172.21.15.99:0/808252499 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03ac9e00 con 0x562a03b76600 2024-09-13T23:25:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f72267ab640 1 --2- 172.21.15.99:0/808252499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03c07660 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f721800a520 tx=0x7f7218045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc925e6be8ba309 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7225faa640 1 -- 172.21.15.99:0/808252499 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7218055070 con 0x562a03b76600 2024-09-13T23:25:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7225faa640 1 -- 172.21.15.99:0/808252499 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180515b0 con 0x562a03b76600 2024-09-13T23:25:35.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7225faa640 1 -- 172.21.15.99:0/808252499 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72180518d0 con 0x562a03b76600 2024-09-13T23:25:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 -- 172.21.15.99:0/808252499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 msgr2=0x562a03c07660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 --2- 172.21.15.99:0/808252499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03c07660 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f721800a520 tx=0x7f7218045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 -- 172.21.15.99:0/808252499 shutdown_connections 2024-09-13T23:25:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 --2- 172.21.15.99:0/808252499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03c07660 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 -- 172.21.15.99:0/808252499 >> 172.21.15.99:0/808252499 conn(0x562a03bfcdd0 msgr2=0x562a03bff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 -- 172.21.15.99:0/808252499 shutdown_connections 2024-09-13T23:25:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.074+0000 7f7228cb7800 1 -- 172.21.15.99:0/808252499 wait complete. 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.088+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.088+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.088+0000 7f7228cb7800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.088+0000 7f7228cb7800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562a03b4e320 con 0x562a03b76600 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f72267ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f72267ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56166/0 (socket says 172.21.15.99:56166) 2024-09-13T23:25:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f72267ab640 1 -- 172.21.15.99:0/3505978622 learned_addr learned my addr 172.21.15.99:0/3505978622 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f72267ab640 1 -- 172.21.15.99:0/3505978622 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03a9bbc0 con 0x562a03b76600 2024-09-13T23:25:35.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f72267ab640 1 --2- 172.21.15.99:0/3505978622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7218025da0 tx=0x7f7218051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75e04cb5da4f2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f7114608640 1 -- 172.21.15.99:0/3505978622 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7218051ac0 con 0x562a03b76600 2024-09-13T23:25:35.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f7114608640 1 -- 172.21.15.99:0/3505978622 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7218051c60 con 0x562a03b76600 2024-09-13T23:25:35.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.089+0000 7f7114608640 1 -- 172.21.15.99:0/3505978622 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7218066460 con 0x562a03b76600 2024-09-13T23:25:35.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- 172.21.15.99:0/3505978622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 msgr2=0x562a03cf3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3505978622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7218025da0 tx=0x7f7218051000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- 172.21.15.99:0/3505978622 shutdown_connections 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3505978622 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cf3830 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- 172.21.15.99:0/3505978622 >> 172.21.15.99:0/3505978622 conn(0x562a03bfcdd0 msgr2=0x562a03cef1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- 172.21.15.99:0/3505978622 shutdown_connections 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- 172.21.15.99:0/3505978622 wait complete. 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.090+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f7228cb7800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f7228cb7800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562a03c0b980 con 0x562a03b76600 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f72267ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f72267ab640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56172/0 (socket says 172.21.15.99:56172) 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f72267ab640 1 -- 172.21.15.99:0/4286315858 learned_addr learned my addr 172.21.15.99:0/4286315858 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f72267ab640 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03aaffe0 con 0x562a03b76600 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.091+0000 7f72267ab640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f72180460a0 tx=0x7f7218003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.092+0000 7f7112e05640 1 -- 172.21.15.99:0/4286315858 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7218066650 con 0x562a03b76600 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.092+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a03cfb6c0 con 0x562a03b76600 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.092+0000 7f7112e05640 1 -- 172.21.15.99:0/4286315858 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72180667f0 con 0x562a03b76600 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.092+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a03cfbbe0 con 0x562a03b76600 2024-09-13T23:25:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.092+0000 7f7112e05640 1 -- 172.21.15.99:0/4286315858 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7218066ad0 con 0x562a03b76600 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7112e05640 1 -- 172.21.15.99:0/4286315858 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7218079060 con 0x562a03b76600 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7112e05640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 0x7f710c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7112e05640 1 -- 172.21.15.99:0/4286315858 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7218062070 con 0x562a03b76600 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f721ffff640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 0x7f710c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 0x562a03d021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d02730 con 0x562a03c07ba0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7226fac640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 0x562a03d021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f721ffff640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 0x7f710c039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7210000c00 tx=0x7f72100013b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.093+0000 7f7226fac640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 0x562a03d021f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f7226fac640 1 -- 172.21.15.99:0/4286315858 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f722000a4a0 con 0x562a03c07ba0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03cff7a0 con 0x562a03c07ba0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f7226fac640 1 -- 172.21.15.99:0/4286315858 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f722000a4a0 con 0x562a03c07ba0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 0x562a03d06e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d07500 con 0x562a03d04a40 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f72267ab640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 0x562a03d06e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.094+0000 7f72267ab640 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 0x562a03d06e30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f72267ab640 1 -- 172.21.15.99:0/4286315858 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7218084040 con 0x562a03d04a40 2024-09-13T23:25:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d038e0 con 0x562a03c07ba0 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f7226fac640 1 -- 172.21.15.99:0/4286315858 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f722000a4a0 con 0x562a03c07ba0 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d03d80 con 0x562a03d04a40 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f72267ab640 1 -- 172.21.15.99:0/4286315858 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7218084040 con 0x562a03d04a40 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.095+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7228cb7800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7228cb7800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562a03a9d580 con 0x562a03d15e70 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56184/0 (socket says 172.21.15.99:56184) 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7226fac640 1 -- 172.21.15.99:0/3904889815 learned_addr learned my addr 172.21.15.99:0/3904889815 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7226fac640 1 -- 172.21.15.99:0/3904889815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03d167d0 con 0x562a03d15e70 2024-09-13T23:25:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f7226fac640 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x562a03cfbfa0 tx=0x7f72200167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f710bfff640 1 -- 172.21.15.99:0/3904889815 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220013640 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.096+0000 7f710bfff640 1 -- 172.21.15.99:0/3904889815 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72200137e0 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a03d16a60 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f710bfff640 1 -- 172.21.15.99:0/3904889815 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220013ae0 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a03d19740 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f710bfff640 1 -- 172.21.15.99:0/3904889815 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7220011040 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f710bfff640 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 0x7f7100039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.097+0000 7f710bfff640 1 -- 172.21.15.99:0/3904889815 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f722000e040 con 0x562a03d15e70 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f72267ab640 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 0x7f7100039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f72267ab640 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 0x7f7100039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562a03d02be0 tx=0x7f72180503e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7228cb7800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7228cb7800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562a03cf3f20 con 0x562a03d22b90 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56198/0 (socket says 172.21.15.99:56198) 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.098+0000 7f7226fac640 1 -- 172.21.15.99:0/3194425199 learned_addr learned my addr 172.21.15.99:0/3194425199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7226fac640 1 -- 172.21.15.99:0/3194425199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03d23560 con 0x562a03d22b90 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7226fac640 1 --2- 172.21.15.99:0/3194425199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7220005cf0 tx=0x7f722004cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05e1a8902cc43e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7109ffb640 1 -- 172.21.15.99:0/3194425199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722001f340 con 0x562a03d22b90 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7109ffb640 1 -- 172.21.15.99:0/3194425199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7220014cc0 con 0x562a03d22b90 2024-09-13T23:25:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7109ffb640 1 -- 172.21.15.99:0/3194425199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722001f4e0 con 0x562a03d22b90 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 -- 172.21.15.99:0/3194425199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 msgr2=0x562a03d22f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3194425199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7220005cf0 tx=0x7f722004cfc0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 -- 172.21.15.99:0/3194425199 shutdown_connections 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3194425199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d22f90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 -- 172.21.15.99:0/3194425199 >> 172.21.15.99:0/3194425199 conn(0x562a03d1ef40 msgr2=0x562a03d1d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 -- 172.21.15.99:0/3194425199 shutdown_connections 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.099+0000 7f7228cb7800 1 -- 172.21.15.99:0/3194425199 wait complete. 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7228cb7800 1 Processor -- start 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7228cb7800 1 -- start start 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7228cb7800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7228cb7800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x562a03d23b30 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7226fac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56206/0 (socket says 172.21.15.99:56206) 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 learned_addr learned my addr 172.21.15.99:0/2544115723 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a03d2a510 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f7226fac640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7220021750 tx=0x7f722004cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.100+0000 7f70f7fff640 1 -- 172.21.15.99:0/2544115723 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7220039070 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f70f7fff640 1 -- 172.21.15.99:0/2544115723 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f722001f6c0 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a03d2a7a0 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f70f7fff640 1 -- 172.21.15.99:0/2544115723 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722001f9a0 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a03d2d450 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f70f7fff640 1 -- 172.21.15.99:0/2544115723 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f722004e150 con 0x562a03d22b90 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f70f7fff640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f70f0036af0 0x7f70f0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.101+0000 7f70f7fff640 1 -- 172.21.15.99:0/2544115723 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f7220031070 con 0x562a03d22b90 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f72267ab640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f70f0036af0 0x7f70f0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03d35ab0 0x562a03d37f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d386c0 con 0x562a03d35ab0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f72267ab640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f70f0036af0 0x7f70f0038fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f72180863f0 tx=0x7f7218095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f721ffff640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03d35ab0 0x562a03d37f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.102+0000 7f721ffff640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03d35ab0 0x562a03d37f70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f721000f5f0 con 0x562a03d35ab0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 realm 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d34f00 con 0x562a03d35ab0 2024-09-13T23:25:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f721000f5f0 con 0x562a03d35ab0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d391a0 con 0x562a03d35ab0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f721000f5f0 con 0x562a03d35ab0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d39a70 con 0x562a03d35ab0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f721000f5f0 con 0x562a03d35ab0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d3a370 0x562a03d3c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3cee0 con 0x562a03d3a370 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.103+0000 7f7226fac640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d3a370 0x562a03d3c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7226fac640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d3a370 0x562a03d3c780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7228cb7800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7228cb7800 20 searching for the correct realm 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x562a03d3ef90 0x562a03d41450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f72267ab640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x562a03d3ef90 0x562a03d41450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.104+0000 7f72267ab640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x562a03d3ef90 0x562a03d41450 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f7226fac640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7220047c20 0x7f7220045830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f721ffff640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7220047c20 0x7f7220045830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.105+0000 7f721ffff640 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7220047c20 0x7f7220045830 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721000f5f0 con 0x7f7220047c20 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721000f5f0 con 0x562a03d35ab0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x7f7220047c20 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.106+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x7f7220047c20 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x7f7220047c20 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.107+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x7f7220047c20 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.108+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.109+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x7f7220047c20 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721002b040 con 0x562a03d35ab0 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.110+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3ef90 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.111+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x7f7220047c20 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d35ab0 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d41b20 con 0x562a03d3a370 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3d990 con 0x562a03d35ab0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.112+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3d5a0 con 0x562a03d35ab0 2024-09-13T23:25:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 zone default found 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 4 Realm: () 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 zonegroup default 2024-09-13T23:25:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d42450 con 0x7f7220047c20 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d43ec0 con 0x562a03d3ef90 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.113+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d44310 con 0x562a03d3ef90 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 20 started sync module instance, tier type = 2024-09-13T23:25:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.114+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d432c0 con 0x562a03d3a370 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.115+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.115+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738452854752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d432c0 con 0x562a03d3a370 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.115+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d44dd0 con 0x562a03d35ab0 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.116+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738452854752] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.116+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.116+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738452859104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d432c0 con 0x562a03d35ab0 2024-09-13T23:25:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.116+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d45820 con 0x562a03d3ef90 2024-09-13T23:25:35.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.117+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738452859104] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.117+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.117+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738452852240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d43230 con 0x562a03d3ef90 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.117+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d46710 con 0x562a03d3a370 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.118+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738452852240] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.118+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.118+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738452865632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d46680 con 0x562a03d3a370 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.118+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d475d0 con 0x562a03d35ab0 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.119+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.119+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738452869408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d47540 con 0x562a03d35ab0 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.119+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d48530 con 0x7f7220047c20 2024-09-13T23:25:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.119+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738452865632] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.120+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.120+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738452867840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d48530 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.120+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d48f80 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.121+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738452869408] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.121+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738452867840] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.122+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.122+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738452873232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d48a90 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.122+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d49450 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738452873232] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738452877216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d49870 con 0x7f7220047c20 2024-09-13T23:25:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=0 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=1 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=2 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=3 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=4 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=5 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.123+0000 7f7228cb7800 20 add_watcher() i=6 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738452877216] v31'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f7228cb7800 20 add_watcher() i=7 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f7228cb7800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x562a03d4c8a0 con 0x562a03d35ab0 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.124+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738452878272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d49c90 con 0x562a03d35ab0 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738452878272] v31'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f70dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f7228cb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f7228cb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f7228cb7800 5 note: GC not initialized 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f70577fe640 20 reqs_thread_entry: start 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f7228cb7800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.125+0000 7f7228cb7800 20 Filter name: none 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f70557fa640 20 reqs_thread_entry: start 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7f220 con 0x562a03d3ef90 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(62 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7f220 con 0x562a03d3ef90 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(63 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7f220 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(64 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.126+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3d5a0 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 [pgnls start_epoch 31 out=49b] v31'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3d5a0 con 0x562a03d3a370 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(67 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.127+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(69 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(71 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(72 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.128+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(75 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(76 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.129+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(77 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(78 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(79 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(80 [pgnls start_epoch 31 out=70b] v31'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.130+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(81 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(82 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(83 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(84 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(85 [pgnls start_epoch 31 out=127b] v31'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.131+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(86 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(87 [pgnls start_epoch 31 out=49b] v31'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(88 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(89 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.132+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x7f7220047c20 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(90 [pgnls start_epoch 31 out=49b] v31'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d35ab0 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(91 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3ef90 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(92 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3e340 con 0x562a03d3a370 2024-09-13T23:25:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(93 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f7228cb7800 20 RGWRados::pool_iterate: got myfoo 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.133+0000 7f7228cb7800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.134+0000 7f70dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.134+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738452878272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d3d5a0 con 0x562a03d35ab0 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.135+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94738452878272] v31'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.135+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738452854752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7d4e0 con 0x562a03d3a370 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.136+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94738452854752] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.136+0000 7f7228cb7800 20 remove_watcher() i=0 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.136+0000 7f7228cb7800 2 removed watcher, disabling cache 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.136+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738452859104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7d4e0 con 0x562a03d35ab0 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.137+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94738452859104] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.137+0000 7f7228cb7800 20 remove_watcher() i=1 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.137+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738452852240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d7d4e0 con 0x562a03d3ef90 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.138+0000 7f72267ab640 1 -- 172.21.15.99:0/2544115723 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94738452852240] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7218084040 con 0x562a03d3ef90 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.138+0000 7f7228cb7800 20 remove_watcher() i=2 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.138+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738452865632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d437e0 con 0x562a03d3a370 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.139+0000 7f7226fac640 1 -- 172.21.15.99:0/2544115723 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94738452865632] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722003b030 con 0x562a03d3a370 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.139+0000 7f7228cb7800 20 remove_watcher() i=3 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.139+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738452869408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d42e10 con 0x562a03d35ab0 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.140+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94738452869408] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x562a03d35ab0 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.140+0000 7f7228cb7800 20 remove_watcher() i=4 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.140+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738452867840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d46260 con 0x7f7220047c20 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.141+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94738452867840] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.141+0000 7f7228cb7800 20 remove_watcher() i=5 2024-09-13T23:25:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.141+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738452873232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d437e0 con 0x7f7220047c20 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.142+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94738452873232] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.142+0000 7f7228cb7800 20 remove_watcher() i=6 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.142+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738452877216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x562a03d47120 con 0x7f7220047c20 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94738452877216] v31'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f721003b040 con 0x7f7220047c20 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 20 remove_watcher() i=7 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7220047c20 msgr2=0x7f7220045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7220047c20 0x7f7220045830 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03d35ab0 msgr2=0x562a03d37f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03d35ab0 0x562a03d37f70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d3a370 msgr2=0x562a03d3c780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d3a370 0x562a03d3c780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x562a03d3ef90 msgr2=0x562a03d41450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x562a03d3ef90 0x562a03d41450 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f70f0036af0 msgr2=0x7f70f0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f70f0036af0 0x7f70f0038fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f72180863f0 tx=0x7f7218095000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 msgr2=0x562a03d29fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f721ffff640 1 -- 172.21.15.99:0/2544115723 reap_dead start 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7220021750 tx=0x7f722004cca0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 shutdown_connections 2024-09-13T23:25:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 --2- 172.21.15.99:0/2544115723 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d22b90 0x562a03d29fd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.143+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 >> 172.21.15.99:0/2544115723 conn(0x562a03d1ef40 msgr2=0x562a03d242a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 shutdown_connections 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/2544115723 wait complete. 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 msgr2=0x7f7100039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 0x7f7100039000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562a03d02be0 tx=0x7f72180503e0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 msgr2=0x562a03d16290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x562a03cfbfa0 tx=0x7f72200167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 shutdown_connections 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7100036b40 0x7f7100039000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/3904889815 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03d15e70 0x562a03d16290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 >> 172.21.15.99:0/3904889815 conn(0x562a03d0ae00 msgr2=0x562a03d0d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 shutdown_connections 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/3904889815 wait complete. 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 msgr2=0x562a03d021f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 0x562a03d021f0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 msgr2=0x562a03d06e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 0x562a03d06e30 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 msgr2=0x7f710c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 0x7f710c039000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7210000c00 tx=0x7f72100013b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 msgr2=0x562a03cfb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f72180460a0 tx=0x7f7218003020 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 shutdown_connections 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x562a03d04a40 0x562a03d06e30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x562a03c07ba0 0x562a03d021f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f710c036b40 0x7f710c039000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 --2- 172.21.15.99:0/4286315858 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x562a03b76600 0x562a03cfb180 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 >> 172.21.15.99:0/4286315858 conn(0x562a03bfcdd0 msgr2=0x562a03ceda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 shutdown_connections 2024-09-13T23:25:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.144+0000 7f7228cb7800 1 -- 172.21.15.99:0/4286315858 wait complete. 2024-09-13T23:25:35.162 INFO:teuthology.orchestra.run.smithi099.stdout:["myfoo"] 2024-09-13T23:25:35.162 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T23:25:35.172 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.181 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.192 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.237 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T23:25:35.264 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.290 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.316 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.316 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:35.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:35.316 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:25:35.360 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.361 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.360+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.360+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.360+0000 7f1393b3e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5647c8deb900 0x5647c8dedcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.360+0000 7f1393b3e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647c8ca7b30 con 0x5647c8de74c0 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.360+0000 7f1393b3e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5647c8c89360 con 0x5647c8deb900 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.361+0000 7f1387033640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5647c8deb900 0x5647c8dedcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.361+0000 7f138f834640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5647c8de74c0 0x5647c8de78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41898/0 (socket says 172.21.15.99:41898) 2024-09-13T23:25:35.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.361+0000 7f138f834640 1 -- 172.21.15.99:0/4143071275 learned_addr learned my addr 172.21.15.99:0/4143071275 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:35.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.361+0000 7f1387033640 1 -- 172.21.15.99:0/4143071275 >> v1:172.21.15.43:6789/0 conn(0x5647c8de74c0 legacy=0x5647c8de78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.361+0000 7f1387033640 1 -- 172.21.15.99:0/4143071275 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8cafe00 con 0x5647c8deb900 2024-09-13T23:25:35.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1387033640 1 --2- 172.21.15.99:0/4143071275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8deb900 0x5647c8dedcf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f137800a470 tx=0x7f1378045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b251f86b7de440e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f138f033640 1 -- 172.21.15.99:0/4143071275 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1378053570 con 0x5647c8deb900 2024-09-13T23:25:35.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f138f033640 1 -- 172.21.15.99:0/4143071275 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1378058070 con 0x5647c8deb900 2024-09-13T23:25:35.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f138f033640 1 -- 172.21.15.99:0/4143071275 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1378053880 con 0x5647c8deb900 2024-09-13T23:25:35.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 -- 172.21.15.99:0/4143071275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8deb900 msgr2=0x5647c8dedcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 --2- 172.21.15.99:0/4143071275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8deb900 0x5647c8dedcf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f137800a470 tx=0x7f1378045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:35.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 -- 172.21.15.99:0/4143071275 shutdown_connections 2024-09-13T23:25:35.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 --2- 172.21.15.99:0/4143071275 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8deb900 0x5647c8dedcf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 -- 172.21.15.99:0/4143071275 >> 172.21.15.99:0/4143071275 conn(0x5647c8de2df0 msgr2=0x5647c8de5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 -- 172.21.15.99:0/4143071275 shutdown_connections 2024-09-13T23:25:35.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.363+0000 7f1393b3e800 1 -- 172.21.15.99:0/4143071275 wait complete. 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.377+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.377+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.377+0000 7f1393b3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.377+0000 7f1393b3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647c8d34330 con 0x5647c8de74c0 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f138f834640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f138f834640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56226/0 (socket says 172.21.15.99:56226) 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f138f834640 1 -- 172.21.15.99:0/621228972 learned_addr learned my addr 172.21.15.99:0/621228972 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f138f834640 1 -- 172.21.15.99:0/621228972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8c81bc0 con 0x5647c8de74c0 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f138f834640 1 --2- 172.21.15.99:0/621228972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1380001d80 tx=0x7f1380001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8320707a00f14350 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f127de0b640 1 -- 172.21.15.99:0/621228972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1380013030 con 0x5647c8de74c0 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f127de0b640 1 -- 172.21.15.99:0/621228972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f138000e470 con 0x5647c8de74c0 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.378+0000 7f127de0b640 1 -- 172.21.15.99:0/621228972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138000e810 con 0x5647c8de74c0 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- 172.21.15.99:0/621228972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 msgr2=0x5647c8ed6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 --2- 172.21.15.99:0/621228972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1380001d80 tx=0x7f1380001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- 172.21.15.99:0/621228972 shutdown_connections 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 --2- 172.21.15.99:0/621228972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ed6750 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- 172.21.15.99:0/621228972 >> 172.21.15.99:0/621228972 conn(0x5647c8de2df0 msgr2=0x5647c8ed2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- 172.21.15.99:0/621228972 shutdown_connections 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- 172.21.15.99:0/621228972 wait complete. 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.379+0000 7f1393b3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647c8dee530 con 0x5647c8de74c0 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f138f834640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f138f834640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56234/0 (socket says 172.21.15.99:56234) 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f138f834640 1 -- 172.21.15.99:0/2123638109 learned_addr learned my addr 172.21.15.99:0/2123638109 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f138f834640 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8c95fe0 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f138f834640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1380004000 tx=0x7f1380000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f1277fff640 1 -- 172.21.15.99:0/2123638109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1380027070 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f1277fff640 1 -- 172.21.15.99:0/2123638109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1380019900 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f1277fff640 1 -- 172.21.15.99:0/2123638109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1380019c60 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647c8ede690 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.380+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c8edebb0 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1277fff640 1 -- 172.21.15.99:0/2123638109 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f138002a070 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1277fff640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 0x7f1278039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1277fff640 1 -- 172.21.15.99:0/2123638109 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f138001f070 con 0x5647c8de74c0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1387033640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 0x7f1278039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 0x5647c8ee51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.381+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8ee5740 con 0x5647c8deb900 2024-09-13T23:25:35.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1390035640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 0x5647c8ee51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1387033640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 0x7f1278039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1378057000 tx=0x7f1378052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1390035640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 0x5647c8ee51c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1390035640 1 -- 172.21.15.99:0/2123638109 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f138800a4a0 con 0x5647c8deb900 2024-09-13T23:25:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8ee2790 con 0x5647c8deb900 2024-09-13T23:25:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1390035640 1 -- 172.21.15.99:0/2123638109 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f138800a4a0 con 0x5647c8deb900 2024-09-13T23:25:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 0x5647c8ee9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.382+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8eea570 con 0x5647c8ee7a90 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f138f834640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 0x5647c8ee9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f138f834640 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 0x5647c8ee9e80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f138f834640 1 -- 172.21.15.99:0/2123638109 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1380029030 con 0x5647c8ee7a90 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8ee6930 con 0x5647c8deb900 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f1390035640 1 -- 172.21.15.99:0/2123638109 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f138800a4a0 con 0x5647c8deb900 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.383+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8ee6e10 con 0x5647c8ee7a90 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.384+0000 7f138f834640 1 -- 172.21.15.99:0/2123638109 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1380029030 con 0x5647c8ee7a90 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.384+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.384+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.384+0000 7f1393b3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.384+0000 7f1393b3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647c8c83580 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56240/0 (socket says 172.21.15.99:56240) 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1390035640 1 -- 172.21.15.99:0/92264838 learned_addr learned my addr 172.21.15.99:0/92264838 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1390035640 1 -- 172.21.15.99:0/92264838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8ef9860 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1390035640 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5647c8edf550 tx=0x7f1388013720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f12757fa640 1 -- 172.21.15.99:0/92264838 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388018110 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f12757fa640 1 -- 172.21.15.99:0/92264838 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13880182b0 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647c8ef9af0 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f12757fa640 1 -- 172.21.15.99:0/92264838 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13880165d0 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.385+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c8d5b570 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.386+0000 7f12757fa640 1 -- 172.21.15.99:0/92264838 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1388011040 con 0x5647c8ef8f00 2024-09-13T23:25:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.386+0000 7f12757fa640 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 0x7f1268039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.386+0000 7f12757fa640 1 -- 172.21.15.99:0/92264838 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f138801e030 con 0x5647c8ef8f00 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.386+0000 7f138f834640 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 0x7f1268039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.386+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f138f834640 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 0x7f1268039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5647c8ee6040 tx=0x7f138004ad80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1393b3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1393b3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647c8ed6f00 con 0x5647c8f04b50 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56252/0 (socket says 172.21.15.99:56252) 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1390035640 1 -- 172.21.15.99:0/189428093 learned_addr learned my addr 172.21.15.99:0/189428093 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1390035640 1 -- 172.21.15.99:0/189428093 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8f05520 con 0x5647c8f04b50 2024-09-13T23:25:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f1390035640 1 --2- 172.21.15.99:0/189428093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f138804e5a0 tx=0x7f138804e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560e27f99e8d997d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f126effd640 1 -- 172.21.15.99:0/189428093 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138802c770 con 0x5647c8f04b50 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f126effd640 1 -- 172.21.15.99:0/189428093 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388022c60 con 0x5647c8f04b50 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.387+0000 7f126effd640 1 -- 172.21.15.99:0/189428093 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138802c910 con 0x5647c8f04b50 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- 172.21.15.99:0/189428093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 msgr2=0x5647c8f04f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 --2- 172.21.15.99:0/189428093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f138804e5a0 tx=0x7f138804e770 comp rx=0 tx=0).stop 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- 172.21.15.99:0/189428093 shutdown_connections 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 --2- 172.21.15.99:0/189428093 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f04f50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- 172.21.15.99:0/189428093 >> 172.21.15.99:0/189428093 conn(0x5647c8f00eb0 msgr2=0x5647c8efefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- 172.21.15.99:0/189428093 shutdown_connections 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- 172.21.15.99:0/189428093 wait complete. 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 Processor -- start 2024-09-13T23:25:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- start start 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.388+0000 7f1393b3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5647c8f05b90 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1390035640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56268/0 (socket says 172.21.15.99:56268) 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 learned_addr learned my addr 172.21.15.99:0/1429324769 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647c8f108e0 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1390035640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f103a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x5647c8effb20 tx=0x7f138804e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f126d7fa640 1 -- 172.21.15.99:0/1429324769 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388041030 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f126d7fa640 1 -- 172.21.15.99:0/1429324769 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1388032040 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f126d7fa640 1 -- 172.21.15.99:0/1429324769 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388016770 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647c8f10b70 con 0x5647c8f04b50 2024-09-13T23:25:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.389+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647c8f13820 con 0x5647c8f04b50 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.390+0000 7f126d7fa640 1 -- 172.21.15.99:0/1429324769 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1388021bf0 con 0x5647c8f04b50 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.390+0000 7f126d7fa640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1258036af0 0x7f1258038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.390+0000 7f126d7fa640 1 -- 172.21.15.99:0/1429324769 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1388041e00 con 0x5647c8f04b50 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.390+0000 7f138f834640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1258036af0 0x7f1258038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f138f834640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1258036af0 0x7f1258038fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1380016fd0 tx=0x7f1380037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8f1c090 0x5647c8f1e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f1eca0 con 0x5647c8f1c090 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1387033640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8f1c090 0x5647c8f1e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1387033640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8f1c090 0x5647c8f1e550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 20 realm 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.391+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f1f0d0 con 0x5647c8f1c090 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f1f9a0 con 0x5647c8f1c090 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f1fd40 con 0x5647c8f1c090 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8f20aa0 0x5647c8f22e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f233d0 con 0x5647c8f20aa0 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1390035640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8f20aa0 0x5647c8f22e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.392+0000 7f1390035640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8f20aa0 0x5647c8f22e90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f138800a4a0 con 0x5647c8f20aa0 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f1393b3e800 20 searching for the correct realm 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647c8f25450 0x5647c8f27910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f25450 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f138f834640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647c8f25450 0x5647c8f27910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f138f834640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647c8f25450 0x5647c8f27910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.393+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f20aa0 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1390035640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1388011c00 0x7f13880399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x7f1388011c00 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1387033640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1388011c00 0x7f13880399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1387033640 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1388011c00 0x7f13880399a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.394+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f1c090 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f1c090 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x7f1388011c00 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x7f1388011c00 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.395+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f20aa0 2024-09-13T23:25:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f25450 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f1c090 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.396+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x7f1388011c00 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f1c090 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f27fe0 con 0x5647c8f20aa0 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.397+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x7f1388011c00 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f1c090 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.398+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f1c090 2024-09-13T23:25:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x7f1388011c00 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.399+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f20aa0 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f1c090 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x7f1388011c00 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.400+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x7f1388011c00 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f20aa0 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f25450 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.401+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x7f1388011c00 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f1c090 2024-09-13T23:25:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f13880660a0 con 0x5647c8f20aa0 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f23e50 con 0x5647c8f1c090 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f23a60 con 0x5647c8f1c090 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.402+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f247c0 con 0x5647c8f20aa0 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 zone default found 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 4 Realm: () 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 zonegroup default 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f28910 con 0x7f1388011c00 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2a6c0 con 0x5647c8f25450 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.403+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2ab70 con 0x5647c8f25450 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.404+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.404+0000 7f1393b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.404+0000 7f1393b3e800 20 started sync module instance, tier type = 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.404+0000 7f1393b3e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.404+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f29b30 con 0x5647c8f20aa0 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.405+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.405+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94866314010672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f29b30 con 0x5647c8f20aa0 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.405+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2b680 con 0x5647c8f1c090 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.405+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94866314010672] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.406+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.406+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94866314015088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f29b30 con 0x5647c8f1c090 2024-09-13T23:25:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.406+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2c140 con 0x5647c8f25450 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.407+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94866314015088] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.407+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.407+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94866314017808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2c4e0 con 0x5647c8f25450 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.407+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2cfd0 con 0x5647c8f20aa0 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.408+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94866314017808] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.408+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.408+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94866314021536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2d3c0 con 0x5647c8f20aa0 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.408+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2dde0 con 0x5647c8f1c090 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.409+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94866314021536] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.409+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.409+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94866314025168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2dda0 con 0x5647c8f1c090 2024-09-13T23:25:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.409+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2e820 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.410+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.410+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94866314027888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2e790 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.411+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2f770 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.411+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94866314025168] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.412+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94866314027888] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.412+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.412+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94866314030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f29680 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.412+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2fbe0 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94866314030144] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94866314031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f2fbe0 con 0x7f1388011c00 2024-09-13T23:25:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=0 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=1 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=2 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=3 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=4 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=5 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.413+0000 7f1393b3e800 20 add_watcher() i=6 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94866314031712] v31'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1393b3e800 20 add_watcher() i=7 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1393b3e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f32fe0 con 0x5647c8f1c090 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.414+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94866314033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f30500 con 0x5647c8f1c090 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94866314033408] v31'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1393b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1393b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1393b3e800 5 note: GC not initialized 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1244fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1393b3e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.415+0000 7f1393b3e800 20 Filter name: none 2024-09-13T23:25:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f11be7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f662d0 con 0x5647c8f20aa0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.416+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f66c00 con 0x7f1388011c00 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f66c40 con 0x5647c8f20aa0 2024-09-13T23:25:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f683b0 con 0x7f1388011c00 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.417+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(65 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 4.e 4:7028012c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f679b0 con 0x5647c8f20aa0 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 4.c 4:33dc3341:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f6cef0 con 0x5647c8f1c090 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 4.3b 4:dce212c8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f6f880 con 0x5647c8f25450 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 4.12 4:4a62fc7a:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f6cef0 con 0x5647c8f1c090 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 4.25 4:a75b679e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f746d0 con 0x5647c8f25450 2024-09-13T23:25:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 4.17 4:eacd9cd7:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f77560 con 0x7f1388011c00 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f7a200 con 0x5647c8f1c090 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 4.c 4:3158085e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f7ce60 con 0x5647c8f1c090 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 4.22 4:440f5098:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f7fcd0 con 0x5647c8f1c090 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 4.d 4:b2317d3d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f82b40 con 0x5647c8f25450 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(67 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 4.3f 4:fd7bfd5e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f7ce60 con 0x5647c8f20aa0 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(70 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(75 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(69 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(74 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(73 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.418+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(72 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.419+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.419+0000 7f1245fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.419+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94866314033408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f82b40 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.420+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94866314033408] v31'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.420+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94866314010672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x5647c8f20aa0 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.421+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94866314010672] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.421+0000 7f1393b3e800 20 remove_watcher() i=0 2024-09-13T23:25:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.421+0000 7f1393b3e800 2 removed watcher, disabling cache 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.421+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94866314015088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x5647c8f1c090 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.422+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94866314015088] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.422+0000 7f1393b3e800 20 remove_watcher() i=1 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.422+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94866314017808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x5647c8f25450 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.424+0000 7f138f834640 1 -- 172.21.15.99:0/1429324769 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94866314017808] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1380043050 con 0x5647c8f25450 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.424+0000 7f1393b3e800 20 remove_watcher() i=2 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.424+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94866314021536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x5647c8f20aa0 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.425+0000 7f1390035640 1 -- 172.21.15.99:0/1429324769 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94866314021536] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1388060040 con 0x5647c8f20aa0 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.425+0000 7f1393b3e800 20 remove_watcher() i=3 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.425+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94866314025168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x5647c8f1c090 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.426+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94866314025168] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x5647c8f1c090 2024-09-13T23:25:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.426+0000 7f1393b3e800 20 remove_watcher() i=4 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.426+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94866314027888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94866314027888] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1393b3e800 20 remove_watcher() i=5 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94866314030144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94866314030144] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1393b3e800 20 remove_watcher() i=6 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.427+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94866314031712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5647c8f63d30 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.428+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94866314031712] v31'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1378051070 con 0x7f1388011c00 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.428+0000 7f1393b3e800 20 remove_watcher() i=7 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1388011c00 msgr2=0x7f13880399a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1388011c00 0x7f13880399a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8f1c090 msgr2=0x5647c8f1e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8f1c090 0x5647c8f1e550 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8f20aa0 msgr2=0x5647c8f22e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8f20aa0 0x5647c8f22e90 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647c8f25450 msgr2=0x5647c8f27910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5647c8f25450 0x5647c8f27910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1258036af0 msgr2=0x7f1258038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1258036af0 0x7f1258038fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1380016fd0 tx=0x7f1380037000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 msgr2=0x5647c8f103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/1429324769 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8f04b50 0x5647c8f103a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x5647c8effb20 tx=0x7f138804e500 comp rx=0 tx=0).stop 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 reap_dead start 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1387033640 1 -- 172.21.15.99:0/1429324769 reap_dead start 2024-09-13T23:25:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 shutdown_connections 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 >> 172.21.15.99:0/1429324769 conn(0x5647c8f00eb0 msgr2=0x5647c8efef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 shutdown_connections 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/1429324769 wait complete. 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 msgr2=0x7f1268039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 0x7f1268039000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x5647c8ee6040 tx=0x7f138004ad80 comp rx=0 tx=0).stop 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 msgr2=0x5647c8ef9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5647c8edf550 tx=0x7f1388013720 comp rx=0 tx=0).stop 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 shutdown_connections 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1268036b40 0x7f1268039000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/92264838 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8ef8f00 0x5647c8ef9320 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 >> 172.21.15.99:0/92264838 conn(0x5647c8eede90 msgr2=0x5647c8ef0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 shutdown_connections 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/92264838 wait complete. 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 msgr2=0x5647c8ee51c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.429+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 0x5647c8ee51c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 msgr2=0x5647c8ee9e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 0x5647c8ee9e80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 msgr2=0x7f1278039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 0x7f1278039050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1378057000 tx=0x7f1378052000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 msgr2=0x5647c8ede150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1380004000 tx=0x7f1380000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 shutdown_connections 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5647c8ee7a90 0x5647c8ee9e80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5647c8deb900 0x5647c8ee51c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1278036b90 0x7f1278039050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 --2- 172.21.15.99:0/2123638109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5647c8de74c0 0x5647c8ede150 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 >> 172.21.15.99:0/2123638109 conn(0x5647c8de2df0 msgr2=0x5647c8ed0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 shutdown_connections 2024-09-13T23:25:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.430+0000 7f1393b3e800 1 -- 172.21.15.99:0/2123638109 wait complete. 2024-09-13T23:25:35.448 INFO:teuthology.orchestra.run.smithi099.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"30ca56dc-5661-43d6-a109-42ef24013139","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:25:34.896252Z","creation_time":"2024-09-13T23:25:34.891317Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:25:35.448 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:25:34.896252Z', 'creation_time': '2024-09-13T23:25:34.891317Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:25:35.448 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:25:35.448 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T23:25:35.449 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T23:25:35.493 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.493 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.492+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.492+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.492+0000 7f92d980e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55703e0fc4c0 0x55703e0fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.492+0000 7f92d980e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55703dfbcb30 con 0x55703e0fce00 2024-09-13T23:25:35.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.492+0000 7f92d980e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55703df9e360 con 0x55703e0fc4c0 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92d4f0c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55703e0fc4c0 0x55703e0fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92cc70b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55703e0fce00 0x55703e101980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41902/0 (socket says 172.21.15.99:41902) 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92d4f0c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55703e0fc4c0 0x55703e0fc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56278/0 (socket says 172.21.15.99:56278) 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92cc70b640 1 -- 172.21.15.99:0/1424209061 learned_addr learned my addr 172.21.15.99:0/1424209061 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92d4f0c640 1 -- 172.21.15.99:0/1424209061 >> v1:172.21.15.43:6789/0 conn(0x55703e0fce00 legacy=0x55703e101980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.493+0000 7f92d4f0c640 1 -- 172.21.15.99:0/1424209061 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703dfc4e00 con 0x55703e0fc4c0 2024-09-13T23:25:35.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/1424209061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e0fc8c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f92c400a470 tx=0x7f92c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e50e6fe89be4c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92cffff640 1 -- 172.21.15.99:0/1424209061 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4053570 con 0x55703e0fc4c0 2024-09-13T23:25:35.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92cffff640 1 -- 172.21.15.99:0/1424209061 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c4058070 con 0x55703e0fc4c0 2024-09-13T23:25:35.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92cffff640 1 -- 172.21.15.99:0/1424209061 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4053880 con 0x55703e0fc4c0 2024-09-13T23:25:35.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d980e800 1 -- 172.21.15.99:0/1424209061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 msgr2=0x55703e0fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d980e800 1 --2- 172.21.15.99:0/1424209061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e0fc8c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f92c400a470 tx=0x7f92c4045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:35.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d980e800 1 -- 172.21.15.99:0/1424209061 shutdown_connections 2024-09-13T23:25:35.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d980e800 1 --2- 172.21.15.99:0/1424209061 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e0fc8c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.495+0000 7f92d980e800 1 -- 172.21.15.99:0/1424209061 >> 172.21.15.99:0/1424209061 conn(0x55703e0f7df0 msgr2=0x55703e0fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.496+0000 7f92d980e800 1 -- 172.21.15.99:0/1424209061 shutdown_connections 2024-09-13T23:25:35.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.496+0000 7f92d980e800 1 -- 172.21.15.99:0/1424209061 wait complete. 2024-09-13T23:25:35.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.509+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.509+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d980e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d980e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55703e049330 con 0x55703e0fc4c0 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d4f0c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d4f0c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56284/0 (socket says 172.21.15.99:56284) 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d4f0c640 1 -- 172.21.15.99:0/2358650413 learned_addr learned my addr 172.21.15.99:0/2358650413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d4f0c640 1 -- 172.21.15.99:0/2358650413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703df96bc0 con 0x55703e0fc4c0 2024-09-13T23:25:35.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/2358650413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f92c4025c20 tx=0x7f92c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89cd5fbfed5f4665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.510+0000 7f91c2e0d640 1 -- 172.21.15.99:0/2358650413 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4053ba0 con 0x55703e0fc4c0 2024-09-13T23:25:35.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f91c2e0d640 1 -- 172.21.15.99:0/2358650413 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c4063030 con 0x55703e0fc4c0 2024-09-13T23:25:35.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f91c2e0d640 1 -- 172.21.15.99:0/2358650413 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4053440 con 0x55703e0fc4c0 2024-09-13T23:25:35.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 -- 172.21.15.99:0/2358650413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 msgr2=0x55703e1ea670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 --2- 172.21.15.99:0/2358650413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f92c4025c20 tx=0x7f92c4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 -- 172.21.15.99:0/2358650413 shutdown_connections 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 --2- 172.21.15.99:0/2358650413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1ea670 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 -- 172.21.15.99:0/2358650413 >> 172.21.15.99:0/2358650413 conn(0x55703e0f7df0 msgr2=0x55703e1e6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 -- 172.21.15.99:0/2358650413 shutdown_connections 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.511+0000 7f92d980e800 1 -- 172.21.15.99:0/2358650413 wait complete. 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d980e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d980e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55703e1034e0 con 0x55703e0fc4c0 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d4f0c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d4f0c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56286/0 (socket says 172.21.15.99:56286) 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d4f0c640 1 -- 172.21.15.99:0/3756169116 learned_addr learned my addr 172.21.15.99:0/3756169116 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.512+0000 7f92d4f0c640 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703dfaafe0 con 0x55703e0fc4c0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55703e1eb4d0 tx=0x7f92c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f91c160a640 1 -- 172.21.15.99:0/3756169116 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4078070 con 0x55703e0fc4c0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f91c160a640 1 -- 172.21.15.99:0/3756169116 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c4053570 con 0x55703e0fc4c0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703e1f6900 con 0x55703e0fc4c0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f91c160a640 1 -- 172.21.15.99:0/3756169116 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92c4053850 con 0x55703e0fc4c0 2024-09-13T23:25:35.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703e1f6e80 con 0x55703e0fc4c0 2024-09-13T23:25:35.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.513+0000 7f91c160a640 1 -- 172.21.15.99:0/3756169116 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f92c407b070 con 0x55703e0fc4c0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f91c160a640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 0x7f91bc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f91c160a640 1 -- 172.21.15.99:0/3756169116 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f92c4070070 con 0x55703e0fc4c0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92cc70b640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 0x7f91bc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 0x55703e1fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e1fda80 con 0x55703e0fce00 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d570d640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 0x55703e1fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92cc70b640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 0x7f91bc039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92bc000f60 tx=0x7f92bc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d570d640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 0x55703e1fd430 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d570d640 1 -- 172.21.15.99:0/3756169116 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92d000a4a0 con 0x55703e0fce00 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.514+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e1faa00 con 0x55703e0fce00 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d570d640 1 -- 172.21.15.99:0/3756169116 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92d000a4a0 con 0x55703e0fce00 2024-09-13T23:25:35.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 0x55703e2021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e2028c0 con 0x55703e1ffde0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 0x55703e2021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 0x55703e2021d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d4f0c640 1 -- 172.21.15.99:0/3756169116 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f92c407a030 con 0x55703e1ffde0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.515+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e1febc0 con 0x55703e0fce00 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d570d640 1 -- 172.21.15.99:0/3756169116 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92d000a4a0 con 0x55703e0fce00 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e1ff0a0 con 0x55703e1ffde0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d4f0c640 1 -- 172.21.15.99:0/3756169116 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f92c407a030 con 0x55703e1ffde0 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d980e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.516+0000 7f92d980e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55703df98580 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56288/0 (socket says 172.21.15.99:56288) 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d570d640 1 -- 172.21.15.99:0/3919105864 learned_addr learned my addr 172.21.15.99:0/3919105864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d570d640 1 -- 172.21.15.99:0/3919105864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703e211a80 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d570d640 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55703e1fde40 tx=0x7f92d00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f91ba7fc640 1 -- 172.21.15.99:0/3919105864 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0013450 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f91ba7fc640 1 -- 172.21.15.99:0/3919105864 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d00135f0 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703e211d10 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f91ba7fc640 1 -- 172.21.15.99:0/3919105864 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d00138d0 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.517+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703e2149f0 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.518+0000 7f91ba7fc640 1 -- 172.21.15.99:0/3919105864 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f92d0011040 con 0x55703e211120 2024-09-13T23:25:35.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.518+0000 7f91ba7fc640 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 0x7f91ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.518+0000 7f91ba7fc640 1 -- 172.21.15.99:0/3919105864 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f92d000e040 con 0x55703e211120 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.518+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 0x7f91ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 0x7f91ac039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55703e1fe390 tx=0x7f92c408ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d980e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d980e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55703e1eadc0 con 0x55703e21de70 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56294/0 (socket says 172.21.15.99:56294) 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d570d640 1 -- 172.21.15.99:0/1755241698 learned_addr learned my addr 172.21.15.99:0/1755241698 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.519+0000 7f92d570d640 1 -- 172.21.15.99:0/1755241698 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703e21e840 con 0x55703e21de70 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d570d640 1 --2- 172.21.15.99:0/1755241698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f92d004cdd0 tx=0x7f92d0029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e484089f9e97d924 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f91abfff640 1 -- 172.21.15.99:0/1755241698 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d004a020 con 0x55703e21de70 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f91abfff640 1 -- 172.21.15.99:0/1755241698 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d002a440 con 0x55703e21de70 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f91abfff640 1 -- 172.21.15.99:0/1755241698 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d001f390 con 0x55703e21de70 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 -- 172.21.15.99:0/1755241698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 msgr2=0x55703e21e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 --2- 172.21.15.99:0/1755241698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f92d004cdd0 tx=0x7f92d0029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 -- 172.21.15.99:0/1755241698 shutdown_connections 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 --2- 172.21.15.99:0/1755241698 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e21e270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 -- 172.21.15.99:0/1755241698 >> 172.21.15.99:0/1755241698 conn(0x55703e21a1d0 msgr2=0x55703e2182d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 -- 172.21.15.99:0/1755241698 shutdown_connections 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.520+0000 7f92d980e800 1 -- 172.21.15.99:0/1755241698 wait complete. 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d980e800 1 Processor -- start 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d980e800 1 -- start start 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d980e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e2252b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d980e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55703e21eeb0 con 0x55703e21de70 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e2252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d570d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e2252b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56304/0 (socket says 172.21.15.99:56304) 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 learned_addr learned my addr 172.21.15.99:0/983998387 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703e2257f0 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d570d640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e2252b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f92d0048000 tx=0x7f92d004cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f91aa7fc640 1 -- 172.21.15.99:0/983998387 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d0038070 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f91aa7fc640 1 -- 172.21.15.99:0/983998387 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92d0020c00 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.521+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55703e225a80 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.522+0000 7f91aa7fc640 1 -- 172.21.15.99:0/983998387 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f92d001f710 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.522+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703e228730 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.522+0000 7f91aa7fc640 1 -- 172.21.15.99:0/983998387 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f92d001f8b0 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.522+0000 7f91aa7fc640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91a0036b40 0x7f91a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.522+0000 7f91aa7fc640 1 -- 172.21.15.99:0/983998387 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f92d003eb10 con 0x55703e21de70 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91a0036b40 0x7f91a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91a0036b40 0x7f91a0039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92c405ffd0 tx=0x7f92c4092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e230d80 0x55703e233240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e233990 con 0x55703e230d80 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92cc70b640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e230d80 0x55703e233240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.523+0000 7f92cc70b640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e230d80 0x55703e233240 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92bc009050 con 0x55703e230d80 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 realm 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e2301d0 con 0x55703e230d80 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92bc009050 con 0x55703e230d80 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e234470 con 0x55703e230d80 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92bc009050 con 0x55703e230d80 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e234d40 con 0x55703e230d80 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f92bc009050 con 0x55703e230d80 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e2355f0 0x55703e2379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e238120 con 0x55703e2355f0 2024-09-13T23:25:35.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.524+0000 7f92d570d640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e2355f0 0x55703e2379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d570d640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e2355f0 0x55703e2379e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d980e800 20 searching for the correct realm 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55703e23a1d0 0x55703e23c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55703e23a1d0 0x55703e23c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d4f0c640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55703e23a1d0 0x55703e23c690 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.525+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.526+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.526+0000 7f92d570d640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f92d0013070 0x7f92d0040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.526+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.526+0000 7f92cc70b640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f92d0013070 0x7f92d0040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.526+0000 7f92cc70b640 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f92d0013070 0x7f92d0040660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc009050 con 0x7f92d0013070 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc009050 con 0x55703e230d80 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.527+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.528+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.529+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.530+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.531+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.532+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e23a1d0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x7f92d0013070 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e230d80 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.533+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55703e23cd60 con 0x55703e2355f0 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e238bd0 con 0x55703e230d80 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e2387e0 con 0x55703e230d80 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e239540 con 0x55703e2355f0 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 zone default found 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 4 Realm: () 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 zonegroup default 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.534+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e23d690 con 0x7f92d0013070 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e23f4a0 con 0x55703e23a1d0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e23f8f0 con 0x55703e23a1d0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 started sync module instance, tier type = 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.535+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e23e8b0 con 0x55703e2355f0 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.536+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.536+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93940567240112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e23e8b0 con 0x55703e2355f0 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.536+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e240470 con 0x55703e230d80 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.537+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93940567240112] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.538+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.538+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93940567244608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e23e8b0 con 0x55703e230d80 2024-09-13T23:25:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.538+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e240f20 con 0x55703e23a1d0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.539+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93940567244608] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.539+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.539+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93940567237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e23e820 con 0x55703e23a1d0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.539+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e241de0 con 0x55703e2355f0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.540+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.540+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93940567237632] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.540+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93940567251760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e2421d0 con 0x55703e2355f0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.540+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e242c00 con 0x55703e230d80 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.541+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93940567251760] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.541+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.541+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93940567249680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e242bc0 con 0x55703e230d80 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.541+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e243680 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.542+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93940567249680] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.542+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.542+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93940567257488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e242bc0 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.542+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e2440c0 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.543+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.543+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93940567260176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e2444e0 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.543+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e245000 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.543+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93940567257488] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93940567263952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e244fc0 con 0x7f92d0013070 2024-09-13T23:25:35.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=0 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=1 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=2 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=3 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=4 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=5 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93940567260176] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.544+0000 7f92d980e800 20 add_watcher() i=6 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93940567263952] v31'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92d980e800 20 add_watcher() i=7 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92d980e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e244030 con 0x55703e230d80 2024-09-13T23:25:35.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.545+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93940567254800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e244030 con 0x55703e230d80 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.546+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93940567254800] v31'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f918afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 5 note: GC not initialized 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f9189fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 Filter name: none 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f90fb7fe640 20 reqs_thread_entry: start 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27af60 con 0x55703e230d80 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.547+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27b950 con 0x55703e230d80 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27c960 con 0x55703e2355f0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27a0b0 con 0x55703e2355f0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.548+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27c650 con 0x7f92d0013070 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 4.e 4:7028012c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e27bac0 con 0x55703e2355f0 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 4.c 4:33dc3341:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e281200 con 0x55703e230d80 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 4.3b 4:dce212c8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e283ab0 con 0x55703e23a1d0 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 4.12 4:4a62fc7a:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e286410 con 0x55703e230d80 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 4.25 4:a75b679e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e288d50 con 0x55703e23a1d0 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 4.17 4:eacd9cd7:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e28bc10 con 0x7f92d0013070 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e28e620 con 0x55703e230d80 2024-09-13T23:25:35.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 4.c 4:3158085e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e2914a0 con 0x55703e230d80 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 4.22 4:440f5098:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e294360 con 0x55703e230d80 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:76 4.d 4:b2317d3d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e2971d0 con 0x55703e23a1d0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:77 4.3f 4:fd7bfd5e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55703e29a040 con 0x55703e2355f0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.549+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(67 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(71 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(76 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(77 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(70 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(74 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(73 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(75 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.550+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.551+0000 7f918afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.551+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93940567254800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e2971d0 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.552+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93940567254800] v31'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.552+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93940567240112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x55703e2355f0 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.553+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93940567240112] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.553+0000 7f92d980e800 20 remove_watcher() i=0 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.553+0000 7f92d980e800 2 removed watcher, disabling cache 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.553+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93940567244608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.554+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93940567244608] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.554+0000 7f92d980e800 20 remove_watcher() i=1 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.554+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93940567237632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x55703e23a1d0 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.555+0000 7f92d4f0c640 1 -- 172.21.15.99:0/983998387 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93940567237632] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92c407a030 con 0x55703e23a1d0 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.555+0000 7f92d980e800 20 remove_watcher() i=2 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.555+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93940567251760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x55703e2355f0 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.556+0000 7f92d570d640 1 -- 172.21.15.99:0/983998387 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93940567251760] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92d0027020 con 0x55703e2355f0 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.556+0000 7f92d980e800 20 remove_watcher() i=3 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.556+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93940567249680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x55703e230d80 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.557+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93940567249680] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x55703e230d80 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.557+0000 7f92d980e800 20 remove_watcher() i=4 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.557+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93940567257488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x7f92d0013070 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.558+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93940567257488] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.558+0000 7f92d980e800 20 remove_watcher() i=5 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.558+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93940567260176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x7f92d0013070 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.559+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93940567260176] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.559+0000 7f92d980e800 20 remove_watcher() i=6 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.559+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93940567263952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55703e278d30 con 0x7f92d0013070 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93940567263952] v31'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f92bc029040 con 0x7f92d0013070 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 20 remove_watcher() i=7 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f92d0013070 msgr2=0x7f92d0040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f92d0013070 0x7f92d0040660 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e230d80 msgr2=0x55703e233240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e230d80 0x55703e233240 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e2355f0 msgr2=0x55703e2379e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e2355f0 0x55703e2379e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55703e23a1d0 msgr2=0x55703e23c690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55703e23a1d0 0x55703e23c690 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91a0036b40 msgr2=0x7f91a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91a0036b40 0x7f91a0039000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92c405ffd0 tx=0x7f92c4092000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 msgr2=0x55703e2252b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 --2- 172.21.15.99:0/983998387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e21de70 0x55703e2252b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f92d0048000 tx=0x7f92d004cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92cc70b640 1 -- 172.21.15.99:0/983998387 reap_dead start 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 shutdown_connections 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 >> 172.21.15.99:0/983998387 conn(0x55703e21a1d0 msgr2=0x55703e2182a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 shutdown_connections 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.560+0000 7f92d980e800 1 -- 172.21.15.99:0/983998387 wait complete. 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 msgr2=0x7f91ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 0x7f91ac039000 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55703e1fe390 tx=0x7f92c408ec10 comp rx=0 tx=0).stop 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 msgr2=0x55703e211540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55703e1fde40 tx=0x7f92d00163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 shutdown_connections 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91ac036b40 0x7f91ac039000 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3919105864 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e211120 0x55703e211540 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 >> 172.21.15.99:0/3919105864 conn(0x55703e2060b0 msgr2=0x55703e208c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 shutdown_connections 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3919105864 wait complete. 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 msgr2=0x55703e1fd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 0x55703e1fd430 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 msgr2=0x55703e2021d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 0x55703e2021d0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 msgr2=0x7f91bc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 0x7f91bc039000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f92bc000f60 tx=0x7f92bc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 msgr2=0x55703e1f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55703e1eb4d0 tx=0x7f92c4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 shutdown_connections 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55703e1ffde0 0x55703e2021d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55703e0fce00 0x55703e1fd430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f91bc036b40 0x7f91bc039000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 --2- 172.21.15.99:0/3756169116 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55703e0fc4c0 0x55703e1f63c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 >> 172.21.15.99:0/3756169116 conn(0x55703e0f7df0 msgr2=0x55703e1e48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 shutdown_connections 2024-09-13T23:25:35.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.561+0000 7f92d980e800 1 -- 172.21.15.99:0/3756169116 wait complete. 2024-09-13T23:25:35.579 INFO:teuthology.orchestra.run.smithi099.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"30ca56dc-5661-43d6-a109-42ef24013139","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:25:34.896252Z","creation_time":"2024-09-13T23:25:34.891317Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T23:25:35.580 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:25:34.896252Z', 'creation_time': '2024-09-13T23:25:34.891317Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:25:35.586 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:25:35.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:35.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:35.586 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:25:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.664+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.664+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.664+0000 7fb127f30800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bf851c4db0 0x55bf851c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.664+0000 7fb127f30800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bf8507db30 con 0x55bf851325f0 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.664+0000 7fb127f30800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55bf8505f360 con 0x55bf851c4db0 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.665+0000 7fb123462640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bf851c4db0 0x55bf851c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.665+0000 7fb123c63640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55bf851325f0 0x55bf851c3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41916/0 (socket says 172.21.15.99:41916) 2024-09-13T23:25:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.665+0000 7fb123c63640 1 -- 172.21.15.99:0/1905118621 learned_addr learned my addr 172.21.15.99:0/1905118621 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.665+0000 7fb123462640 1 -- 172.21.15.99:0/1905118621 >> v1:172.21.15.43:6789/0 conn(0x55bf851325f0 legacy=0x55bf851c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.665+0000 7fb123462640 1 -- 172.21.15.99:0/1905118621 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf85085e00 con 0x55bf851c4db0 2024-09-13T23:25:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb123462640 1 --2- 172.21.15.99:0/1905118621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851c4db0 0x55bf851c71a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb11800a470 tx=0x7fb118045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e40be77c083eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb122c61640 1 -- 172.21.15.99:0/1905118621 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb118053570 con 0x55bf851c4db0 2024-09-13T23:25:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb122c61640 1 -- 172.21.15.99:0/1905118621 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb118058070 con 0x55bf851c4db0 2024-09-13T23:25:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb122c61640 1 -- 172.21.15.99:0/1905118621 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb118053880 con 0x55bf851c4db0 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 -- 172.21.15.99:0/1905118621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851c4db0 msgr2=0x55bf851c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 --2- 172.21.15.99:0/1905118621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851c4db0 0x55bf851c71a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb11800a470 tx=0x7fb118045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 -- 172.21.15.99:0/1905118621 shutdown_connections 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 --2- 172.21.15.99:0/1905118621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851c4db0 0x55bf851c71a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 -- 172.21.15.99:0/1905118621 >> 172.21.15.99:0/1905118621 conn(0x55bf851b8de0 msgr2=0x55bf851bb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 -- 172.21.15.99:0/1905118621 shutdown_connections 2024-09-13T23:25:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.667+0000 7fb127f30800 1 -- 172.21.15.99:0/1905118621 wait complete. 2024-09-13T23:25:35.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.681+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.681+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.681+0000 7fb127f30800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.681+0000 7fb127f30800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf8510a330 con 0x55bf851325f0 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb123c63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb123c63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56318/0 (socket says 172.21.15.99:56318) 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb123c63640 1 -- 172.21.15.99:0/4075000307 learned_addr learned my addr 172.21.15.99:0/4075000307 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb123c63640 1 -- 172.21.15.99:0/4075000307 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf85057bc0 con 0x55bf851325f0 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb123c63640 1 --2- 172.21.15.99:0/4075000307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb1140017a0 tx=0x7fb114001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497203d212eae2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb011e0b640 1 -- 172.21.15.99:0/4075000307 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114016070 con 0x55bf851325f0 2024-09-13T23:25:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb011e0b640 1 -- 172.21.15.99:0/4075000307 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb114004520 con 0x55bf851325f0 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.682+0000 7fb011e0b640 1 -- 172.21.15.99:0/4075000307 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114004820 con 0x55bf851325f0 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- 172.21.15.99:0/4075000307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 msgr2=0x55bf852afa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 --2- 172.21.15.99:0/4075000307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb1140017a0 tx=0x7fb114001c60 comp rx=0 tx=0).stop 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- 172.21.15.99:0/4075000307 shutdown_connections 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 --2- 172.21.15.99:0/4075000307 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852afa80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- 172.21.15.99:0/4075000307 >> 172.21.15.99:0/4075000307 conn(0x55bf851b8de0 msgr2=0x55bf852ab440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- 172.21.15.99:0/4075000307 shutdown_connections 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- 172.21.15.99:0/4075000307 wait complete. 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.683+0000 7fb127f30800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf851c7980 con 0x55bf851325f0 2024-09-13T23:25:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb123c63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb123c63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56330/0 (socket says 172.21.15.99:56330) 2024-09-13T23:25:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb123c63640 1 -- 172.21.15.99:0/3492575191 learned_addr learned my addr 172.21.15.99:0/3492575191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb123c63640 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf8506bfe0 con 0x55bf851325f0 2024-09-13T23:25:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb123c63640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb114014040 tx=0x7fb114001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb00bfff640 1 -- 172.21.15.99:0/3492575191 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114020070 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb00bfff640 1 -- 172.21.15.99:0/3492575191 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb114011550 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb00bfff640 1 -- 172.21.15.99:0/3492575191 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb114016040 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf852b79c0 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.684+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf852b7f40 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb00bfff640 1 -- 172.21.15.99:0/3492575191 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb114023070 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb00bfff640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 0x7fb00c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb00bfff640 1 -- 172.21.15.99:0/3492575191 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb11404be10 con 0x55bf851325f0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb123462640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 0x7fb00c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 0x55bf852be4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852beac0 con 0x55bf851c4db0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.685+0000 7fb124464640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 0x55bf852be4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb123462640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 0x7fb00c039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb118057000 tx=0x7fb118052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb124464640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 0x55bf852be4f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb124464640 1 -- 172.21.15.99:0/3492575191 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb11c0083e0 con 0x55bf851c4db0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852bba80 con 0x55bf851c4db0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb124464640 1 -- 172.21.15.99:0/3492575191 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb11c0083e0 con 0x55bf851c4db0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 0x55bf852c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852c38b0 con 0x55bf852c0df0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.686+0000 7fb123c63640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 0x55bf852c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.687+0000 7fb123c63640 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 0x55bf852c31e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.687+0000 7fb123c63640 1 -- 172.21.15.99:0/3492575191 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb11402c070 con 0x55bf852c0df0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.687+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852bfc90 con 0x55bf851c4db0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.687+0000 7fb124464640 1 -- 172.21.15.99:0/3492575191 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb11c0083e0 con 0x55bf851c4db0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.687+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852c0130 con 0x55bf852c0df0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb123c63640 1 -- 172.21.15.99:0/3492575191 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb11402c070 con 0x55bf852c0df0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb127f30800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb127f30800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf85059580 con 0x55bf852d2210 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56338/0 (socket says 172.21.15.99:56338) 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb124464640 1 -- 172.21.15.99:0/2093203999 learned_addr learned my addr 172.21.15.99:0/2093203999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.688+0000 7fb124464640 1 -- 172.21.15.99:0/2093203999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf852d2b70 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb124464640 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55bf852b8530 tx=0x7fb11c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb0097fa640 1 -- 172.21.15.99:0/2093203999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c01c020 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb0097fa640 1 -- 172.21.15.99:0/2093203999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c007cf0 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf852d2e00 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb0097fa640 1 -- 172.21.15.99:0/2093203999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c018440 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.689+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf852d5ae0 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb0097fa640 1 -- 172.21.15.99:0/2093203999 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb11c01f020 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb0097fa640 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 0x7faffc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb0097fa640 1 -- 172.21.15.99:0/2093203999 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb11c04e150 con 0x55bf852d2210 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb123c63640 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 0x7faffc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb123c63640 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 0x7faffc039000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55bf852bf3a0 tx=0x7fb11401cf50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb127f30800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb127f30800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf852b0230 con 0x55bf852deee0 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.690+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56346/0 (socket says 172.21.15.99:56346) 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb124464640 1 -- 172.21.15.99:0/1230758022 learned_addr learned my addr 172.21.15.99:0/1230758022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb124464640 1 -- 172.21.15.99:0/1230758022 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf852df8b0 con 0x55bf852deee0 2024-09-13T23:25:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb124464640 1 --2- 172.21.15.99:0/1230758022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb11c04c630 tx=0x7fb11c04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb7750783ee6e97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb002ffd640 1 -- 172.21.15.99:0/1230758022 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c021400 con 0x55bf852deee0 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb002ffd640 1 -- 172.21.15.99:0/1230758022 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c018b50 con 0x55bf852deee0 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb002ffd640 1 -- 172.21.15.99:0/1230758022 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c0215a0 con 0x55bf852deee0 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb127f30800 1 -- 172.21.15.99:0/1230758022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 msgr2=0x55bf852df2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.691+0000 7fb127f30800 1 --2- 172.21.15.99:0/1230758022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb11c04c630 tx=0x7fb11c04c8e0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- 172.21.15.99:0/1230758022 shutdown_connections 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 --2- 172.21.15.99:0/1230758022 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852df2e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- 172.21.15.99:0/1230758022 >> 172.21.15.99:0/1230758022 conn(0x55bf852db240 msgr2=0x55bf852d9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- 172.21.15.99:0/1230758022 shutdown_connections 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- 172.21.15.99:0/1230758022 wait complete. 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 Processor -- start 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- start start 2024-09-13T23:25:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb127f30800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf852dfe30 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb124464640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56358/0 (socket says 172.21.15.99:56358) 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 learned_addr learned my addr 172.21.15.99:0/2151405977 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.692+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf852e6830 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb124464640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb11c04b550 tx=0x7fb11c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb0017fa640 1 -- 172.21.15.99:0/2151405977 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c04b290 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb0017fa640 1 -- 172.21.15.99:0/2151405977 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c016d60 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf852e6ac0 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb0017fa640 1 -- 172.21.15.99:0/2151405977 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb11c020bc0 con 0x55bf852deee0 2024-09-13T23:25:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.693+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf852e6ac0 con 0x55bf852deee0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb0017fa640 1 -- 172.21.15.99:0/2151405977 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb11c03e060 con 0x55bf852deee0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb0017fa640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fafec036ce0 0x7fafec0391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb0017fa640 1 -- 172.21.15.99:0/2151405977 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fb11c04fb20 con 0x55bf852deee0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb123c63640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fafec036ce0 0x7fafec0391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf852f1c20 0x55bf852f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f4830 con 0x55bf852f1c20 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb123462640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf852f1c20 0x55bf852f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.694+0000 7fb123c63640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fafec036ce0 0x7fafec0391a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1140403f0 tx=0x7fb114034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb123462640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf852f1c20 0x55bf852f40e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 realm 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f4c60 con 0x55bf852f1c20 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f5530 con 0x55bf852f1c20 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f58d0 con 0x55bf852f1c20 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.695+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852f6630 0x55bf852f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f8f60 con 0x55bf852f6630 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb124464640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852f6630 0x55bf852f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb124464640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852f6630 0x55bf852f8a20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb11c057040 con 0x55bf852f6630 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb127f30800 20 searching for the correct realm 2024-09-13T23:25:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf852fafa0 0x55bf852fd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.696+0000 7fb123c63640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf852fafa0 0x55bf852fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb123c63640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf852fafa0 0x55bf852fd460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11c057040 con 0x55bf852f6630 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb124464640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb11c021020 0x7fb11c019070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.697+0000 7fb123462640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb11c021020 0x7fb11c019070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.698+0000 7fb123462640 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb11c021020 0x7fb11c019070 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.698+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.698+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.698+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.698+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb11c057040 con 0x55bf852f6630 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.699+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb11c057040 con 0x55bf852f6630 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.700+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.701+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.702+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11c057040 con 0x55bf852f6630 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.703+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852fafa0 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.704+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x7fb11c021020 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f1c20 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fdb30 con 0x55bf852f6630 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f99a0 con 0x55bf852f1c20 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.705+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852f95b0 con 0x55bf852f1c20 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fa310 con 0x55bf852f6630 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 zone default found 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 4 Realm: () 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 zonegroup default 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fe460 con 0x7fb11c021020 2024-09-13T23:25:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf852fe070 con 0x55bf852fafa0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.706+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf85300760 con 0x55bf852fafa0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.707+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.707+0000 7fb127f30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.707+0000 7fb127f30800 20 started sync module instance, tier type = 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.707+0000 7fb127f30800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.707+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf852ffb20 con 0x55bf852f6630 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.708+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.708+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94281061630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf852ffb20 con 0x55bf852f6630 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.708+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85301260 con 0x55bf852f1c20 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.709+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94281061630064] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.709+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.709+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94281061633328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf852ffb20 con 0x55bf852f1c20 2024-09-13T23:25:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.709+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85301cf0 con 0x55bf852fafa0 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.710+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94281061633328] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.710+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.710+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94281061627504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf852ffa90 con 0x55bf852fafa0 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.710+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85302bb0 con 0x55bf852f6630 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.711+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.711+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94281061640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85303350 con 0x55bf852f6630 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.711+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85303e70 con 0x55bf852f1c20 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.711+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94281061627504] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.712+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.712+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94281061644608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85303e30 con 0x55bf852f1c20 2024-09-13T23:25:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.712+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf853048c0 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.712+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94281061640416] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.713+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94281061644608] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.713+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.713+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94281061638368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf853048c0 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.713+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85305160 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.714+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94281061638368] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.714+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.714+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94281061647312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf853048c0 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.714+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85305780 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94281061647312] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94281061649056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85305780 con 0x7fb11c021020 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=0 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=1 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=2 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=3 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=4 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=5 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.715+0000 7fb127f30800 20 add_watcher() i=6 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94281061649056] v31'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb127f30800 20 add_watcher() i=7 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb127f30800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf85308a90 con 0x55bf852f1c20 2024-09-13T23:25:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.716+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94281061651520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf85305d10 con 0x55bf852f1c20 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.717+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94281061651520] v31'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.717+0000 7fafd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 5 note: GC not initialized 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fafd8fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 Filter name: none 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7faf527fc640 20 reqs_thread_entry: start 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8533be00 con 0x55bf852f6630 2024-09-13T23:25:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.718+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8533c730 con 0x7fb11c021020 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8533c770 con 0x55bf852f6630 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.719+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8533dee0 con 0x7fb11c021020 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(65 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 4.e 4:7028012c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8533d4f0 con 0x55bf852f6630 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 4.c 4:33dc3341:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf85342a50 con 0x55bf852f1c20 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 4.3b 4:dce212c8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf853452c0 con 0x55bf852fafa0 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 4.12 4:4a62fc7a:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf85347b30 con 0x55bf852f1c20 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 4.25 4:a75b679e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534a3a0 con 0x55bf852fafa0 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 4.17 4:eacd9cd7:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534cc90 con 0x7fb11c021020 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f1c20 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 4.c 4:3158085e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf853529c0 con 0x55bf852f1c20 2024-09-13T23:25:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 4.22 4:440f5098:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf85355880 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 4.d 4:b2317d3d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf853586f0 con 0x55bf852fafa0 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 4.3f 4:fd7bfd5e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55bf8535b130 con 0x55bf852f6630 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(67 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(70 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.720+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(69 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(72 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(75 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(73 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(74 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.721+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.722+0000 7fafd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.722+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94281061651520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f1c20 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.723+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94281061651520] v31'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.723+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94281061630064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f6630 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.724+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94281061630064] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.724+0000 7fb127f30800 20 remove_watcher() i=0 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.724+0000 7fb127f30800 2 removed watcher, disabling cache 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.724+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94281061633328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f1c20 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.725+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94281061633328] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.725+0000 7fb127f30800 20 remove_watcher() i=1 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.725+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94281061627504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852fafa0 2024-09-13T23:25:35.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.726+0000 7fb123c63640 1 -- 172.21.15.99:0/2151405977 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94281061627504] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11404f070 con 0x55bf852fafa0 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.726+0000 7fb127f30800 20 remove_watcher() i=2 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.726+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94281061640416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f6630 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.727+0000 7fb124464640 1 -- 172.21.15.99:0/2151405977 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94281061640416] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb11c062040 con 0x55bf852f6630 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.727+0000 7fb127f30800 20 remove_watcher() i=3 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.727+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94281061644608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x55bf852f1c20 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.728+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94281061644608] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x55bf852f1c20 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.728+0000 7fb127f30800 20 remove_watcher() i=4 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.728+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94281061638368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x7fb11c021020 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.729+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94281061638368] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.729+0000 7fb127f30800 20 remove_watcher() i=5 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.729+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94281061647312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x7fb11c021020 2024-09-13T23:25:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.730+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94281061647312] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.730+0000 7fb127f30800 20 remove_watcher() i=6 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.730+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94281061649056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55bf8534fb90 con 0x7fb11c021020 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94281061649056] v31'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb118051070 con 0x7fb11c021020 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 20 remove_watcher() i=7 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb11c021020 msgr2=0x7fb11c019070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb11c021020 0x7fb11c019070 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf852f1c20 msgr2=0x55bf852f40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf852f1c20 0x55bf852f40e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852f6630 msgr2=0x55bf852f8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852f6630 0x55bf852f8a20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf852fafa0 msgr2=0x55bf852fd460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf852fafa0 0x55bf852fd460 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fafec036ce0 msgr2=0x7fafec0391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fafec036ce0 0x7fafec0391a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1140403f0 tx=0x7fb114034000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 msgr2=0x55bf852e62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb123462640 1 -- 172.21.15.99:0/2151405977 reap_dead start 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb11c04b550 tx=0x7fb11c04b000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 shutdown_connections 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2151405977 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852deee0 0x55bf852e62f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 >> 172.21.15.99:0/2151405977 conn(0x55bf852db240 msgr2=0x55bf852d9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 shutdown_connections 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2151405977 wait complete. 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 msgr2=0x7faffc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 0x7faffc039000 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55bf852bf3a0 tx=0x7fb11401cf50 comp rx=0 tx=0).stop 2024-09-13T23:25:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 msgr2=0x55bf852d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55bf852b8530 tx=0x7fb11c00beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 shutdown_connections 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faffc036b40 0x7faffc039000 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 --2- 172.21.15.99:0/2093203999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf852d2210 0x55bf852d2630 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 >> 172.21.15.99:0/2093203999 conn(0x55bf852c71a0 msgr2=0x55bf852c9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 shutdown_connections 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.732+0000 7fb127f30800 1 -- 172.21.15.99:0/2093203999 wait complete. 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 msgr2=0x55bf852be4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 0x55bf852be4f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 msgr2=0x55bf852c31e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 0x55bf852c31e0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 msgr2=0x7fb00c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 0x7fb00c039000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb118057000 tx=0x7fb118052000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 msgr2=0x55bf852b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb114014040 tx=0x7fb114001250 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 shutdown_connections 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf852c0df0 0x55bf852c31e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf851c4db0 0x55bf852be4f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb00c036b40 0x7fb00c039000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 --2- 172.21.15.99:0/3492575191 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf851325f0 0x55bf852b7480 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 >> 172.21.15.99:0/3492575191 conn(0x55bf851b8de0 msgr2=0x55bf852a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 shutdown_connections 2024-09-13T23:25:35.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.733+0000 7fb127f30800 1 -- 172.21.15.99:0/3492575191 wait complete. 2024-09-13T23:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"30ca56dc-5661-43d6-a109-42ef24013139","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:25:34.896252Z","creation_time":"2024-09-13T23:25:34.891317Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:25:35.751 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:25:34.896252Z', 'creation_time': '2024-09-13T23:25:34.891317Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:25:35.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:25:35.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T23:25:35.751 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T23:25:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa410c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f4613c5e10 0x55f461457600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa410c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f461311b30 con 0x55f461457b40 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa410c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55f4612f3360 con 0x55f4613c5e10 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2fa1c00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f4613c5e10 0x55f461457600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2f9bfff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55f461457b40 0x55f461459f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41920/0 (socket says 172.21.15.99:41920) 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.796+0000 7f2f9bfff640 1 -- 172.21.15.99:0/126833512 learned_addr learned my addr 172.21.15.99:0/126833512 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.797+0000 7f2fa1c00640 1 -- 172.21.15.99:0/126833512 >> v1:172.21.15.43:6789/0 conn(0x55f461457b40 legacy=0x55f461459f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.797+0000 7f2fa1c00640 1 -- 172.21.15.99:0/126833512 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f461319e00 con 0x55f4613c5e10 2024-09-13T23:25:35.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.798+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/126833512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461457600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400a470 tx=0x7f2f94045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867c4147f5550c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa13ff640 1 -- 172.21.15.99:0/126833512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f94053570 con 0x55f4613c5e10 2024-09-13T23:25:35.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa13ff640 1 -- 172.21.15.99:0/126833512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f94058070 con 0x55f4613c5e10 2024-09-13T23:25:35.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa13ff640 1 -- 172.21.15.99:0/126833512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f94053880 con 0x55f4613c5e10 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 -- 172.21.15.99:0/126833512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 msgr2=0x55f461457600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 --2- 172.21.15.99:0/126833512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461457600 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400a470 tx=0x7f2f94045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 -- 172.21.15.99:0/126833512 shutdown_connections 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 --2- 172.21.15.99:0/126833512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461457600 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 -- 172.21.15.99:0/126833512 >> 172.21.15.99:0/126833512 conn(0x55f46144cdd0 msgr2=0x55f46144f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 -- 172.21.15.99:0/126833512 shutdown_connections 2024-09-13T23:25:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.799+0000 7f2fa410c800 1 -- 172.21.15.99:0/126833512 wait complete. 2024-09-13T23:25:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa410c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa410c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f46139e360 con 0x55f4613c5e10 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56382/0 (socket says 172.21.15.99:56382) 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.813+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2504515011 learned_addr learned my addr 172.21.15.99:0/2504515011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.814+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2504515011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4612ebbc0 con 0x55f4613c5e10 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.814+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/2504515011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f94025c20 tx=0x7f2f94051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e4afef4e25859d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.814+0000 7f2e8fe07640 1 -- 172.21.15.99:0/2504515011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9405c580 con 0x55f4613c5e10 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.814+0000 7f2e8fe07640 1 -- 172.21.15.99:0/2504515011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f94063030 con 0x55f4613c5e10 2024-09-13T23:25:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.814+0000 7f2e8fe07640 1 -- 172.21.15.99:0/2504515011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9405c850 con 0x55f4613c5e10 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- 172.21.15.99:0/2504515011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 msgr2=0x55f461543a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2504515011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f94025c20 tx=0x7f2f94051000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- 172.21.15.99:0/2504515011 shutdown_connections 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2504515011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f461543a80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- 172.21.15.99:0/2504515011 >> 172.21.15.99:0/2504515011 conn(0x55f46144cdd0 msgr2=0x55f46153f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- 172.21.15.99:0/2504515011 shutdown_connections 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- 172.21.15.99:0/2504515011 wait complete. 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.815+0000 7f2fa410c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f46145b920 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa1c00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56394/0 (socket says 172.21.15.99:56394) 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2733529726 learned_addr learned my addr 172.21.15.99:0/2733529726 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4612fffe0 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55f4615448e0 tx=0x7f2f94002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2e8e604640 1 -- 172.21.15.99:0/2733529726 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f94054ad0 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2e8e604640 1 -- 172.21.15.99:0/2733529726 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f94054c70 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f46154b8f0 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2e8e604640 1 -- 172.21.15.99:0/2733529726 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f94068420 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.816+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f46154be10 con 0x55f4613c5e10 2024-09-13T23:25:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2e8e604640 1 -- 172.21.15.99:0/2733529726 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f940685c0 con 0x55f4613c5e10 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2e8e604640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 0x7f2e88039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2e8e604640 1 -- 172.21.15.99:0/2733529726 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2f94070030 con 0x55f4613c5e10 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 0x7f2e88039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 0x55f461552420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615529b0 con 0x55f461457b40 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.817+0000 7f2fa2401640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 0x55f461552420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 0x7f2e88039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000f60 tx=0x7f2f8c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa2401640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 0x55f461552420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa2401640 1 -- 172.21.15.99:0/2733529726 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f9c00a4a0 con 0x55f461457b40 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46154f9f0 con 0x55f461457b40 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa2401640 1 -- 172.21.15.99:0/2733529726 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f9c00a4a0 con 0x55f461457b40 2024-09-13T23:25:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 0x55f461557140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f461557830 con 0x55f461554d50 2024-09-13T23:25:35.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.818+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 0x55f461557140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.819+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 0x55f461557140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.819+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2733529726 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f94051070 con 0x55f461554d50 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.819+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f461553bf0 con 0x55f461457b40 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.819+0000 7f2fa2401640 1 -- 172.21.15.99:0/2733529726 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f9c00a4a0 con 0x55f461457b40 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.819+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f461554090 con 0x55f461554d50 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa1c00640 1 -- 172.21.15.99:0/2733529726 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f94051070 con 0x55f461554d50 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa410c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa410c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f4612ed580 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56396/0 (socket says 172.21.15.99:56396) 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.820+0000 7f2fa2401640 1 -- 172.21.15.99:0/3791288728 learned_addr learned my addr 172.21.15.99:0/3791288728 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2fa2401640 1 -- 172.21.15.99:0/3791288728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f461566b00 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2fa2401640 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55f46154c5d0 tx=0x7f2f9c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2e877fe640 1 -- 172.21.15.99:0/3791288728 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c013640 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2e877fe640 1 -- 172.21.15.99:0/3791288728 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c0137e0 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f461566d90 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2e877fe640 1 -- 172.21.15.99:0/3791288728 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c013ae0 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.821+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f461569a70 con 0x55f4615661a0 2024-09-13T23:25:35.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2e877fe640 1 -- 172.21.15.99:0/3791288728 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f9c011040 con 0x55f4615661a0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2e877fe640 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 0x7f2e7c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2e877fe640 1 -- 172.21.15.99:0/3791288728 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2f9c00e040 con 0x55f4615661a0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 0x7f2e7c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 0x7f2e7c039000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f461553bc0 tx=0x7f2f94060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa410c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.822+0000 7f2fa410c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f4615441d0 con 0x55f461572ef0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56408/0 (socket says 172.21.15.99:56408) 2024-09-13T23:25:35.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2fa2401640 1 -- 172.21.15.99:0/4269234956 learned_addr learned my addr 172.21.15.99:0/4269234956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2fa2401640 1 -- 172.21.15.99:0/4269234956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4615738c0 con 0x55f461572ef0 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2fa2401640 1 --2- 172.21.15.99:0/4269234956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00b010 tx=0x7f2f9c04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df4bc4dc51b6d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2e857fa640 1 -- 172.21.15.99:0/4269234956 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c02aa40 con 0x55f461572ef0 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2e857fa640 1 -- 172.21.15.99:0/4269234956 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c04a020 con 0x55f461572ef0 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.823+0000 7f2e857fa640 1 -- 172.21.15.99:0/4269234956 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c02a520 con 0x55f461572ef0 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- 172.21.15.99:0/4269234956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 msgr2=0x55f4615732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 --2- 172.21.15.99:0/4269234956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c00b010 tx=0x7f2f9c04d000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- 172.21.15.99:0/4269234956 shutdown_connections 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 --2- 172.21.15.99:0/4269234956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f4615732f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- 172.21.15.99:0/4269234956 >> 172.21.15.99:0/4269234956 conn(0x55f46156f250 msgr2=0x55f46156d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- 172.21.15.99:0/4269234956 shutdown_connections 2024-09-13T23:25:35.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- 172.21.15.99:0/4269234956 wait complete. 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 Processor -- start 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- start start 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.824+0000 7f2fa410c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f461573f30 con 0x55f461572ef0 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa2401640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56416/0 (socket says 172.21.15.99:56416) 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 learned_addr learned my addr 172.21.15.99:0/3075748960 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f46157a8a0 con 0x55f461572ef0 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa2401640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c04cd60 tx=0x7f2f9c04cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2e737fe640 1 -- 172.21.15.99:0/3075748960 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c029ca0 con 0x55f461572ef0 2024-09-13T23:25:35.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2e737fe640 1 -- 172.21.15.99:0/3075748960 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9c029e40 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2e737fe640 1 -- 172.21.15.99:0/3075748960 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f9c01f7f0 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f46157ab30 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.825+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f46157ab30 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2e737fe640 1 -- 172.21.15.99:0/3075748960 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2f9c040140 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2e737fe640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e6c036b40 0x7f2e6c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2e737fe640 1 -- 172.21.15.99:0/3075748960 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2f9c04b030 con 0x55f461572ef0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e6c036b40 0x7f2e6c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.826+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461585bc0 0x55f461588080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615887d0 con 0x55f461585bc0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461585bc0 0x55f461588080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e6c036b40 0x7f2e6c039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f9408f370 tx=0x7f2f94091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461585bc0 0x55f461588080 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f8c009050 con 0x55f461585bc0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 20 realm 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f461585010 con 0x55f461585bc0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f8c009050 con 0x55f461585bc0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.827+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615892b0 con 0x55f461585bc0 2024-09-13T23:25:35.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f8c009050 con 0x55f461585bc0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f461589b80 con 0x55f461585bc0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f8c009050 con 0x55f461585bc0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f46158a430 0x55f46158c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46158cf60 con 0x55f46158a430 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa2401640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f46158a430 0x55f46158c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.828+0000 7f2fa2401640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f46158a430 0x55f46158c820 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f9c038020 con 0x55f46158a430 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa410c800 20 searching for the correct realm 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f46158f010 0x55f4615914d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f46158f010 0x55f4615914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa1c00640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f46158f010 0x55f4615914d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.829+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f9c038020 con 0x55f46158a430 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2fa2401640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2f9c03b3f0 0x7f2f9c03b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2f9c03b3f0 0x7f2f9c03b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2f9bfff640 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2f9c03b3f0 0x7f2f9c03b7f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c009050 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.830+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c009050 con 0x55f461585bc0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.831+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f9c038020 con 0x55f46158a430 2024-09-13T23:25:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.832+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2f9c038020 con 0x55f46158a430 2024-09-13T23:25:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.833+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.834+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.835+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f9c038020 con 0x55f46158a430 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.836+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158f010 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.837+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f461585bc0 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f461591ba0 con 0x55f46158a430 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46158da40 con 0x55f461585bc0 2024-09-13T23:25:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46158d650 con 0x55f461585bc0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.838+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46158e3b0 con 0x55f46158a430 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 zone default found 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 4 Realm: () 2024-09-13T23:25:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 zonegroup default 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615924d0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615920e0 con 0x55f46158f010 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.839+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615947a0 con 0x55f46158f010 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.840+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.840+0000 7f2fa410c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.840+0000 7f2fa410c800 20 started sync module instance, tier type = 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.840+0000 7f2fa410c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.840+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461593b90 con 0x55f46158a430 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.841+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.841+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94508093620096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615950b0 con 0x55f46158a430 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.841+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461595900 con 0x55f461585bc0 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.842+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94508093620096] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.842+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.842+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94508093623296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615955d0 con 0x55f461585bc0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.842+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615960f0 con 0x55f46158f010 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.843+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94508093623296] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.843+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.843+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94508093627328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615964e0 con 0x55f46158f010 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.843+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461596f50 con 0x55f46158a430 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.844+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94508093627328] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.844+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.844+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94508093631008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461597340 con 0x55f46158a430 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.844+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461597d80 con 0x55f461585bc0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.845+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.845+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94508093634640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461597d40 con 0x55f461585bc0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.845+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461598cf0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.845+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94508093631008] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.846+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94508093634640] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.846+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.846+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94508093624352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461598840 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.846+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615995c0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.847+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94508093624352] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.847+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.847+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94508093636896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461598840 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.847+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461599be0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94508093636896] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94508093640640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f461599be0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=0 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=1 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=2 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=3 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=4 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=5 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.848+0000 7f2fa410c800 20 add_watcher() i=6 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94508093640640] v31'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2fa410c800 20 add_watcher() i=7 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2fa410c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f46159cec0 con 0x55f461585bc0 2024-09-13T23:25:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.849+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94508093642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f46159a170 con 0x55f461585bc0 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94508093642912] v31'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2e537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 5 note: GC not initialized 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2e527fc640 20 reqs_thread_entry: start 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 20 Filter name: none 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2dc3fff640 20 reqs_thread_entry: start 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.851+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cfeb0 con 0x55f461585bc0 2024-09-13T23:25:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d1400 con 0x55f46158a430 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.852+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d1400 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 4.e 4:7028012c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d2e70 con 0x55f46158a430 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 4.c 4:33dc3341:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d5b20 con 0x55f461585bc0 2024-09-13T23:25:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 4.3b 4:dce212c8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d8850 con 0x55f46158f010 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 4.12 4:4a62fc7a:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615db3a0 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 4.25 4:a75b679e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615ddc10 con 0x55f46158f010 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 4.17 4:eacd9cd7:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615e00e0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(66 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0710 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 4.c 4:3158085e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d10e0 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(69 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 4.22 4:440f5098:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615daef0 con 0x55f461585bc0 2024-09-13T23:25:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:74 4.d 4:b2317d3d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615e00e0 con 0x55f46158f010 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.853+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:75 4.3f 4:fd7bfd5e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0710 con 0x55f46158a430 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(72 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(75 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(74 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(73 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(71 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.854+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0c30 con 0x55f46158a430 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.855+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 foo.buckets [call] v31'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.855+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0c30 con 0x55f46158a430 2024-09-13T23:25:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(77 foo.buckets [call] v31'18 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa410c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0c30 con 0x55f461585bc0 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa410c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0c30 con 0x55f46158a430 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.856+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv18 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.857+0000 7f2e537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.857+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94508093642912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615d0c30 con 0x55f461585bc0 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.858+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94508093642912] v31'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.858+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94508093620096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x55f46158a430 2024-09-13T23:25:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.859+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94508093620096] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.859+0000 7f2fa410c800 20 remove_watcher() i=0 2024-09-13T23:25:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.859+0000 7f2fa410c800 2 removed watcher, disabling cache 2024-09-13T23:25:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.859+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94508093623296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x55f461585bc0 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.860+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94508093623296] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.860+0000 7f2fa410c800 20 remove_watcher() i=1 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.860+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94508093627328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x55f46158f010 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.861+0000 7f2fa1c00640 1 -- 172.21.15.99:0/3075748960 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94508093627328] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f94051070 con 0x55f46158f010 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.861+0000 7f2fa410c800 20 remove_watcher() i=2 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.861+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94508093631008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x55f46158a430 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.862+0000 7f2fa2401640 1 -- 172.21.15.99:0/3075748960 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94508093631008] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f9c061040 con 0x55f46158a430 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.862+0000 7f2fa410c800 20 remove_watcher() i=3 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.862+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94508093634640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x55f461585bc0 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.863+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94508093634640] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x55f461585bc0 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.863+0000 7f2fa410c800 20 remove_watcher() i=4 2024-09-13T23:25:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.863+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94508093624352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.864+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94508093624352] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.864+0000 7f2fa410c800 20 remove_watcher() i=5 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.864+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94508093636896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.865+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94508093636896] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.865+0000 7f2fa410c800 20 remove_watcher() i=6 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.865+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94508093640640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f4615cdcc0 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94508093640640] v31'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f8c029040 con 0x7f2f9c03b3f0 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 20 remove_watcher() i=7 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2f9c03b3f0 msgr2=0x7f2f9c03b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2f9c03b3f0 0x7f2f9c03b7f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461585bc0 msgr2=0x55f461588080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461585bc0 0x55f461588080 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f46158a430 msgr2=0x55f46158c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f46158a430 0x55f46158c820 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f46158f010 msgr2=0x55f4615914d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f46158f010 0x55f4615914d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e6c036b40 msgr2=0x7f2e6c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e6c036b40 0x7f2e6c039000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2f9408f370 tx=0x7f2f94091000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 msgr2=0x55f46157a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2f9bfff640 1 -- 172.21.15.99:0/3075748960 reap_dead start 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c04cd60 tx=0x7f2f9c04cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 shutdown_connections 2024-09-13T23:25:35.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3075748960 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f461572ef0 0x55f46157a360 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 >> 172.21.15.99:0/3075748960 conn(0x55f46156f250 msgr2=0x55f46156d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 shutdown_connections 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.866+0000 7f2fa410c800 1 -- 172.21.15.99:0/3075748960 wait complete. 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 msgr2=0x7f2e7c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 0x7f2e7c039000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55f461553bc0 tx=0x7f2f94060ee0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 msgr2=0x55f4615665c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55f46154c5d0 tx=0x7f2f9c0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 shutdown_connections 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e7c036b40 0x7f2e7c039000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/3791288728 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4615661a0 0x55f4615665c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 >> 172.21.15.99:0/3791288728 conn(0x55f46155b130 msgr2=0x55f46155dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 shutdown_connections 2024-09-13T23:25:35.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/3791288728 wait complete. 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 msgr2=0x55f461552420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 0x55f461552420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 msgr2=0x55f461557140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 0x55f461557140 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 msgr2=0x7f2e88039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 0x7f2e88039000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000f60 tx=0x7f2f8c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 msgr2=0x55f46154b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55f4615448e0 tx=0x7f2f94002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 shutdown_connections 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f461554d50 0x55f461557140 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f461457b40 0x55f461552420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2e88036b40 0x7f2e88039000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 --2- 172.21.15.99:0/2733529726 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f4613c5e10 0x55f46154b3b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 >> 172.21.15.99:0/2733529726 conn(0x55f46144cdd0 msgr2=0x55f46153dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 shutdown_connections 2024-09-13T23:25:35.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.867+0000 7f2fa410c800 1 -- 172.21.15.99:0/2733529726 wait complete. 2024-09-13T23:25:35.886 INFO:teuthology.orchestra.run.smithi099.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T23:25:35.856404Z","last_stats_update":"2024-09-13T23:25:35.855257Z"} 2024-09-13T23:25:35.886 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T23:25:35.856404Z', 'last_stats_update': '2024-09-13T23:25:35.855257Z'} 2024-09-13T23:25:35.891 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:35.891 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:25:35.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T23:25:35.892 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T23:25:35.938 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:35.938 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:35.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.937+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.937+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.937+0000 7fdd46120800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5641c87be630 0x5641c884d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.937+0000 7fdd46120800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641c8709b30 con 0x5641c884d740 2024-09-13T23:25:35.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.937+0000 7fdd46120800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5641c86eb360 con 0x5641c87be630 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41e16640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5641c87be630 0x5641c884d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41615640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5641c884d740 0x5641c884fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41926/0 (socket says 172.21.15.99:41926) 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41e16640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5641c87be630 0x5641c884d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56428/0 (socket says 172.21.15.99:56428) 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41615640 1 -- 172.21.15.99:0/3459018693 learned_addr learned my addr 172.21.15.99:0/3459018693 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41e16640 1 -- 172.21.15.99:0/3459018693 >> v1:172.21.15.43:6789/0 conn(0x5641c884d740 legacy=0x5641c884fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.938+0000 7fdd41e16640 1 -- 172.21.15.99:0/3459018693 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c8711e00 con 0x5641c87be630 2024-09-13T23:25:35.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd41e16640 1 --2- 172.21.15.99:0/3459018693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884d200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400a470 tx=0x7fdd34045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d756bd65a2011d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd40e14640 1 -- 172.21.15.99:0/3459018693 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34053570 con 0x5641c87be630 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd40e14640 1 -- 172.21.15.99:0/3459018693 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34058070 con 0x5641c87be630 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd40e14640 1 -- 172.21.15.99:0/3459018693 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34053880 con 0x5641c87be630 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 -- 172.21.15.99:0/3459018693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 msgr2=0x5641c884d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 --2- 172.21.15.99:0/3459018693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884d200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400a470 tx=0x7fdd34045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 -- 172.21.15.99:0/3459018693 shutdown_connections 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 --2- 172.21.15.99:0/3459018693 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884d200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 -- 172.21.15.99:0/3459018693 >> 172.21.15.99:0/3459018693 conn(0x5641c8844db0 msgr2=0x5641c88471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 -- 172.21.15.99:0/3459018693 shutdown_connections 2024-09-13T23:25:35.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.940+0000 7fdd46120800 1 -- 172.21.15.99:0/3459018693 wait complete. 2024-09-13T23:25:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd46120800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd46120800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641c8796360 con 0x5641c87be630 2024-09-13T23:25:35.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd41e16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd41e16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56436/0 (socket says 172.21.15.99:56436) 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.954+0000 7fdd41e16640 1 -- 172.21.15.99:0/3583780609 learned_addr learned my addr 172.21.15.99:0/3583780609 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.955+0000 7fdd41e16640 1 -- 172.21.15.99:0/3583780609 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c86e3bc0 con 0x5641c87be630 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.955+0000 7fdd41e16640 1 --2- 172.21.15.99:0/3583780609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdd34025c20 tx=0x7fdd34051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2cc76c62feedf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.955+0000 7fdc2fe07640 1 -- 172.21.15.99:0/3583780609 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34053ba0 con 0x5641c87be630 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.955+0000 7fdc2fe07640 1 -- 172.21.15.99:0/3583780609 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34063030 con 0x5641c87be630 2024-09-13T23:25:35.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.955+0000 7fdc2fe07640 1 -- 172.21.15.99:0/3583780609 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34053440 con 0x5641c87be630 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- 172.21.15.99:0/3583780609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 msgr2=0x5641c884ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 --2- 172.21.15.99:0/3583780609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdd34025c20 tx=0x7fdd34051000 comp rx=0 tx=0).stop 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- 172.21.15.99:0/3583780609 shutdown_connections 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 --2- 172.21.15.99:0/3583780609 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c884ab30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- 172.21.15.99:0/3583780609 >> 172.21.15.99:0/3583780609 conn(0x5641c8844db0 msgr2=0x5641c8935230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- 172.21.15.99:0/3583780609 shutdown_connections 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- 172.21.15.99:0/3583780609 wait complete. 2024-09-13T23:25:35.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.956+0000 7fdd46120800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641c8851610 con 0x5641c87be630 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd41e16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd41e16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56446/0 (socket says 172.21.15.99:56446) 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd41e16640 1 -- 172.21.15.99:0/3184067397 learned_addr learned my addr 172.21.15.99:0/3184067397 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd41e16640 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c86f7fe0 con 0x5641c87be630 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd41e16640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5641c884a230 tx=0x7fdd34002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdc2e604640 1 -- 172.21.15.99:0/3184067397 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34078070 con 0x5641c87be630 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdc2e604640 1 -- 172.21.15.99:0/3184067397 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd34053570 con 0x5641c87be630 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c8943890 con 0x5641c87be630 2024-09-13T23:25:35.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdc2e604640 1 -- 172.21.15.99:0/3184067397 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd34053850 con 0x5641c87be630 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.957+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c8943e10 con 0x5641c87be630 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdc2e604640 1 -- 172.21.15.99:0/3184067397 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdd3407b070 con 0x5641c87be630 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdc2e604640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 0x7fdc28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdc2e604640 1 -- 172.21.15.99:0/3184067397 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fdd34070070 con 0x5641c87be630 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdd41615640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 0x7fdc28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 0x5641c894a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c894aa10 con 0x5641c884d740 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.958+0000 7fdd42617640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 0x5641c894a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd41615640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 0x7fdc28039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000f60 tx=0x7fdd380012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd42617640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 0x5641c894a3c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd42617640 1 -- 172.21.15.99:0/3184067397 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd3c00a4a0 con 0x5641c884d740 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c8947970 con 0x5641c884d740 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd42617640 1 -- 172.21.15.99:0/3184067397 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd3c00a4a0 con 0x5641c884d740 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 0x5641c894f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.959+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c894f850 con 0x5641c894cd70 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd41e16640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 0x5641c894f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd41e16640 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 0x5641c894f160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd41e16640 1 -- 172.21.15.99:0/3184067397 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c894cd70 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c894bb50 con 0x5641c884d740 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd42617640 1 -- 172.21.15.99:0/3184067397 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd3c00a4a0 con 0x5641c884d740 2024-09-13T23:25:35.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.960+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c894c030 con 0x5641c894cd70 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.961+0000 7fdd41e16640 1 -- 172.21.15.99:0/3184067397 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c894cd70 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.961+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.961+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.961+0000 7fdd46120800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.961+0000 7fdd46120800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641c86e5580 con 0x5641c895e130 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56452/0 (socket says 172.21.15.99:56452) 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd42617640 1 -- 172.21.15.99:0/2090375743 learned_addr learned my addr 172.21.15.99:0/2090375743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd42617640 1 -- 172.21.15.99:0/2090375743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c895ea90 con 0x5641c895e130 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd42617640 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5641c894adf0 tx=0x7fdd3c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdc277fe640 1 -- 172.21.15.99:0/2090375743 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c013450 con 0x5641c895e130 2024-09-13T23:25:35.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdc277fe640 1 -- 172.21.15.99:0/2090375743 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0135f0 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c895ed20 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdc277fe640 1 -- 172.21.15.99:0/2090375743 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c0138d0 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.962+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c8961a00 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.963+0000 7fdc277fe640 1 -- 172.21.15.99:0/2090375743 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdd3c011040 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.963+0000 7fdc277fe640 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 0x7fdc1c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.963+0000 7fdc277fe640 1 -- 172.21.15.99:0/2090375743 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fdd3c00e040 con 0x5641c895e130 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.963+0000 7fdd41e16640 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 0x7fdc1c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.963+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd41e16640 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 0x7fdc1c039000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5641c894b320 tx=0x7fdd3408ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd46120800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd46120800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641c88491a0 con 0x5641c896ae80 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56456/0 (socket says 172.21.15.99:56456) 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd42617640 1 -- 172.21.15.99:0/3192316978 learned_addr learned my addr 172.21.15.99:0/3192316978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd42617640 1 -- 172.21.15.99:0/3192316978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c896b850 con 0x5641c896ae80 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdd42617640 1 --2- 172.21.15.99:0/3192316978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c04cdd0 tx=0x7fdd3c029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ec8816e204253f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdc257fa640 1 -- 172.21.15.99:0/3192316978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c04a020 con 0x5641c896ae80 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdc257fa640 1 -- 172.21.15.99:0/3192316978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c02a440 con 0x5641c896ae80 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.964+0000 7fdc257fa640 1 -- 172.21.15.99:0/3192316978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c01f390 con 0x5641c896ae80 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- 172.21.15.99:0/3192316978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 msgr2=0x5641c896b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 --2- 172.21.15.99:0/3192316978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c04cdd0 tx=0x7fdd3c029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- 172.21.15.99:0/3192316978 shutdown_connections 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 --2- 172.21.15.99:0/3192316978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c896b280 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- 172.21.15.99:0/3192316978 >> 172.21.15.99:0/3192316978 conn(0x5641c89671e0 msgr2=0x5641c89652e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- 172.21.15.99:0/3192316978 shutdown_connections 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- 172.21.15.99:0/3192316978 wait complete. 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 Processor -- start 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- start start 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c89722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.965+0000 7fdd46120800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5641c896bec0 con 0x5641c896ae80 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c89722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd42617640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c89722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56462/0 (socket says 172.21.15.99:56462) 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 learned_addr learned my addr 172.21.15.99:0/856215167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:35.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641c8972800 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd42617640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c89722c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c048000 tx=0x7fdd3c04cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdc137fe640 1 -- 172.21.15.99:0/856215167 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c038070 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdc137fe640 1 -- 172.21.15.99:0/856215167 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c020c00 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5641c8972a90 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdc137fe640 1 -- 172.21.15.99:0/856215167 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd3c01f710 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.966+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641c8975740 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.967+0000 7fdc137fe640 1 -- 172.21.15.99:0/856215167 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fdd3c01f8b0 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.967+0000 7fdc137fe640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc0c036b40 0x7fdc0c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.967+0000 7fdc137fe640 1 -- 172.21.15.99:0/856215167 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fdd3c03eb10 con 0x5641c896ae80 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.967+0000 7fdd41e16640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc0c036b40 0x7fdc0c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd41e16640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc0c036b40 0x7fdc0c039000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd3405ffd0 tx=0x7fdd34092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c897dde0 0x5641c89802a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89809f0 con 0x5641c897dde0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd41615640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c897dde0 0x5641c89802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd41615640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c897dde0 0x5641c89802a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd38009050 con 0x5641c897dde0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.968+0000 7fdd46120800 20 realm 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c897d230 con 0x5641c897dde0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd38009050 con 0x5641c897dde0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89814e0 con 0x5641c897dde0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd38009050 con 0x5641c897dde0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c8981db0 con 0x5641c897dde0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdd38009050 con 0x5641c897dde0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c89826f0 0x5641c8984ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c8985270 con 0x5641c89826f0 2024-09-13T23:25:35.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.969+0000 7fdd42617640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c89826f0 0x5641c8984ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd42617640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c89826f0 0x5641c8984ae0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd46120800 20 searching for the correct realm 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5641c8987240 0x5641c8989700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd41e16640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5641c8987240 0x5641c8989700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.970+0000 7fdd41e16640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5641c8987240 0x5641c8989700 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:35.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd42617640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fdd3c013070 0x7fdd3c040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd41615640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fdd3c013070 0x7fdd3c040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:35.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.971+0000 7fdd41615640 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fdd3c013070 0x7fdd3c040660 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38009050 con 0x7fdd3c013070 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38009050 con 0x5641c897dde0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.972+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.973+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.974+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.975+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.976+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.977+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c8987240 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x7fdd3c013070 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c897dde0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.978+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5641c8989dd0 con 0x5641c89826f0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c8985c30 con 0x5641c897dde0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89864d0 con 0x5641c897dde0 2024-09-13T23:25:36.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c898a250 con 0x5641c89826f0 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 zone default found 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 4 Realm: () 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 zonegroup default 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.979+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c898a6a0 con 0x7fdd3c013070 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c898c970 con 0x5641c8987240 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c898cd10 con 0x5641c8987240 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 started sync module instance, tier type = 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.980+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898be00 con 0x5641c89826f0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.981+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.981+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94840538317568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898be00 con 0x5641c89826f0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.981+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898d710 con 0x5641c897dde0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.982+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94840538317568] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.983+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.983+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94840538321440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898be00 con 0x5641c897dde0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.983+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898e1a0 con 0x5641c8987240 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.984+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94840538321440] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.984+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.984+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94840538315088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898bd70 con 0x5641c8987240 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.984+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898f060 con 0x5641c89826f0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.985+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94840538315088] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.985+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.985+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94840538327984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898f480 con 0x5641c89826f0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.985+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898fe40 con 0x5641c897dde0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.986+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94840538327984] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.986+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.986+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94840538329312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898fe40 con 0x5641c897dde0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.986+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c8990800 con 0x7fdd3c013070 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.987+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94840538329312] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.987+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.987+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94840538334512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c898fe40 con 0x7fdd3c013070 2024-09-13T23:25:36.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.987+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c8991210 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.988+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94840538334512] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.988+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.988+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94840538331536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89913f0 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.988+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c8991c40 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94840538331536] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94840538338768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c8991fc0 con 0x7fdd3c013070 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=0 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=1 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=2 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=3 2024-09-13T23:25:36.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=4 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=5 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.989+0000 7fdd46120800 20 add_watcher() i=6 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94840538338768] v31'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd46120800 20 add_watcher() i=7 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd46120800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c8990fd0 con 0x5641c897dde0 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.990+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94840538339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c8990fd0 con 0x5641c897dde0 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.991+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94840538339952] v31'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.991+0000 7fdbf3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.991+0000 7fdd46120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 5 note: GC not initialized 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdbf2ffd640 20 reqs_thread_entry: start 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 Filter name: none 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdbf0ff9640 20 reqs_thread_entry: start 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c8590 con 0x5641c897dde0 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:36.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.992+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c8070 con 0x5641c89826f0 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89cbe00 con 0x7fdd3c013070 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.993+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89cd3f0 con 0x5641c89826f0 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.994+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 foo.buckets [call] v31'19 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89ccf40 con 0x5641c89826f0 2024-09-13T23:25:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:25:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.995+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89d3420 con 0x5641c89826f0 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'20 uv20 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd46120800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd46120800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd46120800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94840538591024 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5641c89d0910 con 0x7fdd3c013070 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== watch-notify(notify (1) cookie 94840538331536 notify 133143986178 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5641c89cc1f0 con 0x7fdd3c013070 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdc257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94840538331536 notifier 4486 bl.length()=338 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdc257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:25:36.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdc257fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdc257fa640 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fdc04003ea0 con 0x7fdd3c013070 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.996+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(68 notify.6 [notify cookie 94840538591024 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.997+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.997+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== watch-notify(notify_complete (2) cookie 94840538591024 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5641c89ca320 con 0x7fdd3c013070 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.998+0000 7fdbf3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.998+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94840538339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c897dde0 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.999+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94840538339952] v31'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:35.999+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94840538317568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c89826f0 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.000+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94840538317568] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.000+0000 7fdd46120800 20 remove_watcher() i=0 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.000+0000 7fdd46120800 2 removed watcher, disabling cache 2024-09-13T23:25:36.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.000+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94840538321440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c897dde0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.001+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94840538321440] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.001+0000 7fdd46120800 20 remove_watcher() i=1 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.001+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94840538315088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c8987240 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.002+0000 7fdd41e16640 1 -- 172.21.15.99:0/856215167 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94840538315088] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3407a030 con 0x5641c8987240 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.002+0000 7fdd46120800 20 remove_watcher() i=2 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.002+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94840538327984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c89826f0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.003+0000 7fdd42617640 1 -- 172.21.15.99:0/856215167 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94840538327984] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd3c027020 con 0x5641c89826f0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.003+0000 7fdd46120800 20 remove_watcher() i=3 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.003+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94840538329312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x5641c897dde0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.004+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94840538329312] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x5641c897dde0 2024-09-13T23:25:36.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.004+0000 7fdd46120800 20 remove_watcher() i=4 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.004+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94840538334512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.005+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94840538334512] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.005+0000 7fdd46120800 20 remove_watcher() i=5 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.005+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94840538331536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.006+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94840538331536] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.006+0000 7fdd46120800 20 remove_watcher() i=6 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.006+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94840538338768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5641c89c62e0 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94840538338768] v31'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd38029040 con 0x7fdd3c013070 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 20 remove_watcher() i=7 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fdd3c013070 msgr2=0x7fdd3c040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fdd3c013070 0x7fdd3c040660 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c897dde0 msgr2=0x5641c89802a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c897dde0 0x5641c89802a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c89826f0 msgr2=0x5641c8984ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c89826f0 0x5641c8984ae0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5641c8987240 msgr2=0x5641c8989700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5641c8987240 0x5641c8989700 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc0c036b40 msgr2=0x7fdc0c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc0c036b40 0x7fdc0c039000 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdd3405ffd0 tx=0x7fdd34092000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 msgr2=0x5641c89722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd46120800 1 --2- 172.21.15.99:0/856215167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c896ae80 0x5641c89722c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c048000 tx=0x7fdd3c04cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 reap_dead start 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.007+0000 7fdd41615640 1 -- 172.21.15.99:0/856215167 reap_dead start 2024-09-13T23:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 shutdown_connections 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 >> 172.21.15.99:0/856215167 conn(0x5641c89671e0 msgr2=0x5641c89652b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 shutdown_connections 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/856215167 wait complete. 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 msgr2=0x7fdc1c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 0x7fdc1c039000 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5641c894b320 tx=0x7fdd3408ec10 comp rx=0 tx=0).stop 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 msgr2=0x5641c895e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5641c894adf0 tx=0x7fdd3c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 shutdown_connections 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc1c036b40 0x7fdc1c039000 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/2090375743 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c895e130 0x5641c895e550 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 >> 172.21.15.99:0/2090375743 conn(0x5641c89530c0 msgr2=0x5641c8955c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 shutdown_connections 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/2090375743 wait complete. 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 msgr2=0x5641c894a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 0x5641c894a3c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 msgr2=0x5641c894f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 0x5641c894f160 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 msgr2=0x7fdc28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 0x7fdc28039000 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdd38000f60 tx=0x7fdd380012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 msgr2=0x5641c8943350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5641c884a230 tx=0x7fdd34002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 shutdown_connections 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5641c894cd70 0x5641c894f160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5641c884d740 0x5641c894a3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fdc28036b40 0x7fdc28039000 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.008+0000 7fdd46120800 1 --2- 172.21.15.99:0/3184067397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5641c87be630 0x5641c8943350 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.009+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 >> 172.21.15.99:0/3184067397 conn(0x5641c8844db0 msgr2=0x5641c8934e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.009+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 shutdown_connections 2024-09-13T23:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.009+0000 7fdd46120800 1 -- 172.21.15.99:0/3184067397 wait complete. 2024-09-13T23:25:36.026 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:25:36.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:25:36.026 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:25:36.079 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.079 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.078+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.078+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f2856751800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f64cde0940 0x55f64cde2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f2856751800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f64cc9cb30 con 0x55f64cddc500 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f2856751800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55f64cc7e360 con 0x55f64cde0940 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f284ba44640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f64cde0940 0x55f64cde2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f2854245640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55f64cddc500 0x55f64cddc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41930/0 (socket says 172.21.15.99:41930) 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f2854245640 1 -- 172.21.15.99:0/1245641110 learned_addr learned my addr 172.21.15.99:0/1245641110 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f284ba44640 1 -- 172.21.15.99:0/1245641110 >> v1:172.21.15.43:6789/0 conn(0x55f64cddc500 legacy=0x55f64cddc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.079+0000 7f284ba44640 1 -- 172.21.15.99:0/1245641110 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cca4e00 con 0x55f64cde0940 2024-09-13T23:25:36.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.081+0000 7f284ba44640 1 --2- 172.21.15.99:0/1245641110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cde0940 0x55f64cde2d30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f283c00a470 tx=0x7f283c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddf67b114a43e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.081+0000 7f2853a44640 1 -- 172.21.15.99:0/1245641110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f283c053570 con 0x55f64cde0940 2024-09-13T23:25:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.081+0000 7f2853a44640 1 -- 172.21.15.99:0/1245641110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f283c058070 con 0x55f64cde0940 2024-09-13T23:25:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.081+0000 7f2853a44640 1 -- 172.21.15.99:0/1245641110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f283c053880 con 0x55f64cde0940 2024-09-13T23:25:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 -- 172.21.15.99:0/1245641110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cde0940 msgr2=0x55f64cde2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 --2- 172.21.15.99:0/1245641110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cde0940 0x55f64cde2d30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f283c00a470 tx=0x7f283c045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:36.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 -- 172.21.15.99:0/1245641110 shutdown_connections 2024-09-13T23:25:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 --2- 172.21.15.99:0/1245641110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cde0940 0x55f64cde2d30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 -- 172.21.15.99:0/1245641110 >> 172.21.15.99:0/1245641110 conn(0x55f64cdd7e30 msgr2=0x55f64cdda250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 -- 172.21.15.99:0/1245641110 shutdown_connections 2024-09-13T23:25:36.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.082+0000 7f2856751800 1 -- 172.21.15.99:0/1245641110 wait complete. 2024-09-13T23:25:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.095+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.095+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2856751800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2856751800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f64cd29370 con 0x55f64cddc500 2024-09-13T23:25:36.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2854245640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2854245640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56490/0 (socket says 172.21.15.99:56490) 2024-09-13T23:25:36.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2854245640 1 -- 172.21.15.99:0/3613043132 learned_addr learned my addr 172.21.15.99:0/3613043132 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2854245640 1 -- 172.21.15.99:0/3613043132 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cc76bc0 con 0x55f64cddc500 2024-09-13T23:25:36.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f2854245640 1 --2- 172.21.15.99:0/3613043132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2844001d80 tx=0x7f2844001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962cb31bc8957fae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f274260c640 1 -- 172.21.15.99:0/3613043132 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844013030 con 0x55f64cddc500 2024-09-13T23:25:36.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f274260c640 1 -- 172.21.15.99:0/3613043132 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284400e470 con 0x55f64cddc500 2024-09-13T23:25:36.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.096+0000 7f274260c640 1 -- 172.21.15.99:0/3613043132 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284400e810 con 0x55f64cddc500 2024-09-13T23:25:36.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 -- 172.21.15.99:0/3613043132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 msgr2=0x55f64cd50dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 --2- 172.21.15.99:0/3613043132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2844001d80 tx=0x7f2844001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 -- 172.21.15.99:0/3613043132 shutdown_connections 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 --2- 172.21.15.99:0/3613043132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64cd50dc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 -- 172.21.15.99:0/3613043132 >> 172.21.15.99:0/3613043132 conn(0x55f64cdd7e30 msgr2=0x55f64cec7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 -- 172.21.15.99:0/3613043132 shutdown_connections 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.097+0000 7f2856751800 1 -- 172.21.15.99:0/3613043132 wait complete. 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2856751800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2856751800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f64cde3570 con 0x55f64cddc500 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2854245640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2854245640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56502/0 (socket says 172.21.15.99:56502) 2024-09-13T23:25:36.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2854245640 1 -- 172.21.15.99:0/1797423795 learned_addr learned my addr 172.21.15.99:0/1797423795 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2854245640 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cc8afe0 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.098+0000 7f2854245640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2844004000 tx=0x7f2844000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2740e09640 1 -- 172.21.15.99:0/1797423795 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844027070 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2740e09640 1 -- 172.21.15.99:0/1797423795 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2844019900 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f64cecb690 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2740e09640 1 -- 172.21.15.99:0/1797423795 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844019c60 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f64cecbbb0 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.099+0000 7f2740e09640 1 -- 172.21.15.99:0/1797423795 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f284402a070 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2740e09640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2740e09640 1 -- 172.21.15.99:0/1797423795 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f284401f070 con 0x55f64cddc500 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f284ba44640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 0x55f64cedd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64ceddc80 con 0x55f64cde0940 2024-09-13T23:25:36.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2854a46640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 0x55f64cedd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f284ba44640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 0x7f273c039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f283c057000 tx=0x7f283c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2854a46640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 0x55f64cedd740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2854a46640 1 -- 172.21.15.99:0/1797423795 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284c00a4a0 con 0x55f64cde0940 2024-09-13T23:25:36.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.100+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cede4d0 con 0x55f64cde0940 2024-09-13T23:25:36.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2854a46640 1 -- 172.21.15.99:0/1797423795 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284c00a4a0 con 0x55f64cde0940 2024-09-13T23:25:36.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 0x55f64cee2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cee2b00 con 0x55f64cedff00 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2854245640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 0x55f64cee2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2854245640 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 0x55f64cee2370 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2854245640 1 -- 172.21.15.99:0/1797423795 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2844029030 con 0x55f64cedff00 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.101+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64ceded20 con 0x55f64cde0940 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2854a46640 1 -- 172.21.15.99:0/1797423795 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f284c00a4a0 con 0x55f64cde0940 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cedf100 con 0x55f64cedff00 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2854245640 1 -- 172.21.15.99:0/1797423795 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2844029030 con 0x55f64cedff00 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2856751800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.102+0000 7f2856751800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f64cecd4e0 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56514/0 (socket says 172.21.15.99:56514) 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2854a46640 1 -- 172.21.15.99:0/1020437828 learned_addr learned my addr 172.21.15.99:0/1020437828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2854a46640 1 -- 172.21.15.99:0/1020437828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cef1de0 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2854a46640 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55f64ceccce0 tx=0x7f284c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2739ffb640 1 -- 172.21.15.99:0/1020437828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013450 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2739ffb640 1 -- 172.21.15.99:0/1020437828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0135f0 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f64cef2070 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2739ffb640 1 -- 172.21.15.99:0/1020437828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c013910 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.103+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f64cef4d50 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.104+0000 7f2739ffb640 1 -- 172.21.15.99:0/1020437828 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f284c011040 con 0x55f64cef1480 2024-09-13T23:25:36.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.104+0000 7f2739ffb640 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 0x7f272c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.104+0000 7f2739ffb640 1 -- 172.21.15.99:0/1020437828 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f284c00e040 con 0x55f64cef1480 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.104+0000 7f2854245640 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 0x7f272c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854245640 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 0x7f272c039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f64cecc030 tx=0x7f284402ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2856751800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2856751800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f64cc78580 con 0x55f64cefe170 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56516/0 (socket says 172.21.15.99:56516) 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854a46640 1 -- 172.21.15.99:0/4258611929 learned_addr learned my addr 172.21.15.99:0/4258611929 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854a46640 1 -- 172.21.15.99:0/4258611929 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cefeb40 con 0x55f64cefe170 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.105+0000 7f2854a46640 1 --2- 172.21.15.99:0/4258611929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f284c04ce30 tx=0x7f284c01ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef74af5ded7b92ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f27337fe640 1 -- 172.21.15.99:0/4258611929 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c03de60 con 0x55f64cefe170 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f27337fe640 1 -- 172.21.15.99:0/4258611929 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c02a440 con 0x55f64cefe170 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f27337fe640 1 -- 172.21.15.99:0/4258611929 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c01f390 con 0x55f64cefe170 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- 172.21.15.99:0/4258611929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 msgr2=0x55f64cefe570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 --2- 172.21.15.99:0/4258611929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f284c04ce30 tx=0x7f284c01ff70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- 172.21.15.99:0/4258611929 shutdown_connections 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 --2- 172.21.15.99:0/4258611929 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cefe570 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- 172.21.15.99:0/4258611929 >> 172.21.15.99:0/4258611929 conn(0x55f64cefa4d0 msgr2=0x55f64cef85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- 172.21.15.99:0/4258611929 shutdown_connections 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- 172.21.15.99:0/4258611929 wait complete. 2024-09-13T23:25:36.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 Processor -- start 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.106+0000 7f2856751800 1 -- start start 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2856751800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cf053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2856751800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f64ceff030 con 0x55f64cefe170 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cf053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2854a46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cf053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56528/0 (socket says 172.21.15.99:56528) 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 learned_addr learned my addr 172.21.15.99:0/3588046591 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64cf05920 con 0x55f64cefe170 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2854a46640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cf053e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55f64cef9140 tx=0x7f284c04cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2731ffb640 1 -- 172.21.15.99:0/3588046591 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c040330 con 0x55f64cefe170 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2731ffb640 1 -- 172.21.15.99:0/3588046591 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284c0404d0 con 0x55f64cefe170 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2731ffb640 1 -- 172.21.15.99:0/3588046591 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c04e1c0 con 0x55f64cefe170 2024-09-13T23:25:36.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f64cf05bb0 con 0x55f64cefe170 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.107+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f64cf08860 con 0x55f64cefe170 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.108+0000 7f2731ffb640 1 -- 172.21.15.99:0/3588046591 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f284c04e430 con 0x55f64cefe170 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.108+0000 7f2731ffb640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2724036b40 0x7f2724039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.108+0000 7f2731ffb640 1 -- 172.21.15.99:0/3588046591 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f284c03e030 con 0x55f64cefe170 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.108+0000 7f2854245640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2724036b40 0x7f2724039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f2854245640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2724036b40 0x7f2724039000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2844016fd0 tx=0x7f2844038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cf10fa0 0x55f64cf13460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf13bb0 con 0x55f64cf10fa0 2024-09-13T23:25:36.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f284ba44640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cf10fa0 0x55f64cf13460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.109+0000 7f284ba44640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cf10fa0 0x55f64cf13460 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 realm 2024-09-13T23:25:36.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf13fe0 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf148b0 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf14c50 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cf159b0 0x55f64cf17da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf183f0 con 0x55f64cf159b0 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.110+0000 7f2854a46640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cf159b0 0x55f64cf17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2854a46640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cf159b0 0x55f64cf17da0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2856751800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2856751800 20 searching for the correct realm 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f64cf1a380 0x55f64cf1c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2854245640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f64cf1a380 0x55f64cf1c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.111+0000 7f2854245640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f64cf1a380 0x55f64cf1c840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f2854a46640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f284c046c20 0x7f284c04b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.112+0000 7f284ba44640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f284c046c20 0x7f284c04b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f284c046c20 0x7f284c04b230 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.113+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.114+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.115+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.116+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.117+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.118+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf1a380 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x7f284c046c20 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf10fa0 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.119+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1cf10 con 0x55f64cf159b0 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf18db0 con 0x55f64cf10fa0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf19650 con 0x55f64cf10fa0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1d390 con 0x55f64cf159b0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 zone default found 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 4 Realm: () 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 zonegroup default 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.120+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1dbe0 con 0x7f284c046c20 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1f960 con 0x55f64cf1a380 2024-09-13T23:25:36.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1fd80 con 0x55f64cf1a380 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 started sync module instance, tier type = 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.121+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf1ee00 con 0x55f64cf159b0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.122+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.122+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94516341240304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf20690 con 0x55f64cf159b0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.122+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf20ee0 con 0x55f64cf10fa0 2024-09-13T23:25:36.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.123+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94516341240304] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.124+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.124+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94516341244384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf20b90 con 0x55f64cf10fa0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.124+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf21690 con 0x55f64cf1a380 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.124+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.124+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94516341248384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf21f60 con 0x55f64cf1a380 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.125+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf22a30 con 0x55f64cf159b0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.125+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94516341244384] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.125+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94516341248384] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.126+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.126+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94516341250736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf20600 con 0x55f64cf159b0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.126+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf23440 con 0x55f64cf10fa0 2024-09-13T23:25:36.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.127+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.127+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94516341256080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf23860 con 0x55f64cf10fa0 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.127+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf24350 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.127+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94516341250736] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.128+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.128+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94516341256080] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.128+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94516341259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf24310 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.128+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf248b0 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.128+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94516341259808] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.129+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.129+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94516341257136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf248b0 con 0x7f284c046c20 2024-09-13T23:25:36.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.129+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf25270 con 0x7f284c046c20 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94516341263808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf25690 con 0x7f284c046c20 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=0 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=1 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=2 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=3 2024-09-13T23:25:36.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=4 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=5 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94516341257136] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f2856751800 20 add_watcher() i=6 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.130+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94516341263808] v31'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.131+0000 7f2856751800 20 add_watcher() i=7 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.131+0000 7f2856751800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.131+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf25690 con 0x55f64cf10fa0 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.131+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.131+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94516341264864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf25600 con 0x55f64cf10fa0 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94516341264864] v31'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f270a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f2856751800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f2856751800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f2856751800 5 note: GC not initialized 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f27097e2640 20 reqs_thread_entry: start 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f2856751800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f2856751800 20 Filter name: none 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.132+0000 7f267affd640 20 reqs_thread_entry: start 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5ba80 con 0x7f284c046c20 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.133+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5a0c0 con 0x7f284c046c20 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:25:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.134+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5a960 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v31'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f2856751800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f2856751800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f2856751800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94516341482672 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5f520 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify (1) cookie 94516341259808 notify 133143986179 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55f64cf5ad00 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f27337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94516341259808 notifier 4493 bl.length()=556 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(65 notify.5 [notify cookie 94516341482672 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f27337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f27337fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f27337fe640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2718003ea0 con 0x7f284c046c20 2024-09-13T23:25:36.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify_complete (2) cookie 94516341482672 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f64cf5a270 con 0x7f284c046c20 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.135+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5d050 con 0x7f284c046c20 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v31'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f2856751800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f2856751800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f2856751800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94516341482560 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf5f520 con 0x55f64cf1a380 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 94516341248384 notify 133143986178 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55f64cecbbb0 con 0x55f64cf1a380 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.136+0000 7f27337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986178 cookie 94516341248384 notifier 4493 bl.length()=177 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f27337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f27337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [notify cookie 94516341482560 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f27337fe640 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f2718003ea0 con 0x55f64cf1a380 2024-09-13T23:25:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== watch-notify(notify_complete (2) cookie 94516341482560 notify 133143986178 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f64cecb690 con 0x55f64cf1a380 2024-09-13T23:25:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.137+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.154 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:25:36.135184Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:36.135174Z","tags":[],"group_ids":[]} 2024-09-13T23:25:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.138+0000 7f270a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.138+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94516341264864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf10fa0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.139+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94516341264864] v31'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.139+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94516341240304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf159b0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.140+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94516341240304] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.140+0000 7f2856751800 20 remove_watcher() i=0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.140+0000 7f2856751800 2 removed watcher, disabling cache 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.140+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94516341244384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf10fa0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.141+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94516341244384] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.141+0000 7f2856751800 20 remove_watcher() i=1 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.141+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94516341248384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf1a380 2024-09-13T23:25:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.142+0000 7f2854245640 1 -- 172.21.15.99:0/3588046591 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94516341248384] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844029030 con 0x55f64cf1a380 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.142+0000 7f2856751800 20 remove_watcher() i=2 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.142+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94516341250736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf159b0 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.143+0000 7f2854a46640 1 -- 172.21.15.99:0/3588046591 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94516341250736] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f284c027020 con 0x55f64cf159b0 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.143+0000 7f2856751800 20 remove_watcher() i=3 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.143+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94516341256080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x55f64cf10fa0 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.144+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94516341256080] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x55f64cf10fa0 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.144+0000 7f2856751800 20 remove_watcher() i=4 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.144+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94516341259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x7f284c046c20 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.145+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94516341259808] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.145+0000 7f2856751800 20 remove_watcher() i=5 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.145+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94516341257136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x7f284c046c20 2024-09-13T23:25:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.146+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94516341257136] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.146+0000 7f2856751800 20 remove_watcher() i=6 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.146+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94516341263808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f64cf59740 con 0x7f284c046c20 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94516341263808] v31'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f283c051070 con 0x7f284c046c20 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 20 remove_watcher() i=7 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f284c046c20 msgr2=0x7f284c04b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f284c046c20 0x7f284c04b230 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cf10fa0 msgr2=0x55f64cf13460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cf10fa0 0x55f64cf13460 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cf159b0 msgr2=0x55f64cf17da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cf159b0 0x55f64cf17da0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f64cf1a380 msgr2=0x55f64cf1c840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f64cf1a380 0x55f64cf1c840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2724036b40 msgr2=0x7f2724039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2724036b40 0x7f2724039000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2844016fd0 tx=0x7f2844038000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 msgr2=0x55f64cf053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/3588046591 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cefe170 0x55f64cf053e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x55f64cef9140 tx=0x7f284c04cdc0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 reap_dead start 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f284ba44640 1 -- 172.21.15.99:0/3588046591 reap_dead start 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 shutdown_connections 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 >> 172.21.15.99:0/3588046591 conn(0x55f64cefa4d0 msgr2=0x55f64cef85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 shutdown_connections 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/3588046591 wait complete. 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 msgr2=0x7f272c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 0x7f272c039000 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55f64cecc030 tx=0x7f284402ae80 comp rx=0 tx=0).stop 2024-09-13T23:25:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 msgr2=0x55f64cef18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x55f64ceccce0 tx=0x7f284c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 shutdown_connections 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f272c036b40 0x7f272c039000 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 --2- 172.21.15.99:0/1020437828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cef1480 0x55f64cef18a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 >> 172.21.15.99:0/1020437828 conn(0x55f64cee6410 msgr2=0x55f64cee8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 shutdown_connections 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.147+0000 7f2856751800 1 -- 172.21.15.99:0/1020437828 wait complete. 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 msgr2=0x55f64cedd740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 0x55f64cedd740 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 msgr2=0x55f64cee2370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 0x55f64cee2370 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 msgr2=0x7f273c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 0x7f273c039000 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f283c057000 tx=0x7f283c052000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 msgr2=0x55f64ceccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2844004000 tx=0x7f2844000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 shutdown_connections 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f64cedff00 0x55f64cee2370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f64cde0940 0x55f64cedd740 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f273c036b40 0x7f273c039000 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 --2- 172.21.15.99:0/1797423795 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f64cddc500 0x55f64ceccfa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 >> 172.21.15.99:0/1797423795 conn(0x55f64cdd7e30 msgr2=0x55f64cec5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 shutdown_connections 2024-09-13T23:25:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.148+0000 7f2856751800 1 -- 172.21.15.99:0/1797423795 wait complete. 2024-09-13T23:25:36.166 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:25:36.135184Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:36.135174Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:36.171 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:25:36.175 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:36.175 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:25:36.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T23:25:36.176 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T23:25:36.218 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.219 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed57af800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x561920eabe90 0x561920f3b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed57af800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561920df7b30 con 0x561920f3b680 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed57af800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x561920dd9360 con 0x561920eabe90 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ed32a3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x561920eabe90 0x561920f3b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.218+0000 7f2ecbfff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x561920f3b680 0x561920f3da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41942/0 (socket says 172.21.15.99:41942) 2024-09-13T23:25:36.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.219+0000 7f2ed32a3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x561920eabe90 0x561920f3b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56532/0 (socket says 172.21.15.99:56532) 2024-09-13T23:25:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.219+0000 7f2ecbfff640 1 -- 172.21.15.99:0/2105880623 learned_addr learned my addr 172.21.15.99:0/2105880623 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.219+0000 7f2ed32a3640 1 -- 172.21.15.99:0/2105880623 >> v1:172.21.15.43:6789/0 conn(0x561920f3b680 legacy=0x561920f3da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.219+0000 7f2ed32a3640 1 -- 172.21.15.99:0/2105880623 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561920dffe00 con 0x561920eabe90 2024-09-13T23:25:36.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/2105880623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f3b140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400a470 tx=0x7f2ec4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cdcf7156a613c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed2aa2640 1 -- 172.21.15.99:0/2105880623 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec4053570 con 0x561920eabe90 2024-09-13T23:25:36.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed2aa2640 1 -- 172.21.15.99:0/2105880623 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4058070 con 0x561920eabe90 2024-09-13T23:25:36.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed2aa2640 1 -- 172.21.15.99:0/2105880623 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec4053880 con 0x561920eabe90 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 -- 172.21.15.99:0/2105880623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 msgr2=0x561920f3b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2105880623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f3b140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400a470 tx=0x7f2ec4045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 -- 172.21.15.99:0/2105880623 shutdown_connections 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2105880623 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f3b140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 -- 172.21.15.99:0/2105880623 >> 172.21.15.99:0/2105880623 conn(0x561920f32df0 msgr2=0x561920f35210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 -- 172.21.15.99:0/2105880623 shutdown_connections 2024-09-13T23:25:36.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.221+0000 7f2ed57af800 1 -- 172.21.15.99:0/2105880623 wait complete. 2024-09-13T23:25:36.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.235+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.235+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.235+0000 7f2ed57af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.235+0000 7f2ed57af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561920e84330 con 0x561920eabe90 2024-09-13T23:25:36.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2ed32a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2ed32a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56544/0 (socket says 172.21.15.99:56544) 2024-09-13T23:25:36.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2ed32a3640 1 -- 172.21.15.99:0/2437354547 learned_addr learned my addr 172.21.15.99:0/2437354547 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2ed32a3640 1 -- 172.21.15.99:0/2437354547 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561920dd1bc0 con 0x561920eabe90 2024-09-13T23:25:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/2437354547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4025c20 tx=0x7f2ec4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e709e5ccd977d1bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2dc160a640 1 -- 172.21.15.99:0/2437354547 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec405c580 con 0x561920eabe90 2024-09-13T23:25:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2dc160a640 1 -- 172.21.15.99:0/2437354547 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4063030 con 0x561920eabe90 2024-09-13T23:25:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.236+0000 7f2dc160a640 1 -- 172.21.15.99:0/2437354547 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec405c850 con 0x561920eabe90 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- 172.21.15.99:0/2437354547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 msgr2=0x561920f38a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2437354547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4025c20 tx=0x7f2ec4051000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- 172.21.15.99:0/2437354547 shutdown_connections 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2437354547 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561920f38a70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- 172.21.15.99:0/2437354547 >> 172.21.15.99:0/2437354547 conn(0x561920f32df0 msgr2=0x561921023270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- 172.21.15.99:0/2437354547 shutdown_connections 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- 172.21.15.99:0/2437354547 wait complete. 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.237+0000 7f2ed57af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561920f3f5f0 con 0x561920eabe90 2024-09-13T23:25:36.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed32a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed32a3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56554/0 (socket says 172.21.15.99:56554) 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed32a3640 1 -- 172.21.15.99:0/597545088 learned_addr learned my addr 172.21.15.99:0/597545088 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed32a3640 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561920de5fe0 con 0x561920eabe90 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400a330 tx=0x7f2ec4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2dbfe07640 1 -- 172.21.15.99:0/597545088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec406c030 con 0x561920eabe90 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2dbfe07640 1 -- 172.21.15.99:0/597545088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec405c580 con 0x561920eabe90 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619210318d0 con 0x561920eabe90 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2dbfe07640 1 -- 172.21.15.99:0/597545088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ec405c880 con 0x561920eabe90 2024-09-13T23:25:36.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.238+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561921031e50 con 0x561920eabe90 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2dbfe07640 1 -- 172.21.15.99:0/597545088 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ec4053440 con 0x561920eabe90 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2dbfe07640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 0x7f2db80391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2dbfe07640 1 -- 172.21.15.99:0/597545088 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ec4070020 con 0x561920eabe90 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 0x7f2db80391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 0x561921038400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921038980 con 0x561920f3b680 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.239+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 0x561921038400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 0x7f2db80391a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f60 tx=0x7f2ebc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 0x561921038400 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/597545088 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ecc00a4a0 con 0x561920f3b680 2024-09-13T23:25:36.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5619210359b0 con 0x561920f3b680 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/597545088 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ecc00a4a0 con 0x561920f3b680 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 0x56192103d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.240+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192103d7e0 con 0x56192103ad00 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 0x56192103d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 0x56192103d0f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed32a3640 1 -- 172.21.15.99:0/597545088 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ec407b070 con 0x56192103ad00 2024-09-13T23:25:36.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921039ba0 con 0x561920f3b680 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/597545088 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ecc00a4a0 con 0x561920f3b680 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.241+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192103a040 con 0x56192103ad00 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed32a3640 1 -- 172.21.15.99:0/597545088 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ec407b070 con 0x56192103ad00 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed57af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed57af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561920dd3580 con 0x56192104c150 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56556/0 (socket says 172.21.15.99:56556) 2024-09-13T23:25:36.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.242+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/2075055194 learned_addr learned my addr 172.21.15.99:0/2075055194 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/2075055194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56192104cab0 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x5619210325b0 tx=0x7f2ecc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2dbd602640 1 -- 172.21.15.99:0/2075055194 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc013640 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2dbd602640 1 -- 172.21.15.99:0/2075055194 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc0137e0 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56192104cd40 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2dbd602640 1 -- 172.21.15.99:0/2075055194 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc013ae0 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.243+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56192104fa20 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2dbd602640 1 -- 172.21.15.99:0/2075055194 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ecc011040 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2dbd602640 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 0x7f2dac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2dbd602640 1 -- 172.21.15.99:0/2075055194 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ecc00e040 con 0x56192104c150 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 0x7f2dac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 0x7f2dac039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561921039b70 tx=0x7f2ec408ee50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed57af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.244+0000 7f2ed57af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561920f370e0 con 0x561921058e50 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56566/0 (socket says 172.21.15.99:56566) 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/2488729100 learned_addr learned my addr 172.21.15.99:0/2488729100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/2488729100 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561921059820 con 0x561921058e50 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/2488729100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00b010 tx=0x7f2ecc014a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7d73a94273eee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2db6ffd640 1 -- 172.21.15.99:0/2488729100 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc02a3f0 con 0x561921058e50 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2db6ffd640 1 -- 172.21.15.99:0/2488729100 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc01f340 con 0x561921058e50 2024-09-13T23:25:36.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.245+0000 7f2db6ffd640 1 -- 172.21.15.99:0/2488729100 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc02a590 con 0x561921058e50 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- 172.21.15.99:0/2488729100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 msgr2=0x561921059250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2488729100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00b010 tx=0x7f2ecc014a70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- 172.21.15.99:0/2488729100 shutdown_connections 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2488729100 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x561921059250 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- 172.21.15.99:0/2488729100 >> 172.21.15.99:0/2488729100 conn(0x5619210551b0 msgr2=0x561921053300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- 172.21.15.99:0/2488729100 shutdown_connections 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- 172.21.15.99:0/2488729100 wait complete. 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 Processor -- start 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- start start 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x5619210602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed57af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x561921059df0 con 0x561921058e50 2024-09-13T23:25:36.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x5619210602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed3aa4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x5619210602e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56578/0 (socket says 172.21.15.99:56578) 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.246+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 learned_addr learned my addr 172.21.15.99:0/888703084 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561921060820 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x5619210602e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc03f040 tx=0x7f2ecc04cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2db57fa640 1 -- 172.21.15.99:0/888703084 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc037070 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2db57fa640 1 -- 172.21.15.99:0/888703084 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc01f8d0 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2db57fa640 1 -- 172.21.15.99:0/888703084 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ecc02e030 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561921060ab0 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.247+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561921060ab0 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2db57fa640 1 -- 172.21.15.99:0/888703084 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2ecc03a070 con 0x561921058e50 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2db57fa640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2d9c036b40 0x7f2d9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2db57fa640 1 -- 172.21.15.99:0/888703084 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2ecc02f070 con 0x561921058e50 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2d9c036b40 0x7f2d9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56192106bbb0 0x56192106e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192106e7c0 con 0x56192106bbb0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56192106bbb0 0x56192106e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.248+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2d9c036b40 0x7f2d9c039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4008370 tx=0x7f2ec4091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56192106bbb0 0x56192106e070 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ebc009050 con 0x56192106bbb0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 realm 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192106b000 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ebc009050 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192106f2a0 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ebc009050 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.249+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192106fb70 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ebc009050 con 0x56192106bbb0 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x561921070470 0x561921072860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921072fc0 con 0x561921070470 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x561921070470 0x561921072860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x561921070470 0x561921072860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 20 searching for the correct realm 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x561921075070 0x561921077530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.250+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x561921075070 0x561921077530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed32a3640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x561921075070 0x561921077530 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed3aa4640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2ecc040690 0x7f2ecc04b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.251+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.252+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2ecc040690 0x7f2ecc04b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.252+0000 7f2ecbfff640 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2ecc040690 0x7f2ecc04b670 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.252+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc009050 con 0x7f2ecc040690 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.252+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.252+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc009050 con 0x56192106bbb0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.253+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x7f2ecc040690 2024-09-13T23:25:36.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.254+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x7f2ecc040690 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.255+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.256+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x7f2ecc040690 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc029040 con 0x56192106bbb0 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.257+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.258+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921075070 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.259+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.259+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x7f2ecc040690 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.259+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.259+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x56192106bbb0 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x561921077c00 con 0x561921070470 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921073a70 con 0x56192106bbb0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921073680 con 0x56192106bbb0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.260+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5619210743e0 con 0x561921070470 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 zone default found 2024-09-13T23:25:36.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 4 Realm: () 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 zonegroup default 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921078530 con 0x7f2ecc040690 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x561921079f70 con 0x561921075070 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192107a3e0 con 0x561921075070 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 started sync module instance, tier type = 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.261+0000 7f2ed57af800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.262+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210793a0 con 0x561921070470 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.262+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.263+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94665928317088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210793a0 con 0x561921070470 2024-09-13T23:25:36.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.263+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107af20 con 0x56192106bbb0 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.263+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94665928317088] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.264+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.264+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94665928321552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107aee0 con 0x56192106bbb0 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.264+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107b9c0 con 0x561921075070 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.265+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94665928321552] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.265+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.265+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94665928314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107bde0 con 0x561921075070 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.265+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107c820 con 0x561921070470 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.266+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.266+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94665928327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107d0c0 con 0x561921070470 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.266+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94665928314608] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.266+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107b4f0 con 0x56192106bbb0 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.267+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.267+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94665928332976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107d0c0 con 0x56192106bbb0 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.267+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107e5e0 con 0x7f2ecc040690 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.267+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94665928327920] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.268+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94665928332976] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.268+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.268+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94665928334032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107cc10 con 0x7f2ecc040690 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.268+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107eeb0 con 0x7f2ecc040690 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.269+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94665928334032] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.269+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.269+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94665928335600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107cc10 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.269+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107f440 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94665928339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107f8b0 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94665928335600] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=0 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=1 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=2 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=3 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=4 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=5 2024-09-13T23:25:36.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.270+0000 7f2ed57af800 20 add_watcher() i=6 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94665928339216] v31'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ed57af800 20 add_watcher() i=7 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ed57af800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56192107f8b0 con 0x56192106bbb0 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.271+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94665928340480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107f890 con 0x56192106bbb0 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.272+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94665928340480] v31'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.272+0000 7f2d89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.272+0000 7f2ed57af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.272+0000 7f2ed57af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.272+0000 7f2ed57af800 5 note: GC not initialized 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2d88fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:36.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2ed57af800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2ed57af800 20 Filter name: none 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2d027fc640 20 reqs_thread_entry: start 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2ed57af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.273+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5619210b5710 con 0x561921070470 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.274+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.274+0000 7f2ed57af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.274+0000 7f2d89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.274+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94665928340480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210b3550 con 0x56192106bbb0 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.275+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94665928340480] v31'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.275+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94665928317088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210b3550 con 0x561921070470 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.276+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94665928317088] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.276+0000 7f2ed57af800 20 remove_watcher() i=0 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.276+0000 7f2ed57af800 2 removed watcher, disabling cache 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.276+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94665928321552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210b3550 con 0x56192106bbb0 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.277+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94665928321552] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.277+0000 7f2ed57af800 20 remove_watcher() i=1 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.277+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94665928314608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107aa10 con 0x561921075070 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.279+0000 7f2ed32a3640 1 -- 172.21.15.99:0/888703084 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94665928314608] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ec407b070 con 0x561921075070 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.279+0000 7f2ed57af800 20 remove_watcher() i=2 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.279+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94665928327920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210b3550 con 0x561921070470 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.280+0000 7f2ed3aa4640 1 -- 172.21.15.99:0/888703084 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94665928327920] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ecc039030 con 0x561921070470 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.280+0000 7f2ed57af800 20 remove_watcher() i=3 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.280+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94665928332976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561921078ef0 con 0x56192106bbb0 2024-09-13T23:25:36.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.281+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94665928332976] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x56192106bbb0 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.281+0000 7f2ed57af800 20 remove_watcher() i=4 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.281+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94665928334032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56192107aa10 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.281+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94665928334032] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.282+0000 7f2ed57af800 20 remove_watcher() i=5 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.282+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94665928335600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5619210b3550 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.283+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94665928335600] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.283+0000 7f2ed57af800 20 remove_watcher() i=6 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.283+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94665928339216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x561921078ef0 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94665928339216] v31'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ebc039040 con 0x7f2ecc040690 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 20 remove_watcher() i=7 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2ecc040690 msgr2=0x7f2ecc04b670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2ecc040690 0x7f2ecc04b670 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56192106bbb0 msgr2=0x56192106e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56192106bbb0 0x56192106e070 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x561921070470 msgr2=0x561921072860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x561921070470 0x561921072860 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x561921075070 msgr2=0x561921077530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x561921075070 0x561921077530 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2d9c036b40 msgr2=0x7f2d9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2d9c036b40 0x7f2d9c039000 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4008370 tx=0x7f2ec4091000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 msgr2=0x5619210602e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/888703084 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561921058e50 0x5619210602e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc03f040 tx=0x7f2ecc04cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 reap_dead start 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ecbfff640 1 -- 172.21.15.99:0/888703084 reap_dead start 2024-09-13T23:25:36.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 shutdown_connections 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 >> 172.21.15.99:0/888703084 conn(0x5619210551b0 msgr2=0x561921053270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 shutdown_connections 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/888703084 wait complete. 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 msgr2=0x7f2dac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 0x7f2dac039000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561921039b70 tx=0x7f2ec408ee50 comp rx=0 tx=0).stop 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 msgr2=0x56192104c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x5619210325b0 tx=0x7f2ecc0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 shutdown_connections 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2dac036b40 0x7f2dac039000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 --2- 172.21.15.99:0/2075055194 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56192104c150 0x56192104c570 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 >> 172.21.15.99:0/2075055194 conn(0x5619210410e0 msgr2=0x561921043c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 shutdown_connections 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.284+0000 7f2ed57af800 1 -- 172.21.15.99:0/2075055194 wait complete. 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 msgr2=0x561921038400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 0x561921038400 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 msgr2=0x56192103d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 0x56192103d0f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 msgr2=0x7f2db80391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 0x7f2db80391a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f60 tx=0x7f2ebc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 msgr2=0x561921031390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400a330 tx=0x7f2ec4002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 shutdown_connections 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56192103ad00 0x56192103d0f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x561920f3b680 0x561921038400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2db8036ce0 0x7f2db80391a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 --2- 172.21.15.99:0/597545088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x561920eabe90 0x561921031390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 >> 172.21.15.99:0/597545088 conn(0x561920f32df0 msgr2=0x561921022e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 shutdown_connections 2024-09-13T23:25:36.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.285+0000 7f2ed57af800 1 -- 172.21.15.99:0/597545088 wait complete. 2024-09-13T23:25:36.301 INFO:teuthology.orchestra.run.smithi099.stdout:{"key":"bucket:myfoo","ver":{"tag":"_4grrMQ5ATRJkPqvPlRqoEYL","ver":2},"mtime":"2024-09-13T23:25:35.996405Z","data":{"bucket":{"name":"myfoo","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","bucket_id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T23:25:34.891317Z","linked":false,"has_bucket_info":false}} 2024-09-13T23:25:36.301 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_4grrMQ5ATRJkPqvPlRqoEYL', 'ver': 2}, 'mtime': '2024-09-13T23:25:35.996405Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'bucket_id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T23:25:34.891317Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T23:25:36.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1'] 2024-09-13T23:25:36.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1'] 2024-09-13T23:25:36.301 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a53af800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5610e6411dd0 0x5610e64141c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a53af800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610e62cab30 con 0x5610e637f610 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a53af800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5610e62ac360 con 0x5610e6411dd0 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa99bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5610e6411dd0 0x5610e64141c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a2ea3640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5610e637f610 0x5610e64106b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41944/0 (socket says 172.21.15.99:41944) 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.389+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/885953593 learned_addr learned my addr 172.21.15.99:0/885953593 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.390+0000 7fa99bfff640 1 -- 172.21.15.99:0/885953593 >> v1:172.21.15.43:6789/0 conn(0x5610e637f610 legacy=0x5610e64106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.390+0000 7fa99bfff640 1 -- 172.21.15.99:0/885953593 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e62d2e00 con 0x5610e6411dd0 2024-09-13T23:25:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.391+0000 7fa99bfff640 1 --2- 172.21.15.99:0/885953593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e6411dd0 0x5610e64141c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00a470 tx=0x7fa98c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fcc8ad2dc642f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a26a2640 1 -- 172.21.15.99:0/885953593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa98c053570 con 0x5610e6411dd0 2024-09-13T23:25:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a26a2640 1 -- 172.21.15.99:0/885953593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa98c058070 con 0x5610e6411dd0 2024-09-13T23:25:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a26a2640 1 -- 172.21.15.99:0/885953593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa98c053880 con 0x5610e6411dd0 2024-09-13T23:25:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 -- 172.21.15.99:0/885953593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e6411dd0 msgr2=0x5610e64141c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 --2- 172.21.15.99:0/885953593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e6411dd0 0x5610e64141c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00a470 tx=0x7fa98c045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 -- 172.21.15.99:0/885953593 shutdown_connections 2024-09-13T23:25:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 --2- 172.21.15.99:0/885953593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e6411dd0 0x5610e64141c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 -- 172.21.15.99:0/885953593 >> 172.21.15.99:0/885953593 conn(0x5610e6405e00 msgr2=0x5610e6408220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 -- 172.21.15.99:0/885953593 shutdown_connections 2024-09-13T23:25:36.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.392+0000 7fa9a53af800 1 -- 172.21.15.99:0/885953593 wait complete. 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.406+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.406+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.406+0000 7fa9a53af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.406+0000 7fa9a53af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5610e6357350 con 0x5610e637f610 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.406+0000 7fa9a2ea3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa9a2ea3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56600/0 (socket says 172.21.15.99:56600) 2024-09-13T23:25:36.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1143661991 learned_addr learned my addr 172.21.15.99:0/1143661991 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1143661991 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e62a4bc0 con 0x5610e637f610 2024-09-13T23:25:36.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1143661991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa994001d80 tx=0x7fa994001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1a4ccdf2ea0c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa890e09640 1 -- 172.21.15.99:0/1143661991 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994013030 con 0x5610e637f610 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa890e09640 1 -- 172.21.15.99:0/1143661991 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99400e470 con 0x5610e637f610 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.407+0000 7fa890e09640 1 -- 172.21.15.99:0/1143661991 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99400e810 con 0x5610e637f610 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- 172.21.15.99:0/1143661991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 msgr2=0x5610e64fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1143661991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa994001d80 tx=0x7fa994001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- 172.21.15.99:0/1143661991 shutdown_connections 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1143661991 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e64fcb60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- 172.21.15.99:0/1143661991 >> 172.21.15.99:0/1143661991 conn(0x5610e6405e00 msgr2=0x5610e64f8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- 172.21.15.99:0/1143661991 shutdown_connections 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- 172.21.15.99:0/1143661991 wait complete. 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.408+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a53af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a53af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5610e64149a0 con 0x5610e637f610 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a2ea3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a2ea3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56606/0 (socket says 172.21.15.99:56606) 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/3560820505 learned_addr learned my addr 172.21.15.99:0/3560820505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e62b8fe0 con 0x5610e637f610 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa994004000 tx=0x7fa994000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.409+0000 7fa88f606640 1 -- 172.21.15.99:0/3560820505 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994027070 con 0x5610e637f610 2024-09-13T23:25:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.410+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610e6504ad0 con 0x5610e637f610 2024-09-13T23:25:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.410+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e6504ff0 con 0x5610e637f610 2024-09-13T23:25:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.410+0000 7fa88f606640 1 -- 172.21.15.99:0/3560820505 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa994001400 con 0x5610e637f610 2024-09-13T23:25:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.410+0000 7fa88f606640 1 -- 172.21.15.99:0/3560820505 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa994019a70 con 0x5610e637f610 2024-09-13T23:25:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.410+0000 7fa88f606640 1 -- 172.21.15.99:0/3560820505 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa99402a070 con 0x5610e637f610 2024-09-13T23:25:36.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa88f606640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 0x7fa888039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa88f606640 1 -- 172.21.15.99:0/3560820505 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa99401f070 con 0x5610e637f610 2024-09-13T23:25:36.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa99bfff640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 0x7fa888039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 0x5610e650b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e650bb80 con 0x5610e6411dd0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 0x5610e650b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa99bfff640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 0x7fa888039000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa98c057000 tx=0x7fa98c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 0x5610e650b600 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.411+0000 7fa9a36a4640 1 -- 172.21.15.99:0/3560820505 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa99c00a4a0 con 0x5610e6411dd0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6508bd0 con 0x5610e6411dd0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a36a4640 1 -- 172.21.15.99:0/3560820505 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa99c00a4a0 con 0x5610e6411dd0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 0x5610e65102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e65109b0 con 0x5610e650ded0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 0x5610e65102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 0x5610e65102c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/3560820505 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa994029030 con 0x5610e650ded0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.412+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e650cd70 con 0x5610e6411dd0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.413+0000 7fa9a36a4640 1 -- 172.21.15.99:0/3560820505 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa99c00a4a0 con 0x5610e6411dd0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.413+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e650d250 con 0x5610e650ded0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.413+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/3560820505 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa994029030 con 0x5610e650ded0 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.413+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.413+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a53af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a53af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5610e62a6580 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56610/0 (socket says 172.21.15.99:56610) 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1438746763 learned_addr learned my addr 172.21.15.99:0/1438746763 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1438746763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e651fcc0 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5610e650bf80 tx=0x7fa99c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa88ce01640 1 -- 172.21.15.99:0/1438746763 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c013450 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa88ce01640 1 -- 172.21.15.99:0/1438746763 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c0135f0 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610e651ff50 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa88ce01640 1 -- 172.21.15.99:0/1438746763 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c0138d0 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.414+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e6522c30 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.415+0000 7fa88ce01640 1 -- 172.21.15.99:0/1438746763 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa99c011040 con 0x5610e651f360 2024-09-13T23:25:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.415+0000 7fa88ce01640 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 0x7fa87c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.415+0000 7fa88ce01640 1 -- 172.21.15.99:0/1438746763 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa99c00e040 con 0x5610e651f360 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.415+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 0x7fa87c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 0x7fa87c039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5610e650c480 tx=0x7fa994016bb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a53af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a53af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5610e64fd310 con 0x5610e652c0b0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56614/0 (socket says 172.21.15.99:56614) 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a36a4640 1 -- 172.21.15.99:0/415917101 learned_addr learned my addr 172.21.15.99:0/415917101 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a36a4640 1 -- 172.21.15.99:0/415917101 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e652ca80 con 0x5610e652c0b0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.416+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/415917101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa99c04cdd0 tx=0x7fa99c029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8594d060c3a7f1f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa8867fc640 1 -- 172.21.15.99:0/415917101 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c04a020 con 0x5610e652c0b0 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa8867fc640 1 -- 172.21.15.99:0/415917101 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c02a440 con 0x5610e652c0b0 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa8867fc640 1 -- 172.21.15.99:0/415917101 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c01f390 con 0x5610e652c0b0 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- 172.21.15.99:0/415917101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 msgr2=0x5610e652c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 --2- 172.21.15.99:0/415917101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa99c04cdd0 tx=0x7fa99c029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- 172.21.15.99:0/415917101 shutdown_connections 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 --2- 172.21.15.99:0/415917101 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e652c4b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- 172.21.15.99:0/415917101 >> 172.21.15.99:0/415917101 conn(0x5610e6528410 msgr2=0x5610e6526510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- 172.21.15.99:0/415917101 shutdown_connections 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- 172.21.15.99:0/415917101 wait complete. 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 Processor -- start 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.417+0000 7fa9a53af800 1 -- start start 2024-09-13T23:25:36.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a53af800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e6533550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a53af800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5610e652d0f0 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e6533550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a36a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e6533550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56618/0 (socket says 172.21.15.99:56618) 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 learned_addr learned my addr 172.21.15.99:0/1184285608 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610e6533a90 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e6533550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa99c048000 tx=0x7fa99c04cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa884ff9640 1 -- 172.21.15.99:0/1184285608 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c03a070 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa884ff9640 1 -- 172.21.15.99:0/1184285608 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa99c020c00 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610e6533d20 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa884ff9640 1 -- 172.21.15.99:0/1184285608 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa99c01f710 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.418+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610e65369d0 con 0x5610e652c0b0 2024-09-13T23:25:36.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.419+0000 7fa884ff9640 1 -- 172.21.15.99:0/1184285608 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa99c03d070 con 0x5610e652c0b0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.419+0000 7fa884ff9640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa86c036b90 0x7fa86c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.419+0000 7fa884ff9640 1 -- 172.21.15.99:0/1184285608 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fa99c015420 con 0x5610e652c0b0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.419+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa86c036b90 0x7fa86c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa86c036b90 0x7fa86c039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5610e650c020 tx=0x7fa994048000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e653f1e0 0x5610e65416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6541df0 con 0x5610e653f1e0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa99bfff640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e653f1e0 0x5610e65416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.420+0000 7fa99bfff640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e653f1e0 0x5610e65416a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 realm 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6542220 con 0x5610e653f1e0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6542af0 con 0x5610e653f1e0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6542e90 con 0x5610e653f1e0 2024-09-13T23:25:36.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e6543bf0 0x5610e6545fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e65465f0 con 0x5610e6543bf0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.421+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e6543bf0 0x5610e6545fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e6543bf0 0x5610e6545fe0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a53af800 20 searching for the correct realm 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5610e65485d0 0x5610e654aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5610e65485d0 0x5610e654aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.422+0000 7fa9a2ea3640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5610e65485d0 0x5610e654aa90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa9a36a4640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa99c058040 0x7fa99c040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.423+0000 7fa99bfff640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa99c058040 0x7fa99c040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa99c058040 0x7fa99c040660 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.424+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.425+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.426+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.427+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.428+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.429+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e65485d0 2024-09-13T23:25:36.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x7fa99c058040 2024-09-13T23:25:36.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.430+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e653f1e0 2024-09-13T23:25:36.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b160 con 0x5610e6543bf0 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6546e70 con 0x5610e653f1e0 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6547260 con 0x5610e653f1e0 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.431+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b5e0 con 0x5610e6543bf0 2024-09-13T23:25:36.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 zone default found 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 4 Realm: () 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 zonegroup default 2024-09-13T23:25:36.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e654b9f0 con 0x7fa99c058040 2024-09-13T23:25:36.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e654dcc0 con 0x5610e65485d0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.432+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e654e060 con 0x5610e65485d0 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.433+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.433+0000 7fa9a53af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.433+0000 7fa9a53af800 20 started sync module instance, tier type = 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.433+0000 7fa9a53af800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.433+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654d150 con 0x5610e6543bf0 2024-09-13T23:25:36.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.434+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.434+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630583785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654d150 con 0x5610e6543bf0 2024-09-13T23:25:36.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.434+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654eab0 con 0x5610e653f1e0 2024-09-13T23:25:36.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.435+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630583785120] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.435+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.435+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630583788960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654d150 con 0x5610e653f1e0 2024-09-13T23:25:36.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.435+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654f520 con 0x5610e65485d0 2024-09-13T23:25:36.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.436+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.436+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630583791632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654fdf0 con 0x5610e65485d0 2024-09-13T23:25:36.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.436+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630583788960] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.436+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e654cca0 con 0x5610e6543bf0 2024-09-13T23:25:36.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.437+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630583791632] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.437+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.437+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630583793984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6550860 con 0x5610e6543bf0 2024-09-13T23:25:36.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.437+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6551220 con 0x5610e653f1e0 2024-09-13T23:25:36.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.438+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.438+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630583799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6551190 con 0x5610e653f1e0 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.438+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65521f0 con 0x7fa99c058040 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.438+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630583793984] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.439+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630583799152] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.439+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.439+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630583803104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65521b0 con 0x7fa99c058040 2024-09-13T23:25:36.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.439+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6552a90 con 0x7fa99c058040 2024-09-13T23:25:36.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.440+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.440+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630583805408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65521b0 con 0x7fa99c058040 2024-09-13T23:25:36.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.440+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6553570 con 0x7fa99c058040 2024-09-13T23:25:36.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.440+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630583803104] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630583805408] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630583796656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6553080 con 0x7fa99c058040 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=0 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=1 2024-09-13T23:25:36.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=2 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=3 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=4 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=5 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.441+0000 7fa9a53af800 20 add_watcher() i=6 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630583796656] v31'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa9a53af800 20 add_watcher() i=7 2024-09-13T23:25:36.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa9a53af800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6556480 con 0x5610e653f1e0 2024-09-13T23:25:36.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.442+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630583806464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6553940 con 0x5610e653f1e0 2024-09-13T23:25:36.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.443+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630583806464] v31'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.443+0000 7fa8597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 5 note: GC not initialized 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa7d3fff640 20 reqs_thread_entry: start 2024-09-13T23:25:36.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 20 Filter name: none 2024-09-13T23:25:36.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa7d1ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:36.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:36.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.444+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6589870 con 0x7fa99c058040 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e658b950 con 0x5610e6543bf0 2024-09-13T23:25:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:36.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:36.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.445+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e658d360 con 0x7fa99c058040 2024-09-13T23:25:36.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.446+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65918f0 con 0x5610e6543bf0 2024-09-13T23:25:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.447+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 foo.buckets [call] v31'21 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.447+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6597810 con 0x7fa99c058040 2024-09-13T23:25:36.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa9a53af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa9a53af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa9a53af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa9a53af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.448+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94630584044592 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e6591d20 con 0x7fa99c058040 2024-09-13T23:25:36.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify (1) cookie 94630583805408 notify 133143986180 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5610e658d750 con 0x7fa99c058040 2024-09-13T23:25:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa8867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94630583805408 notifier 4507 bl.length()=752 2024-09-13T23:25:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa8867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa8867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa8867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(67 notify.6 [notify cookie 94630584044592 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa8867fc640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa868003ea0 con 0x7fa99c058040 2024-09-13T23:25:36.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify_complete (2) cookie 94630584044592 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5610e658c8d0 con 0x7fa99c058040 2024-09-13T23:25:36.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa9a53af800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:36.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa9a53af800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa9a53af800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa9a53af800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.449+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6596010 con 0x7fa99c058040 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.450+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(69 fud.buckets [call] v31'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.450+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e6597020 con 0x5610e6543bf0 2024-09-13T23:25:36.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.451+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'22 uv22 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.451+0000 7fa9a53af800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:36.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.451+0000 7fa9a53af800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.451+0000 7fa9a53af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:36.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.451+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94630584044592 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5610e65964c0 con 0x7fa99c058040 2024-09-13T23:25:36.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== watch-notify(notify (1) cookie 94630583805408 notify 133143986181 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fa98c082040 con 0x7fa99c058040 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa8867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94630583805408 notifier 4507 bl.length()=314 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa8867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa8867fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(71 notify.6 [notify cookie 94630584044592 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa8867fc640 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fa868003ea0 con 0x7fa99c058040 2024-09-13T23:25:36.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== watch-notify(notify_complete (2) cookie 94630584044592 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5610e62d2e00 con 0x7fa99c058040 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.452+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.453+0000 7fa8597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.453+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630583806464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e653f1e0 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.454+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94630583806464] v31'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.454+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630583785120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e6543bf0 2024-09-13T23:25:36.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.454+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94630583785120] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.455+0000 7fa9a53af800 20 remove_watcher() i=0 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.455+0000 7fa9a53af800 2 removed watcher, disabling cache 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.455+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630583788960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e653f1e0 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.456+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94630583788960] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.456+0000 7fa9a53af800 20 remove_watcher() i=1 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.456+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630583791632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e65485d0 2024-09-13T23:25:36.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.457+0000 7fa9a2ea3640 1 -- 172.21.15.99:0/1184285608 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94630583791632] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99403e070 con 0x5610e65485d0 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.457+0000 7fa9a53af800 20 remove_watcher() i=2 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.457+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630583793984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e6543bf0 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.458+0000 7fa9a36a4640 1 -- 172.21.15.99:0/1184285608 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94630583793984] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa99c03c030 con 0x5610e6543bf0 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.458+0000 7fa9a53af800 20 remove_watcher() i=3 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.458+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630583799152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x5610e653f1e0 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94630583799152] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x5610e653f1e0 2024-09-13T23:25:36.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa9a53af800 20 remove_watcher() i=4 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630583803104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94630583803104] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa9a53af800 20 remove_watcher() i=5 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.459+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630583805408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.460+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94630583805408] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.460+0000 7fa9a53af800 20 remove_watcher() i=6 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.460+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630583796656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5610e65875c0 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.461+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94630583796656] v31'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa98c051070 con 0x7fa99c058040 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.461+0000 7fa9a53af800 20 remove_watcher() i=7 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa99c058040 msgr2=0x7fa99c040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa99c058040 0x7fa99c040660 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e653f1e0 msgr2=0x5610e65416a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e653f1e0 0x5610e65416a0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e6543bf0 msgr2=0x5610e6545fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e6543bf0 0x5610e6545fe0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5610e65485d0 msgr2=0x5610e654aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5610e65485d0 0x5610e654aa90 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa86c036b90 msgr2=0x7fa86c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa86c036b90 0x7fa86c039050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x5610e650c020 tx=0x7fa994048000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 msgr2=0x5610e6533550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1184285608 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e652c0b0 0x5610e6533550 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa99c048000 tx=0x7fa99c04cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 reap_dead start 2024-09-13T23:25:36.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa99bfff640 1 -- 172.21.15.99:0/1184285608 reap_dead start 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 shutdown_connections 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 >> 172.21.15.99:0/1184285608 conn(0x5610e6528410 msgr2=0x5610e65264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 shutdown_connections 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1184285608 wait complete. 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 msgr2=0x7fa87c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 0x7fa87c039000 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x5610e650c480 tx=0x7fa994016bb0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 msgr2=0x5610e651f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x5610e650bf80 tx=0x7fa99c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 shutdown_connections 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa87c036b40 0x7fa87c039000 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 --2- 172.21.15.99:0/1438746763 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e651f360 0x5610e651f780 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 >> 172.21.15.99:0/1438746763 conn(0x5610e65142f0 msgr2=0x5610e6516e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 shutdown_connections 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.462+0000 7fa9a53af800 1 -- 172.21.15.99:0/1438746763 wait complete. 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 msgr2=0x5610e650b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 0x5610e650b600 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 msgr2=0x5610e65102c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 0x5610e65102c0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 msgr2=0x7fa888039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 0x7fa888039000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa98c057000 tx=0x7fa98c052000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 msgr2=0x5610e6504590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa994004000 tx=0x7fa994000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 shutdown_connections 2024-09-13T23:25:36.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5610e650ded0 0x5610e65102c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5610e6411dd0 0x5610e650b600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa888036b40 0x7fa888039000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 --2- 172.21.15.99:0/3560820505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5610e637f610 0x5610e6504590 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 >> 172.21.15.99:0/3560820505 conn(0x5610e6405e00 msgr2=0x5610e64f6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 shutdown_connections 2024-09-13T23:25:36.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.463+0000 7fa9a53af800 1 -- 172.21.15.99:0/3560820505 wait complete. 2024-09-13T23:25:36.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:36.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:36.504 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:25:36.549 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.549 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.548+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.548+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.548+0000 7f49e7e11800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f37dd118e0 0x55f37dd13cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.548+0000 7f49e7e11800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f37dbccb30 con 0x55f37dc80e10 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.548+0000 7f49e7e11800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55f37dbae360 con 0x55f37dd118e0 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49dae3a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f37dd118e0 0x55f37dd13cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49dae3a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f37dd118e0 0x55f37dd13cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56624/0 (socket says 172.21.15.99:56624) 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49dae3a640 1 -- 172.21.15.99:0/216045803 learned_addr learned my addr 172.21.15.99:0/216045803 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49e363b640 1 --1- 172.21.15.99:0/216045803 >> v1:172.21.15.43:6789/0 conn(0x55f37dc80e10 0x55f37dd101c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41954/0 (socket says 172.21.15.99:41954) 2024-09-13T23:25:36.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49dae3a640 1 -- 172.21.15.99:0/216045803 >> v1:172.21.15.43:6789/0 conn(0x55f37dc80e10 legacy=0x55f37dd101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.549+0000 7f49dae3a640 1 -- 172.21.15.99:0/216045803 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37dbd4e00 con 0x55f37dd118e0 2024-09-13T23:25:36.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.551+0000 7f49dae3a640 1 --2- 172.21.15.99:0/216045803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dd118e0 0x55f37dd13cd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00a520 tx=0x7f49cc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbc93bd0e1f7c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.551+0000 7f49e2e3a640 1 -- 172.21.15.99:0/216045803 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc055070 con 0x55f37dd118e0 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.551+0000 7f49e2e3a640 1 -- 172.21.15.99:0/216045803 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49cc0515b0 con 0x55f37dd118e0 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.551+0000 7f49e2e3a640 1 -- 172.21.15.99:0/216045803 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49cc0518d0 con 0x55f37dd118e0 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 -- 172.21.15.99:0/216045803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dd118e0 msgr2=0x55f37dd13cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 --2- 172.21.15.99:0/216045803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dd118e0 0x55f37dd13cd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f49cc00a520 tx=0x7f49cc045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 -- 172.21.15.99:0/216045803 shutdown_connections 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 --2- 172.21.15.99:0/216045803 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dd118e0 0x55f37dd13cd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 -- 172.21.15.99:0/216045803 >> 172.21.15.99:0/216045803 conn(0x55f37dd07df0 msgr2=0x55f37dd0a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 -- 172.21.15.99:0/216045803 shutdown_connections 2024-09-13T23:25:36.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.552+0000 7f49e7e11800 1 -- 172.21.15.99:0/216045803 wait complete. 2024-09-13T23:25:36.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.565+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.565+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.565+0000 7f49e7e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.565+0000 7f49e7e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f37dc59330 con 0x55f37dc80e10 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f49e363b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f49e363b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56632/0 (socket says 172.21.15.99:56632) 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f49e363b640 1 -- 172.21.15.99:0/3335620352 learned_addr learned my addr 172.21.15.99:0/3335620352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f49e363b640 1 -- 172.21.15.99:0/3335620352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37dba6bc0 con 0x55f37dc80e10 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f49e363b640 1 --2- 172.21.15.99:0/3335620352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49d4001e40 tx=0x7f49d4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3449677ead2e5eff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f48d160a640 1 -- 172.21.15.99:0/3335620352 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d400e5c0 con 0x55f37dc80e10 2024-09-13T23:25:36.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f48d160a640 1 -- 172.21.15.99:0/3335620352 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d4006070 con 0x55f37dc80e10 2024-09-13T23:25:36.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.566+0000 7f48d160a640 1 -- 172.21.15.99:0/3335620352 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d400e910 con 0x55f37dc80e10 2024-09-13T23:25:36.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 -- 172.21.15.99:0/3335620352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 msgr2=0x55f37dd0daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3335620352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f49d4001e40 tx=0x7f49d4001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 -- 172.21.15.99:0/3335620352 shutdown_connections 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3335620352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37dd0daf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 -- 172.21.15.99:0/3335620352 >> 172.21.15.99:0/3335620352 conn(0x55f37dd07df0 msgr2=0x55f37ddf8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 -- 172.21.15.99:0/3335620352 shutdown_connections 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 -- 172.21.15.99:0/3335620352 wait complete. 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.567+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e7e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e7e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f37dd14600 con 0x55f37dc80e10 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e363b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e363b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56636/0 (socket says 172.21.15.99:56636) 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e363b640 1 -- 172.21.15.99:0/2990469241 learned_addr learned my addr 172.21.15.99:0/2990469241 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e363b640 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37dbbafe0 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f49e363b640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f49d4004000 tx=0x7f49d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.568+0000 7f48cfe07640 1 -- 172.21.15.99:0/2990469241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d401a7c0 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f48cfe07640 1 -- 172.21.15.99:0/2990469241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d401a960 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37de069b0 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f48cfe07640 1 -- 172.21.15.99:0/2990469241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49d401acc0 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37de06ed0 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f48cfe07640 1 -- 172.21.15.99:0/2990469241 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f49d4017070 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.569+0000 7f48cfe07640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 0x7f48c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f48cfe07640 1 -- 172.21.15.99:0/2990469241 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f49d4015020 con 0x55f37dc80e10 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49dae3a640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 0x7f48c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 0x55f37de0d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de0dab0 con 0x55f37dd118e0 2024-09-13T23:25:36.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 0x55f37de0d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49dae3a640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 0x7f48c8039000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49cc057000 tx=0x7f49cc052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 0x55f37de0d4e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e3e3c640 1 -- 172.21.15.99:0/2990469241 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49dc00a4a0 con 0x55f37dd118e0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.570+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de0aa90 con 0x55f37dd118e0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e3e3c640 1 -- 172.21.15.99:0/2990469241 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49dc00a4a0 con 0x55f37dd118e0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 0x55f37de121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de12850 con 0x55f37de0fdc0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e363b640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 0x55f37de121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e363b640 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 0x55f37de121b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e363b640 1 -- 172.21.15.99:0/2990469241 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de0fdc0 2024-09-13T23:25:36.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.571+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de0ec60 con 0x55f37dd118e0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e3e3c640 1 -- 172.21.15.99:0/2990469241 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49dc00a4a0 con 0x55f37dd118e0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de0f140 con 0x55f37de0fdc0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e363b640 1 -- 172.21.15.99:0/2990469241 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de0fdc0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e7e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.572+0000 7f49e7e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f37dba8580 con 0x55f37de211e0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56640/0 (socket says 172.21.15.99:56640) 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e3e3c640 1 -- 172.21.15.99:0/1644895430 learned_addr learned my addr 172.21.15.99:0/1644895430 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e3e3c640 1 -- 172.21.15.99:0/1644895430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37de21b40 con 0x55f37de211e0 2024-09-13T23:25:36.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55f37de07520 tx=0x7f49dc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f48cd602640 1 -- 172.21.15.99:0/1644895430 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc013640 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f48cd602640 1 -- 172.21.15.99:0/1644895430 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc0137e0 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37de21dd0 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f48cd602640 1 -- 172.21.15.99:0/1644895430 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc013ae0 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.573+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37de24ab0 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.574+0000 7f48cd602640 1 -- 172.21.15.99:0/1644895430 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f49dc011040 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.574+0000 7f48cd602640 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 0x7f48bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.574+0000 7f48cd602640 1 -- 172.21.15.99:0/1644895430 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f49dc00e040 con 0x55f37de211e0 2024-09-13T23:25:36.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.574+0000 7f49e363b640 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 0x7f48bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e363b640 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 0x7f48bc039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55f37de0a9d0 tx=0x7f49d404b730 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e7e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e7e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f37dd0c1c0 con 0x55f37de2df00 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56654/0 (socket says 172.21.15.99:56654) 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e3e3c640 1 -- 172.21.15.99:0/1600583574 learned_addr learned my addr 172.21.15.99:0/1600583574 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e3e3c640 1 -- 172.21.15.99:0/1600583574 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37de2e8d0 con 0x55f37de2df00 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/1600583574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49dc04cde0 tx=0x7f49dc0203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a293add0942900 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.575+0000 7f48c6ffd640 1 -- 172.21.15.99:0/1600583574 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc012c00 con 0x55f37de2df00 2024-09-13T23:25:36.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f48c6ffd640 1 -- 172.21.15.99:0/1600583574 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc021960 con 0x55f37de2df00 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f48c6ffd640 1 -- 172.21.15.99:0/1600583574 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc021440 con 0x55f37de2df00 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- 172.21.15.99:0/1600583574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 msgr2=0x55f37de2e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1600583574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f49dc04cde0 tx=0x7f49dc0203a0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- 172.21.15.99:0/1600583574 shutdown_connections 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1600583574 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de2e300 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- 172.21.15.99:0/1600583574 >> 172.21.15.99:0/1600583574 conn(0x55f37de2a260 msgr2=0x55f37de28360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- 172.21.15.99:0/1600583574 shutdown_connections 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- 172.21.15.99:0/1600583574 wait complete. 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 Processor -- start 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- start start 2024-09-13T23:25:36.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de35340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.576+0000 7f49e7e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f37de2ef40 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de35340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e3e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de35340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56656/0 (socket says 172.21.15.99:56656) 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 learned_addr learned my addr 172.21.15.99:0/3385066852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37de35880 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de35340 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f49dc04cd40 tx=0x7f49dc00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f48c57fa640 1 -- 172.21.15.99:0/3385066852 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc039070 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f48c57fa640 1 -- 172.21.15.99:0/3385066852 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc021440 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37de35b10 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f48c57fa640 1 -- 172.21.15.99:0/3385066852 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc01f6c0 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.577+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37de387c0 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.578+0000 7f48c57fa640 1 -- 172.21.15.99:0/3385066852 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f49dc01f860 con 0x55f37de2df00 2024-09-13T23:25:36.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.578+0000 7f48c57fa640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48ac036b90 0x7f48ac039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.578+0000 7f48c57fa640 1 -- 172.21.15.99:0/3385066852 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f49dc031050 con 0x55f37de2df00 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.578+0000 7f49e363b640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48ac036b90 0x7f48ac039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e363b640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48ac036b90 0x7f48ac039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d401d8a0 tx=0x7f49d4038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37de40e70 0x55f37de43330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de43a80 con 0x55f37de40e70 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49dae3a640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37de40e70 0x55f37de43330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49dae3a640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37de40e70 0x55f37de43330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 20 realm 2024-09-13T23:25:36.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.579+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de43eb0 con 0x55f37de40e70 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de44780 con 0x55f37de40e70 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de44b20 con 0x55f37de40e70 2024-09-13T23:25:36.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de45880 0x55f37de47c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de482c0 con 0x55f37de45880 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de45880 0x55f37de47c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.580+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de45880 0x55f37de47c70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e7e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e7e11800 20 searching for the correct realm 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f37de4a270 0x55f37de4c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e363b640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f37de4a270 0x55f37de4c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e363b640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f37de4a270 0x55f37de4c730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.581+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.582+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.582+0000 7f49e3e3c640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f49dc04b290 0x7f49dc044830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.582+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.582+0000 7f49dae3a640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f49dc04b290 0x7f49dc044830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.582+0000 7f49dae3a640 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f49dc04b290 0x7f49dc044830 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.583+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.584+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.585+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.586+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.587+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de4a270 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.588+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x7f49dc04b290 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de40e70 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ce00 con 0x55f37de45880 2024-09-13T23:25:36.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de48c80 con 0x55f37de40e70 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.589+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de488c0 con 0x55f37de40e70 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de49660 con 0x55f37de45880 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 zone default found 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 4 Realm: () 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 zonegroup default 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4d730 con 0x7f49dc04b290 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f9e0 con 0x55f37de4a270 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.590+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4fd80 con 0x55f37de4a270 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.591+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.591+0000 7f49e7e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.591+0000 7f49e7e11800 20 started sync module instance, tier type = 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.591+0000 7f49e7e11800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.591+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4ee20 con 0x55f37de45880 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.592+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.592+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504277570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f630 con 0x55f37de45880 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.592+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de50a80 con 0x55f37de40e70 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.593+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504277570064] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.593+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.593+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504277574400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de50ea0 con 0x55f37de40e70 2024-09-13T23:25:36.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.593+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de51900 con 0x55f37de4a270 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.594+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.594+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504277578720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de521a0 con 0x55f37de4a270 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.594+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de52c20 con 0x55f37de45880 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.594+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504277574400] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.595+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504277578720] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.595+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.595+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504277581040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de507e0 con 0x55f37de45880 2024-09-13T23:25:36.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.595+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de53630 con 0x55f37de40e70 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.596+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.596+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504277586304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de53a50 con 0x55f37de40e70 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.596+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de54470 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.596+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504277581040] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.597+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504277586304] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.597+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.597+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504277589856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de535a0 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.597+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de54d40 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.598+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504277589856] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.598+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.598+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504277583632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de535a0 con 0x7f49dc04b290 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.598+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de552e0 con 0x7f49dc04b290 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504277583632] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504277593648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de55250 con 0x7f49dc04b290 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=0 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=1 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=2 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=3 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=4 2024-09-13T23:25:36.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=5 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.599+0000 7f49e7e11800 20 add_watcher() i=6 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.600+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504277593648] v31'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.600+0000 7f49e7e11800 20 add_watcher() i=7 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.600+0000 7f49e7e11800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.601+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de586e0 con 0x55f37de40e70 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.601+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.601+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504277592080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de55c00 con 0x55f37de40e70 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.602+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504277592080] v31'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.602+0000 7f4899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.602+0000 7f49e7e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.602+0000 7f49e7e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.602+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de61120 con 0x55f37de40e70 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.603+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.603+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de617f0 con 0x7f49dc04b290 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.604+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.604+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de61c10 con 0x55f37de4a270 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.605+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.605+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62460 con 0x55f37de40e70 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.606+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'113 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.606+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5ce20 con 0x55f37de45880 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.607+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.607+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5cdf0 con 0x55f37de4a270 2024-09-13T23:25:36.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.608+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.608+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5cdf0 con 0x55f37de40e70 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.609+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.609+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5cdf0 con 0x7f49dc04b290 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.610+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.610+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5cdf0 con 0x55f37de45880 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.611+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.611+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5cea0 con 0x55f37de4a270 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.612+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.612+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de45880 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.613+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.613+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x7f49dc04b290 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.614+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.614+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de45880 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.615+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.615+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x7f49dc04b290 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.616+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.616+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de40e70 2024-09-13T23:25:36.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.617+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'114 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.617+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.618+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.618+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de45880 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.619+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.619+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.620+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.620+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de40e70 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.621+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.621+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de40e70 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.622+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'115 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x55f37de40e70 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.622+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.623+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.623+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de45880 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.624+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.624+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.625+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.625+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.626+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.626+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.627+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.627+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.628+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.628+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x7f49dc04b290 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.629+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.629+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.630+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.630+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x7f49dc04b290 2024-09-13T23:25:36.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.631+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.631+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x55f37de4a270 2024-09-13T23:25:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.632+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.632+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de62fc0 con 0x7f49dc04b290 2024-09-13T23:25:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.633+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.633+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5c770 con 0x55f37de45880 2024-09-13T23:25:36.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.634+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.634+0000 7f4898fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.634+0000 7f49e7e11800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.634+0000 7f49e7e11800 20 Filter name: none 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.634+0000 7f48127fc640 20 reqs_thread_entry: start 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de8dc90 con 0x7f49dc04b290 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:25:36.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55f37de90660 con 0x7f49dc04b290 2024-09-13T23:25:36.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.635+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f49cc057030 con 0x7f49dc04b290 2024-09-13T23:25:36.638 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:25:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.636+0000 7f4899fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.636+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504277592080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de5ff80 con 0x55f37de40e70 2024-09-13T23:25:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.637+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94504277592080] v31'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x55f37de40e70 2024-09-13T23:25:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.637+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504277570064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de54810 con 0x55f37de45880 2024-09-13T23:25:36.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.638+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94504277570064] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.638+0000 7f49e7e11800 20 remove_watcher() i=0 2024-09-13T23:25:36.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.638+0000 7f49e7e11800 2 removed watcher, disabling cache 2024-09-13T23:25:36.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.638+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504277574400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f210 con 0x55f37de40e70 2024-09-13T23:25:36.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.639+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94504277574400] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x55f37de40e70 2024-09-13T23:25:36.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.639+0000 7f49e7e11800 20 remove_watcher() i=1 2024-09-13T23:25:36.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.639+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504277578720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f210 con 0x55f37de4a270 2024-09-13T23:25:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.640+0000 7f49e363b640 1 -- 172.21.15.99:0/3385066852 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94504277578720] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49d402e070 con 0x55f37de4a270 2024-09-13T23:25:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.640+0000 7f49e7e11800 20 remove_watcher() i=2 2024-09-13T23:25:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.640+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504277581040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f210 con 0x55f37de45880 2024-09-13T23:25:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.641+0000 7f49e3e3c640 1 -- 172.21.15.99:0/3385066852 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94504277581040] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49dc03b030 con 0x55f37de45880 2024-09-13T23:25:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.642+0000 7f49e7e11800 20 remove_watcher() i=3 2024-09-13T23:25:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.642+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504277586304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de51cf0 con 0x55f37de40e70 2024-09-13T23:25:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.643+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94504277586304] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x55f37de40e70 2024-09-13T23:25:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.643+0000 7f49e7e11800 20 remove_watcher() i=4 2024-09-13T23:25:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.643+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504277589856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f210 con 0x7f49dc04b290 2024-09-13T23:25:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.643+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94504277589856] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x7f49dc04b290 2024-09-13T23:25:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.644+0000 7f49e7e11800 20 remove_watcher() i=5 2024-09-13T23:25:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.644+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504277583632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de53180 con 0x7f49dc04b290 2024-09-13T23:25:36.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.644+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94504277583632] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x7f49dc04b290 2024-09-13T23:25:36.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.644+0000 7f49e7e11800 20 remove_watcher() i=6 2024-09-13T23:25:36.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.644+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504277593648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55f37de4f210 con 0x7f49dc04b290 2024-09-13T23:25:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.645+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94504277593648] v31'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49cc089040 con 0x7f49dc04b290 2024-09-13T23:25:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.645+0000 7f49e7e11800 20 remove_watcher() i=7 2024-09-13T23:25:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f49dc04b290 msgr2=0x7f49dc044830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f49dc04b290 0x7f49dc044830 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37de40e70 msgr2=0x55f37de43330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37de40e70 0x55f37de43330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de45880 msgr2=0x55f37de47c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de45880 0x55f37de47c70 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f37de4a270 msgr2=0x55f37de4c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f37de4a270 0x55f37de4c730 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48ac036b90 msgr2=0x7f48ac039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48ac036b90 0x7f48ac039050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f49d401d8a0 tx=0x7f49d4038000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 msgr2=0x55f37de35340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/3385066852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de2df00 0x55f37de35340 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f49dc04cd40 tx=0x7f49dc00af70 comp rx=0 tx=0).stop 2024-09-13T23:25:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 reap_dead start 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49dae3a640 1 -- 172.21.15.99:0/3385066852 reap_dead start 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 shutdown_connections 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 >> 172.21.15.99:0/3385066852 conn(0x55f37de2a260 msgr2=0x55f37de28330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 shutdown_connections 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/3385066852 wait complete. 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 msgr2=0x7f48bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 0x7f48bc039050 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55f37de0a9d0 tx=0x7f49d404b730 comp rx=0 tx=0).stop 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 msgr2=0x55f37de21600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55f37de07520 tx=0x7f49dc0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 shutdown_connections 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48bc036b90 0x7f48bc039050 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 --2- 172.21.15.99:0/1644895430 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37de211e0 0x55f37de21600 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 >> 172.21.15.99:0/1644895430 conn(0x55f37de16170 msgr2=0x55f37de18cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 shutdown_connections 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.646+0000 7f49e7e11800 1 -- 172.21.15.99:0/1644895430 wait complete. 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 msgr2=0x55f37de0d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 0x55f37de0d4e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 msgr2=0x55f37de121b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 0x55f37de121b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 msgr2=0x7f48c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 0x7f48c8039000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f49cc057000 tx=0x7f49cc052000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 msgr2=0x55f37de06470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f49d4004000 tx=0x7f49d4000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 shutdown_connections 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f37de0fdc0 0x55f37de121b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f37dd118e0 0x55f37de0d4e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f48c8036b40 0x7f48c8039000 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 --2- 172.21.15.99:0/2990469241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f37dc80e10 0x55f37de06470 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 >> 172.21.15.99:0/2990469241 conn(0x55f37dd07df0 msgr2=0x55f37ddf7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 shutdown_connections 2024-09-13T23:25:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.647+0000 7f49e7e11800 1 -- 172.21.15.99:0/2990469241 wait complete. 2024-09-13T23:25:36.656 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:25:36.657 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:25:36.657 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T23:25:36.657 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T23:25:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.743 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4133721800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55814620d910 0x55814620fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4133721800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5581460c9b30 con 0x558146209a50 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4133721800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5581460ab360 con 0x55814620d910 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4126cab640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55814620d910 0x55814620fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f412f4ac640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x558146209a50 0x558146209e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41956/0 (socket says 172.21.15.99:41956) 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f412f4ac640 1 -- 172.21.15.99:0/1742829009 learned_addr learned my addr 172.21.15.99:0/1742829009 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4126cab640 1 -- 172.21.15.99:0/1742829009 >> v1:172.21.15.43:6789/0 conn(0x558146209a50 legacy=0x558146209e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f412ecab640 1 -- 172.21.15.99:0/1742829009 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799521586 0 0) 0x5581460c9b30 con 0x558146209a50 2024-09-13T23:25:36.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.743+0000 7f4126cab640 1 -- 172.21.15.99:0/1742829009 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581460d1e00 con 0x55814620d910 2024-09-13T23:25:36.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.745+0000 7f4126cab640 1 --2- 172.21.15.99:0/1742829009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814620d910 0x55814620fd00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f411800a470 tx=0x7f4118045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca4d9e74329e975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.745+0000 7f412ecab640 1 -- 172.21.15.99:0/1742829009 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4118053570 con 0x55814620d910 2024-09-13T23:25:36.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f412ecab640 1 -- 172.21.15.99:0/1742829009 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4118058070 con 0x55814620d910 2024-09-13T23:25:36.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f412ecab640 1 -- 172.21.15.99:0/1742829009 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4118053880 con 0x55814620d910 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 -- 172.21.15.99:0/1742829009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814620d910 msgr2=0x55814620fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 --2- 172.21.15.99:0/1742829009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814620d910 0x55814620fd00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f411800a470 tx=0x7f4118045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 -- 172.21.15.99:0/1742829009 shutdown_connections 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 --2- 172.21.15.99:0/1742829009 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814620d910 0x55814620fd00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 -- 172.21.15.99:0/1742829009 >> 172.21.15.99:0/1742829009 conn(0x558146204550 msgr2=0x558146206970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 -- 172.21.15.99:0/1742829009 shutdown_connections 2024-09-13T23:25:36.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.746+0000 7f4133721800 1 -- 172.21.15.99:0/1742829009 wait complete. 2024-09-13T23:25:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f4133721800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f4133721800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558146156360 con 0x558146209a50 2024-09-13T23:25:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f412f4ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f412f4ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56664/0 (socket says 172.21.15.99:56664) 2024-09-13T23:25:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.760+0000 7f412f4ac640 1 -- 172.21.15.99:0/1313859434 learned_addr learned my addr 172.21.15.99:0/1313859434 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.761+0000 7f412f4ac640 1 -- 172.21.15.99:0/1313859434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581460a3bc0 con 0x558146209a50 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.761+0000 7f412f4ac640 1 --2- 172.21.15.99:0/1313859434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f412000b210 tx=0x7f412000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6273ac16a680ef3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.761+0000 7f401d60a640 1 -- 172.21.15.99:0/1313859434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4120008070 con 0x558146209a50 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.761+0000 7f401d60a640 1 -- 172.21.15.99:0/1313859434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412000d500 con 0x558146209a50 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.761+0000 7f401d60a640 1 -- 172.21.15.99:0/1313859434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412000d840 con 0x558146209a50 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- 172.21.15.99:0/1313859434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 msgr2=0x5581462f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 --2- 172.21.15.99:0/1313859434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f412000b210 tx=0x7f412000b6d0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- 172.21.15.99:0/1313859434 shutdown_connections 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 --2- 172.21.15.99:0/1313859434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581462f9670 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- 172.21.15.99:0/1313859434 >> 172.21.15.99:0/1313859434 conn(0x558146204550 msgr2=0x5581462f7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- 172.21.15.99:0/1313859434 shutdown_connections 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- 172.21.15.99:0/1313859434 wait complete. 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.762+0000 7f4133721800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558146210540 con 0x558146209a50 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f412f4ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f412f4ac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56668/0 (socket says 172.21.15.99:56668) 2024-09-13T23:25:36.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f412f4ac640 1 -- 172.21.15.99:0/1363427598 learned_addr learned my addr 172.21.15.99:0/1363427598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f412f4ac640 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581460b7fe0 con 0x558146209a50 2024-09-13T23:25:36.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f412f4ac640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f412000b210 tx=0x7f4120000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f401be07640 1 -- 172.21.15.99:0/1363427598 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412000f950 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f401be07640 1 -- 172.21.15.99:0/1363427598 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412000faf0 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581463015e0 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f401be07640 1 -- 172.21.15.99:0/1363427598 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412000fdd0 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.763+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558146301b00 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.764+0000 7f401be07640 1 -- 172.21.15.99:0/1363427598 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4120017040 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.764+0000 7f401be07640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 0x7f4014038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.764+0000 7f401be07640 1 -- 172.21.15.99:0/1363427598 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4120015020 con 0x558146209a50 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.764+0000 7f4126cab640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 0x7f4014038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 0x558146308110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146308650 con 0x55814620d910 2024-09-13T23:25:36.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f412fcad640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 0x558146308110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f4126cab640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 0x7f4014038fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4118057000 tx=0x7f4118052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f412fcad640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 0x558146308110 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f412fcad640 1 -- 172.21.15.99:0/1363427598 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f412800a4a0 con 0x55814620d910 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.765+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5581463056e0 con 0x55814620d910 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f412fcad640 1 -- 172.21.15.99:0/1363427598 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f412800a4a0 con 0x55814620d910 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 0x55814630cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814630d440 con 0x55814630a960 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f412f4ac640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 0x55814630cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f412f4ac640 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 0x55814630cd50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f412f4ac640 1 -- 172.21.15.99:0/1363427598 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f412002d070 con 0x55814630a960 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146309800 con 0x55814620d910 2024-09-13T23:25:36.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.766+0000 7f412fcad640 1 -- 172.21.15.99:0/1363427598 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f412800a4a0 con 0x55814620d910 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146309ce0 con 0x55814630a960 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f412f4ac640 1 -- 172.21.15.99:0/1363427598 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f412002d070 con 0x55814630a960 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f4133721800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f4133721800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5581460a5580 con 0x5581462f5470 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56680/0 (socket says 172.21.15.99:56680) 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.767+0000 7f412fcad640 1 -- 172.21.15.99:0/450057327 learned_addr learned my addr 172.21.15.99:0/450057327 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f412fcad640 1 -- 172.21.15.99:0/450057327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581462f5890 con 0x5581462f5470 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f412fcad640 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x558146308a10 tx=0x7f41280163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f4019602640 1 -- 172.21.15.99:0/450057327 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4128013450 con 0x5581462f5470 2024-09-13T23:25:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f4019602640 1 -- 172.21.15.99:0/450057327 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41280135f0 con 0x5581462f5470 2024-09-13T23:25:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f4019602640 1 -- 172.21.15.99:0/450057327 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41280138d0 con 0x5581462f5470 2024-09-13T23:25:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581462f40c0 con 0x5581462f5470 2024-09-13T23:25:36.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.768+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581462f45c0 con 0x5581462f5470 2024-09-13T23:25:36.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f4019602640 1 -- 172.21.15.99:0/450057327 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4128011040 con 0x5581462f5470 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f4019602640 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 0x7f4008039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f4019602640 1 -- 172.21.15.99:0/450057327 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f412800e040 con 0x5581462f5470 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f412f4ac640 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 0x7f4008039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f412f4ac640 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 0x7f4008039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x558146308f10 tx=0x7f412004b6e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.769+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f4133721800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f4133721800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5581462f9e20 con 0x55814632ad40 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56682/0 (socket says 172.21.15.99:56682) 2024-09-13T23:25:36.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f412fcad640 1 -- 172.21.15.99:0/2684629536 learned_addr learned my addr 172.21.15.99:0/2684629536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f412fcad640 1 -- 172.21.15.99:0/2684629536 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55814632b710 con 0x55814632ad40 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f412fcad640 1 --2- 172.21.15.99:0/2684629536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f412804cd90 tx=0x7f412804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5236823a2866adb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f4012ffd640 1 -- 172.21.15.99:0/2684629536 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412804a070 con 0x55814632ad40 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f4012ffd640 1 -- 172.21.15.99:0/2684629536 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412802a570 con 0x55814632ad40 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.770+0000 7f4012ffd640 1 -- 172.21.15.99:0/2684629536 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412801f4c0 con 0x55814632ad40 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- 172.21.15.99:0/2684629536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 msgr2=0x55814632b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 --2- 172.21.15.99:0/2684629536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f412804cd90 tx=0x7f412804cf90 comp rx=0 tx=0).stop 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- 172.21.15.99:0/2684629536 shutdown_connections 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 --2- 172.21.15.99:0/2684629536 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x55814632b140 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- 172.21.15.99:0/2684629536 >> 172.21.15.99:0/2684629536 conn(0x558146327050 msgr2=0x5581463251a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- 172.21.15.99:0/2684629536 shutdown_connections 2024-09-13T23:25:36.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- 172.21.15.99:0/2684629536 wait complete. 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 Processor -- start 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- start start 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f4133721800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55814632bd80 con 0x55814632ad40 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.771+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f412fcad640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56688/0 (socket says 172.21.15.99:56688) 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 learned_addr learned my addr 172.21.15.99:0/2554437644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558146332740 con 0x55814632ad40 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f412fcad640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f412802ac70 tx=0x7f412804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f40117fa640 1 -- 172.21.15.99:0/2554437644 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412801f710 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f40117fa640 1 -- 172.21.15.99:0/2554437644 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4128039070 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581463329d0 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f40117fa640 1 -- 172.21.15.99:0/2554437644 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f412801f9e0 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.772+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558146335680 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.773+0000 7f40117fa640 1 -- 172.21.15.99:0/2554437644 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4128033070 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.773+0000 7f40117fa640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3ff8036b90 0x7f3ff8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.773+0000 7f40117fa640 1 -- 172.21.15.99:0/2554437644 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4128041040 con 0x55814632ad40 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.773+0000 7f412f4ac640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3ff8036b90 0x7f3ff8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.773+0000 7f412f4ac640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3ff8036b90 0x7f3ff8039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f412000e910 tx=0x7f412004bf90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814633de80 0x558146340340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146340a90 con 0x55814633de80 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4126cab640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814633de80 0x558146340340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4126cab640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814633de80 0x558146340340 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 20 realm 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.774+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146340ec0 con 0x55814633de80 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146341790 con 0x55814633de80 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146341b30 con 0x55814633de80 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558146342890 0x558146344c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146345290 con 0x558146342890 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.775+0000 7f412fcad640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558146342890 0x558146344c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412fcad640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558146342890 0x558146344c80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f4133721800 20 searching for the correct realm 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558146347220 0x5581463496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412f4ac640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558146347220 0x5581463496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412f4ac640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558146347220 0x5581463496e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.776+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.777+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.777+0000 7f412fcad640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4128059040 0x7f41280126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.777+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.777+0000 7f4126cab640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4128059040 0x7f41280126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.777+0000 7f4126cab640 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4128059040 0x7f41280126f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.778+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.779+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.780+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.781+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.782+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.783+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146347220 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x7f4128059040 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x55814633de80 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.784+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558146349db0 con 0x558146342890 2024-09-13T23:25:36.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146345ae0 con 0x55814633de80 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146345ed0 con 0x55814633de80 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.785+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814634a230 con 0x558146342890 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 zone default found 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 4 Realm: () 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 zonegroup default 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814634aa80 con 0x7f4128059040 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814634c460 con 0x558146347220 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814634c8c0 con 0x558146347220 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 started sync module instance, tier type = 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.786+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634b8f0 con 0x558146342890 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.787+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.787+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94013717003488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634b550 con 0x558146342890 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.788+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634d7f0 con 0x55814633de80 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.788+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94013717003488] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.789+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.789+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94013717007648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634d7f0 con 0x55814633de80 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.789+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634e230 con 0x558146347220 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.790+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94013717007648] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.790+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.790+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94013717009216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634d760 con 0x558146347220 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.790+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634f0f0 con 0x558146342890 2024-09-13T23:25:36.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.791+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94013717009216] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.791+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.791+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94013717015616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634f060 con 0x558146342890 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.791+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634ffb0 con 0x55814633de80 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.792+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.792+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94013717019392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634ff20 con 0x55814633de80 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.792+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94013717015616] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.792+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146350ef0 con 0x7f4128059040 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.793+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.793+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94013717019392] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.793+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94013717023168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146350eb0 con 0x7f4128059040 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.793+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463503a0 con 0x7f4128059040 2024-09-13T23:25:36.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.794+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94013717023168] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.795+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.795+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94013717021600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146351450 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.795+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146351e10 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94013717027168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146352230 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=0 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=1 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=2 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=3 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=4 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=5 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94013717021600] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.796+0000 7f4133721800 20 add_watcher() i=6 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94013717027168] v31'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4133721800 20 add_watcher() i=7 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4133721800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146352230 con 0x55814633de80 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.797+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94013717028224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463521a0 con 0x55814633de80 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.798+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94013717028224] v31'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4118051070 con 0x55814633de80 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.798+0000 7f3fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.798+0000 7f4133721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.798+0000 7f4133721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.798+0000 7f4133721800 5 note: GC not initialized 2024-09-13T23:25:36.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f3fe4fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 20 Filter name: none 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f3f5e7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146388550 con 0x7f4128059040 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:36.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.799+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814638a630 con 0x558146342890 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814638c070 con 0x7f4128059040 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.800+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814638d590 con 0x7f4128059040 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.801+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(65 fud.buckets [call] v31'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4118051070 con 0x7f4128059040 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.801+0000 7f4133721800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.801+0000 7f4133721800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.801+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55814638d990 con 0x558146342890 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f4133721800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f4133721800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T23:25:36.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f4133721800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f4133721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.802+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558146393580 con 0x558146342890 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v31'23 uv23 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4133721800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4133721800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4133721800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94013717278864 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558146390b10 con 0x7f4128059040 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify (1) cookie 94013717021600 notify 133143986182 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55814638c460 con 0x7f4128059040 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4012ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986182 cookie 94013717021600 notifier 4521 bl.length()=338 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4012ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4012ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4012ffd640 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f3ff4003ea0 con 0x7f4128059040 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.803+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(68 notify.6 [notify cookie 94013717278864 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f411807f040 con 0x7f4128059040 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.804+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x7f4128059040 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.804+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify_complete (2) cookie 94013717278864 notify 133143986182 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55814638b5b0 con 0x7f4128059040 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.805+0000 7f3fe5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.805+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94013717028224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463862a0 con 0x55814633de80 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.806+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94013717028224] v31'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f411807f040 con 0x55814633de80 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.806+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94013717003488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463862a0 con 0x558146342890 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.807+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94013717003488] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.807+0000 7f4133721800 20 remove_watcher() i=0 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.807+0000 7f4133721800 2 removed watcher, disabling cache 2024-09-13T23:25:36.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.807+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94013717007648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463862a0 con 0x55814633de80 2024-09-13T23:25:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.808+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94013717007648] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x55814633de80 2024-09-13T23:25:36.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.808+0000 7f4133721800 20 remove_watcher() i=1 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.808+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94013717009216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5581463862a0 con 0x558146347220 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.809+0000 7f412f4ac640 1 -- 172.21.15.99:0/2554437644 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94013717009216] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f412002d070 con 0x558146347220 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.809+0000 7f4133721800 20 remove_watcher() i=2 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.809+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94013717015616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634bce0 con 0x558146342890 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.810+0000 7f412fcad640 1 -- 172.21.15.99:0/2554437644 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94013717015616] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4128027020 con 0x558146342890 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.810+0000 7f4133721800 20 remove_watcher() i=3 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.810+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94013717019392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634cd20 con 0x55814633de80 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.811+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94013717019392] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x55814633de80 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.811+0000 7f4133721800 20 remove_watcher() i=4 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.811+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94013717023168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634d340 con 0x7f4128059040 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.812+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94013717023168] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x7f4128059040 2024-09-13T23:25:36.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.812+0000 7f4133721800 20 remove_watcher() i=5 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.812+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94013717021600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634ec40 con 0x7f4128059040 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.813+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94013717021600] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x7f4128059040 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.813+0000 7f4133721800 20 remove_watcher() i=6 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.813+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94013717027168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55814634fb00 con 0x7f4128059040 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.813+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94013717027168] v31'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f411807f040 con 0x7f4128059040 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.813+0000 7f4133721800 20 remove_watcher() i=7 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4128059040 msgr2=0x7f41280126f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4128059040 0x7f41280126f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814633de80 msgr2=0x558146340340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814633de80 0x558146340340 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558146342890 msgr2=0x558146344c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558146342890 0x558146344c80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558146347220 msgr2=0x5581463496e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558146347220 0x5581463496e0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3ff8036b90 msgr2=0x7f3ff8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3ff8036b90 0x7f3ff8039050 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f412000e910 tx=0x7f412004bf90 comp rx=0 tx=0).stop 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 msgr2=0x558146332200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4126cab640 1 -- 172.21.15.99:0/2554437644 reap_dead start 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f412802ac70 tx=0x7f412804cd20 comp rx=0 tx=0).stop 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 shutdown_connections 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/2554437644 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55814632ad40 0x558146332200 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 >> 172.21.15.99:0/2554437644 conn(0x558146327050 msgr2=0x558146325170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 shutdown_connections 2024-09-13T23:25:36.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/2554437644 wait complete. 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 msgr2=0x7f4008039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 0x7f4008039050 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x558146308f10 tx=0x7f412004b6e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 msgr2=0x5581462f3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x558146308a10 tx=0x7f41280163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 shutdown_connections 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4008036b90 0x7f4008039050 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 --2- 172.21.15.99:0/450057327 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5581462f5470 0x5581462f3ac0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 >> 172.21.15.99:0/450057327 conn(0x558146310d80 msgr2=0x558146313900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 shutdown_connections 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.814+0000 7f4133721800 1 -- 172.21.15.99:0/450057327 wait complete. 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 msgr2=0x558146308110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 0x558146308110 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 msgr2=0x55814630cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 0x55814630cd50 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 msgr2=0x7f4014038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 0x7f4014038fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4118057000 tx=0x7f4118052000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 msgr2=0x5581463010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f412000b210 tx=0x7f4120000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 shutdown_connections 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55814630a960 0x55814630cd50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55814620d910 0x558146308110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4014036af0 0x7f4014038fb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 --2- 172.21.15.99:0/1363427598 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558146209a50 0x5581463010a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 >> 172.21.15.99:0/1363427598 conn(0x558146204550 msgr2=0x5581462f7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 shutdown_connections 2024-09-13T23:25:36.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.815+0000 7f4133721800 1 -- 172.21.15.99:0/1363427598 wait complete. 2024-09-13T23:25:36.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1'] 2024-09-13T23:25:36.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1'] 2024-09-13T23:25:36.831 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.879 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:36.880 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b42211800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55da768fb4e0 0x55da768fb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b42211800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da767bbb30 con 0x55da768fbe20 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b42211800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55da7679d360 con 0x55da768fb4e0 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b3d92c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55da768fb4e0 0x55da768fb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b3d92c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55da768fb4e0 0x55da768fb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56704/0 (socket says 172.21.15.99:56704) 2024-09-13T23:25:36.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b37fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55da768fbe20 0x55da769009a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41962/0 (socket says 172.21.15.99:41962) 2024-09-13T23:25:36.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.879+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2844107755 learned_addr learned my addr 172.21.15.99:0/2844107755 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.880+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2844107755 >> v1:172.21.15.43:6789/0 conn(0x55da768fbe20 legacy=0x55da769009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.880+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2844107755 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da767c3e00 con 0x55da768fb4e0 2024-09-13T23:25:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.881+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/2844107755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da768fb8e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000a6b0 tx=0x7f4b30047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5678b4f8c383aad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.881+0000 7f4b3d12b640 1 -- 172.21.15.99:0/2844107755 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3000a200 con 0x55da768fb4e0 2024-09-13T23:25:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.881+0000 7f4b3d12b640 1 -- 172.21.15.99:0/2844107755 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3000a3a0 con 0x55da768fb4e0 2024-09-13T23:25:36.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b3d12b640 1 -- 172.21.15.99:0/2844107755 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b30008700 con 0x55da768fb4e0 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 -- 172.21.15.99:0/2844107755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 msgr2=0x55da768fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 --2- 172.21.15.99:0/2844107755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da768fb8e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000a6b0 tx=0x7f4b30047e30 comp rx=0 tx=0).stop 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 -- 172.21.15.99:0/2844107755 shutdown_connections 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 --2- 172.21.15.99:0/2844107755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da768fb8e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 -- 172.21.15.99:0/2844107755 >> 172.21.15.99:0/2844107755 conn(0x55da768f6e10 msgr2=0x55da768f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 -- 172.21.15.99:0/2844107755 shutdown_connections 2024-09-13T23:25:36.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.882+0000 7f4b42211800 1 -- 172.21.15.99:0/2844107755 wait complete. 2024-09-13T23:25:36.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b42211800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b42211800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da76848350 con 0x55da768fb4e0 2024-09-13T23:25:36.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b3d92c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b3d92c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56706/0 (socket says 172.21.15.99:56706) 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.896+0000 7f4b3d92c640 1 -- 172.21.15.99:0/611883309 learned_addr learned my addr 172.21.15.99:0/611883309 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.897+0000 7f4b3d92c640 1 -- 172.21.15.99:0/611883309 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da76795bc0 con 0x55da768fb4e0 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.897+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/611883309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b30048360 tx=0x7f4b30051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea95e70984926802 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.897+0000 7f4a2be07640 1 -- 172.21.15.99:0/611883309 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3000a200 con 0x55da768fb4e0 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.897+0000 7f4a2be07640 1 -- 172.21.15.99:0/611883309 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30065070 con 0x55da768fb4e0 2024-09-13T23:25:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.897+0000 7f4a2be07640 1 -- 172.21.15.99:0/611883309 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b300086e0 con 0x55da768fb4e0 2024-09-13T23:25:36.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- 172.21.15.99:0/611883309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 msgr2=0x55da769e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 --2- 172.21.15.99:0/611883309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b30048360 tx=0x7f4b30051000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- 172.21.15.99:0/611883309 shutdown_connections 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 --2- 172.21.15.99:0/611883309 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769e9700 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- 172.21.15.99:0/611883309 >> 172.21.15.99:0/611883309 conn(0x55da768f6e10 msgr2=0x55da769e50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- 172.21.15.99:0/611883309 shutdown_connections 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- 172.21.15.99:0/611883309 wait complete. 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b42211800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da769024a0 con 0x55da768fb4e0 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b3d92c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b3d92c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56716/0 (socket says 172.21.15.99:56716) 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.898+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2859368959 learned_addr learned my addr 172.21.15.99:0/2859368959 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da767a9fe0 con 0x55da768fb4e0 2024-09-13T23:25:36.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4b30062040 tx=0x7f4b30002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4a2a604640 1 -- 172.21.15.99:0/2859368959 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b30008ad0 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4a2a604640 1 -- 172.21.15.99:0/2859368959 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30008c90 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da769f5940 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4a2a604640 1 -- 172.21.15.99:0/2859368959 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3004f4c0 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.899+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da769f5ec0 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4a2a604640 1 -- 172.21.15.99:0/2859368959 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b3004f660 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4a2a604640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 0x7f4a24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4a2a604640 1 -- 172.21.15.99:0/2859368959 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4b3005d040 con 0x55da768fb4e0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4b37fff640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 0x7f4a24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 0x55da769fc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da769fc9b0 con 0x55da768fbe20 2024-09-13T23:25:36.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 0x55da769fc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.900+0000 7f4b37fff640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 0x7f4a24039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b28000f60 tx=0x7f4b28001370 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 0x55da769fc470 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b3e12d640 1 -- 172.21.15.99:0/2859368959 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3800a4a0 con 0x55da768fbe20 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da769f9a40 con 0x55da768fbe20 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b3e12d640 1 -- 172.21.15.99:0/2859368959 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b3800a4a0 con 0x55da768fbe20 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 0x55da76a010f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a01790 con 0x55da769fed00 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 0x55da76a010f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.901+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 0x55da76a010f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.902+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2859368959 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da769fed00 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.902+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da769fdba0 con 0x55da768fbe20 2024-09-13T23:25:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.902+0000 7f4b3e12d640 1 -- 172.21.15.99:0/2859368959 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b3800a4a0 con 0x55da768fbe20 2024-09-13T23:25:36.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.902+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da769fe080 con 0x55da769fed00 2024-09-13T23:25:36.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.902+0000 7f4b3d92c640 1 -- 172.21.15.99:0/2859368959 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da769fed00 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b42211800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b42211800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da76797580 con 0x55da76a100b0 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56722/0 (socket says 172.21.15.99:56722) 2024-09-13T23:25:36.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b3e12d640 1 -- 172.21.15.99:0/968262740 learned_addr learned my addr 172.21.15.99:0/968262740 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b3e12d640 1 -- 172.21.15.99:0/968262740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da76a10a10 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.903+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55da769f64b0 tx=0x7f4b380167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4a237fe640 1 -- 172.21.15.99:0/968262740 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38013640 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4a237fe640 1 -- 172.21.15.99:0/968262740 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b380137e0 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da76a10ca0 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4a237fe640 1 -- 172.21.15.99:0/968262740 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38013ae0 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da76a13980 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.904+0000 7f4a237fe640 1 -- 172.21.15.99:0/968262740 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b38011040 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4a237fe640 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 0x7f4a18039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4a237fe640 1 -- 172.21.15.99:0/968262740 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4b3800e040 con 0x55da76a100b0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 0x7f4a18039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 0x7f4a18039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55da769f9960 tx=0x7f4b30050f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b42211800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.905+0000 7f4b42211800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da769e9df0 con 0x55da76a1cd70 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56734/0 (socket says 172.21.15.99:56734) 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4b3e12d640 1 -- 172.21.15.99:0/104520565 learned_addr learned my addr 172.21.15.99:0/104520565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4b3e12d640 1 -- 172.21.15.99:0/104520565 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da76a1d740 con 0x55da76a1cd70 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/104520565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800afb0 tx=0x7f4b3801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e13f44647c70d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4a217fa640 1 -- 172.21.15.99:0/104520565 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38021ae0 con 0x55da76a1cd70 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4a217fa640 1 -- 172.21.15.99:0/104520565 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3801f340 con 0x55da76a1cd70 2024-09-13T23:25:36.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.906+0000 7f4a217fa640 1 -- 172.21.15.99:0/104520565 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38014cc0 con 0x55da76a1cd70 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- 172.21.15.99:0/104520565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 msgr2=0x55da76a1d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 --2- 172.21.15.99:0/104520565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b3800afb0 tx=0x7f4b3801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- 172.21.15.99:0/104520565 shutdown_connections 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 --2- 172.21.15.99:0/104520565 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a1d170 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- 172.21.15.99:0/104520565 >> 172.21.15.99:0/104520565 conn(0x55da76a190d0 msgr2=0x55da76a171d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- 172.21.15.99:0/104520565 shutdown_connections 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- 172.21.15.99:0/104520565 wait complete. 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 Processor -- start 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- start start 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a242a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b42211800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55da76a1ddb0 con 0x55da76a1cd70 2024-09-13T23:25:36.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b3e12d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a242a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56738/0 (socket says 172.21.15.99:56738) 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.907+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 learned_addr learned my addr 172.21.15.99:0/1367471829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da76a247e0 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a242a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b3803d040 tx=0x7f4b3800a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4a0f7fe640 1 -- 172.21.15.99:0/1367471829 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38039070 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4a0f7fe640 1 -- 172.21.15.99:0/1367471829 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b38021ae0 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da76a24a70 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4a0f7fe640 1 -- 172.21.15.99:0/1367471829 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b38040480 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.908+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da76a27720 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.909+0000 7f4a0f7fe640 1 -- 172.21.15.99:0/1367471829 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4b3804e980 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.909+0000 7f4a0f7fe640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a08036b90 0x7f4a08039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.909+0000 7f4a0f7fe640 1 -- 172.21.15.99:0/1367471829 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4b38035ad0 con 0x55da76a1cd70 2024-09-13T23:25:36.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.909+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a08036b90 0x7f4a08039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.909+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a08036b90 0x7f4a08039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b300023d0 tx=0x7f4b30093000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da76a2fce0 0x55da76a321a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a328f0 con 0x55da76a2fce0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b37fff640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da76a2fce0 0x55da76a321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b37fff640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da76a2fce0 0x55da76a321a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b2800f610 con 0x55da76a2fce0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 20 realm 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.910+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a2f130 con 0x55da76a2fce0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b2800f610 con 0x55da76a2fce0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a333e0 con 0x55da76a2fce0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b2800f610 con 0x55da76a2fce0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a33cb0 con 0x55da76a2fce0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b2800f610 con 0x55da76a2fce0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da76a346d0 0x55da76a36ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a371b0 con 0x55da76a346d0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da76a346d0 0x55da76a36ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.911+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da76a346d0 0x55da76a36ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b42211800 20 searching for the correct realm 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55da76a39180 0x55da76a3b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55da76a39180 0x55da76a3b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b3d92c640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55da76a39180 0x55da76a3b640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.912+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b3e12d640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4b3804d9b0 0x7f4b3804d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b37fff640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4b3804d9b0 0x7f4b3804d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b37fff640 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4b3804d9b0 0x7f4b3804d250 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2800f610 con 0x7f4b3804d9b0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.913+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2800f610 con 0x55da76a2fce0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.914+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.915+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.916+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.917+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2802b040 con 0x55da76a2fce0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.918+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a39180 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.919+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a2fce0 2024-09-13T23:25:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3bd10 con 0x55da76a346d0 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:36.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a37b70 con 0x55da76a2fce0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.920+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a38410 con 0x55da76a2fce0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a377b0 con 0x55da76a346d0 2024-09-13T23:25:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 zone default found 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 4 Realm: () 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 zonegroup default 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3c640 con 0x7f4b3804d9b0 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3e2b0 con 0x55da76a39180 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.921+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3e740 con 0x55da76a39180 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.922+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.922+0000 7f4b42211800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.922+0000 7f4b42211800 20 started sync module instance, tier type = 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.922+0000 7f4b42211800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.922+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3d180 con 0x55da76a346d0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.923+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.923+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396781679984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3f050 con 0x55da76a346d0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.923+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3f8a0 con 0x55da76a2fce0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.924+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396781679984] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.924+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.924+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396781685664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3f570 con 0x55da76a2fce0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.924+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a40030 con 0x55da76a39180 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.925+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.925+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396781689600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a408d0 con 0x55da76a39180 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.925+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a413d0 con 0x55da76a346d0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.925+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396781685664] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.926+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396781689600] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.926+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.926+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396781691936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a3efc0 con 0x55da76a346d0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.926+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a41e10 con 0x55da76a2fce0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.927+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.927+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396781697376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a42230 con 0x55da76a2fce0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.927+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a42c50 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.927+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396781691936] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.928+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.928+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396781700928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a42c10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.928+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396781697376] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.928+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a434f0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.929+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396781700928] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.929+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.929+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396781694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a430c0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.929+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a43ae0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396781694656] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396781704656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a43cc0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=1 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=2 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=3 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=4 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=5 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.930+0000 7f4b42211800 20 add_watcher() i=6 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.931+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396781704656] v31'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.931+0000 7f4b42211800 20 add_watcher() i=7 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.931+0000 7f4b42211800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.931+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a47090 con 0x55da76a2fce0 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.932+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.932+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396781706160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a44480 con 0x55da76a2fce0 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396781706160] v31'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f49ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 5 note: GC not initialized 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f49ee7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 20 Filter name: none 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f495ffff640 20 reqs_thread_entry: start 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.933+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a7a3e0 con 0x55da76a2fce0 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a79f30 con 0x55da76a346d0 2024-09-13T23:25:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 20 rados->read ofs=0 len=0 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.934+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a7e090 con 0x7f4b3804d9b0 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.935+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a827e0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.936+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(65 fud.buckets [call] v31'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.936+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a88740 con 0x7f4b3804d9b0 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b42211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b42211800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b42211800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b42211800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94396781946704 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a82c10 con 0x7f4b3804d9b0 2024-09-13T23:25:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify (1) cookie 94396781694656 notify 133143986183 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55da76a7e480 con 0x7f4b3804d9b0 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4a217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986183 cookie 94396781694656 notifier 4528 bl.length()=752 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(67 notify.6 [notify cookie 94396781946704 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4a217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4a217fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4a217fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4a217fa640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4a00003ea0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.937+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify_complete (2) cookie 94396781946704 notify 133143986183 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55da76a7d5b0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.938+0000 7f4b42211800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.938+0000 7f4b42211800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.938+0000 7f4b42211800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.938+0000 7f4b42211800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.938+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a7e850 con 0x55da76a346d0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.939+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(69 foo.buckets [call] v31'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.939+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a7e850 con 0x55da76a346d0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'25 uv25 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b42211800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b42211800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b42211800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94396781946960 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55da76a873b0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== watch-notify(notify (1) cookie 94396781694656 notify 133143986184 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f4b28018040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4a217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986184 cookie 94396781694656 notifier 4528 bl.length()=314 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4a217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4a217fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:36.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4a217fa640 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4a00003ea0 con 0x7f4b3804d9b0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.940+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(71 notify.6 [notify cookie 94396781946960 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.941+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== watch-notify(notify_complete (2) cookie 94396781946960 notify 133143986184 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4b28009050 con 0x7f4b3804d9b0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.941+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.941+0000 7f49ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.941+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396781706160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a2fce0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.942+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94396781706160] v31'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.943+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396781679984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a346d0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.944+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94396781679984] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.944+0000 7f4b42211800 20 remove_watcher() i=0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.944+0000 7f4b42211800 2 removed watcher, disabling cache 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.944+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396781685664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a2fce0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.945+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94396781685664] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.945+0000 7f4b42211800 20 remove_watcher() i=1 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.945+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396781689600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a39180 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.946+0000 7f4b3d92c640 1 -- 172.21.15.99:0/1367471829 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94396781689600] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b30057cf0 con 0x55da76a39180 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.946+0000 7f4b42211800 20 remove_watcher() i=2 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.946+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396781691936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a346d0 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.947+0000 7f4b3e12d640 1 -- 172.21.15.99:0/1367471829 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94396781691936] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3803b030 con 0x55da76a346d0 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.947+0000 7f4b42211800 20 remove_watcher() i=3 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.947+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396781697376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x55da76a2fce0 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.948+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94396781697376] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x55da76a2fce0 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.948+0000 7f4b42211800 20 remove_watcher() i=4 2024-09-13T23:25:36.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.948+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396781700928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x7f4b3804d9b0 2024-09-13T23:25:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.949+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94396781700928] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.949+0000 7f4b42211800 20 remove_watcher() i=5 2024-09-13T23:25:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.949+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396781694656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x7f4b3804d9b0 2024-09-13T23:25:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.950+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94396781694656] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.950+0000 7f4b42211800 20 remove_watcher() i=6 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.950+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396781704656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55da76a78130 con 0x7f4b3804d9b0 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94396781704656] v31'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b2803b040 con 0x7f4b3804d9b0 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 20 remove_watcher() i=7 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4b3804d9b0 msgr2=0x7f4b3804d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4b3804d9b0 0x7f4b3804d250 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da76a2fce0 msgr2=0x55da76a321a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da76a2fce0 0x55da76a321a0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da76a346d0 msgr2=0x55da76a36ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da76a346d0 0x55da76a36ac0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55da76a39180 msgr2=0x55da76a3b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55da76a39180 0x55da76a3b640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a08036b90 msgr2=0x7f4a08039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a08036b90 0x7f4a08039050 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b300023d0 tx=0x7f4b30093000 comp rx=0 tx=0).stop 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 msgr2=0x55da76a242a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 --2- 172.21.15.99:0/1367471829 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a1cd70 0x55da76a242a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b3803d040 tx=0x7f4b3800a7e0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 reap_dead start 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b37fff640 1 -- 172.21.15.99:0/1367471829 reap_dead start 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 shutdown_connections 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 >> 172.21.15.99:0/1367471829 conn(0x55da76a190d0 msgr2=0x55da76a171a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 shutdown_connections 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.951+0000 7f4b42211800 1 -- 172.21.15.99:0/1367471829 wait complete. 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 msgr2=0x7f4a18039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 0x7f4a18039050 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55da769f9960 tx=0x7f4b30050f40 comp rx=0 tx=0).stop 2024-09-13T23:25:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 msgr2=0x55da76a104d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x55da769f64b0 tx=0x7f4b380167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 shutdown_connections 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a18036b90 0x7f4a18039050 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/968262740 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da76a100b0 0x55da76a104d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 >> 172.21.15.99:0/968262740 conn(0x55da76a05040 msgr2=0x55da76a07bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 shutdown_connections 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/968262740 wait complete. 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 msgr2=0x55da769fc470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 0x55da769fc470 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 msgr2=0x55da76a010f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 0x55da76a010f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 msgr2=0x7f4a24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 0x7f4a24039050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4b28000f60 tx=0x7f4b28001370 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 msgr2=0x55da769f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4b30062040 tx=0x7f4b30002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 shutdown_connections 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55da769fed00 0x55da76a010f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55da768fbe20 0x55da769fc470 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4a24036b90 0x7f4a24039050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 --2- 172.21.15.99:0/2859368959 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55da768fb4e0 0x55da769f5400 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 >> 172.21.15.99:0/2859368959 conn(0x55da768f6e10 msgr2=0x55da769e3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 shutdown_connections 2024-09-13T23:25:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:36.952+0000 7f4b42211800 1 -- 172.21.15.99:0/2859368959 wait complete. 2024-09-13T23:25:36.972 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:36.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T23:25:36.972 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T23:25:37.016 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.016 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a19e11800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b8731d8900 0x55b8731dacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a19e11800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b873094b30 con 0x55b8731d44c0 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a19e11800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b873076360 con 0x55b8731d8900 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a0ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b8731d8900 0x55b8731dacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a0ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b8731d8900 0x55b8731dacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56750/0 (socket says 172.21.15.99:56750) 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a1563b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b8731d44c0 0x55b8731d48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41972/0 (socket says 172.21.15.99:41972) 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.016+0000 7f2a0ffff640 1 -- 172.21.15.99:0/847222511 learned_addr learned my addr 172.21.15.99:0/847222511 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.017+0000 7f2a0ffff640 1 -- 172.21.15.99:0/847222511 >> v1:172.21.15.43:6789/0 conn(0x55b8731d44c0 legacy=0x55b8731d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.017+0000 7f2a14e3a640 1 -- 172.21.15.99:0/847222511 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646122698 0 0) 0x55b873094b30 con 0x55b8731d44c0 2024-09-13T23:25:37.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.017+0000 7f2a0ffff640 1 -- 172.21.15.99:0/847222511 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87309ce00 con 0x55b8731d8900 2024-09-13T23:25:37.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.018+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/847222511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d8900 0x55b8731dacf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a520 tx=0x7f2a00045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37137e22e5688d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.018+0000 7f2a14e3a640 1 -- 172.21.15.99:0/847222511 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a00055070 con 0x55b8731d8900 2024-09-13T23:25:37.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.018+0000 7f2a14e3a640 1 -- 172.21.15.99:0/847222511 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000515b0 con 0x55b8731d8900 2024-09-13T23:25:37.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a14e3a640 1 -- 172.21.15.99:0/847222511 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a000518d0 con 0x55b8731d8900 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 -- 172.21.15.99:0/847222511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d8900 msgr2=0x55b8731dacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 --2- 172.21.15.99:0/847222511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d8900 0x55b8731dacf0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a520 tx=0x7f2a00045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 -- 172.21.15.99:0/847222511 shutdown_connections 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 --2- 172.21.15.99:0/847222511 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d8900 0x55b8731dacf0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 -- 172.21.15.99:0/847222511 >> 172.21.15.99:0/847222511 conn(0x55b8731cfdf0 msgr2=0x55b8731d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 -- 172.21.15.99:0/847222511 shutdown_connections 2024-09-13T23:25:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.019+0000 7f2a19e11800 1 -- 172.21.15.99:0/847222511 wait complete. 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a19e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a19e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b873121330 con 0x55b8731d44c0 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a1563b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a1563b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56766/0 (socket says 172.21.15.99:56766) 2024-09-13T23:25:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.033+0000 7f2a1563b640 1 -- 172.21.15.99:0/2418289737 learned_addr learned my addr 172.21.15.99:0/2418289737 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.034+0000 7f2a1563b640 1 -- 172.21.15.99:0/2418289737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b87306ebc0 con 0x55b8731d44c0 2024-09-13T23:25:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.034+0000 7f2a1563b640 1 --2- 172.21.15.99:0/2418289737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800b240 tx=0x7f2a0800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52af92f93ef78409 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.034+0000 7f2903606640 1 -- 172.21.15.99:0/2418289737 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08008070 con 0x55b8731d44c0 2024-09-13T23:25:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.034+0000 7f2903606640 1 -- 172.21.15.99:0/2418289737 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0800d500 con 0x55b8731d44c0 2024-09-13T23:25:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.034+0000 7f2903606640 1 -- 172.21.15.99:0/2418289737 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0800d860 con 0x55b8731d44c0 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- 172.21.15.99:0/2418289737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 msgr2=0x55b873148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2418289737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800b240 tx=0x7f2a0800b700 comp rx=0 tx=0).stop 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- 172.21.15.99:0/2418289737 shutdown_connections 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2418289737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b873148d80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- 172.21.15.99:0/2418289737 >> 172.21.15.99:0/2418289737 conn(0x55b8731cfdf0 msgr2=0x55b8732beed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- 172.21.15.99:0/2418289737 shutdown_connections 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- 172.21.15.99:0/2418289737 wait complete. 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a19e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8731db530 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a1563b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a1563b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56774/0 (socket says 172.21.15.99:56774) 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.035+0000 7f2a1563b640 1 -- 172.21.15.99:0/2954113999 learned_addr learned my addr 172.21.15.99:0/2954113999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2a1563b640 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b873082fe0 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2a1563b640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55b873148480 tx=0x7f2a08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2901e03640 1 -- 172.21.15.99:0/2954113999 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08019870 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2901e03640 1 -- 172.21.15.99:0/2954113999 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08019a10 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8732ce7d0 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2901e03640 1 -- 172.21.15.99:0/2954113999 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a08019d30 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.036+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8732cecf0 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2901e03640 1 -- 172.21.15.99:0/2954113999 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2a08017040 con 0x55b8731d44c0 2024-09-13T23:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2901e03640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 0x7f28fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2901e03640 1 -- 172.21.15.99:0/2954113999 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2a08015020 con 0x55b8731d44c0 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 0x7f28fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 0x55b8732d5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8732d5840 con 0x55b8731d8900 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 0x55b8732d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 0x7f28fc039000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a00057000 tx=0x7f2a00052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.037+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 0x55b8732d5300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a15e3c640 1 -- 172.21.15.99:0/2954113999 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a1000a4a0 con 0x55b8731d8900 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8732d28b0 con 0x55b8731d8900 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a15e3c640 1 -- 172.21.15.99:0/2954113999 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a1000a4a0 con 0x55b8731d8900 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 0x55b8732d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8732da5e0 con 0x55b8732d7b50 2024-09-13T23:25:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a1563b640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 0x55b8732d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.038+0000 7f2a1563b640 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 0x55b8732d9f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a1563b640 1 -- 172.21.15.99:0/2954113999 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a0802d070 con 0x55b8732d7b50 2024-09-13T23:25:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8732d69f0 con 0x55b8731d8900 2024-09-13T23:25:37.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a15e3c640 1 -- 172.21.15.99:0/2954113999 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a1000a4a0 con 0x55b8731d8900 2024-09-13T23:25:37.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8732d6ed0 con 0x55b8732d7b50 2024-09-13T23:25:37.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a1563b640 1 -- 172.21.15.99:0/2954113999 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a0802d070 con 0x55b8732d7b50 2024-09-13T23:25:37.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.039+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a19e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a19e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b873070580 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56788/0 (socket says 172.21.15.99:56788) 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a15e3c640 1 -- 172.21.15.99:0/3610292029 learned_addr learned my addr 172.21.15.99:0/3610292029 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a15e3c640 1 -- 172.21.15.99:0/3610292029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8732e98d0 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.040+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55b8732cf340 tx=0x7f2a100167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f28faffd640 1 -- 172.21.15.99:0/3610292029 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10013640 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f28faffd640 1 -- 172.21.15.99:0/3610292029 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a100137e0 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f28faffd640 1 -- 172.21.15.99:0/3610292029 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10013ae0 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8732e9b60 con 0x55b8732e8f70 2024-09-13T23:25:37.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8732ec840 con 0x55b8732e8f70 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.041+0000 7f28faffd640 1 -- 172.21.15.99:0/3610292029 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2a10011040 con 0x55b8732e8f70 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f28faffd640 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 0x7f28ec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f28faffd640 1 -- 172.21.15.99:0/3610292029 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2a1000e040 con 0x55b8732e8f70 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a1563b640 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 0x7f28ec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a1563b640 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 0x7f28ec039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55b8732d27f0 tx=0x7f2a0801b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a19e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a19e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8732c9740 con 0x55b8732f5c30 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56790/0 (socket says 172.21.15.99:56790) 2024-09-13T23:25:37.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.042+0000 7f2a15e3c640 1 -- 172.21.15.99:0/552060736 learned_addr learned my addr 172.21.15.99:0/552060736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a15e3c640 1 -- 172.21.15.99:0/552060736 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8732f6600 con 0x55b8732f5c30 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/552060736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000afb0 tx=0x7f2a1001fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d179868f3cffbb57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f28f8ff9640 1 -- 172.21.15.99:0/552060736 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10021ae0 con 0x55b8732f5c30 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f28f8ff9640 1 -- 172.21.15.99:0/552060736 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1001f340 con 0x55b8732f5c30 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f28f8ff9640 1 -- 172.21.15.99:0/552060736 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10014cc0 con 0x55b8732f5c30 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 -- 172.21.15.99:0/552060736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 msgr2=0x55b8732f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 --2- 172.21.15.99:0/552060736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000afb0 tx=0x7f2a1001fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 -- 172.21.15.99:0/552060736 shutdown_connections 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 --2- 172.21.15.99:0/552060736 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732f6030 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 -- 172.21.15.99:0/552060736 >> 172.21.15.99:0/552060736 conn(0x55b8732f1f90 msgr2=0x55b8732f0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 -- 172.21.15.99:0/552060736 shutdown_connections 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.043+0000 7f2a19e11800 1 -- 172.21.15.99:0/552060736 wait complete. 2024-09-13T23:25:37.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a19e11800 1 Processor -- start 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a19e11800 1 -- start start 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a19e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a19e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8732f6c70 con 0x55b8732f5c30 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a15e3c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56794/0 (socket says 172.21.15.99:56794) 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 learned_addr learned my addr 172.21.15.99:0/12553012 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.044+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8732fd5e0 con 0x55b8732f5c30 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a1003d040 tx=0x7f2a1000a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f28eaffd640 1 -- 172.21.15.99:0/12553012 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10039070 con 0x55b8732f5c30 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f28eaffd640 1 -- 172.21.15.99:0/12553012 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a10021ae0 con 0x55b8732f5c30 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b8732fd870 con 0x55b8732f5c30 2024-09-13T23:25:37.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f28eaffd640 1 -- 172.21.15.99:0/12553012 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a10040480 con 0x55b8732f5c30 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b873300520 con 0x55b8732f5c30 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.045+0000 7f28eaffd640 1 -- 172.21.15.99:0/12553012 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2a1004e980 con 0x55b8732f5c30 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f28eaffd640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28e0036b90 0x7f28e0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f28eaffd640 1 -- 172.21.15.99:0/12553012 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f2a10035ad0 con 0x55b8732f5c30 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a1563b640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28e0036b90 0x7f28e0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a1563b640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28e0036b90 0x7f28e0039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a0804d0b0 tx=0x7f2a08031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b873308ae0 0x55b87330afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b87330b6f0 con 0x55b873308ae0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.046+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b873308ae0 0x55b87330afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b873308ae0 0x55b87330afa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 realm 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b87330bb20 con 0x55b873308ae0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b87330c3f0 con 0x55b873308ae0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.047+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b87330c790 con 0x55b873308ae0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b87330d4f0 0x55b87330f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b87330fef0 con 0x55b87330d4f0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b87330d4f0 0x55b87330f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b87330d4f0 0x55b87330f8e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 20 searching for the correct realm 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b873311e80 0x55b873314340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.048+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a1563b640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b873311e80 0x55b873314340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a1563b640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b873311e80 0x55b873314340 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a15e3c640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2a1004d9b0 0x7f2a1004d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.049+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2a1004d9b0 0x7f2a1004d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2a1004d9b0 0x7f2a1004d250 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.050+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.051+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.052+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.053+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.054+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.055+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873311e80 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.056+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b873308ae0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b873314a10 con 0x55b87330d4f0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8733113d0 con 0x55b873308ae0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873310c40 con 0x55b873308ae0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.057+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873310380 con 0x55b87330d4f0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 zone default found 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 4 Realm: () 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 zonegroup default 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873315340 con 0x7f2a1004d9b0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b8733175c0 con 0x55b873311e80 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.058+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873317960 con 0x55b873311e80 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.059+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.059+0000 7f2a19e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.059+0000 7f2a19e11800 20 started sync module instance, tier type = 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.059+0000 7f2a19e11800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.059+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873316a00 con 0x55b87330d4f0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.060+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.060+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250694962592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8733171c0 con 0x55b87330d4f0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.060+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8733186a0 con 0x55b873308ae0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.061+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250694962592] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.061+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.061+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250694966528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873318ac0 con 0x55b873308ae0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.061+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b8733194c0 con 0x55b873311e80 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.062+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250694966528] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.062+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.062+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250694967584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873319860 con 0x55b873311e80 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.062+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331a330 con 0x55b87330d4f0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.063+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250694967584] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.063+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.063+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250694975008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331a750 con 0x55b87330d4f0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.063+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331b190 con 0x55b873308ae0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.064+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.064+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250694978656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331b150 con 0x55b873308ae0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.064+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331c150 con 0x7f2a1004d9b0 2024-09-13T23:25:37.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.064+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250694975008] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.065+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250694978656] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.065+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.065+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250694982784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331c150 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.065+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331c5a0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.066+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.066+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250694980992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331ca10 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.066+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331d500 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.066+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250694982784] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250694980992] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250694987728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331c560 con 0x7f2a1004d9b0 2024-09-13T23:25:37.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=0 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=1 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=2 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=3 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=4 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=5 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.067+0000 7f2a19e11800 20 add_watcher() i=6 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.068+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250694987728] v31'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.068+0000 7f2a19e11800 20 add_watcher() i=7 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.068+0000 7f2a19e11800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.068+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873320600 con 0x55b873308ae0 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.069+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.069+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250694971344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331da80 con 0x55b873308ae0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.069+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250694971344] v31'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.070+0000 7f28cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.070+0000 7f2a19e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.070+0000 7f2a19e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.070+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873328e30 con 0x55b873308ae0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.071+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.071+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873329500 con 0x7f2a1004d9b0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.072+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.072+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873329900 con 0x55b873311e80 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.073+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.073+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332a320 con 0x55b873308ae0 2024-09-13T23:25:37.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.074+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'122 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.074+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873324ae0 con 0x55b87330d4f0 2024-09-13T23:25:37.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.075+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'35 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.075+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873324ae0 con 0x55b873311e80 2024-09-13T23:25:37.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.076+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.076+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873324b00 con 0x55b873308ae0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.077+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.077+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873324bb0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.078+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.078+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873324bb0 con 0x55b87330d4f0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.079+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.079+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.080+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.080+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b87330d4f0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.081+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'36 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.081+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.082+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.082+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b87330d4f0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.083+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.083+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.084+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.084+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873308ae0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.085+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'123 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.085+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.086+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.086+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b87330d4f0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.087+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.087+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.088+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.088+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873308ae0 2024-09-13T23:25:37.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.089+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.089+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873308ae0 2024-09-13T23:25:37.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.090+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'124 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x55b873308ae0 2024-09-13T23:25:37.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.090+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.091+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.091+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b87330d4f0 2024-09-13T23:25:37.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.092+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.092+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.093+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.093+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.094+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.094+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.095+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.095+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.096+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.096+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.097+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.097+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.098+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.098+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.099+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.099+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b873311e80 2024-09-13T23:25:37.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.100+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.100+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.101+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.101+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87332aec0 con 0x55b87330d4f0 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.102+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.102+0000 7f28ca7e4640 20 reqs_thread_entry: start 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f2a19e11800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f2a19e11800 20 Filter name: none 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f283bfff640 20 reqs_thread_entry: start 2024-09-13T23:25:37.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f2a19e11800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:25:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f2a19e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.103+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873355f60 con 0x7f2a1004d9b0 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2a00057030 con 0x7f2a1004d9b0 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873358890 con 0x7f2a1004d9b0 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:25:37.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.104+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873356870 con 0x7f2a1004d9b0 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f2a19e11800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94250695226240 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873358ec0 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== watch-notify(notify (1) cookie 94250694967584 notify 133143986179 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b873324bb0 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f28f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986179 cookie 94250694967584 notifier 4535 bl.length()=170 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f28f8ff9640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f28d8003d60 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.105+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(97 notify.2 [notify cookie 94250695226240 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.106+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.106+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== watch-notify(notify_complete (2) cookie 94250695226240 notify 133143986179 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b873329ca0 con 0x55b873311e80 2024-09-13T23:25:37.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.106+0000 7f2a19e11800 10 removing email index: 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.106+0000 7f2a19e11800 10 removing user buckets index 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.106+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873358dc0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(99 fud.buckets [delete] v31'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a19e11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94250695231760 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873358390 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== watch-notify(notify (1) cookie 94250694980992 notify 133143986185 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55b8733251c0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f28ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986185 cookie 94250694980992 notifier 4535 bl.length()=160 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f28ebfff640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f28480032c0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(100 notify.6 [notify cookie 94250695231760 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== watch-notify(notify_complete (2) cookie 94250695231760 notify 133143986185 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b8733287d0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a19e11800 10 removing user index: fud 2024-09-13T23:25:37.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.107+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873358dc0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.108+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(102 fud [call,call,delete] v31'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.108+0000 7f2a19e11800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:25:37.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.108+0000 7f2a19e11800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.108+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94250695231760 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b873357380 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== watch-notify(notify (1) cookie 94250694982784 notify 133143986186 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b8733287d0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f28f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986186 cookie 94250694982784 notifier 4535 bl.length()=152 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f28f8ff9640 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f28d8003d60 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(103 notify.5 [notify cookie 94250695231760 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.109+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== watch-notify(notify_complete (2) cookie 94250695231760 notify 133143986186 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b873328fc0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.110+0000 7f28cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.110+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250694971344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873358dc0 con 0x55b873308ae0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.111+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94250694971344] v31'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x55b873308ae0 2024-09-13T23:25:37.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.111+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250694962592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873318fd0 con 0x55b87330d4f0 2024-09-13T23:25:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.112+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94250694962592] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.112+0000 7f2a19e11800 20 remove_watcher() i=0 2024-09-13T23:25:37.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.112+0000 7f2a19e11800 2 removed watcher, disabling cache 2024-09-13T23:25:37.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.112+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250694966528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873318fd0 con 0x55b873308ae0 2024-09-13T23:25:37.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.113+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94250694966528] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x55b873308ae0 2024-09-13T23:25:37.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.113+0000 7f2a19e11800 20 remove_watcher() i=1 2024-09-13T23:25:37.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.113+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250694967584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873317d00 con 0x55b873311e80 2024-09-13T23:25:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.114+0000 7f2a1563b640 1 -- 172.21.15.99:0/12553012 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94250694967584] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a08044d70 con 0x55b873311e80 2024-09-13T23:25:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.114+0000 7f2a19e11800 20 remove_watcher() i=2 2024-09-13T23:25:37.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.114+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250694975008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873318fd0 con 0x55b87330d4f0 2024-09-13T23:25:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.115+0000 7f2a15e3c640 1 -- 172.21.15.99:0/12553012 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94250694975008] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a1003b030 con 0x55b87330d4f0 2024-09-13T23:25:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.115+0000 7f2a19e11800 20 remove_watcher() i=3 2024-09-13T23:25:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.115+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250694978656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873319e20 con 0x55b873308ae0 2024-09-13T23:25:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.116+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94250694978656] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x55b873308ae0 2024-09-13T23:25:37.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.116+0000 7f2a19e11800 20 remove_watcher() i=4 2024-09-13T23:25:37.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.116+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250694982784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873318fd0 con 0x7f2a1004d9b0 2024-09-13T23:25:37.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.117+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94250694982784] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.117+0000 7f2a19e11800 20 remove_watcher() i=5 2024-09-13T23:25:37.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.117+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250694980992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b873319e20 con 0x7f2a1004d9b0 2024-09-13T23:25:37.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.118+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94250694980992] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.118+0000 7f2a19e11800 20 remove_watcher() i=6 2024-09-13T23:25:37.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.118+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250694987728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b87331bc80 con 0x7f2a1004d9b0 2024-09-13T23:25:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94250694987728] v31'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a00080040 con 0x7f2a1004d9b0 2024-09-13T23:25:37.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 20 remove_watcher() i=7 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2a1004d9b0 msgr2=0x7f2a1004d250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f2a1004d9b0 0x7f2a1004d250 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b873308ae0 msgr2=0x55b87330afa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b873308ae0 0x55b87330afa0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b87330d4f0 msgr2=0x55b87330f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b87330d4f0 0x55b87330f8e0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b873311e80 msgr2=0x55b873314340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b873311e80 0x55b873314340 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28e0036b90 msgr2=0x7f28e0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28e0036b90 0x7f28e0039050 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2a0804d0b0 tx=0x7f2a08031000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 msgr2=0x55b8732fd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a0ffff640 1 -- 172.21.15.99:0/12553012 reap_dead start 2024-09-13T23:25:37.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2a1003d040 tx=0x7f2a1000a7e0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 shutdown_connections 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 --2- 172.21.15.99:0/12553012 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732f5c30 0x55b8732fd0a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 >> 172.21.15.99:0/12553012 conn(0x55b8732f1f90 msgr2=0x55b8732f0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 shutdown_connections 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.119+0000 7f2a19e11800 1 -- 172.21.15.99:0/12553012 wait complete. 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 msgr2=0x7f28ec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 0x7f28ec039050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55b8732d27f0 tx=0x7f2a0801b540 comp rx=0 tx=0).stop 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 msgr2=0x55b8732e9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x55b8732cf340 tx=0x7f2a100167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 shutdown_connections 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28ec036b90 0x7f28ec039050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/3610292029 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8732e8f70 0x55b8732e9390 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 >> 172.21.15.99:0/3610292029 conn(0x55b8732ddf00 msgr2=0x55b8732e0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 shutdown_connections 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/3610292029 wait complete. 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 msgr2=0x55b8732d5300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 0x55b8732d5300 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 msgr2=0x55b8732d9f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 0x55b8732d9f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 msgr2=0x7f28fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 0x7f28fc039000 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2a00057000 tx=0x7f2a00052000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 msgr2=0x55b8732ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55b873148480 tx=0x7f2a08000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 shutdown_connections 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b8732d7b50 0x55b8732d9f40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b8731d8900 0x55b8732d5300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f28fc036b40 0x7f28fc039000 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 --2- 172.21.15.99:0/2954113999 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8731d44c0 0x55b8732ce290 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 >> 172.21.15.99:0/2954113999 conn(0x55b8731cfdf0 msgr2=0x55b8732bd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 shutdown_connections 2024-09-13T23:25:37.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.120+0000 7f2a19e11800 1 -- 172.21.15.99:0/2954113999 wait complete. 2024-09-13T23:25:37.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:25:37.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T23:25:37.133 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T23:25:37.187 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.188 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc15af1f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55dcd6fa4680 0x55dcd7033210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc15af1f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dcd6eefb30 con 0x55dcd7033750 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc15af1f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55dcd6ed1360 con 0x55dcd6fa4680 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.187+0000 7fc156b95640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55dcd6fa4680 0x55dcd7033210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.188+0000 7fc156394640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55dcd7033750 0x55dcd7035b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41980/0 (socket says 172.21.15.99:41980) 2024-09-13T23:25:37.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.188+0000 7fc156394640 1 -- 172.21.15.99:0/2759138688 learned_addr learned my addr 172.21.15.99:0/2759138688 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:37.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.188+0000 7fc156b95640 1 -- 172.21.15.99:0/2759138688 >> v1:172.21.15.43:6789/0 conn(0x55dcd7033750 legacy=0x55dcd7035b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.188+0000 7fc156b95640 1 -- 172.21.15.99:0/2759138688 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd6ef7e00 con 0x55dcd6fa4680 2024-09-13T23:25:37.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc156b95640 1 --2- 172.21.15.99:0/2759138688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7033210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc148045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6461329cc507cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc155b93640 1 -- 172.21.15.99:0/2759138688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc148058530 con 0x55dcd6fa4680 2024-09-13T23:25:37.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc155b93640 1 -- 172.21.15.99:0/2759138688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1480586d0 con 0x55dcd6fa4680 2024-09-13T23:25:37.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc155b93640 1 -- 172.21.15.99:0/2759138688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1480589d0 con 0x55dcd6fa4680 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 -- 172.21.15.99:0/2759138688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 msgr2=0x55dcd7033210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2759138688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7033210 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc148005fd0 tx=0x7fc148045c30 comp rx=0 tx=0).stop 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 -- 172.21.15.99:0/2759138688 shutdown_connections 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2759138688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7033210 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 -- 172.21.15.99:0/2759138688 >> 172.21.15.99:0/2759138688 conn(0x55dcd702ade0 msgr2=0x55dcd702d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 -- 172.21.15.99:0/2759138688 shutdown_connections 2024-09-13T23:25:37.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.190+0000 7fc15af1f800 1 -- 172.21.15.99:0/2759138688 wait complete. 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.204+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.204+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.204+0000 7fc15af1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.204+0000 7fc15af1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dcd6f7c450 con 0x55dcd6fa4680 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.204+0000 7fc156b95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc156b95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56798/0 (socket says 172.21.15.99:56798) 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc156b95640 1 -- 172.21.15.99:0/2705308410 learned_addr learned my addr 172.21.15.99:0/2705308410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc156b95640 1 -- 172.21.15.99:0/2705308410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd6ec9bc0 con 0x55dcd6fa4680 2024-09-13T23:25:37.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc156b95640 1 --2- 172.21.15.99:0/2705308410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc14800a3f0 tx=0x7fc148051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c140237caeb64e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc044e09640 1 -- 172.21.15.99:0/2705308410 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc148058a30 con 0x55dcd6fa4680 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc044e09640 1 -- 172.21.15.99:0/2705308410 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148068070 con 0x55dcd6fa4680 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.205+0000 7fc044e09640 1 -- 172.21.15.99:0/2705308410 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc148058d60 con 0x55dcd6fa4680 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- 172.21.15.99:0/2705308410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 msgr2=0x55dcd711f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2705308410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc14800a3f0 tx=0x7fc148051000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- 172.21.15.99:0/2705308410 shutdown_connections 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2705308410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd711f970 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- 172.21.15.99:0/2705308410 >> 172.21.15.99:0/2705308410 conn(0x55dcd702ade0 msgr2=0x55dcd711b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- 172.21.15.99:0/2705308410 shutdown_connections 2024-09-13T23:25:37.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- 172.21.15.99:0/2705308410 wait complete. 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc15af1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dcd7037650 con 0x55dcd6fa4680 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc156b95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc156b95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56810/0 (socket says 172.21.15.99:56810) 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.206+0000 7fc156b95640 1 -- 172.21.15.99:0/994981805 learned_addr learned my addr 172.21.15.99:0/994981805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc156b95640 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd6eddfe0 con 0x55dcd6fa4680 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc156b95640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc148046130 tx=0x7fc148003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc043606640 1 -- 172.21.15.99:0/994981805 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1480636b0 con 0x55dcd6fa4680 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc043606640 1 -- 172.21.15.99:0/994981805 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc148063850 con 0x55dcd6fa4680 2024-09-13T23:25:37.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd702f230 con 0x55dcd6fa4680 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc043606640 1 -- 172.21.15.99:0/994981805 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc148063b70 con 0x55dcd6fa4680 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.207+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd702f750 con 0x55dcd6fa4680 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc043606640 1 -- 172.21.15.99:0/994981805 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc148075020 con 0x55dcd6fa4680 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc043606640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 0x7fc03c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc043606640 1 -- 172.21.15.99:0/994981805 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc148090b80 con 0x55dcd6fa4680 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc156394640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 0x7fc03c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 0x55dcd71305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7130b30 con 0x55dcd7033750 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.208+0000 7fc157396640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 0x55dcd71305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc156394640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 0x7fc03c039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc14c000f60 tx=0x7fc14c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc157396640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 0x55dcd71305f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc157396640 1 -- 172.21.15.99:0/994981805 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1500083e0 con 0x55dcd7033750 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7131380 con 0x55dcd7033750 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc157396640 1 -- 172.21.15.99:0/994981805 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1500083e0 con 0x55dcd7033750 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 0x55dcd7135170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7135900 con 0x55dcd7132cd0 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.209+0000 7fc156b95640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 0x55dcd7135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc156b95640 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 0x55dcd7135170 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc156b95640 1 -- 172.21.15.99:0/994981805 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc148077c60 con 0x55dcd7132cd0 2024-09-13T23:25:37.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7131bd0 con 0x55dcd7033750 2024-09-13T23:25:37.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc157396640 1 -- 172.21.15.99:0/994981805 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1500083e0 con 0x55dcd7033750 2024-09-13T23:25:37.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7131f70 con 0x55dcd7132cd0 2024-09-13T23:25:37.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.210+0000 7fc156b95640 1 -- 172.21.15.99:0/994981805 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc148077c60 con 0x55dcd7132cd0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc15af1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc15af1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dcd7031080 con 0x55dcd71442c0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56822/0 (socket says 172.21.15.99:56822) 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.211+0000 7fc157396640 1 -- 172.21.15.99:0/2853190239 learned_addr learned my addr 172.21.15.99:0/2853190239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc157396640 1 -- 172.21.15.99:0/2853190239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd7144c20 con 0x55dcd71442c0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc157396640 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55dcd7030880 tx=0x7fc15000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc040e01640 1 -- 172.21.15.99:0/2853190239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15001c020 con 0x55dcd71442c0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc040e01640 1 -- 172.21.15.99:0/2853190239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150007cf0 con 0x55dcd71442c0 2024-09-13T23:25:37.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd7144eb0 con 0x55dcd71442c0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc040e01640 1 -- 172.21.15.99:0/2853190239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150018440 con 0x55dcd71442c0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.212+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd7147b90 con 0x55dcd71442c0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc040e01640 1 -- 172.21.15.99:0/2853190239 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc15001f020 con 0x55dcd71442c0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc040e01640 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 0x7fc030039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc040e01640 1 -- 172.21.15.99:0/2853190239 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc15004e0c0 con 0x55dcd71442c0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc156b95640 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 0x7fc030039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc156b95640 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 0x7fc030039000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55dcd702fc50 tx=0x7fc148000f40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc15af1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.213+0000 7fc15af1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dcd6ecb580 con 0x55dcd7150f50 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56830/0 (socket says 172.21.15.99:56830) 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc157396640 1 -- 172.21.15.99:0/2721432244 learned_addr learned my addr 172.21.15.99:0/2721432244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc157396640 1 -- 172.21.15.99:0/2721432244 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd7151920 con 0x55dcd7150f50 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc157396640 1 --2- 172.21.15.99:0/2721432244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc15004c660 tx=0x7fc1500206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3bc67e9dddd32f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc03a7fc640 1 -- 172.21.15.99:0/2721432244 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15003f020 con 0x55dcd7150f50 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc03a7fc640 1 -- 172.21.15.99:0/2721432244 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150021530 con 0x55dcd7150f50 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.214+0000 7fc03a7fc640 1 -- 172.21.15.99:0/2721432244 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150018ca0 con 0x55dcd7150f50 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- 172.21.15.99:0/2721432244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 msgr2=0x55dcd7151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2721432244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc15004c660 tx=0x7fc1500206e0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- 172.21.15.99:0/2721432244 shutdown_connections 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2721432244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd7151350 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- 172.21.15.99:0/2721432244 >> 172.21.15.99:0/2721432244 conn(0x55dcd714d2b0 msgr2=0x55dcd714b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- 172.21.15.99:0/2721432244 shutdown_connections 2024-09-13T23:25:37.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- 172.21.15.99:0/2721432244 wait complete. 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 Processor -- start 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- start start 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc15af1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55dcd7151d20 con 0x55dcd7150f50 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc157396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56836/0 (socket says 172.21.15.99:56836) 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.215+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 learned_addr learned my addr 172.21.15.99:0/4254375073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcd7158700 con 0x55dcd7150f50 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc157396640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc150020720 tx=0x7fc15004c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc038ff9640 1 -- 172.21.15.99:0/4254375073 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150039070 con 0x55dcd7150f50 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc038ff9640 1 -- 172.21.15.99:0/4254375073 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc150016d60 con 0x55dcd7150f50 2024-09-13T23:25:37.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dcd7158990 con 0x55dcd7150f50 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc038ff9640 1 -- 172.21.15.99:0/4254375073 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc150020c00 con 0x55dcd7150f50 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.216+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcd715b640 con 0x55dcd7150f50 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.217+0000 7fc038ff9640 1 -- 172.21.15.99:0/4254375073 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc150016040 con 0x55dcd7150f50 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.217+0000 7fc038ff9640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc020036b40 0x7fc020039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.217+0000 7fc038ff9640 1 -- 172.21.15.99:0/4254375073 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc150031070 con 0x55dcd7150f50 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.217+0000 7fc156b95640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc020036b40 0x7fc020039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.217+0000 7fc156b95640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc020036b40 0x7fc020039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc148077fd0 tx=0x7fc148095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7163cd0 0x55dcd7166190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71668e0 con 0x55dcd7163cd0 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc156394640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7163cd0 0x55dcd7166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc156394640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7163cd0 0x55dcd7166190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc14c009050 con 0x55dcd7163cd0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 realm 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7163120 con 0x55dcd7163cd0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc14c009050 con 0x55dcd7163cd0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.218+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71673d0 con 0x55dcd7163cd0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc14c009050 con 0x55dcd7163cd0 2024-09-13T23:25:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7167ca0 con 0x55dcd7163cd0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc14c009050 con 0x55dcd7163cd0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd71685e0 0x55dcd716a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716b160 con 0x55dcd71685e0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc157396640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd71685e0 0x55dcd716a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc157396640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd71685e0 0x55dcd716a9d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.219+0000 7fc15af1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc15af1f800 20 searching for the correct realm 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55dcd716d130 0x55dcd716f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc156b95640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55dcd716d130 0x55dcd716f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc156b95640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55dcd716d130 0x55dcd716f5f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc157396640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc150058040 0x7fc1500176e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.220+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.221+0000 7fc156394640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc150058040 0x7fc1500176e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.221+0000 7fc156394640 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc150058040 0x7fc1500176e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.221+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c009050 con 0x7fc150058040 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.221+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c009050 con 0x55dcd7163cd0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.222+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.223+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.224+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.225+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.226+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd716d130 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.227+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x7fc150058040 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd7163cd0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716fcc0 con 0x55dcd71685e0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716bb20 con 0x55dcd7163cd0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.228+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716c3c0 con 0x55dcd7163cd0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd716b760 con 0x55dcd71685e0 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 zone default found 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 4 Realm: () 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 zonegroup default 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71701a0 con 0x7fc150058040 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.229+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7172470 con 0x55dcd716d130 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7172810 con 0x55dcd716d130 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 20 started sync module instance, tier type = 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.230+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7171900 con 0x55dcd71685e0 2024-09-13T23:25:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.231+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.231+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406989782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7171900 con 0x55dcd71685e0 2024-09-13T23:25:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.231+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7173210 con 0x55dcd7163cd0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.232+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406989782576] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.232+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.232+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406989786400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7171900 con 0x55dcd7163cd0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.232+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7173ca0 con 0x55dcd716d130 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.233+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.233+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406989789040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7174540 con 0x55dcd716d130 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.233+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7175010 con 0x55dcd71685e0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.233+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406989786400] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.234+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406989789040] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.234+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.234+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406989791376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7171450 con 0x55dcd71685e0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.234+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71758b0 con 0x55dcd7163cd0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.235+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.235+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406989796352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7175860 con 0x55dcd7163cd0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.235+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7176860 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.235+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406989791376] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.236+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406989796352] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.236+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.236+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406989800272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7176820 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.236+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7175df0 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.237+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.237+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406989802576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7175df0 con 0x7fc150058040 2024-09-13T23:25:37.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.237+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7177c40 con 0x7fc150058040 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.237+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406989800272] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406989805424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7177c40 con 0x7fc150058040 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=0 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=1 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=2 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=3 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=4 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=5 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406989802576] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.238+0000 7fc15af1f800 20 add_watcher() i=6 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406989805424] v31'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc15af1f800 20 add_watcher() i=7 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc15af1f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd7177070 con 0x55dcd7163cd0 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.239+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406989794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71783b0 con 0x55dcd7163cd0 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.240+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406989794048] v31'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.240+0000 7fc00d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.240+0000 7fc15af1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.240+0000 7fc15af1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.240+0000 7fc15af1f800 5 note: GC not initialized 2024-09-13T23:25:37.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fbf87fff640 20 reqs_thread_entry: start 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 20 Filter name: none 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fbf85ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71ae180 con 0x7fc150058040 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:25:37.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.241+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71ac710 con 0x7fc150058040 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.242+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71b0e40 con 0x7fc150058040 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v31'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc15af1f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc15af1f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:25:37.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc15af1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94406990038976 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71b19b0 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== watch-notify(notify (1) cookie 94406989791376 notify 133143986188 ret 0) ==== 652+0+0 (crc 0 0 0) 0x55dcd7158990 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc03a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94406989791376 notifier 4542 bl.length()=610 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc03a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc03a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 notify.3 [notify cookie 94406990038976 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc03a7fc640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc01c003ea0 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== watch-notify(notify_complete (2) cookie 94406990038976 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dcd7158700 con 0x55dcd71685e0 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.243+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71b0790 con 0x7fc150058040 2024-09-13T23:25:37.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v31'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc15af1f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc15af1f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc15af1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94406990038880 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71afd10 con 0x55dcd716d130 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 94406989789040 notify 133143986180 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55dcd702f750 con 0x55dcd716d130 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc039ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986180 cookie 94406989789040 notifier 4542 bl.length()=192 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc039ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc039ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [notify cookie 94406990038880 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc039ffb640 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fbf8c003400 con 0x55dcd716d130 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.245+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== watch-notify(notify_complete (2) cookie 94406990038880 notify 133143986180 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55dcd702f230 con 0x55dcd716d130 2024-09-13T23:25:37.265 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:25:37.243114Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:37.243102Z","tags":[],"group_ids":[]} 2024-09-13T23:25:37.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.246+0000 7fc00d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.246+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406989794048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd7163cd0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.247+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94406989794048] v31'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.247+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406989782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd71685e0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.248+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94406989782576] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.248+0000 7fc15af1f800 20 remove_watcher() i=0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.248+0000 7fc15af1f800 2 removed watcher, disabling cache 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.248+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406989786400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd7163cd0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.249+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94406989786400] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.249+0000 7fc15af1f800 20 remove_watcher() i=1 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.249+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406989789040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd716d130 2024-09-13T23:25:37.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.250+0000 7fc156b95640 1 -- 172.21.15.99:0/4254375073 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94406989789040] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14808b050 con 0x55dcd716d130 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.250+0000 7fc15af1f800 20 remove_watcher() i=2 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.250+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406989791376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd71685e0 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.251+0000 7fc157396640 1 -- 172.21.15.99:0/4254375073 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94406989791376] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15003b030 con 0x55dcd71685e0 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.251+0000 7fc15af1f800 20 remove_watcher() i=3 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.251+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406989796352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x55dcd7163cd0 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.252+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94406989796352] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x55dcd7163cd0 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.252+0000 7fc15af1f800 20 remove_watcher() i=4 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.252+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406989800272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x7fc150058040 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.253+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94406989800272] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.253+0000 7fc15af1f800 20 remove_watcher() i=5 2024-09-13T23:25:37.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.253+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406989802576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x7fc150058040 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.254+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94406989802576] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.254+0000 7fc15af1f800 20 remove_watcher() i=6 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.254+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406989805424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55dcd71abca0 con 0x7fc150058040 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94406989805424] v31'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc14c029040 con 0x7fc150058040 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 20 remove_watcher() i=7 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc150058040 msgr2=0x7fc1500176e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc150058040 0x7fc1500176e0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7163cd0 msgr2=0x55dcd7166190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7163cd0 0x55dcd7166190 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd71685e0 msgr2=0x55dcd716a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd71685e0 0x55dcd716a9d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55dcd716d130 msgr2=0x55dcd716f5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55dcd716d130 0x55dcd716f5f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc020036b40 msgr2=0x7fc020039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc020036b40 0x7fc020039000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc148077fd0 tx=0x7fc148095000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 msgr2=0x55dcd71581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc156394640 1 -- 172.21.15.99:0/4254375073 reap_dead start 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc150020720 tx=0x7fc15004c5f0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 shutdown_connections 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 --2- 172.21.15.99:0/4254375073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd7150f50 0x55dcd71581c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.255+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 >> 172.21.15.99:0/4254375073 conn(0x55dcd714d2b0 msgr2=0x55dcd714b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 shutdown_connections 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/4254375073 wait complete. 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 msgr2=0x7fc030039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 0x7fc030039000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55dcd702fc50 tx=0x7fc148000f40 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 msgr2=0x55dcd71446e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55dcd7030880 tx=0x7fc15000beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 shutdown_connections 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc030036b40 0x7fc030039000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/2853190239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd71442c0 0x55dcd71446e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 >> 172.21.15.99:0/2853190239 conn(0x55dcd7139250 msgr2=0x55dcd713bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 shutdown_connections 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/2853190239 wait complete. 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 msgr2=0x55dcd71305f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 0x55dcd71305f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 msgr2=0x55dcd7135170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 0x55dcd7135170 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 msgr2=0x7fc03c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 0x7fc03c039000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc14c000f60 tx=0x7fc14c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 msgr2=0x55dcd7030b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc148046130 tx=0x7fc148003330 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 shutdown_connections 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55dcd7132cd0 0x55dcd7135170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55dcd7033750 0x55dcd71305f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc03c036b40 0x7fc03c039000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 --2- 172.21.15.99:0/994981805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55dcd6fa4680 0x55dcd7030b40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 >> 172.21.15.99:0/994981805 conn(0x55dcd702ade0 msgr2=0x55dcd7119ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 shutdown_connections 2024-09-13T23:25:37.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.256+0000 7fc15af1f800 1 -- 172.21.15.99:0/994981805 wait complete. 2024-09-13T23:25:37.277 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:25:37.243114Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:37.243102Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:37.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:25:37.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:25:37.277 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T23:25:37.326 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.327 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.326+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.326+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.326+0000 7f9487134800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a497b50db0 0x55a497be0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.326+0000 7f9487134800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a497a9cb30 con 0x55a497be07a0 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.326+0000 7f9487134800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a497a7e360 con 0x55a497b50db0 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482e63640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a497b50db0 0x55a497be0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482662640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55a497be07a0 0x55a497be2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41992/0 (socket says 172.21.15.99:41992) 2024-09-13T23:25:37.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482e63640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a497b50db0 0x55a497be0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56848/0 (socket says 172.21.15.99:56848) 2024-09-13T23:25:37.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482662640 1 -- 172.21.15.99:0/3011110245 learned_addr learned my addr 172.21.15.99:0/3011110245 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:37.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482e63640 1 -- 172.21.15.99:0/3011110245 >> v1:172.21.15.43:6789/0 conn(0x55a497be07a0 legacy=0x55a497be2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.327+0000 7f9482e63640 1 -- 172.21.15.99:0/3011110245 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497aa4e00 con 0x55a497b50db0 2024-09-13T23:25:37.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9482e63640 1 --2- 172.21.15.99:0/3011110245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497be0260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f947400a470 tx=0x7f9474045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde3a3e8a0b11072 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9481e61640 1 -- 172.21.15.99:0/3011110245 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474053570 con 0x55a497b50db0 2024-09-13T23:25:37.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9481e61640 1 -- 172.21.15.99:0/3011110245 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474058070 con 0x55a497b50db0 2024-09-13T23:25:37.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9481e61640 1 -- 172.21.15.99:0/3011110245 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474053880 con 0x55a497b50db0 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 -- 172.21.15.99:0/3011110245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 msgr2=0x55a497be0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 --2- 172.21.15.99:0/3011110245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497be0260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f947400a470 tx=0x7f9474045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 -- 172.21.15.99:0/3011110245 shutdown_connections 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 --2- 172.21.15.99:0/3011110245 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497be0260 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 -- 172.21.15.99:0/3011110245 >> 172.21.15.99:0/3011110245 conn(0x55a497bd7e10 msgr2=0x55a497bda230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 -- 172.21.15.99:0/3011110245 shutdown_connections 2024-09-13T23:25:37.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.329+0000 7f9487134800 1 -- 172.21.15.99:0/3011110245 wait complete. 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9487134800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9487134800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a497b29350 con 0x55a497b50db0 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9482e63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9482e63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56854/0 (socket says 172.21.15.99:56854) 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9482e63640 1 -- 172.21.15.99:0/3754457017 learned_addr learned my addr 172.21.15.99:0/3754457017 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.344+0000 7f9482e63640 1 -- 172.21.15.99:0/3754457017 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497a76bc0 con 0x55a497b50db0 2024-09-13T23:25:37.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9482e63640 1 --2- 172.21.15.99:0/3754457017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9474025c20 tx=0x7f9474051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572800dbaa023398 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9370e09640 1 -- 172.21.15.99:0/3754457017 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474053ba0 con 0x55a497b50db0 2024-09-13T23:25:37.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9370e09640 1 -- 172.21.15.99:0/3754457017 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474063030 con 0x55a497b50db0 2024-09-13T23:25:37.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9370e09640 1 -- 172.21.15.99:0/3754457017 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474053440 con 0x55a497b50db0 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9487134800 1 -- 172.21.15.99:0/3754457017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 msgr2=0x55a497bddb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.345+0000 7f9487134800 1 --2- 172.21.15.99:0/3754457017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9474025c20 tx=0x7f9474051000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- 172.21.15.99:0/3754457017 shutdown_connections 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 --2- 172.21.15.99:0/3754457017 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497bddb90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- 172.21.15.99:0/3754457017 >> 172.21.15.99:0/3754457017 conn(0x55a497bd7e10 msgr2=0x55a497cc8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- 172.21.15.99:0/3754457017 shutdown_connections 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- 172.21.15.99:0/3754457017 wait complete. 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9487134800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a497be4640 con 0x55a497b50db0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9482e63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9482e63640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56870/0 (socket says 172.21.15.99:56870) 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.346+0000 7f9482e63640 1 -- 172.21.15.99:0/1473237775 learned_addr learned my addr 172.21.15.99:0/1473237775 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f9482e63640 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497a8afe0 con 0x55a497b50db0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f9482e63640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55a497bdd290 tx=0x7f9474002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f936f606640 1 -- 172.21.15.99:0/1473237775 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474078070 con 0x55a497b50db0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f936f606640 1 -- 172.21.15.99:0/1473237775 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9474053570 con 0x55a497b50db0 2024-09-13T23:25:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a497cd6880 con 0x55a497b50db0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f936f606640 1 -- 172.21.15.99:0/1473237775 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9474053850 con 0x55a497b50db0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.347+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a497cd6e00 con 0x55a497b50db0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f936f606640 1 -- 172.21.15.99:0/1473237775 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f947407b070 con 0x55a497b50db0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f936f606640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 0x7f9368039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f936f606640 1 -- 172.21.15.99:0/1473237775 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9474070070 con 0x55a497b50db0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f9482662640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 0x7f9368039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 0x55a497cdd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497cdda00 con 0x55a497be07a0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.348+0000 7f9483664640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 0x55a497cdd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9482662640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 0x7f9368039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9478000f60 tx=0x7f94780012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9483664640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 0x55a497cdd3b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9483664640 1 -- 172.21.15.99:0/1473237775 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f947c00a4a0 con 0x55a497be07a0 2024-09-13T23:25:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497cda980 con 0x55a497be07a0 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9483664640 1 -- 172.21.15.99:0/1473237775 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f947c00a4a0 con 0x55a497be07a0 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 0x55a497ce2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.349+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497ce2840 con 0x55a497cdfd60 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9482e63640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 0x55a497ce2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9482e63640 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 0x55a497ce2150 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9482e63640 1 -- 172.21.15.99:0/1473237775 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f947407a030 con 0x55a497cdfd60 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497cdeb40 con 0x55a497be07a0 2024-09-13T23:25:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9483664640 1 -- 172.21.15.99:0/1473237775 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f947c00a4a0 con 0x55a497be07a0 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.350+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497cdf020 con 0x55a497cdfd60 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9482e63640 1 -- 172.21.15.99:0/1473237775 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f947407a030 con 0x55a497cdfd60 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9487134800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9487134800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a497a78580 con 0x55a497cf1120 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56882/0 (socket says 172.21.15.99:56882) 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.351+0000 7f9483664640 1 -- 172.21.15.99:0/2947349305 learned_addr learned my addr 172.21.15.99:0/2947349305 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f9483664640 1 -- 172.21.15.99:0/2947349305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497cf1a80 con 0x55a497cf1120 2024-09-13T23:25:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f9483664640 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55a497cdddc0 tx=0x7f947c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f936ce01640 1 -- 172.21.15.99:0/2947349305 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c013450 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f936ce01640 1 -- 172.21.15.99:0/2947349305 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c0135f0 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a497cf1d10 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f936ce01640 1 -- 172.21.15.99:0/2947349305 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c0138d0 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.352+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a497cf49f0 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.353+0000 7f936ce01640 1 -- 172.21.15.99:0/2947349305 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f947c011040 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.353+0000 7f936ce01640 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 0x7f935c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.353+0000 7f936ce01640 1 -- 172.21.15.99:0/2947349305 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f947c00e040 con 0x55a497cf1120 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.353+0000 7f9482e63640 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 0x7f935c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9482e63640 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 0x7f935c039000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55a497cde310 tx=0x7f947408ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9487134800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9487134800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a497bdc200 con 0x55a497cfde70 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56892/0 (socket says 172.21.15.99:56892) 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9483664640 1 -- 172.21.15.99:0/1390190183 learned_addr learned my addr 172.21.15.99:0/1390190183 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.354+0000 7f9483664640 1 -- 172.21.15.99:0/1390190183 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497cfe840 con 0x55a497cfde70 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9483664640 1 --2- 172.21.15.99:0/1390190183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f947c04cdd0 tx=0x7f947c029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b610785b0fdc49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f93667fc640 1 -- 172.21.15.99:0/1390190183 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c04a020 con 0x55a497cfde70 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f93667fc640 1 -- 172.21.15.99:0/1390190183 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c02a440 con 0x55a497cfde70 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f93667fc640 1 -- 172.21.15.99:0/1390190183 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c01f390 con 0x55a497cfde70 2024-09-13T23:25:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 -- 172.21.15.99:0/1390190183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 msgr2=0x55a497cfe270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 --2- 172.21.15.99:0/1390190183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f947c04cdd0 tx=0x7f947c029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 -- 172.21.15.99:0/1390190183 shutdown_connections 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 --2- 172.21.15.99:0/1390190183 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497cfe270 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 -- 172.21.15.99:0/1390190183 >> 172.21.15.99:0/1390190183 conn(0x55a497cfa1d0 msgr2=0x55a497cf82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 -- 172.21.15.99:0/1390190183 shutdown_connections 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.355+0000 7f9487134800 1 -- 172.21.15.99:0/1390190183 wait complete. 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9487134800 1 Processor -- start 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9487134800 1 -- start start 2024-09-13T23:25:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9487134800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9487134800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a497cfeeb0 con 0x55a497cfde70 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9483664640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56896/0 (socket says 172.21.15.99:56896) 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 learned_addr learned my addr 172.21.15.99:0/3397392121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a497d057f0 con 0x55a497cfde70 2024-09-13T23:25:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.356+0000 7f9483664640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f947c048000 tx=0x7f947c04cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.357+0000 7f9364ff9640 1 -- 172.21.15.99:0/3397392121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c038070 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.357+0000 7f9364ff9640 1 -- 172.21.15.99:0/3397392121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c020c00 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.357+0000 7f9364ff9640 1 -- 172.21.15.99:0/3397392121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f947c01f710 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.357+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a497d05a80 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.358+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a497d08730 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.358+0000 7f9364ff9640 1 -- 172.21.15.99:0/3397392121 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f947c01f8b0 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.358+0000 7f9364ff9640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f934c036b40 0x7f934c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.358+0000 7f9364ff9640 1 -- 172.21.15.99:0/3397392121 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f947c03eb10 con 0x55a497cfde70 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.358+0000 7f9482e63640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f934c036b40 0x7f934c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9482e63640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f934c036b40 0x7f934c039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f947405ffd0 tx=0x7f9474092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497d10dd0 0x55a497d13290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d139e0 con 0x55a497d10dd0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9482662640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497d10dd0 0x55a497d13290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.359+0000 7f9482662640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497d10dd0 0x55a497d13290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9478009050 con 0x55a497d10dd0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 realm 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d10220 con 0x55a497d10dd0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9478009050 con 0x55a497d10dd0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d144d0 con 0x55a497d10dd0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9478009050 con 0x55a497d10dd0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.360+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d14da0 con 0x55a497d10dd0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9478009050 con 0x55a497d10dd0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497d156e0 0x55a497d17ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d18260 con 0x55a497d156e0 2024-09-13T23:25:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9483664640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497d156e0 0x55a497d17ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9483664640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497d156e0 0x55a497d17ad0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 20 searching for the correct realm 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a497d1a230 0x55a497d1c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.361+0000 7f9482e63640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a497d1a230 0x55a497d1c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9482e63640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a497d1a230 0x55a497d1c6f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9483664640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f947c013070 0x7f947c040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.362+0000 7f9482662640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f947c013070 0x7f947c040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f947c013070 0x7f947c040660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478009050 con 0x7f947c013070 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478009050 con 0x55a497d10dd0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.363+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.364+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.365+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.366+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.367+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.368+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d1a230 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x7f947c013070 2024-09-13T23:25:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.369+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d10dd0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1cdc0 con 0x55a497d156e0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d18c20 con 0x55a497d10dd0 2024-09-13T23:25:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d194c0 con 0x55a497d10dd0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.370+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1d240 con 0x55a497d156e0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 zone default found 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 4 Realm: () 2024-09-13T23:25:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 zonegroup default 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d190d0 con 0x7f947c013070 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1f970 con 0x55a497d1a230 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1fd10 con 0x55a497d1a230 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 started sync module instance, tier type = 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.371+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1ee00 con 0x55a497d156e0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.372+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.372+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94165410116352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1ee00 con 0x55a497d156e0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.372+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d206d0 con 0x55a497d10dd0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.373+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94165410116352] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.374+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.374+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94165410120704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1ee00 con 0x55a497d10dd0 2024-09-13T23:25:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.374+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d21210 con 0x55a497d1a230 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.375+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94165410120704] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.375+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.375+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94165410113872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d1ed70 con 0x55a497d1a230 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.375+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d220d0 con 0x55a497d156e0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.376+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.376+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94165410127360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d228d0 con 0x55a497d156e0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.376+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d233f0 con 0x55a497d10dd0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.377+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94165410113872] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.377+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.377+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94165410131648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d233b0 con 0x55a497d10dd0 2024-09-13T23:25:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.377+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d23e00 con 0x7f947c013070 2024-09-13T23:25:37.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.377+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94165410127360] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.378+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94165410131648] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.378+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.378+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94165410125312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d23950 con 0x7f947c013070 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.378+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d246a0 con 0x7f947c013070 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.379+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94165410125312] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.379+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.379+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94165410128672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d23950 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.379+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d24cc0 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94165410128672] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94165410136400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d24cc0 con 0x7f947c013070 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=0 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=1 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=2 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=3 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=4 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=5 2024-09-13T23:25:37.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.380+0000 7f9487134800 20 add_watcher() i=6 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.381+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94165410136400] v31'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.381+0000 7f9487134800 20 add_watcher() i=7 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.381+0000 7f9487134800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.381+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d27fa0 con 0x55a497d10dd0 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.381+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.382+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94165410138496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d25250 con 0x55a497d10dd0 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.382+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94165410138496] v31'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f93397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 5 note: GC not initialized 2024-09-13T23:25:37.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f92b3fff640 20 reqs_thread_entry: start 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 20 Filter name: none 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f92b1ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.383+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d5b6b0 con 0x7f947c013070 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d5b100 con 0x55a497d156e0 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv25 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.384+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d5ee50 con 0x7f947c013070 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(64 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:37.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.385+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d63510 con 0x55a497d156e0 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.386+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 foo.buckets [call] v31'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.386+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.6 8:6321689d:root::.bucket.meta.testx%3amyfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66e20 con 0x7f947c013070 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [create,call,writefull 0~412,setxattr (203)] v31'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9487134800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x7 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9487134800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9487134800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:25:37.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9487134800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.387+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94165410401360 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d668b0 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify (1) cookie 94165410125312 notify 133143986187 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55a497d671c0 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f93667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986187 cookie 94165410125312 notifier 4549 bl.length()=847 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f93667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x7 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f93667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f93667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f93667fc640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9348003ea0 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(67 notify.5 [notify cookie 94165410401360 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify_complete (2) cookie 94165410401360 notify 133143986187 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a497d63010 con 0x7f947c013070 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9487134800 20 handle_bi_update(): bucket=testx:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:37.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9487134800 20 handle_bi_update(): bucket=testx:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9487134800 20 handle_bi_update(): bucket=testx:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9487134800 20 handle_bi_update(): bucket=testx:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.388+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66930 con 0x55a497d10dd0 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.389+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v31'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.389+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66930 con 0x55a497d10dd0 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v31'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9487134800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9487134800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9487134800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94165410407552 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d668a0 con 0x55a497d10dd0 2024-09-13T23:25:37.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.390+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94165410131648 notify 133143986193 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55a497d66cd0 con 0x55a497d10dd0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9365ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 94165410131648 notifier 4549 bl.length()=348 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9365ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9365ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9365ffb640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f92b8003400 con 0x55a497d10dd0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(71 notify.4 [notify cookie 94165410407552 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94165410407552 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a497d65c60 con 0x55a497d10dd0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.391+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66930 con 0x55a497d156e0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(73 myfoo [call,delete] v31'27 uv27 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9487134800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9487134800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94165410407552 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d668a0 con 0x7f947c013070 2024-09-13T23:25:37.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== watch-notify(notify (1) cookie 94165410128672 notify 133143986188 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55a497d65c60 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f93667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986188 cookie 94165410128672 notifier 4549 bl.length()=149 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f93667fc640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f9348003ea0 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(74 notify.6 [notify cookie 94165410407552 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.392+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.393+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== watch-notify(notify_complete (2) cookie 94165410407552 notify 133143986188 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a497d63010 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.393+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66930 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(76 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call,delete] v31'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9487134800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 from cache 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9487134800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94165410378960 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55a497d66930 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== watch-notify(notify (1) cookie 94165410128672 notify 133143986189 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55a497d63010 con 0x7f947c013070 2024-09-13T23:25:37.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9365ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94165410128672 notifier 4549 bl.length()=206 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9365ffb640 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f92b80033e0 con 0x7f947c013070 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(77 notify.6 [notify cookie 94165410378960 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.394+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== watch-notify(notify_complete (2) cookie 94165410378960 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a497d5f240 con 0x7f947c013070 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.395+0000 7f93397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.395+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94165410138496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d10dd0 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.396+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94165410138496] v31'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.396+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94165410116352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d156e0 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.397+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94165410116352] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.397+0000 7f9487134800 20 remove_watcher() i=0 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.397+0000 7f9487134800 2 removed watcher, disabling cache 2024-09-13T23:25:37.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.397+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94165410120704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d10dd0 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.398+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94165410120704] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.398+0000 7f9487134800 20 remove_watcher() i=1 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.398+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94165410113872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d1a230 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.399+0000 7f9482e63640 1 -- 172.21.15.99:0/3397392121 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94165410113872] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947407a030 con 0x55a497d1a230 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.399+0000 7f9487134800 20 remove_watcher() i=2 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.399+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94165410127360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d156e0 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.400+0000 7f9483664640 1 -- 172.21.15.99:0/3397392121 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94165410127360] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947c027020 con 0x55a497d156e0 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.400+0000 7f9487134800 20 remove_watcher() i=3 2024-09-13T23:25:37.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.400+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94165410131648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x55a497d10dd0 2024-09-13T23:25:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.401+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94165410131648] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x55a497d10dd0 2024-09-13T23:25:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.401+0000 7f9487134800 20 remove_watcher() i=4 2024-09-13T23:25:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.401+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94165410125312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x7f947c013070 2024-09-13T23:25:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.402+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94165410125312] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.403+0000 7f9487134800 20 remove_watcher() i=5 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.403+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94165410128672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x7f947c013070 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.403+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94165410128672] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.403+0000 7f9487134800 20 remove_watcher() i=6 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.403+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94165410136400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55a497d59260 con 0x7f947c013070 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.404+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94165410136400] v31'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9478029040 con 0x7f947c013070 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.404+0000 7f9487134800 20 remove_watcher() i=7 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f947c013070 msgr2=0x7f947c040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f947c013070 0x7f947c040660 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497d10dd0 msgr2=0x55a497d13290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497d10dd0 0x55a497d13290 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497d156e0 msgr2=0x55a497d17ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497d156e0 0x55a497d17ad0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a497d1a230 msgr2=0x55a497d1c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a497d1a230 0x55a497d1c6f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f934c036b40 msgr2=0x7f934c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f934c036b40 0x7f934c039000 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f947405ffd0 tx=0x7f9474092000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 msgr2=0x55a497d052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f947c048000 tx=0x7f947c04cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9482662640 1 -- 172.21.15.99:0/3397392121 reap_dead start 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 shutdown_connections 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/3397392121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cfde70 0x55a497d052b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 >> 172.21.15.99:0/3397392121 conn(0x55a497cfa1d0 msgr2=0x55a497cf82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 shutdown_connections 2024-09-13T23:25:37.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/3397392121 wait complete. 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 msgr2=0x7f935c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 0x7f935c039000 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55a497cde310 tx=0x7f947408ec10 comp rx=0 tx=0).stop 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 msgr2=0x55a497cf1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x55a497cdddc0 tx=0x7f947c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 shutdown_connections 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f935c036b40 0x7f935c039000 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 --2- 172.21.15.99:0/2947349305 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497cf1120 0x55a497cf1540 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 >> 172.21.15.99:0/2947349305 conn(0x55a497ce60b0 msgr2=0x55a497ce8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 shutdown_connections 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.405+0000 7f9487134800 1 -- 172.21.15.99:0/2947349305 wait complete. 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 msgr2=0x55a497cdd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 0x55a497cdd3b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 msgr2=0x55a497ce2150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 0x55a497ce2150 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 msgr2=0x7f9368039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 0x7f9368039000 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9478000f60 tx=0x7f94780012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 msgr2=0x55a497cd6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x55a497bdd290 tx=0x7f9474002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 shutdown_connections 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a497cdfd60 0x55a497ce2150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a497be07a0 0x55a497cdd3b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9368036b40 0x7f9368039000 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 --2- 172.21.15.99:0/1473237775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a497b50db0 0x55a497cd6340 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 >> 172.21.15.99:0/1473237775 conn(0x55a497bd7e10 msgr2=0x55a497cc7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 shutdown_connections 2024-09-13T23:25:37.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.406+0000 7f9487134800 1 -- 172.21.15.99:0/1473237775 wait complete. 2024-09-13T23:25:37.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:25:37.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T23:25:37.422 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T23:25:37.465 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.465 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.464+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.464+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.464+0000 7f1fcfd39800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55978b1fa900 0x55978b1fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.464+0000 7f1fcfd39800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55978b0b6b30 con 0x55978b1f64c0 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.464+0000 7f1fcfd39800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55978b098360 con 0x55978b1fa900 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fc31d0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55978b1fa900 0x55978b1fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fc31d0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55978b1fa900 0x55978b1fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56900/0 (socket says 172.21.15.99:56900) 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fc31d0640 1 -- 172.21.15.99:0/568655940 learned_addr learned my addr 172.21.15.99:0/568655940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fcb9d1640 1 --1- 172.21.15.99:0/568655940 >> v1:172.21.15.43:6789/0 conn(0x55978b1f64c0 0x55978b1f68c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:41996/0 (socket says 172.21.15.99:41996) 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fc31d0640 1 -- 172.21.15.99:0/568655940 >> v1:172.21.15.43:6789/0 conn(0x55978b1f64c0 legacy=0x55978b1f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.465+0000 7f1fc31d0640 1 -- 172.21.15.99:0/568655940 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b0bee00 con 0x55978b1fa900 2024-09-13T23:25:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.467+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/568655940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1fa900 0x55978b1fccf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400a6b0 tx=0x7f1fb4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfdf0af9d92034b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.467+0000 7f1fcb1d0640 1 -- 172.21.15.99:0/568655940 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb400a200 con 0x55978b1fa900 2024-09-13T23:25:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.467+0000 7f1fcb1d0640 1 -- 172.21.15.99:0/568655940 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb400a3a0 con 0x55978b1fa900 2024-09-13T23:25:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.467+0000 7f1fcb1d0640 1 -- 172.21.15.99:0/568655940 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fb4008700 con 0x55978b1fa900 2024-09-13T23:25:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 -- 172.21.15.99:0/568655940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1fa900 msgr2=0x55978b1fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/568655940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1fa900 0x55978b1fccf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400a6b0 tx=0x7f1fb4047e30 comp rx=0 tx=0).stop 2024-09-13T23:25:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 -- 172.21.15.99:0/568655940 shutdown_connections 2024-09-13T23:25:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/568655940 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1fa900 0x55978b1fccf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 -- 172.21.15.99:0/568655940 >> 172.21.15.99:0/568655940 conn(0x55978b1f1df0 msgr2=0x55978b1f4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 -- 172.21.15.99:0/568655940 shutdown_connections 2024-09-13T23:25:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.468+0000 7f1fcfd39800 1 -- 172.21.15.99:0/568655940 wait complete. 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcfd39800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcfd39800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55978b143330 con 0x55978b1f64c0 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcb9d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcb9d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56912/0 (socket says 172.21.15.99:56912) 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/4260162756 learned_addr learned my addr 172.21.15.99:0/4260162756 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/4260162756 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b090bc0 con 0x55978b1f64c0 2024-09-13T23:25:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.482+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/4260162756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00b230 tx=0x7f1fbc00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb70714538aff64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1eb9e0b640 1 -- 172.21.15.99:0/4260162756 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc00e5c0 con 0x55978b1f64c0 2024-09-13T23:25:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1eb9e0b640 1 -- 172.21.15.99:0/4260162756 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc006070 con 0x55978b1f64c0 2024-09-13T23:25:37.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1eb9e0b640 1 -- 172.21.15.99:0/4260162756 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc00e890 con 0x55978b1f64c0 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 -- 172.21.15.99:0/4260162756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 msgr2=0x55978b2e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/4260162756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00b230 tx=0x7f1fbc00b6f0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 -- 172.21.15.99:0/4260162756 shutdown_connections 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/4260162756 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2e4660 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 -- 172.21.15.99:0/4260162756 >> 172.21.15.99:0/4260162756 conn(0x55978b1f1df0 msgr2=0x55978b2e0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 -- 172.21.15.99:0/4260162756 shutdown_connections 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.483+0000 7f1fcfd39800 1 -- 172.21.15.99:0/4260162756 wait complete. 2024-09-13T23:25:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcfd39800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcfd39800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55978b1fd4d0 con 0x55978b1f64c0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcb9d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcb9d1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56916/0 (socket says 172.21.15.99:56916) 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/1778630646 learned_addr learned my addr 172.21.15.99:0/1778630646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b0a4fe0 con 0x55978b1f64c0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.484+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc000c00 tx=0x7f1fbc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1eb3fff640 1 -- 172.21.15.99:0/1778630646 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc00f8d0 con 0x55978b1f64c0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1eb3fff640 1 -- 172.21.15.99:0/1778630646 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00fa90 con 0x55978b1f64c0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978b2ec5a0 con 0x55978b1f64c0 2024-09-13T23:25:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1eb3fff640 1 -- 172.21.15.99:0/1778630646 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fbc00fdb0 con 0x55978b1f64c0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978b2ecac0 con 0x55978b1f64c0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.485+0000 7f1eb3fff640 1 -- 172.21.15.99:0/1778630646 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1fbc017070 con 0x55978b1f64c0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1eb3fff640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 0x7f1eb4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1eb3fff640 1 -- 172.21.15.99:0/1778630646 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fbc015020 con 0x55978b1f64c0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 0x7f1eb4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 0x55978b2f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b2f3650 con 0x55978b1fa900 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 0x55978b2f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 0x7f1eb4039000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4058000 tx=0x7f1fb4053000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.486+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 0x55978b2f30d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/1778630646 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fc400a4a0 con 0x55978b1fa900 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b2f06a0 con 0x55978b1fa900 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/1778630646 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fc400a4a0 con 0x55978b1fa900 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 0x55978b2f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b2f8480 con 0x55978b2f59a0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 0x55978b2f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 0x55978b2f7d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.487+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/1778630646 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b2f59a0 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b2f4810 con 0x55978b1fa900 2024-09-13T23:25:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/1778630646 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fc400a4a0 con 0x55978b1fa900 2024-09-13T23:25:37.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b2f4cf0 con 0x55978b2f59a0 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/1778630646 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b2f59a0 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.488+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcfd39800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcfd39800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55978b092580 con 0x55978b306e00 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56922/0 (socket says 172.21.15.99:56922) 2024-09-13T23:25:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/1724769016 learned_addr learned my addr 172.21.15.99:0/1724769016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/1724769016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b307760 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.489+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55978b2ed460 tx=0x7f1fc40163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1eb17fa640 1 -- 172.21.15.99:0/1724769016 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4013450 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1eb17fa640 1 -- 172.21.15.99:0/1724769016 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc40135f0 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978b3079f0 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1eb17fa640 1 -- 172.21.15.99:0/1724769016 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc4013910 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978b30a6d0 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.490+0000 7f1eb17fa640 1 -- 172.21.15.99:0/1724769016 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1fc4011040 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1eb17fa640 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 0x7f1ea4039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1eb17fa640 1 -- 172.21.15.99:0/1724769016 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fc400e040 con 0x55978b306e00 2024-09-13T23:25:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 0x7f1ea4039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 0x7f1ea4039070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55978b2f3f50 tx=0x7f1fbc04b740 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcfd39800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcfd39800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55978b2e4e10 con 0x55978b313b20 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56934/0 (socket says 172.21.15.99:56934) 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.491+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/3677803239 learned_addr learned my addr 172.21.15.99:0/3677803239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/3677803239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b3144f0 con 0x55978b313b20 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/3677803239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1fc404ce50 tx=0x7f1fc4029f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286741d9048bc078 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1eaaffd640 1 -- 172.21.15.99:0/3677803239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc402a440 con 0x55978b313b20 2024-09-13T23:25:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1eaaffd640 1 -- 172.21.15.99:0/3677803239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc401f390 con 0x55978b313b20 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1eaaffd640 1 -- 172.21.15.99:0/3677803239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc402a5e0 con 0x55978b313b20 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 -- 172.21.15.99:0/3677803239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 msgr2=0x55978b313f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/3677803239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1fc404ce50 tx=0x7f1fc4029f40 comp rx=0 tx=0).stop 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 -- 172.21.15.99:0/3677803239 shutdown_connections 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/3677803239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b313f20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 -- 172.21.15.99:0/3677803239 >> 172.21.15.99:0/3677803239 conn(0x55978b30fed0 msgr2=0x55978b30dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 -- 172.21.15.99:0/3677803239 shutdown_connections 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.492+0000 7f1fcfd39800 1 -- 172.21.15.99:0/3677803239 wait complete. 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcfd39800 1 Processor -- start 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcfd39800 1 -- start start 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcfd39800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcfd39800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55978b314ac0 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcc1d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56944/0 (socket says 172.21.15.99:56944) 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 learned_addr learned my addr 172.21.15.99:0/135019286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b31b3e0 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4029f80 tx=0x7f1fc404cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.493+0000 7f1ea97fa640 1 -- 172.21.15.99:0/135019286 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc401f920 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1ea97fa640 1 -- 172.21.15.99:0/135019286 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fc403b070 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978b31b670 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1ea97fa640 1 -- 172.21.15.99:0/135019286 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fc404e1a0 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978b31e320 con 0x55978b313b20 2024-09-13T23:25:37.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1ea97fa640 1 -- 172.21.15.99:0/135019286 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1fc404e390 con 0x55978b313b20 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1ea97fa640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e94036b40 0x7f1e94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.494+0000 7f1ea97fa640 1 -- 172.21.15.99:0/135019286 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f1fc4044030 con 0x55978b313b20 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e94036b40 0x7f1e94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b326bb0 0x55978b329070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b3297c0 con 0x55978b326bb0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b326bb0 0x55978b329070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e94036b40 0x7f1e94039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc04a590 tx=0x7f1fbc038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b326bb0 0x55978b329070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 20 realm 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.495+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b329bf0 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32a4c0 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32a860 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b32b5c0 0x55978b32d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32def0 con 0x55978b32b5c0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b32b5c0 0x55978b32d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.496+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b32b5c0 0x55978b32d9b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcfd39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcfd39800 20 searching for the correct realm 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55978b32ff30 0x55978b3323f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55978b32ff30 0x55978b3323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcb9d1640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55978b32ff30 0x55978b3323f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.497+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fcc1d2640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1fc4013070 0x7f1fc40484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1fc4013070 0x7f1fc40484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fc31d0640 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1fc4013070 0x7f1fc40484a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.498+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.499+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.500+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.501+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.502+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.503+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.504+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32ff30 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x7f1fc4013070 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b326bb0 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55978b332ac0 con 0x55978b32b5c0 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.505+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32e960 con 0x55978b326bb0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32e570 con 0x55978b326bb0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b32f2d0 con 0x55978b32b5c0 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 zone default found 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 4 Realm: () 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 zonegroup default 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b3333f0 con 0x7f1fc4013070 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.506+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b335200 con 0x55978b32ff30 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b335650 con 0x55978b32ff30 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 started sync module instance, tier type = 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.507+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b334610 con 0x55978b32b5c0 2024-09-13T23:25:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.508+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.508+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94109363817264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b334610 con 0x55978b32b5c0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.508+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b336160 con 0x55978b326bb0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.509+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94109363817264] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.509+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.509+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94109363821648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b334610 con 0x55978b326bb0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.509+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b336c20 con 0x55978b32ff30 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.510+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.510+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94109363824368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b3374c0 con 0x55978b32ff30 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.510+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b337fc0 con 0x55978b32b5c0 2024-09-13T23:25:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.511+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94109363821648] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.511+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94109363824368] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.511+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.512+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94109363826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b334160 con 0x55978b32b5c0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.512+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b3389d0 con 0x55978b326bb0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.512+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94109363826704] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.513+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.513+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94109363829424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b3389d0 con 0x55978b326bb0 2024-09-13T23:25:37.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.513+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b339390 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.513+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94109363829424] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.514+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.514+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94109363835072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b3389d0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.514+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b339da0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.515+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.515+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94109363837168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b33a1c0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.515+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b33ace0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.515+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94109363835072] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94109363837168] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94109363840944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b339d10 con 0x7f1fc4013070 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=0 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=1 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=2 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=3 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=4 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=5 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=6 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94109363840944] v31'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x7f1fc4013070 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 20 add_watcher() i=7 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.516+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b33dde0 con 0x55978b326bb0 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.517+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.517+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94109363832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b33b260 con 0x55978b326bb0 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94109363832096] v31'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fb40087b0 con 0x55978b326bb0 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 5 note: GC not initialized 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1e80fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 20 Filter name: none 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1dfa7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.518+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55978b370a30 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.519+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f1fb4081160 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.519+0000 7f1fcfd39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.520+0000 7f1e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.520+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94109363832096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b36e8b0 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.521+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94109363832096] v31'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.521+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94109363817264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b36e8b0 con 0x55978b32b5c0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.522+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94109363817264] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.522+0000 7f1fcfd39800 20 remove_watcher() i=0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.522+0000 7f1fcfd39800 2 removed watcher, disabling cache 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.522+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94109363821648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b36e8b0 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.523+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94109363821648] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x55978b326bb0 2024-09-13T23:25:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.523+0000 7f1fcfd39800 20 remove_watcher() i=1 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.523+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94109363824368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b36e8b0 con 0x55978b32ff30 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.524+0000 7f1fcb9d1640 1 -- 172.21.15.99:0/135019286 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94109363824368] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fbc02e070 con 0x55978b32ff30 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.524+0000 7f1fcfd39800 20 remove_watcher() i=2 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.524+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94109363826704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b335c50 con 0x55978b32b5c0 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.525+0000 7f1fcc1d2640 1 -- 172.21.15.99:0/135019286 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94109363826704] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fc4033040 con 0x55978b32b5c0 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.525+0000 7f1fcfd39800 20 remove_watcher() i=3 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.525+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94109363829424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b337010 con 0x55978b326bb0 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.526+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94109363829424] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x55978b326bb0 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.526+0000 7f1fcfd39800 20 remove_watcher() i=4 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.526+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94109363835072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b335c50 con 0x7f1fc4013070 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.527+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94109363835072] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x7f1fc4013070 2024-09-13T23:25:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.527+0000 7f1fcfd39800 20 remove_watcher() i=5 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.527+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94109363837168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b3390c0 con 0x7f1fc4013070 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.528+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94109363837168] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x7f1fc4013070 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.528+0000 7f1fcfd39800 20 remove_watcher() i=6 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.528+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94109363840944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55978b335c50 con 0x7f1fc4013070 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94109363840944] v31'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fb4081160 con 0x7f1fc4013070 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 20 remove_watcher() i=7 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1fc4013070 msgr2=0x7f1fc40484a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f1fc4013070 0x7f1fc40484a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b326bb0 msgr2=0x55978b329070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b326bb0 0x55978b329070 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b32b5c0 msgr2=0x55978b32d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b32b5c0 0x55978b32d9b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55978b32ff30 msgr2=0x55978b3323f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55978b32ff30 0x55978b3323f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e94036b40 msgr2=0x7f1e94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e94036b40 0x7f1e94039000 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc04a590 tx=0x7f1fbc038000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 msgr2=0x55978b31aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4029f80 tx=0x7f1fc404cdb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fc31d0640 1 -- 172.21.15.99:0/135019286 reap_dead start 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 shutdown_connections 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/135019286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b313b20 0x55978b31aea0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 >> 172.21.15.99:0/135019286 conn(0x55978b30fed0 msgr2=0x55978b30dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 shutdown_connections 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/135019286 wait complete. 2024-09-13T23:25:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 msgr2=0x7f1ea4039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 0x7f1ea4039070 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55978b2f3f50 tx=0x7f1fbc04b740 comp rx=0 tx=0).stop 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 msgr2=0x55978b307220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x55978b2ed460 tx=0x7f1fc40163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 shutdown_connections 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1ea4036bb0 0x7f1ea4039070 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1724769016 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b306e00 0x55978b307220 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 >> 172.21.15.99:0/1724769016 conn(0x55978b2fbd90 msgr2=0x55978b2fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 shutdown_connections 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.529+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1724769016 wait complete. 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 msgr2=0x55978b2f30d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 0x55978b2f30d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 msgr2=0x55978b2f7d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 0x55978b2f7d90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 msgr2=0x7f1eb4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 0x7f1eb4039000 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4058000 tx=0x7f1fb4053000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 msgr2=0x55978b2ec060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc000c00 tx=0x7f1fbc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 shutdown_connections 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55978b2f59a0 0x55978b2f7d90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55978b1fa900 0x55978b2f30d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1eb4036b40 0x7f1eb4039000 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 --2- 172.21.15.99:0/1778630646 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55978b1f64c0 0x55978b2ec060 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 >> 172.21.15.99:0/1778630646 conn(0x55978b1f1df0 msgr2=0x55978b2de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 shutdown_connections 2024-09-13T23:25:37.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.530+0000 7f1fcfd39800 1 -- 172.21.15.99:0/1778630646 wait complete. 2024-09-13T23:25:37.551 INFO:teuthology.orchestra.run.smithi099.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"UJDXtRDPc4102yBijCk2DGjx","ver":2},"mtime":"2024-09-13T23:25:37.390688Z","data":{"bucket":{"name":"myfoo","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","bucket_id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T23:25:34.891317Z","linked":true,"has_bucket_info":false}} 2024-09-13T23:25:37.552 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'UJDXtRDPc4102yBijCk2DGjx', 'ver': 2}, 'mtime': '2024-09-13T23:25:37.390688Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'bucket_id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T23:25:34.891317Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T23:25:37.552 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:25:37.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T23:25:37.552 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T23:25:37.638 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.639 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d0f6bb800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdee980900 0x55fdee982cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d0f6bb800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fdee83bb30 con 0x55fdee8f0650 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d0f6bb800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55fdee81d360 con 0x55fdee980900 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.638+0000 7f4d07fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdee980900 0x55fdee982cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.639+0000 7f4d0d1b6640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55fdee8f0650 0x55fdee97f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42010/0 (socket says 172.21.15.99:42010) 2024-09-13T23:25:37.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.639+0000 7f4d07fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fdee980900 0x55fdee982cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56948/0 (socket says 172.21.15.99:56948) 2024-09-13T23:25:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.639+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/2231798387 learned_addr learned my addr 172.21.15.99:0/2231798387 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.639+0000 7f4d07fff640 1 -- 172.21.15.99:0/2231798387 >> v1:172.21.15.43:6789/0 conn(0x55fdee8f0650 legacy=0x55fdee97f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.639+0000 7f4d07fff640 1 -- 172.21.15.99:0/2231798387 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdee843e00 con 0x55fdee980900 2024-09-13T23:25:37.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d07fff640 1 --2- 172.21.15.99:0/2231798387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee980900 0x55fdee982cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800a470 tx=0x7f4cf8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146169343cfe9d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0c9b5640 1 -- 172.21.15.99:0/2231798387 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cf8053570 con 0x55fdee980900 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0c9b5640 1 -- 172.21.15.99:0/2231798387 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf8058070 con 0x55fdee980900 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0c9b5640 1 -- 172.21.15.99:0/2231798387 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cf8053880 con 0x55fdee980900 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/2231798387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee980900 msgr2=0x55fdee982cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/2231798387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee980900 0x55fdee982cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800a470 tx=0x7f4cf8045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/2231798387 shutdown_connections 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/2231798387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee980900 0x55fdee982cf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/2231798387 >> 172.21.15.99:0/2231798387 conn(0x55fdee976db0 msgr2=0x55fdee9791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/2231798387 shutdown_connections 2024-09-13T23:25:37.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.641+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/2231798387 wait complete. 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.655+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.655+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.655+0000 7f4d0f6bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.655+0000 7f4d0f6bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdee8c8360 con 0x55fdee8f0650 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4d0d1b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4d0d1b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56952/0 (socket says 172.21.15.99:56952) 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/1610308921 learned_addr learned my addr 172.21.15.99:0/1610308921 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/1610308921 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdee815bc0 con 0x55fdee8f0650 2024-09-13T23:25:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/1610308921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001e10 tx=0x7f4d0000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfc4f53f387ab1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4bfb606640 1 -- 172.21.15.99:0/1610308921 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d00012020 con 0x55fdee8f0650 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4bfb606640 1 -- 172.21.15.99:0/1610308921 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0000e5a0 con 0x55fdee8f0650 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.656+0000 7f4bfb606640 1 -- 172.21.15.99:0/1610308921 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0000e8e0 con 0x55fdee8f0650 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/1610308921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 msgr2=0x55fdee97cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/1610308921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001e10 tx=0x7f4d0000b780 comp rx=0 tx=0).stop 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/1610308921 shutdown_connections 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/1610308921 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdee97cb10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/1610308921 >> 172.21.15.99:0/1610308921 conn(0x55fdee976db0 msgr2=0x55fdeea67220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/1610308921 shutdown_connections 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/1610308921 wait complete. 2024-09-13T23:25:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.657+0000 7f4d0f6bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdee983620 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0d1b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0d1b6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56960/0 (socket says 172.21.15.99:56960) 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3333129512 learned_addr learned my addr 172.21.15.99:0/3333129512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdee829fe0 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001e10 tx=0x7f4d00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4bf9e03640 1 -- 172.21.15.99:0/3333129512 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d00012030 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4bf9e03640 1 -- 172.21.15.99:0/3333129512 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0001a7a0 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdeea759a0 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4bf9e03640 1 -- 172.21.15.99:0/3333129512 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0001aac0 con 0x55fdee8f0650 2024-09-13T23:25:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.658+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdeea75ec0 con 0x55fdee8f0650 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4bf9e03640 1 -- 172.21.15.99:0/3333129512 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d00015020 con 0x55fdee8f0650 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4bf9e03640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 0x7f4bf4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4bf9e03640 1 -- 172.21.15.99:0/3333129512 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d00020030 con 0x55fdee8f0650 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 0x7f4bf4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 0x55fdeea7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.659+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeea7ca10 con 0x55fdee980900 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 0x55fdeea7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 0x7f4bf4039000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8057000 tx=0x7f4cf8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 0x55fdeea7c4d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3333129512 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdee980900 2024-09-13T23:25:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeea79a80 con 0x55fdee980900 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3333129512 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdee980900 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 0x55fdeea81110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.660+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeea817b0 con 0x55fdeea7ed20 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 0x55fdeea81110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 0x55fdeea81110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3333129512 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d0000dcd0 con 0x55fdeea7ed20 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeea7dbc0 con 0x55fdee980900 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3333129512 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdee980900 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.661+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeea7e0a0 con 0x55fdeea7ed20 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3333129512 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d0000dcd0 con 0x55fdeea7ed20 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0f6bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0f6bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdee817580 con 0x55fdeea90130 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56966/0 (socket says 172.21.15.99:56966) 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.662+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3547653489 learned_addr learned my addr 172.21.15.99:0/3547653489 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3547653489 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdeea90a90 con 0x55fdeea90130 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55fdeea76510 tx=0x7f4d080167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4bf2ffd640 1 -- 172.21.15.99:0/3547653489 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d08013640 con 0x55fdeea90130 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4bf2ffd640 1 -- 172.21.15.99:0/3547653489 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d080137e0 con 0x55fdeea90130 2024-09-13T23:25:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdeea90d20 con 0x55fdeea90130 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4bf2ffd640 1 -- 172.21.15.99:0/3547653489 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d08013ae0 con 0x55fdeea90130 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.663+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdeea93a00 con 0x55fdeea90130 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4bf2ffd640 1 -- 172.21.15.99:0/3547653489 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d08011040 con 0x55fdeea90130 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4bf2ffd640 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 0x7f4be4039070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4bf2ffd640 1 -- 172.21.15.99:0/3547653489 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d0800e040 con 0x55fdeea90130 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 0x7f4be4039070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 0x7f4be4039070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d0004b040 tx=0x7f4d00024000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0f6bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.664+0000 7f4d0f6bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdee97b1e0 con 0x55fdeea9cdd0 2024-09-13T23:25:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56968/0 (socket says 172.21.15.99:56968) 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/650561944 learned_addr learned my addr 172.21.15.99:0/650561944 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/650561944 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdeea9d710 con 0x55fdeea9cdd0 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/650561944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800afb0 tx=0x7f4d0801fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2986bfd5f555849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/650561944 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d08021570 con 0x55fdeea9cdd0 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/650561944 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0804a030 con 0x55fdeea9cdd0 2024-09-13T23:25:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.665+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/650561944 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0801f4b0 con 0x55fdeea9cdd0 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/650561944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 msgr2=0x55fdeea9d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/650561944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800afb0 tx=0x7f4d0801fd00 comp rx=0 tx=0).stop 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/650561944 shutdown_connections 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/650561944 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeea9d1d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/650561944 >> 172.21.15.99:0/650561944 conn(0x55fdeea99180 msgr2=0x55fdeea97280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/650561944 shutdown_connections 2024-09-13T23:25:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/650561944 wait complete. 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 Processor -- start 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- start start 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0f6bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fdeea9ddb0 con 0x55fdeea9cdd0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0d9b7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56976/0 (socket says 172.21.15.99:56976) 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.666+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 learned_addr learned my addr 172.21.15.99:0/3446358782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdeeaa47e0 con 0x55fdeea9cdd0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800afb0 tx=0x7f4d0804cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4be2ffd640 1 -- 172.21.15.99:0/3446358782 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d0803a070 con 0x55fdeea9cdd0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4be2ffd640 1 -- 172.21.15.99:0/3446358782 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d0803de50 con 0x55fdeea9cdd0 2024-09-13T23:25:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fdeeaa4a70 con 0x55fdeea9cdd0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4be2ffd640 1 -- 172.21.15.99:0/3446358782 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d080400e0 con 0x55fdeea9cdd0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.667+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdeeaa4a70 con 0x55fdeea9cdd0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.668+0000 7f4be2ffd640 1 -- 172.21.15.99:0/3446358782 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4d08040280 con 0x55fdeea9cdd0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.668+0000 7f4be2ffd640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bd8036b40 0x7f4bd8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.668+0000 7f4be2ffd640 1 -- 172.21.15.99:0/3446358782 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4d08036b30 con 0x55fdeea9cdd0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.668+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bd8036b40 0x7f4bd8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.668+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bd8036b40 0x7f4bd8039000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001620 tx=0x7f4d00036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdeeaafbc0 0x55fdeeab2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab27d0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdeeaafbc0 0x55fdeeab2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdeeaafbc0 0x55fdeeab2080 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 20 realm 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.669+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab2c00 con 0x55fdeeaafbc0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab34d0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab3870 con 0x55fdeeaafbc0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeeab45d0 0x55fdeeab69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab6fd0 con 0x55fdeeab45d0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeeab45d0 0x55fdeeab69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.670+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeeab45d0 0x55fdeeab69c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0f6bb800 20 searching for the correct realm 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdeeab8f60 0x55fdeeabb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdeeab8f60 0x55fdeeabb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0d1b6640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdeeab8f60 0x55fdeeabb420 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.671+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.672+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.672+0000 7f4d0d9b7640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4d08040b90 0x7f4d080114f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.672+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.672+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4d08040b90 0x7f4d080114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.672+0000 7f4d07fff640 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4d08040b90 0x7f4d080114f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.673+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.674+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.675+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.676+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.677+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.678+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab8f60 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x7f4d08040b90 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.679+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbaf0 con 0x55fdeeab45d0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab84b0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeab7d20 con 0x55fdeeaafbc0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabbf70 con 0x55fdeeab45d0 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 zone default found 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 4 Realm: () 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 zonegroup default 2024-09-13T23:25:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.680+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabc3c0 con 0x7f4d08040b90 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabe690 con 0x55fdeeab8f60 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabea30 con 0x55fdeeab8f60 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 started sync module instance, tier type = 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.681+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabdb20 con 0x55fdeeab45d0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.683+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.683+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94549119328336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabdb20 con 0x55fdeeab45d0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.683+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabf3f0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.683+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94549119328336] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.684+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.684+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94549119325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabda90 con 0x55fdeeaafbc0 2024-09-13T23:25:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.684+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac02e0 con 0x55fdeeab8f60 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.685+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.685+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94549119335984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac0b30 con 0x55fdeeab8f60 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.685+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac1600 con 0x55fdeeab45d0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.685+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94549119325808] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.686+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94549119335984] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.686+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.686+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94549119338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabf810 con 0x55fdeeab45d0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.686+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac1f30 con 0x55fdeeaafbc0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.687+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94549119338112] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.687+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.687+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94549119343136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac1ef0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.687+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac2940 con 0x7f4d08040b90 2024-09-13T23:25:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.689+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94549119343136] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.689+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.689+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94549119340784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac2940 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.689+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac3350 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.690+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94549119340784] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.690+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.690+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94549119346288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac3350 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.690+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac3d10 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94549119350880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac4130 con 0x7f4d08040b90 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=0 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=1 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=2 2024-09-13T23:25:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=3 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=4 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=5 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94549119346288] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.691+0000 7f4d0f6bb800 20 add_watcher() i=6 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94549119350880] v31'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d0f6bb800 20 add_watcher() i=7 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d0f6bb800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac4130 con 0x55fdeeaafbc0 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.692+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94549119351936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac40a0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.693+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94549119351936] v31'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.693+0000 7f4bc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.693+0000 7f4d0f6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.693+0000 7f4d0f6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.693+0000 7f4d0f6bb800 5 note: GC not initialized 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4bc27e4640 20 reqs_thread_entry: start 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 20 Filter name: none 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4b33fff640 20 reqs_thread_entry: start 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeafa4d0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.694+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeafc5b0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.6 8:6321689d:root::.bucket.meta.testx%3amyfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeafde40 con 0x7f4d08040b90 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.695+0000 7f4d0f6bb800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.696+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb024b0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.696+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v31'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.697+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb05dc0 con 0x7f4d08040b90 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [create,call,writefull 0~379,setxattr (123)] v31'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x7 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94549119613600 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb05740 con 0x7f4d08040b90 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== watch-notify(notify (1) cookie 94549119346288 notify 133143986190 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55fdeeb06160 con 0x7f4d08040b90 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4bf0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986190 cookie 94549119346288 notifier 4563 bl.length()=728 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4bf0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x7 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4bf0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4bf0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:37.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(67 notify.6 [notify cookie 94549119613600 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4bd0003ea0 con 0x7f4d08040b90 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== watch-notify(notify_complete (2) cookie 94549119613600 notify 133143986190 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdeeb01ee0 con 0x7f4d08040b90 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.698+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01550 con 0x55fdeeab45d0 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.700+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(69 foo.buckets [call] v31'28 uv28 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.700+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01550 con 0x55fdeeab45d0 2024-09-13T23:25:37.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v31'29 uv29 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0f6bb800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0f6bb800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0f6bb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94549119602848 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01af0 con 0x7f4d08040b90 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify (1) cookie 94549119346288 notify 133143986191 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55fdeeafe230 con 0x7f4d08040b90 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4bf0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986191 cookie 94549119346288 notifier 4563 bl.length()=314 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4bf0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4bf0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4bd0003ea0 con 0x7f4d08040b90 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(71 notify.6 [notify cookie 94549119602848 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== watch-notify(notify_complete (2) cookie 94549119602848 notify 133143986191 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdeeafd360 con 0x7f4d08040b90 2024-09-13T23:25:37.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.701+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01550 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.702+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v31'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.702+0000 7f4d0f6bb800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.702+0000 7f4d0f6bb800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.702+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94549119602848 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01970 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.702+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify (1) cookie 94549119343136 notify 133143986194 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55fdeeafd360 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4be3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94549119343136 notifier 4563 bl.length()=155 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4be3fff640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4b400032c0 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(74 notify.4 [notify cookie 94549119602848 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== watch-notify(notify_complete (2) cookie 94549119602848 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4cf8083040 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.703+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 8.6 8:6321689d:root::.bucket.meta.testx%3amyfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb01550 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call,delete] v31'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d0f6bb800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 from cache 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d0f6bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94549119588080 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeb010a0 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== watch-notify(notify (1) cookie 94549119340784 notify 133143986192 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7f4cf8083040 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4bf0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986192 cookie 94549119340784 notifier 4563 bl.length()=212 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4bf0ff9640 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4bd0003ea0 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.704+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(77 notify.5 [notify cookie 94549119588080 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.705+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== watch-notify(notify_complete (2) cookie 94549119588080 notify 133143986192 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fdee843e00 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.705+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.706+0000 7f4bc37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.706+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94549119351936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeaf8220 con 0x55fdeeaafbc0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.707+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94549119351936] v31'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.707+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94549119328336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeaf8220 con 0x55fdeeab45d0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.708+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94549119328336] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.708+0000 7f4d0f6bb800 20 remove_watcher() i=0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.708+0000 7f4d0f6bb800 2 removed watcher, disabling cache 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.708+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94549119325808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeaf8220 con 0x55fdeeaafbc0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.709+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94549119325808] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.709+0000 7f4d0f6bb800 20 remove_watcher() i=1 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.709+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94549119335984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeaf8220 con 0x55fdeeab8f60 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.710+0000 7f4d0d1b6640 1 -- 172.21.15.99:0/3446358782 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94549119335984] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d00053040 con 0x55fdeeab8f60 2024-09-13T23:25:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.710+0000 7f4d0f6bb800 20 remove_watcher() i=2 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.710+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94549119338112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabd670 con 0x55fdeeab45d0 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.711+0000 7f4d0d9b7640 1 -- 172.21.15.99:0/3446358782 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94549119338112] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d0800a4a0 con 0x55fdeeab45d0 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.711+0000 7f4d0f6bb800 20 remove_watcher() i=3 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.711+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94549119343136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac0680 con 0x55fdeeaafbc0 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.712+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94549119343136] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x55fdeeaafbc0 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.712+0000 7f4d0f6bb800 20 remove_watcher() i=4 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.712+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94549119340784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabd670 con 0x7f4d08040b90 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.713+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94549119340784] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.713+0000 7f4d0f6bb800 20 remove_watcher() i=5 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.713+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94549119346288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeac10f0 con 0x7f4d08040b90 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.714+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94549119346288] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.714+0000 7f4d0f6bb800 20 remove_watcher() i=6 2024-09-13T23:25:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.714+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94549119350880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55fdeeabd670 con 0x7f4d08040b90 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94549119350880] v31'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cf8051070 con 0x7f4d08040b90 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 20 remove_watcher() i=7 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4d08040b90 msgr2=0x7f4d080114f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4d08040b90 0x7f4d080114f0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdeeaafbc0 msgr2=0x55fdeeab2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdeeaafbc0 0x55fdeeab2080 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeeab45d0 msgr2=0x55fdeeab69c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeeab45d0 0x55fdeeab69c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdeeab8f60 msgr2=0x55fdeeabb420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fdeeab8f60 0x55fdeeabb420 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bd8036b40 msgr2=0x7f4bd8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bd8036b40 0x7f4bd8039000 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001620 tx=0x7f4d00036000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 msgr2=0x55fdeeaa42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d07fff640 1 -- 172.21.15.99:0/3446358782 reap_dead start 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800afb0 tx=0x7f4d0804cdb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 shutdown_connections 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3446358782 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea9cdd0 0x55fdeeaa42a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 >> 172.21.15.99:0/3446358782 conn(0x55fdeea99180 msgr2=0x55fdeea97250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 shutdown_connections 2024-09-13T23:25:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.715+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3446358782 wait complete. 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 msgr2=0x7f4be4039070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 0x7f4be4039070 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d0004b040 tx=0x7f4d00024000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 msgr2=0x55fdeea90550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x55fdeea76510 tx=0x7f4d080167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 shutdown_connections 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4be4036bb0 0x7f4be4039070 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3547653489 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdeea90130 0x55fdeea90550 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 >> 172.21.15.99:0/3547653489 conn(0x55fdeea850c0 msgr2=0x55fdeea87c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 shutdown_connections 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3547653489 wait complete. 2024-09-13T23:25:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 msgr2=0x55fdeea7c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 0x55fdeea7c4d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 msgr2=0x55fdeea81110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 0x55fdeea81110 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 msgr2=0x7f4bf4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 0x7f4bf4039000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8057000 tx=0x7f4cf8052000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 msgr2=0x55fdeea75460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001e10 tx=0x7f4d00000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 shutdown_connections 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fdeea7ed20 0x55fdeea81110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fdee980900 0x55fdeea7c4d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4bf4036b40 0x7f4bf4039000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 --2- 172.21.15.99:0/3333129512 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fdee8f0650 0x55fdeea75460 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 >> 172.21.15.99:0/3333129512 conn(0x55fdee976db0 msgr2=0x55fdeea66df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 shutdown_connections 2024-09-13T23:25:37.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.716+0000 7f4d0f6bb800 1 -- 172.21.15.99:0/3333129512 wait complete. 2024-09-13T23:25:37.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:25:37.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T23:25:37.735 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T23:25:37.781 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.781 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.780+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.780+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.780+0000 7f505332a800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56497e959eb0 0x56497e9eb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.780+0000 7f505332a800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56497e8a5b30 con 0x56497e9ebaa0 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.780+0000 7f505332a800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x56497e887360 con 0x56497e959eb0 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.781+0000 7f504f021640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56497e959eb0 0x56497e9eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.781+0000 7f504f021640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56497e959eb0 0x56497e9eb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56980/0 (socket says 172.21.15.99:56980) 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.781+0000 7f504f021640 1 -- 172.21.15.99:0/730880650 learned_addr learned my addr 172.21.15.99:0/730880650 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.781+0000 7f504f021640 1 -- 172.21.15.99:0/730880650 >> v1:172.21.15.43:6789/0 conn(0x56497e9ebaa0 legacy=0x56497e9ede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.781+0000 7f504f021640 1 -- 172.21.15.99:0/730880650 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497e8ade00 con 0x56497e959eb0 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f504f021640 1 --2- 172.21.15.99:0/730880650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497e9eb560 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5040005fd0 tx=0x7f5040045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10322374d6a37116 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f504e01f640 1 -- 172.21.15.99:0/730880650 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504004e600 con 0x56497e959eb0 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f504e01f640 1 -- 172.21.15.99:0/730880650 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504004e7a0 con 0x56497e959eb0 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f504e01f640 1 -- 172.21.15.99:0/730880650 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504004eaa0 con 0x56497e959eb0 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f505332a800 1 -- 172.21.15.99:0/730880650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 msgr2=0x56497e9eb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.783+0000 7f505332a800 1 --2- 172.21.15.99:0/730880650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497e9eb560 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5040005fd0 tx=0x7f5040045cf0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.784+0000 7f505332a800 1 -- 172.21.15.99:0/730880650 shutdown_connections 2024-09-13T23:25:37.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.784+0000 7f505332a800 1 --2- 172.21.15.99:0/730880650 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497e9eb560 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.784+0000 7f505332a800 1 -- 172.21.15.99:0/730880650 >> 172.21.15.99:0/730880650 conn(0x56497e9e0dd0 msgr2=0x56497e9e31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.784+0000 7f505332a800 1 -- 172.21.15.99:0/730880650 shutdown_connections 2024-09-13T23:25:37.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.784+0000 7f505332a800 1 -- 172.21.15.99:0/730880650 wait complete. 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.797+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.797+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f505332a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f505332a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56497e932360 con 0x56497e959eb0 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f504f021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f504f021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56994/0 (socket says 172.21.15.99:56994) 2024-09-13T23:25:37.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f504f021640 1 -- 172.21.15.99:0/1541263557 learned_addr learned my addr 172.21.15.99:0/1541263557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f504f021640 1 -- 172.21.15.99:0/1541263557 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497e87fbc0 con 0x56497e959eb0 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f504f021640 1 --2- 172.21.15.99:0/1541263557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f504000a4b0 tx=0x7f5040050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4baa9893ab64e959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.798+0000 7f4f3d60a640 1 -- 172.21.15.99:0/1541263557 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504004ea80 con 0x56497e959eb0 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f4f3d60a640 1 -- 172.21.15.99:0/1541263557 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5040066070 con 0x56497e959eb0 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f4f3d60a640 1 -- 172.21.15.99:0/1541263557 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504004edc0 con 0x56497e959eb0 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 -- 172.21.15.99:0/1541263557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 msgr2=0x56497ead7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 --2- 172.21.15.99:0/1541263557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f504000a4b0 tx=0x7f5040050000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 -- 172.21.15.99:0/1541263557 shutdown_connections 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 --2- 172.21.15.99:0/1541263557 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e959eb0 0x56497ead7a70 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 -- 172.21.15.99:0/1541263557 >> 172.21.15.99:0/1541263557 conn(0x56497e9e0dd0 msgr2=0x56497ead3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 -- 172.21.15.99:0/1541263557 shutdown_connections 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.799+0000 7f505332a800 1 -- 172.21.15.99:0/1541263557 wait complete. 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f505332a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f505332a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56497e9ef8b0 con 0x56497e9ebaa0 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f504f021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f504f021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57008/0 (socket says 172.21.15.99:57008) 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f504f021640 1 -- 172.21.15.99:0/39502399 learned_addr learned my addr 172.21.15.99:0/39502399 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f504f021640 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497e893fe0 con 0x56497e9ebaa0 2024-09-13T23:25:37.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.800+0000 7f504f021640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5040063040 tx=0x7f5040003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f4f3be07640 1 -- 172.21.15.99:0/39502399 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5040076470 con 0x56497e9ebaa0 2024-09-13T23:25:37.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f4f3be07640 1 -- 172.21.15.99:0/39502399 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5040071070 con 0x56497e9ebaa0 2024-09-13T23:25:37.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56497eadfa40 con 0x56497e9ebaa0 2024-09-13T23:25:37.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f4f3be07640 1 -- 172.21.15.99:0/39502399 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5040076740 con 0x56497e9ebaa0 2024-09-13T23:25:37.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497eadff60 con 0x56497e9ebaa0 2024-09-13T23:25:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f4f3be07640 1 -- 172.21.15.99:0/39502399 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f50400768e0 con 0x56497e9ebaa0 2024-09-13T23:25:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.801+0000 7f4f3be07640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 0x7f4f34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f4f3be07640 1 -- 172.21.15.99:0/39502399 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f50400914e0 con 0x56497e9ebaa0 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f504e820640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 0x7f4f34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 0x56497eae6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eae6f20 con 0x56497eae4560 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f504f822640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 0x56497eae6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f504e820640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 0x7f4f34039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56497e959850 tx=0x7f5044001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f504f822640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 0x56497eae6950 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f504f822640 1 -- 172.21.15.99:0/39502399 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50480083e0 con 0x56497eae4560 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.802+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eae3b40 con 0x56497eae4560 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f504f822640 1 -- 172.21.15.99:0/39502399 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50480083e0 con 0x56497eae4560 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 0x56497eaeb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eaebd60 con 0x56497eae9280 2024-09-13T23:25:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f504f021640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 0x56497eaeb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f504f021640 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 0x56497eaeb670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f504f021640 1 -- 172.21.15.99:0/39502399 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f504006ad10 con 0x56497eae9280 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.803+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eae8120 con 0x56497eae4560 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f504f822640 1 -- 172.21.15.99:0/39502399 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50480083e0 con 0x56497eae4560 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eae85e0 con 0x56497eae9280 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f504f021640 1 -- 172.21.15.99:0/39502399 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f504006ad10 con 0x56497eae9280 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f505332a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.804+0000 7f505332a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56497e881580 con 0x56497eafa710 2024-09-13T23:25:37.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57016/0 (socket says 172.21.15.99:57016) 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f504f822640 1 -- 172.21.15.99:0/2508833082 learned_addr learned my addr 172.21.15.99:0/2508833082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f504f822640 1 -- 172.21.15.99:0/2508833082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497eafb070 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f504f822640 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x56497eae0720 tx=0x7f504800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f4f39602640 1 -- 172.21.15.99:0/2508833082 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504801c020 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f4f39602640 1 -- 172.21.15.99:0/2508833082 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048007cf0 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56497eafb300 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f4f39602640 1 -- 172.21.15.99:0/2508833082 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5048018440 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.805+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497eafdfe0 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f4f39602640 1 -- 172.21.15.99:0/2508833082 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f504801f020 con 0x56497eafa710 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f4f39602640 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 0x7f4f28039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f4f39602640 1 -- 172.21.15.99:0/2508833082 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f504804e180 con 0x56497eafa710 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f504f021640 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 0x7f4f28039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.806+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f021640 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 0x7f4f28039000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x56497eae7400 tx=0x7f504004e580 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f505332a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f505332a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56497ead8160 con 0x56497eb07350 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57020/0 (socket says 172.21.15.99:57020) 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f822640 1 -- 172.21.15.99:0/2649757846 learned_addr learned my addr 172.21.15.99:0/2649757846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f822640 1 -- 172.21.15.99:0/2649757846 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497eb07d20 con 0x56497eb07350 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f504f822640 1 --2- 172.21.15.99:0/2649757846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f504804c660 tx=0x7f504804c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3195a537e8ce2059 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f4f32ffd640 1 -- 172.21.15.99:0/2649757846 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5048021400 con 0x56497eb07350 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f4f32ffd640 1 -- 172.21.15.99:0/2649757846 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048018b50 con 0x56497eb07350 2024-09-13T23:25:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.807+0000 7f4f32ffd640 1 -- 172.21.15.99:0/2649757846 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50480215a0 con 0x56497eb07350 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- 172.21.15.99:0/2649757846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 msgr2=0x56497eb07750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 --2- 172.21.15.99:0/2649757846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f504804c660 tx=0x7f504804c910 comp rx=0 tx=0).stop 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- 172.21.15.99:0/2649757846 shutdown_connections 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 --2- 172.21.15.99:0/2649757846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb07750 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- 172.21.15.99:0/2649757846 >> 172.21.15.99:0/2649757846 conn(0x56497eb03700 msgr2=0x56497eb01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- 172.21.15.99:0/2649757846 shutdown_connections 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- 172.21.15.99:0/2649757846 wait complete. 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 Processor -- start 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- start start 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb0e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f505332a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56497eb08330 con 0x56497eb07350 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb0e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f504f822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb0e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57022/0 (socket says 172.21.15.99:57022) 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.808+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 learned_addr learned my addr 172.21.15.99:0/3648212377 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56497eb0ec90 con 0x56497eb07350 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f504f822640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb0e750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f504804c660 tx=0x7f504804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f4f317fa640 1 -- 172.21.15.99:0/3648212377 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50480188e0 con 0x56497eb07350 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f4f317fa640 1 -- 172.21.15.99:0/3648212377 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048016d60 con 0x56497eb07350 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56497eb0ef20 con 0x56497eb07350 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f4f317fa640 1 -- 172.21.15.99:0/3648212377 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5048020bc0 con 0x56497eb07350 2024-09-13T23:25:37.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.809+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56497eb0ef20 con 0x56497eb07350 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.810+0000 7f4f317fa640 1 -- 172.21.15.99:0/3648212377 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5048016040 con 0x56497eb07350 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.810+0000 7f4f317fa640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f18036b40 0x7f4f18039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.810+0000 7f4f317fa640 1 -- 172.21.15.99:0/3648212377 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f504804fb50 con 0x56497eb07350 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.810+0000 7f504f021640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f18036b40 0x7f4f18039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.810+0000 7f504f021640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f18036b40 0x7f4f18039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56497eae73d0 tx=0x7f504008a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eb1a120 0x56497eb1c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb1cd30 con 0x56497eb1a120 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f504e820640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eb1a120 0x56497eb1c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f504e820640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eb1a120 0x56497eb1c5e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f504400bdb0 con 0x56497eb1a120 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 20 realm 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.811+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb19570 con 0x56497eb1a120 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f504400bdb0 con 0x56497eb1a120 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb1d820 con 0x56497eb1a120 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f504400bdb0 con 0x56497eb1a120 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb1e0f0 con 0x56497eb1a120 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f504400bdb0 con 0x56497eb1a120 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eb1eb10 0x56497eb20f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb215f0 con 0x56497eb1eb10 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f504f822640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eb1eb10 0x56497eb20f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.812+0000 7f504f822640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eb1eb10 0x56497eb20f00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5048057040 con 0x56497eb1eb10 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f505332a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f505332a800 20 searching for the correct realm 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56497eb235a0 0x56497eb25a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f504f021640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56497eb235a0 0x56497eb25a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f504f021640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56497eb235a0 0x56497eb25a60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.813+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5048057040 con 0x56497eb1eb10 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504f822640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5048021020 0x7f504803f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504e820640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5048021020 0x7f504803f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504e820640 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5048021020 0x7f504803f390 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504400bdb0 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.814+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504400bdb0 con 0x56497eb1a120 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.815+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5048057040 con 0x56497eb1eb10 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.816+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5048057040 con 0x56497eb1eb10 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.817+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.818+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5048057040 con 0x56497eb1eb10 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x56497eb1a120 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.819+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504402a040 con 0x7f5048021020 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb235a0 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.820+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x7f5048021020 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1a120 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26130 con 0x56497eb1eb10 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb21fe0 con 0x56497eb1a120 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.821+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb22880 con 0x56497eb1a120 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb265b0 con 0x56497eb1eb10 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 zone default found 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 4 Realm: () 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 zonegroup default 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb26e00 con 0x7f5048021020 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb28b80 con 0x56497eb235a0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.822+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb28ff0 con 0x56497eb235a0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 20 started sync module instance, tier type = 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.823+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb28020 con 0x56497eb1eb10 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.824+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.824+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94873658230080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb28020 con 0x56497eb1eb10 2024-09-13T23:25:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.824+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb29ad0 con 0x56497eb1a120 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.825+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94873658230080] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.825+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.825+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94873658234304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb28020 con 0x56497eb1a120 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.825+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2a550 con 0x56497eb235a0 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.826+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.826+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94873658237024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2ae20 con 0x56497eb235a0 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.826+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2b900 con 0x56497eb1eb10 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.826+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94873658234304] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.827+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94873658237024] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.827+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.827+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94873658242064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2a970 con 0x56497eb1eb10 2024-09-13T23:25:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.827+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2c1a0 con 0x56497eb1a120 2024-09-13T23:25:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.828+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94873658242064] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.828+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.828+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94873658227568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2a970 con 0x56497eb1a120 2024-09-13T23:25:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.828+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2c870 con 0x7f5048021020 2024-09-13T23:25:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.829+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94873658227568] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.829+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.829+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94873658245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2c830 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.829+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2d280 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.830+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94873658245952] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.830+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.830+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94873658244336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2d280 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.830+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2dc40 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94873658244336] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94873658248656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2de20 con 0x7f5048021020 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=0 2024-09-13T23:25:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=1 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=2 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=3 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=4 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=5 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.831+0000 7f505332a800 20 add_watcher() i=6 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.832+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94873658248656] v31'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.832+0000 7f505332a800 20 add_watcher() i=7 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.832+0000 7f505332a800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.832+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb30fd0 con 0x56497eb1a120 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.833+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.833+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94873658251728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb2e2a0 con 0x56497eb1a120 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.834+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94873658251728] v31'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.834+0000 7f4f05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.834+0000 7f505332a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.834+0000 7f505332a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.834+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb30920 con 0x56497eb1a120 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.835+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.835+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3a150 con 0x7f5048021020 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.837+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.837+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3a6c0 con 0x56497eb235a0 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.838+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.838+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3ac30 con 0x56497eb1a120 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.838+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'135 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.838+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b0e0 con 0x56497eb1eb10 2024-09-13T23:25:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.839+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.839+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b0e0 con 0x56497eb235a0 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.840+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.840+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b0e0 con 0x56497eb1a120 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.841+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.841+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b0e0 con 0x7f5048021020 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.842+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.842+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3af10 con 0x56497eb1eb10 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.843+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.843+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b040 con 0x56497eb235a0 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.844+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.844+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1eb10 2024-09-13T23:25:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.845+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.845+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x7f5048021020 2024-09-13T23:25:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.846+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.846+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1eb10 2024-09-13T23:25:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.847+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.847+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x7f5048021020 2024-09-13T23:25:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.848+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.848+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1a120 2024-09-13T23:25:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.849+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'136 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.849+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.851+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.851+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1eb10 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.852+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.852+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.853+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.853+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1a120 2024-09-13T23:25:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.854+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.854+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1a120 2024-09-13T23:25:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.854+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'137 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.855+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.856+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.856+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb1eb10 2024-09-13T23:25:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.856+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.857+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.857+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.857+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.858+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.858+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x56497eb235a0 2024-09-13T23:25:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.859+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.859+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x56497eb235a0 2024-09-13T23:25:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.860+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.860+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x7f5048021020 2024-09-13T23:25:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.861+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.861+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x56497eb235a0 2024-09-13T23:25:37.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.862+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.862+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x7f5048021020 2024-09-13T23:25:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.864+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.864+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x56497eb235a0 2024-09-13T23:25:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.864+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.865+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x7f5048021020 2024-09-13T23:25:37.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.866+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.866+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb3b9a0 con 0x56497eb1eb10 2024-09-13T23:25:37.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f4f04fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f505332a800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f505332a800 20 Filter name: none 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f4e7e7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f505332a800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f505332a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.867+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb667d0 con 0x7f5048021020 2024-09-13T23:25:37.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T23:25:37.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb69260 con 0x56497eb1a120 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.868+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb67240 con 0x7f5048021020 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.869+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v31'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.869+0000 7f505332a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.869+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94873658490192 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb69630 con 0x56497eb235a0 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== watch-notify(notify (1) cookie 94873658237024 notify 133143986181 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56497eb3b7d0 con 0x56497eb235a0 2024-09-13T23:25:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f4f32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986181 cookie 94873658237024 notifier 4570 bl.length()=170 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f4f32ffd640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4f14003d60 con 0x56497eb235a0 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(97 notify.2 [notify cookie 94873658490192 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== watch-notify(notify_complete (2) cookie 94873658490192 notify 133143986181 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56497eb3a150 con 0x56497eb235a0 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f505332a800 10 removing email index: 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f505332a800 10 removing user buckets index 2024-09-13T23:25:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.870+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb671f0 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v31'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f505332a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94873658490192 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb69630 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== watch-notify(notify (1) cookie 94873658227568 notify 133143986195 ret 0) ==== 217+0+0 (crc 0 0 0) 0x56497eb3b500 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(100 notify.4 [notify cookie 94873658490192 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f4f327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986195 cookie 94873658227568 notifier 4570 bl.length()=175 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.871+0000 7f4f327fc640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4e840032c0 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.872+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== watch-notify(notify_complete (2) cookie 94873658490192 notify 133143986195 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56497eb3a6c0 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.872+0000 7f505332a800 10 removing user index: testx$tenanteduser 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.872+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.872+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x7f5048021020 2024-09-13T23:25:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.873+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v31'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.873+0000 7f505332a800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.873+0000 7f505332a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.873+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94873658486048 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x56497eb68600 con 0x56497eb1eb10 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== watch-notify(notify (1) cookie 94873658242064 notify 133143986189 ret 0) ==== 209+0+0 (crc 0 0 0) 0x56497eb3b040 con 0x56497eb1eb10 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f4f327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986189 cookie 94873658242064 notifier 4570 bl.length()=167 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f4f327fc640 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f4e840032f0 con 0x56497eb1eb10 2024-09-13T23:25:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(103 notify.3 [notify cookie 94873658486048 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== watch-notify(notify_complete (2) cookie 94873658486048 notify 133143986189 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5048033070 con 0x56497eb1eb10 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.874+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.875+0000 7f4f05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.875+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94873658251728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb1a120 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.876+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94873658251728] v31'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.876+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94873658230080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb1eb10 2024-09-13T23:25:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.876+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94873658230080] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.877+0000 7f505332a800 20 remove_watcher() i=0 2024-09-13T23:25:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.877+0000 7f505332a800 2 removed watcher, disabling cache 2024-09-13T23:25:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.877+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94873658234304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb1a120 2024-09-13T23:25:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.878+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94873658234304] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.878+0000 7f505332a800 20 remove_watcher() i=1 2024-09-13T23:25:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.878+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94873658237024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb235a0 2024-09-13T23:25:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.879+0000 7f504f021640 1 -- 172.21.15.99:0/3648212377 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94873658237024] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504006ad10 con 0x56497eb235a0 2024-09-13T23:25:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.879+0000 7f505332a800 20 remove_watcher() i=2 2024-09-13T23:25:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.879+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94873658242064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb1eb10 2024-09-13T23:25:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.880+0000 7f504f822640 1 -- 172.21.15.99:0/3648212377 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94873658242064] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5048062040 con 0x56497eb1eb10 2024-09-13T23:25:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.880+0000 7f505332a800 20 remove_watcher() i=3 2024-09-13T23:25:37.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.880+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94873658227568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x56497eb1a120 2024-09-13T23:25:37.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.880+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94873658227568] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x56497eb1a120 2024-09-13T23:25:37.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.881+0000 7f505332a800 20 remove_watcher() i=4 2024-09-13T23:25:37.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.881+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94873658245952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x7f5048021020 2024-09-13T23:25:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94873658245952] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f505332a800 20 remove_watcher() i=5 2024-09-13T23:25:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94873658244336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x7f5048021020 2024-09-13T23:25:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94873658244336] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f505332a800 20 remove_watcher() i=6 2024-09-13T23:25:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.882+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94873658248656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x56497eb6b2f0 con 0x7f5048021020 2024-09-13T23:25:37.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94873658248656] v31'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f504403a040 con 0x7f5048021020 2024-09-13T23:25:37.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 20 remove_watcher() i=7 2024-09-13T23:25:37.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5048021020 msgr2=0x7f504803f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5048021020 0x7f504803f390 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eb1a120 msgr2=0x56497eb1c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eb1a120 0x56497eb1c5e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eb1eb10 msgr2=0x56497eb20f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eb1eb10 0x56497eb20f00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56497eb235a0 msgr2=0x56497eb25a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x56497eb235a0 0x56497eb25a60 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f18036b40 msgr2=0x7f4f18039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f18036b40 0x7f4f18039000 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56497eae73d0 tx=0x7f504008a000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 msgr2=0x56497eb0e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/3648212377 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eb07350 0x56497eb0e750 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f504804c660 tx=0x7f504804b000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 reap_dead start 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f504e820640 1 -- 172.21.15.99:0/3648212377 reap_dead start 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 shutdown_connections 2024-09-13T23:25:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 >> 172.21.15.99:0/3648212377 conn(0x56497eb03700 msgr2=0x56497eb017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 shutdown_connections 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/3648212377 wait complete. 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 msgr2=0x7f4f28039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 0x7f4f28039000 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x56497eae7400 tx=0x7f504004e580 comp rx=0 tx=0).stop 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 msgr2=0x56497eafab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x56497eae0720 tx=0x7f504800beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 shutdown_connections 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f28036b40 0x7f4f28039000 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 --2- 172.21.15.99:0/2508833082 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497eafa710 0x56497eafab30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 >> 172.21.15.99:0/2508833082 conn(0x56497eaef6a0 msgr2=0x56497eaf2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 shutdown_connections 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.884+0000 7f505332a800 1 -- 172.21.15.99:0/2508833082 wait complete. 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 msgr2=0x56497eae6950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 0x56497eae6950 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 msgr2=0x56497eaeb670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 0x56497eaeb670 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 msgr2=0x7f4f34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 0x7f4f34039000 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x56497e959850 tx=0x7f5044001390 comp rx=0 tx=0).stop 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 msgr2=0x56497eadf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5040063040 tx=0x7f5040003330 comp rx=0 tx=0).stop 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 shutdown_connections 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56497eae9280 0x56497eaeb670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56497eae4560 0x56497eae6950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4f34036b40 0x7f4f34039000 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 --2- 172.21.15.99:0/39502399 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56497e9ebaa0 0x56497eadf500 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 >> 172.21.15.99:0/39502399 conn(0x56497e9e0dd0 msgr2=0x56497ead1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 shutdown_connections 2024-09-13T23:25:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.885+0000 7f505332a800 1 -- 172.21.15.99:0/39502399 wait complete. 2024-09-13T23:25:37.901 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:25:37.904 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T23:25:37.906 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:37.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:25:37.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T23:25:37.907 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T23:25:37.953 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:37.953 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b22010800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e5ec1974e0 0x55e5ec1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b22010800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e5ec057b30 con 0x55e5ec197e20 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b22010800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55e5ec039360 con 0x55e5ec1974e0 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b1d784640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e5ec1974e0 0x55e5ec1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b1cf83640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55e5ec197e20 0x55e5ec19c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42038/0 (socket says 172.21.15.99:42038) 2024-09-13T23:25:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.952+0000 7f9b1cf83640 1 -- 172.21.15.99:0/39960529 learned_addr learned my addr 172.21.15.99:0/39960529 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.953+0000 7f9b1d784640 1 -- 172.21.15.99:0/39960529 >> v1:172.21.15.43:6789/0 conn(0x55e5ec197e20 legacy=0x55e5ec19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.953+0000 7f9b1d784640 1 -- 172.21.15.99:0/39960529 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec05fe00 con 0x55e5ec1974e0 2024-09-13T23:25:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b1d784640 1 --2- 172.21.15.99:0/39960529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec1978e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000a600 tx=0x7f9b10047cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bebec760c337cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b0ffff640 1 -- 172.21.15.99:0/39960529 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10056070 con 0x55e5ec1974e0 2024-09-13T23:25:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b0ffff640 1 -- 172.21.15.99:0/39960529 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1000a200 con 0x55e5ec1974e0 2024-09-13T23:25:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b0ffff640 1 -- 172.21.15.99:0/39960529 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10008590 con 0x55e5ec1974e0 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 -- 172.21.15.99:0/39960529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 msgr2=0x55e5ec1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 --2- 172.21.15.99:0/39960529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec1978e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000a600 tx=0x7f9b10047cb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 -- 172.21.15.99:0/39960529 shutdown_connections 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 --2- 172.21.15.99:0/39960529 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec1978e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 -- 172.21.15.99:0/39960529 >> 172.21.15.99:0/39960529 conn(0x55e5ec192db0 msgr2=0x55e5ec1951d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 -- 172.21.15.99:0/39960529 shutdown_connections 2024-09-13T23:25:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.955+0000 7f9b22010800 1 -- 172.21.15.99:0/39960529 wait complete. 2024-09-13T23:25:37.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b22010800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b22010800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec0e4360 con 0x55e5ec1974e0 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b1d784640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b1d784640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57040/0 (socket says 172.21.15.99:57040) 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.969+0000 7f9b1d784640 1 -- 172.21.15.99:0/3461963454 learned_addr learned my addr 172.21.15.99:0/3461963454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.970+0000 7f9b1d784640 1 -- 172.21.15.99:0/3461963454 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec031bc0 con 0x55e5ec1974e0 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.970+0000 7f9b1d784640 1 --2- 172.21.15.99:0/3461963454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9b10027ae0 tx=0x7f9b10053000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5396e429e060ce7b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.970+0000 7f9a0b606640 1 -- 172.21.15.99:0/3461963454 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10008780 con 0x55e5ec1974e0 2024-09-13T23:25:37.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.970+0000 7f9a0b606640 1 -- 172.21.15.99:0/3461963454 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b10008920 con 0x55e5ec1974e0 2024-09-13T23:25:37.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.970+0000 7f9a0b606640 1 -- 172.21.15.99:0/3461963454 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10008c00 con 0x55e5ec1974e0 2024-09-13T23:25:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- 172.21.15.99:0/3461963454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 msgr2=0x55e5ec285670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 --2- 172.21.15.99:0/3461963454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f9b10027ae0 tx=0x7f9b10053000 comp rx=0 tx=0).stop 2024-09-13T23:25:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- 172.21.15.99:0/3461963454 shutdown_connections 2024-09-13T23:25:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 --2- 172.21.15.99:0/3461963454 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec285670 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- 172.21.15.99:0/3461963454 >> 172.21.15.99:0/3461963454 conn(0x55e5ec192db0 msgr2=0x55e5ec281030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- 172.21.15.99:0/3461963454 shutdown_connections 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- 172.21.15.99:0/3461963454 wait complete. 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b22010800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec19e500 con 0x55e5ec1974e0 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b1d784640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b1d784640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57046/0 (socket says 172.21.15.99:57046) 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.971+0000 7f9b1d784640 1 -- 172.21.15.99:0/3909030409 learned_addr learned my addr 172.21.15.99:0/3909030409 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9b1d784640 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec045fe0 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9b1d784640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9b10027ae0 tx=0x7f9b10002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9a09e03640 1 -- 172.21.15.99:0/3909030409 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b100705a0 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9a09e03640 1 -- 172.21.15.99:0/3909030409 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b10070740 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec28d4b0 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9a09e03640 1 -- 172.21.15.99:0/3909030409 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b10070a20 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.972+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec28d970 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9a09e03640 1 -- 172.21.15.99:0/3909030409 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b10059070 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9a09e03640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 0x7f9a04039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9a09e03640 1 -- 172.21.15.99:0/3909030409 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b10062070 con 0x55e5ec1974e0 2024-09-13T23:25:37.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 0x7f9a04039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 0x55e5ec293fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec294520 con 0x55e5ec197e20 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.973+0000 7f9b1df85640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 0x55e5ec293fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 0x7f9a04039000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000f60 tx=0x7f9b140012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b1df85640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 0x55e5ec293fe0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b1df85640 1 -- 172.21.15.99:0/3909030409 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b1800a4a0 con 0x55e5ec197e20 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2915b0 con 0x55e5ec197e20 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b1df85640 1 -- 172.21.15.99:0/3909030409 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b1800a4a0 con 0x55e5ec197e20 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 0x55e5ec298c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec299330 con 0x55e5ec296850 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.974+0000 7f9b1d784640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 0x55e5ec298c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.975+0000 7f9b1d784640 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 0x55e5ec298c40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.975+0000 7f9b1d784640 1 -- 172.21.15.99:0/3909030409 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b10058030 con 0x55e5ec296850 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.975+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec295630 con 0x55e5ec197e20 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.975+0000 7f9b1df85640 1 -- 172.21.15.99:0/3909030409 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b1800a4a0 con 0x55e5ec197e20 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.975+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec295b10 con 0x55e5ec296850 2024-09-13T23:25:37.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b1d784640 1 -- 172.21.15.99:0/3909030409 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b10058030 con 0x55e5ec296850 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b22010800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b22010800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec033580 con 0x55e5ec2a7c30 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57050/0 (socket says 172.21.15.99:57050) 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.976+0000 7f9b1df85640 1 -- 172.21.15.99:0/705550778 learned_addr learned my addr 172.21.15.99:0/705550778 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9b1df85640 1 -- 172.21.15.99:0/705550778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec2a8590 con 0x55e5ec2a7c30 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9b1df85640 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e5ec294900 tx=0x7f9b180163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9a037fe640 1 -- 172.21.15.99:0/705550778 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b18013450 con 0x55e5ec2a7c30 2024-09-13T23:25:37.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9a037fe640 1 -- 172.21.15.99:0/705550778 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b180135f0 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec2a8820 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9a037fe640 1 -- 172.21.15.99:0/705550778 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b180138d0 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.977+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec2ab500 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9a037fe640 1 -- 172.21.15.99:0/705550778 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b18011040 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9a037fe640 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9a037fe640 1 -- 172.21.15.99:0/705550778 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b1800e040 con 0x55e5ec2a7c30 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b1d784640 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b1d784640 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55e5ec294e00 tx=0x7f9b1006ee50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b22010800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b22010800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec285dc0 con 0x55e5ec2b4980 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.978+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57060/0 (socket says 172.21.15.99:57060) 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b1df85640 1 -- 172.21.15.99:0/863319416 learned_addr learned my addr 172.21.15.99:0/863319416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b1df85640 1 -- 172.21.15.99:0/863319416 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec2b5350 con 0x55e5ec2b4980 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b1df85640 1 --2- 172.21.15.99:0/863319416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9b1804cdd0 tx=0x7f9b18029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f568cea4920db6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9a017fa640 1 -- 172.21.15.99:0/863319416 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1804a020 con 0x55e5ec2b4980 2024-09-13T23:25:37.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9a017fa640 1 -- 172.21.15.99:0/863319416 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1802a570 con 0x55e5ec2b4980 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9a017fa640 1 -- 172.21.15.99:0/863319416 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1801f500 con 0x55e5ec2b4980 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b22010800 1 -- 172.21.15.99:0/863319416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 msgr2=0x55e5ec2b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b22010800 1 --2- 172.21.15.99:0/863319416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9b1804cdd0 tx=0x7f9b18029fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b22010800 1 -- 172.21.15.99:0/863319416 shutdown_connections 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b22010800 1 --2- 172.21.15.99:0/863319416 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2b4d80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.979+0000 7f9b22010800 1 -- 172.21.15.99:0/863319416 >> 172.21.15.99:0/863319416 conn(0x55e5ec2b0ce0 msgr2=0x55e5ec2aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 -- 172.21.15.99:0/863319416 shutdown_connections 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 -- 172.21.15.99:0/863319416 wait complete. 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 Processor -- start 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 -- start start 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b22010800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e5ec2b59c0 con 0x55e5ec2b4980 2024-09-13T23:25:37.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b1df85640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57068/0 (socket says 172.21.15.99:57068) 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 learned_addr learned my addr 172.21.15.99:0/2040702156 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.980+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5ec2c0710 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f9b1df85640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b1804cd30 tx=0x7f9b1804cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f99faffd640 1 -- 172.21.15.99:0/2040702156 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1803a070 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f99faffd640 1 -- 172.21.15.99:0/2040702156 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1801f710 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5ec2c09a0 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f99faffd640 1 -- 172.21.15.99:0/2040702156 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b1801fa30 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5ec2c3650 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.981+0000 7f99faffd640 1 -- 172.21.15.99:0/2040702156 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9b1803d070 con 0x55e5ec2b4980 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f99faffd640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99e4036ce0 0x7f99e40391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:37.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f99faffd640 1 -- 172.21.15.99:0/2040702156 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f9b18035030 con 0x55e5ec2b4980 2024-09-13T23:25:37.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b1d784640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99e4036ce0 0x7f99e40391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:37.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b1d784640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99e4036ce0 0x7f99e40391a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b10091990 tx=0x7f9b10089000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec2cbc80 0x55e5ec2ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ce890 con 0x55e5ec2cbc80 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.982+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec2cbc80 0x55e5ec2ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec2cbc80 0x55e5ec2ce140 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b14009050 con 0x55e5ec2cbc80 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 realm 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2cb0d0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b14009050 con 0x55e5ec2cbc80 2024-09-13T23:25:38.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2cf380 con 0x55e5ec2cbc80 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b14009050 con 0x55e5ec2cbc80 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.983+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2cfc50 con 0x55e5ec2cbc80 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b14009050 con 0x55e5ec2cbc80 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec2d0590 0x55e5ec2d2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d3110 con 0x55e5ec2d0590 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b1df85640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec2d0590 0x55e5ec2d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b1df85640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec2d0590 0x55e5ec2d2980 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 20 searching for the correct realm 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e5ec2d50e0 0x55e5ec2d75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2d50e0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.984+0000 7f9b1d784640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e5ec2d50e0 0x55e5ec2d75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1d784640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e5ec2d50e0 0x55e5ec2d75a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2d0590 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1df85640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b18058040 0x7f9b18040660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x7f9b18058040 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.985+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b18058040 0x7f9b18040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b18058040 0x7f9b18040660 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14009050 con 0x7f9b18058040 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14009050 con 0x55e5ec2cbc80 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.986+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x7f9b18058040 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x7f9b18058040 2024-09-13T23:25:38.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2d0590 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d7c70 con 0x55e5ec2d50e0 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.987+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d0590 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.988+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.989+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d0590 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.990+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.991+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d0590 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x7f9b18058040 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.992+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x7f9b100a7040 con 0x55e5ec2d0590 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:38.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d3b00 con 0x55e5ec2cbc80 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d43a0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d80f0 con 0x55e5ec2d0590 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.993+0000 7f9b22010800 20 zone default found 2024-09-13T23:25:38.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 4 Realm: () 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 zonegroup default 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d8940 con 0x7f9b18058040 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2da6c0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2daae0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 started sync module instance, tier type = 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.994+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d9b60 con 0x55e5ec2d0590 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.995+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.996+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94445998284624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d9b60 con 0x55e5ec2d0590 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.996+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2db3d0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.997+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94445998284624] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.997+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.997+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94445998282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2db3d0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.997+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dbd90 con 0x55e5ec2d50e0 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.998+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.998+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94445998291168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dc1f0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.998+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dccf0 con 0x55e5ec2d0590 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.998+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94445998282688] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.999+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94445998291168] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.999+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.999+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94445998295008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dccb0 con 0x55e5ec2d0590 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:37.999+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dd590 con 0x55e5ec2cbc80 2024-09-13T23:25:38.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.000+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.000+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94445998297312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dd9b0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.000+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2de200 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.000+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94445998295008] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.001+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94445998297312] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.001+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.001+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94445998298368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dddd0 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.001+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2deaa0 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.002+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.002+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94445998302704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2dddd0 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.002+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2df580 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.002+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94445998298368] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94445998302704] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94445998299424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2df090 con 0x7f9b18058040 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=0 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=1 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=2 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=3 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=4 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=5 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.003+0000 7f9b22010800 20 add_watcher() i=6 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94445998299424] v31'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b22010800 20 add_watcher() i=7 2024-09-13T23:25:38.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b22010800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e2570 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.004+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94445998305424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2df990 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.005+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94445998305424] v31'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.005+0000 7f99cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.005+0000 7f9b22010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.005+0000 7f9b22010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.005+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2eaf20 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.007+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.007+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2eb5f0 con 0x7f9b18058040 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.008+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.008+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2eb9f0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.009+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.009+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ebf60 con 0x55e5ec2cbc80 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.010+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v31'140 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.010+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ec410 con 0x55e5ec2d0590 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.011+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v31'41 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.011+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ec410 con 0x55e5ec2d50e0 2024-09-13T23:25:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.012+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.012+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e6bf0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.013+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v31'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.013+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e6bf0 con 0x7f9b18058040 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.014+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v31'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.014+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e6bf0 con 0x55e5ec2d0590 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.014+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.015+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e6cb0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.015+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v31'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.015+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2e6d40 con 0x55e5ec2d0590 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.016+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v31'42 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.016+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x7f9b18058040 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.018+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v31'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.018+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d0590 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.019+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v31'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.019+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x7f9b18058040 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.020+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v31'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.020+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.021+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v31'141 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.021+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.022+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v31'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.022+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d0590 2024-09-13T23:25:38.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.023+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v31'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.023+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.024+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.024+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.025+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v31'26 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.025+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.026+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v31'142 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.026+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.027+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v31'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.027+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d0590 2024-09-13T23:25:38.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.028+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v31'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.028+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.029+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.029+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.030+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v31'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.030+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.031+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v31'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.031+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.032+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.032+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x7f9b18058040 2024-09-13T23:25:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.033+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v31'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.033+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.034+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v31'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.034+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x7f9b18058040 2024-09-13T23:25:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.035+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v31'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.035+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.036+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v31'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.036+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x7f9b18058040 2024-09-13T23:25:38.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.037+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v31'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.037+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2ecda0 con 0x55e5ec2d0590 2024-09-13T23:25:38.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.038+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v31'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.038+0000 7f99ce7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.038+0000 7f9b22010800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.038+0000 7f9b22010800 20 Filter name: none 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.038+0000 7f993ffff640 20 reqs_thread_entry: start 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec317b70 con 0x55e5ec2d0590 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec3195c0 con 0x7f9b18058040 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(95 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 20 get_obj_state: octx=0x7f9b1801fe80 obj=myfoo:four state=0x55e5ec31a8a8 s->prefetch_data=0 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.039+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 3.39 3:9ca39388:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec31b6d0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(96 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 10 manifest: total_size = 4 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5838759584632583365 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 20 get_obj_state: octx=0x7f9b1801fe80 obj=myfoo:four state=0x55e5ec31a8a8 s->prefetch_data=0 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 20 prepare_atomic_modification: state is not atomic. state=0x55e5ec31a8a8 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.040+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec31ffe0 con 0x55e5ec2cbc80 2024-09-13T23:25:38.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.041+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(97 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [stat,call,call] v31'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.041+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 3.39 3:9ca39388:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec31ffe0 con 0x55e5ec2d50e0 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.042+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(98 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1_four [call] v31'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.042+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.043+0000 7f99cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.043+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94445998305424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.043+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(99 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [stat,call,call] v31'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.043+0000 7f9a017fa640 20 handle_completion(): completion ok for obj=four 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.044+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94445998305424] v31'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.044+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94445998284624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2d0590 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.045+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94445998284624] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.045+0000 7f9b22010800 20 remove_watcher() i=0 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.045+0000 7f9b22010800 2 removed watcher, disabling cache 2024-09-13T23:25:38.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.045+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94445998282688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.046+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94445998282688] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.046+0000 7f9b22010800 20 remove_watcher() i=1 2024-09-13T23:25:38.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.046+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94445998291168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2d50e0 2024-09-13T23:25:38.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.047+0000 7f9b1d784640 1 -- 172.21.15.99:0/2040702156 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94445998291168] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b10098040 con 0x55e5ec2d50e0 2024-09-13T23:25:38.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.047+0000 7f9b22010800 20 remove_watcher() i=2 2024-09-13T23:25:38.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.047+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94445998295008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2d0590 2024-09-13T23:25:38.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.048+0000 7f9b1df85640 1 -- 172.21.15.99:0/2040702156 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94445998295008] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b1803c030 con 0x55e5ec2d0590 2024-09-13T23:25:38.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.048+0000 7f9b22010800 20 remove_watcher() i=3 2024-09-13T23:25:38.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.048+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94445998297312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x55e5ec2cbc80 2024-09-13T23:25:38.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.049+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94445998297312] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x55e5ec2cbc80 2024-09-13T23:25:38.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.049+0000 7f9b22010800 20 remove_watcher() i=4 2024-09-13T23:25:38.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.049+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94445998298368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec320a70 con 0x7f9b18058040 2024-09-13T23:25:38.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.050+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94445998298368] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.050+0000 7f9b22010800 20 remove_watcher() i=5 2024-09-13T23:25:38.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.050+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94445998302704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2d9f50 con 0x7f9b18058040 2024-09-13T23:25:38.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.051+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94445998302704] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.051+0000 7f9b22010800 20 remove_watcher() i=6 2024-09-13T23:25:38.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.051+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94445998299424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55e5ec2db8e0 con 0x7f9b18058040 2024-09-13T23:25:38.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94445998299424] v31'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b14029040 con 0x7f9b18058040 2024-09-13T23:25:38.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 20 remove_watcher() i=7 2024-09-13T23:25:38.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b18058040 msgr2=0x7f9b18040660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f9b18058040 0x7f9b18040660 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec2cbc80 msgr2=0x55e5ec2ce140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec2cbc80 0x55e5ec2ce140 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec2d0590 msgr2=0x55e5ec2d2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec2d0590 0x55e5ec2d2980 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e5ec2d50e0 msgr2=0x55e5ec2d75a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.052+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e5ec2d50e0 0x55e5ec2d75a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99e4036ce0 msgr2=0x7f99e40391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99e4036ce0 0x7f99e40391a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9b10091990 tx=0x7f9b10089000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 msgr2=0x55e5ec2c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b1cf83640 1 -- 172.21.15.99:0/2040702156 reap_dead start 2024-09-13T23:25:38.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9b1804cd30 tx=0x7f9b1804cd60 comp rx=0 tx=0).stop 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 shutdown_connections 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/2040702156 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2b4980 0x55e5ec2c01d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 >> 172.21.15.99:0/2040702156 conn(0x55e5ec2b0ce0 msgr2=0x55e5ec2aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 shutdown_connections 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/2040702156 wait complete. 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 msgr2=0x7f99f4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55e5ec294e00 tx=0x7f9b1006ee50 comp rx=0 tx=0).stop 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 msgr2=0x55e5ec2a8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x55e5ec294900 tx=0x7f9b180163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 shutdown_connections 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f99f4036b40 0x7f99f4039000 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/705550778 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec2a7c30 0x55e5ec2a8050 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 >> 172.21.15.99:0/705550778 conn(0x55e5ec29cbc0 msgr2=0x55e5ec29f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 shutdown_connections 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/705550778 wait complete. 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 msgr2=0x55e5ec293fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 0x55e5ec293fe0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 msgr2=0x55e5ec298c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.053+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 0x55e5ec298c40 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 msgr2=0x7f9a04039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 0x7f9a04039000 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b14000f60 tx=0x7f9b140012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 msgr2=0x55e5ec28cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f9b10027ae0 tx=0x7f9b10002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 shutdown_connections 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e5ec296850 0x55e5ec298c40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e5ec197e20 0x55e5ec293fe0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9a04036b40 0x7f9a04039000 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 --2- 172.21.15.99:0/3909030409 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e5ec1974e0 0x55e5ec28cf70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 >> 172.21.15.99:0/3909030409 conn(0x55e5ec192db0 msgr2=0x55e5ec27f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 shutdown_connections 2024-09-13T23:25:38.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.054+0000 7f9b22010800 1 -- 172.21.15.99:0/3909030409 wait complete. 2024-09-13T23:25:38.063 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:38.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T23:25:38.064 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T23:25:38.107 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:38.108 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.107+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.107+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.107+0000 7f4ae9c11800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ebcb491a60 0x55ebcb493e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.107+0000 7f4ae9c11800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebcb34cb30 con 0x55ebcb48d760 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.107+0000 7f4ae9c11800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55ebcb32e360 con 0x55ebcb491a60 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4adcb2b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ebcb491a60 0x55ebcb493e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4adcb2b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ebcb491a60 0x55ebcb493e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57070/0 (socket says 172.21.15.99:57070) 2024-09-13T23:25:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4adcb2b640 1 -- 172.21.15.99:0/946756400 learned_addr learned my addr 172.21.15.99:0/946756400 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4ae532c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55ebcb48d760 0x55ebcb48db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42054/0 (socket says 172.21.15.99:42054) 2024-09-13T23:25:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4adcb2b640 1 -- 172.21.15.99:0/946756400 >> v1:172.21.15.43:6789/0 conn(0x55ebcb48d760 legacy=0x55ebcb48db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.108+0000 7f4adcb2b640 1 -- 172.21.15.99:0/946756400 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb354e00 con 0x55ebcb491a60 2024-09-13T23:25:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/946756400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb491a60 0x55ebcb493e50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000a520 tx=0x7f4ad0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5e570e8dd54bec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae4b2b640 1 -- 172.21.15.99:0/946756400 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad0055070 con 0x55ebcb491a60 2024-09-13T23:25:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae4b2b640 1 -- 172.21.15.99:0/946756400 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad00515b0 con 0x55ebcb491a60 2024-09-13T23:25:38.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae4b2b640 1 -- 172.21.15.99:0/946756400 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad00518d0 con 0x55ebcb491a60 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 -- 172.21.15.99:0/946756400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb491a60 msgr2=0x55ebcb493e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/946756400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb491a60 0x55ebcb493e50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ad000a520 tx=0x7f4ad0045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 -- 172.21.15.99:0/946756400 shutdown_connections 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/946756400 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb491a60 0x55ebcb493e50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 -- 172.21.15.99:0/946756400 >> 172.21.15.99:0/946756400 conn(0x55ebcb488ff0 msgr2=0x55ebcb48b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 -- 172.21.15.99:0/946756400 shutdown_connections 2024-09-13T23:25:38.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.110+0000 7f4ae9c11800 1 -- 172.21.15.99:0/946756400 wait complete. 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.124+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.124+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.124+0000 7f4ae9c11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.124+0000 7f4ae9c11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb3d9330 con 0x55ebcb48d760 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f4ae532c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f4ae532c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57074/0 (socket says 172.21.15.99:57074) 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f4ae532c640 1 -- 172.21.15.99:0/1898768855 learned_addr learned my addr 172.21.15.99:0/1898768855 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f4ae532c640 1 -- 172.21.15.99:0/1898768855 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb326bc0 con 0x55ebcb48d760 2024-09-13T23:25:38.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f4ae532c640 1 --2- 172.21.15.99:0/1898768855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8001e40 tx=0x7f4ad8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14362da611057a5e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f49d3606640 1 -- 172.21.15.99:0/1898768855 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad800e5c0 con 0x55ebcb48d760 2024-09-13T23:25:38.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f49d3606640 1 -- 172.21.15.99:0/1898768855 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad8006070 con 0x55ebcb48d760 2024-09-13T23:25:38.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.125+0000 7f49d3606640 1 -- 172.21.15.99:0/1898768855 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad800e910 con 0x55ebcb48d760 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1898768855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 msgr2=0x55ebcb4036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1898768855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8001e40 tx=0x7f4ad8001e70 comp rx=0 tx=0).stop 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1898768855 shutdown_connections 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1898768855 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb4036c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1898768855 >> 172.21.15.99:0/1898768855 conn(0x55ebcb488ff0 msgr2=0x55ebcb578220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1898768855 shutdown_connections 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1898768855 wait complete. 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.126+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae9c11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae9c11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb494690 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae532c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae532c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57088/0 (socket says 172.21.15.99:57088) 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae532c640 1 -- 172.21.15.99:0/1932984631 learned_addr learned my addr 172.21.15.99:0/1932984631 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae532c640 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb33afe0 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae532c640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000f60 tx=0x7f4ad8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f49d1e03640 1 -- 172.21.15.99:0/1932984631 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad800f8d0 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f49d1e03640 1 -- 172.21.15.99:0/1932984631 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad800fa70 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.127+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcb586a70 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.128+0000 7f49d1e03640 1 -- 172.21.15.99:0/1932984631 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad800fd90 con 0x55ebcb48d760 2024-09-13T23:25:38.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.128+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcb586f90 con 0x55ebcb48d760 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.128+0000 7f49d1e03640 1 -- 172.21.15.99:0/1932984631 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ad8017070 con 0x55ebcb48d760 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.128+0000 7f49d1e03640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 0x7f49cc038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f49d1e03640 1 -- 172.21.15.99:0/1932984631 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4ad8015020 con 0x55ebcb48d760 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 0x7f49cc038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 0x55ebcb58d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb58db70 con 0x55ebcb491a60 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 0x55ebcb58d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 0x7f49cc038fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0057000 tx=0x7f4ad0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 0x55ebcb58d5a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/1932984631 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb491a60 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.129+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb58ab70 con 0x55ebcb491a60 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/1932984631 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb491a60 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 0x55ebcb592270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb592910 con 0x55ebcb58fe80 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae532c640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 0x55ebcb592270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae532c640 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 0x55ebcb592270 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae532c640 1 -- 172.21.15.99:0/1932984631 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4ad802e070 con 0x55ebcb58fe80 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.130+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb58ed20 con 0x55ebcb491a60 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/1932984631 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb491a60 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb58f200 con 0x55ebcb58fe80 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae532c640 1 -- 172.21.15.99:0/1932984631 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ad802e070 con 0x55ebcb58fe80 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae9c11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.131+0000 7f4ae9c11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb328580 con 0x55ebcb5a1230 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57104/0 (socket says 172.21.15.99:57104) 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/700783846 learned_addr learned my addr 172.21.15.99:0/700783846 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/700783846 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb5a1b90 con 0x55ebcb5a1230 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55ebcb5875e0 tx=0x7f4ae00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f49caffd640 1 -- 172.21.15.99:0/700783846 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0013640 con 0x55ebcb5a1230 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f49caffd640 1 -- 172.21.15.99:0/700783846 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae00137e0 con 0x55ebcb5a1230 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcb5a1e20 con 0x55ebcb5a1230 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f49caffd640 1 -- 172.21.15.99:0/700783846 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0013ac0 con 0x55ebcb5a1230 2024-09-13T23:25:38.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.132+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcb5a4b00 con 0x55ebcb5a1230 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.133+0000 7f49caffd640 1 -- 172.21.15.99:0/700783846 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ae0011040 con 0x55ebcb5a1230 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.133+0000 7f49caffd640 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 0x7f49bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.133+0000 7f49caffd640 1 -- 172.21.15.99:0/700783846 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4ae000e040 con 0x55ebcb5a1230 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.133+0000 7f4ae532c640 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 0x7f49bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.133+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae532c640 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 0x7f49bc039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ad804b890 tx=0x7f4ad804b760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae9c11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae9c11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb401d90 con 0x55ebcb5adf30 2024-09-13T23:25:38.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57110/0 (socket says 172.21.15.99:57110) 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4129686993 learned_addr learned my addr 172.21.15.99:0/4129686993 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4129686993 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb5ae900 con 0x55ebcb5adf30 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/4129686993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0016cd0 tx=0x7f4ae001fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba412cb330c51cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f49c8ff9640 1 -- 172.21.15.99:0/4129686993 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0020c50 con 0x55ebcb5adf30 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f49c8ff9640 1 -- 172.21.15.99:0/4129686993 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae0020df0 con 0x55ebcb5adf30 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.134+0000 7f49c8ff9640 1 -- 172.21.15.99:0/4129686993 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0040280 con 0x55ebcb5adf30 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4129686993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 msgr2=0x55ebcb5ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4129686993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0016cd0 tx=0x7f4ae001fb30 comp rx=0 tx=0).stop 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4129686993 shutdown_connections 2024-09-13T23:25:38.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4129686993 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5ae330 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4129686993 >> 172.21.15.99:0/4129686993 conn(0x55ebcb5aa290 msgr2=0x55ebcb5a8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4129686993 shutdown_connections 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4129686993 wait complete. 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 Processor -- start 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- start start 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.135+0000 7f4ae9c11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ebcb5aef70 con 0x55ebcb5adf30 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae5b2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57122/0 (socket says 172.21.15.99:57122) 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 learned_addr learned my addr 172.21.15.99:0/4006260348 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebcb5b5930 con 0x55ebcb5adf30 2024-09-13T23:25:38.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4ae001fe20 tx=0x7f4ae004ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f49baffd640 1 -- 172.21.15.99:0/4006260348 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae001fa30 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f49baffd640 1 -- 172.21.15.99:0/4006260348 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae001f640 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebcb5b5bc0 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f49baffd640 1 -- 172.21.15.99:0/4006260348 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ae0013e40 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.136+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebcb5b8870 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.137+0000 7f49baffd640 1 -- 172.21.15.99:0/4006260348 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4ae00204d0 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.137+0000 7f49baffd640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49b0036b40 0x7f49b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.137+0000 7f49baffd640 1 -- 172.21.15.99:0/4006260348 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f4ae002f070 con 0x55ebcb5adf30 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.137+0000 7f4ae532c640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49b0036b40 0x7f49b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb5c0ea0 0x55ebcb5c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c3ab0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb5c0ea0 0x55ebcb5c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae532c640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49b0036b40 0x7f49b0039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ad804bfd0 tx=0x7f4ad8046000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb5c0ea0 0x55ebcb5c3360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 20 realm 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.138+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c3e80 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c4720 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c4ac0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb5c5570 0x55ebcb5c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c80e0 con 0x55ebcb5c5570 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb5c5570 0x55ebcb5c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.139+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb5c5570 0x55ebcb5c7980 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae9c11800 20 searching for the correct realm 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ebcb5ca190 0x55ebcb5cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae532c640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ebcb5ca190 0x55ebcb5cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae532c640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ebcb5ca190 0x55ebcb5cc650 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad802e070 con 0x55ebcb5ca190 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.140+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.141+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.141+0000 7f4ae5b2d640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4ae0032030 0x7f4ae0045830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.141+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.141+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4ae0032030 0x7f4ae0045830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.141+0000 7f4adcb2b640 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4ae0032030 0x7f4ae0045830 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.142+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad802e070 con 0x55ebcb5ca190 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.143+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.144+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.145+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.146+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5ca190 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.147+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x7f4ae0032030 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ccd20 con 0x55ebcb5c5570 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:38.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c8b90 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.148+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c9010 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5c94b0 con 0x55ebcb5c5570 2024-09-13T23:25:38.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 zone default found 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 4 Realm: () 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 zonegroup default 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5cd650 con 0x7f4ae0032030 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5cf400 con 0x55ebcb5ca190 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.149+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5cf8f0 con 0x55ebcb5ca190 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 20 started sync module instance, tier type = 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.150+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5ce870 con 0x55ebcb5c5570 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.151+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.151+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94471217540192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d0200 con 0x55ebcb5c5570 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.151+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d0a50 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.152+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94471217540192] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.152+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.152+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94471217544528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d0700 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.152+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d1220 con 0x55ebcb5ca190 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.153+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94471217544528] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.153+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.153+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94471217548528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d1610 con 0x55ebcb5ca190 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.153+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d2060 con 0x55ebcb5c5570 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.154+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94471217548528] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.154+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.154+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94471217552208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d2450 con 0x55ebcb5c5570 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.154+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d2eb0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.156+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.156+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94471217555856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d2eb0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.156+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d3e50 con 0x7f4ae0032030 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.156+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94471217552208] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.157+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94471217555856] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.157+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.157+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94471217559840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d3090 con 0x7f4ae0032030 2024-09-13T23:25:38.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.157+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d46f0 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.158+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.158+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94471217562176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d3090 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.158+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d5230 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.158+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94471217559840] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94471217562176] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94471217563232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d0170 con 0x7f4ae0032030 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=0 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=1 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=2 2024-09-13T23:25:38.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=3 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=4 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=5 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.159+0000 7f4ae9c11800 20 add_watcher() i=6 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94471217563232] v31'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4ae9c11800 20 add_watcher() i=7 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4ae9c11800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d8220 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.160+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94471217564928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb5d56a0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.161+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94471217564928] v31'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ad0057030 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.161+0000 7f499b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.161+0000 7f4ae9c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.161+0000 7f4ae9c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.161+0000 7f4ae9c11800 5 note: GC not initialized 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f499a7e4640 20 reqs_thread_entry: start 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 20 Filter name: none 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f490bfff640 20 reqs_thread_entry: start 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60b3e0 con 0x55ebcb5c5570 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.162+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60bd10 con 0x7f4ae0032030 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ad0057030 con 0x7f4ae0032030 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60bd50 con 0x55ebcb5c5570 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.163+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60d450 con 0x7f4ae0032030 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(65 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4ad0089040 con 0x7f4ae0032030 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:38.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 4.e 4:7028012c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60caf0 con 0x55ebcb5c5570 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 4.c 4:33dc3341:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb611fc0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 4.3b 4:dce212c8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb614830 con 0x55ebcb5ca190 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 4.12 4:4a62fc7a:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb6170a0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 4.25 4:a75b679e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb619ba0 con 0x55ebcb5ca190 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 4.17 4:eacd9cd7:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb619ba0 con 0x7f4ae0032030 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 4.28 4:16572756:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb61f010 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 4.c 4:3158085e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb6219f0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 4.22 4:440f5098:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb6244c0 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 4.d 4:b2317d3d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb6269d0 con 0x55ebcb5ca190 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 4.3f 4:fd7bfd5e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60c580 con 0x55ebcb5c5570 2024-09-13T23:25:38.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(70 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.164+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(71 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4ad0089040 con 0x7f4ae0032030 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(75 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(67 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(69 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(73 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(74 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(72 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.165+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.166+0000 7f499b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.166+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94471217564928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb60c580 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.167+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94471217564928] v31'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.167+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94471217540192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x55ebcb5c5570 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.168+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94471217540192] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.168+0000 7f4ae9c11800 20 remove_watcher() i=0 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.168+0000 7f4ae9c11800 2 removed watcher, disabling cache 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.168+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94471217544528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.169+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94471217544528] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.169+0000 7f4ae9c11800 20 remove_watcher() i=1 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.169+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94471217548528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x55ebcb5ca190 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.170+0000 7f4ae532c640 1 -- 172.21.15.99:0/4006260348 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94471217548528] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad8056040 con 0x55ebcb5ca190 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.170+0000 7f4ae9c11800 20 remove_watcher() i=2 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.170+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94471217552208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x55ebcb5c5570 2024-09-13T23:25:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.171+0000 7f4ae5b2d640 1 -- 172.21.15.99:0/4006260348 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94471217552208] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ae000a4a0 con 0x55ebcb5c5570 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.171+0000 7f4ae9c11800 20 remove_watcher() i=3 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.171+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94471217555856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.172+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94471217555856] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x55ebcb5c0ea0 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.172+0000 7f4ae9c11800 20 remove_watcher() i=4 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.172+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94471217559840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.173+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94471217559840] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.173+0000 7f4ae9c11800 20 remove_watcher() i=5 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.173+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94471217562176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.174+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94471217562176] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.174+0000 7f4ae9c11800 20 remove_watcher() i=6 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.174+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94471217563232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55ebcb608e00 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94471217563232] v31'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ad0089040 con 0x7f4ae0032030 2024-09-13T23:25:38.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 20 remove_watcher() i=7 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4ae0032030 msgr2=0x7f4ae0045830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4ae0032030 0x7f4ae0045830 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb5c0ea0 msgr2=0x55ebcb5c3360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb5c0ea0 0x55ebcb5c3360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb5c5570 msgr2=0x55ebcb5c7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb5c5570 0x55ebcb5c7980 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ebcb5ca190 msgr2=0x55ebcb5cc650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ebcb5ca190 0x55ebcb5cc650 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49b0036b40 msgr2=0x7f49b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49b0036b40 0x7f49b0039000 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4ad804bfd0 tx=0x7f4ad8046000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 msgr2=0x55ebcb5b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4ae001fe20 tx=0x7f4ae004ccc0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4adcb2b640 1 -- 172.21.15.99:0/4006260348 reap_dead start 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 shutdown_connections 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/4006260348 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5adf30 0x55ebcb5b53f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 >> 172.21.15.99:0/4006260348 conn(0x55ebcb5aa290 msgr2=0x55ebcb5a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 shutdown_connections 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.175+0000 7f4ae9c11800 1 -- 172.21.15.99:0/4006260348 wait complete. 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 msgr2=0x7f49bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 0x7f49bc039050 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ad804b890 tx=0x7f4ad804b760 comp rx=0 tx=0).stop 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 msgr2=0x55ebcb5a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55ebcb5875e0 tx=0x7f4ae00167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 shutdown_connections 2024-09-13T23:25:38.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49bc036b90 0x7f49bc039050 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/700783846 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb5a1230 0x55ebcb5a1650 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 >> 172.21.15.99:0/700783846 conn(0x55ebcb5961c0 msgr2=0x55ebcb598d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 shutdown_connections 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/700783846 wait complete. 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 msgr2=0x55ebcb58d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 0x55ebcb58d5a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 msgr2=0x55ebcb592270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 0x55ebcb592270 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 msgr2=0x7f49cc038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 0x7f49cc038fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0057000 tx=0x7f4ad0052000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 msgr2=0x55ebcb586530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8000f60 tx=0x7f4ad8000bc0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 shutdown_connections 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ebcb58fe80 0x55ebcb592270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ebcb491a60 0x55ebcb58d5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f49cc036af0 0x7f49cc038fb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 --2- 172.21.15.99:0/1932984631 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ebcb48d760 0x55ebcb586530 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 >> 172.21.15.99:0/1932984631 conn(0x55ebcb488ff0 msgr2=0x55ebcb577df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 shutdown_connections 2024-09-13T23:25:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.176+0000 7f4ae9c11800 1 -- 172.21.15.99:0/1932984631 wait complete. 2024-09-13T23:25:38.200 INFO:teuthology.orchestra.run.smithi099.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"30ca56dc-5661-43d6-a109-42ef24013139","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","marker":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T23:25:37.698057Z","creation_time":"2024-09-13T23:25:34.891317Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T23:25:38.200 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:25:37.698057Z', 'creation_time': '2024-09-13T23:25:34.891317Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:25:38.200 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T23:25:38.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T23:25:38.201 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T23:25:38.243 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:38.243 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:38.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.242+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.242+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f8892126800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55839250b5e0 0x55839259a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f8892126800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558392456b30 con 0x55839259a7c0 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f8892126800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x558392438360 con 0x55839250b5e0 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f888dde3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55839250b5e0 0x55839259a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f888d5e2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55839259a7c0 0x55839259cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42062/0 (socket says 172.21.15.99:42062) 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f888d5e2640 1 -- 172.21.15.99:0/706111638 learned_addr learned my addr 172.21.15.99:0/706111638 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f888dde3640 1 -- 172.21.15.99:0/706111638 >> v1:172.21.15.43:6789/0 conn(0x55839259a7c0 legacy=0x55839259cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.243+0000 7f888dde3640 1 -- 172.21.15.99:0/706111638 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839245ee00 con 0x55839250b5e0 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.245+0000 7f888dde3640 1 --2- 172.21.15.99:0/706111638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839259a280 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8880005fd0 tx=0x7f8880045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf2e8f2819aca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.245+0000 7f888cde1640 1 -- 172.21.15.99:0/706111638 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880058530 con 0x55839250b5e0 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.245+0000 7f888cde1640 1 -- 172.21.15.99:0/706111638 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800586d0 con 0x55839250b5e0 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.245+0000 7f888cde1640 1 -- 172.21.15.99:0/706111638 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88800589d0 con 0x55839250b5e0 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 -- 172.21.15.99:0/706111638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 msgr2=0x55839259a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 --2- 172.21.15.99:0/706111638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839259a280 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8880005fd0 tx=0x7f8880045c30 comp rx=0 tx=0).stop 2024-09-13T23:25:38.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 -- 172.21.15.99:0/706111638 shutdown_connections 2024-09-13T23:25:38.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 --2- 172.21.15.99:0/706111638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839259a280 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 -- 172.21.15.99:0/706111638 >> 172.21.15.99:0/706111638 conn(0x558392591dd0 msgr2=0x5583925941f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 -- 172.21.15.99:0/706111638 shutdown_connections 2024-09-13T23:25:38.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.246+0000 7f8892126800 1 -- 172.21.15.99:0/706111638 wait complete. 2024-09-13T23:25:38.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f8892126800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f8892126800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5583924e3320 con 0x55839250b5e0 2024-09-13T23:25:38.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f888dde3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f888dde3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57144/0 (socket says 172.21.15.99:57144) 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f888dde3640 1 -- 172.21.15.99:0/387834369 learned_addr learned my addr 172.21.15.99:0/387834369 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.260+0000 7f888dde3640 1 -- 172.21.15.99:0/387834369 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558392430bc0 con 0x55839250b5e0 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.261+0000 7f888dde3640 1 --2- 172.21.15.99:0/387834369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f888000a3f0 tx=0x7f8880051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47e99b675449f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.261+0000 7f877be07640 1 -- 172.21.15.99:0/387834369 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88800589b0 con 0x55839250b5e0 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.261+0000 7f877be07640 1 -- 172.21.15.99:0/387834369 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8880068070 con 0x55839250b5e0 2024-09-13T23:25:38.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.261+0000 7f877be07640 1 -- 172.21.15.99:0/387834369 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880058c80 con 0x55839250b5e0 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- 172.21.15.99:0/387834369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 msgr2=0x5583926868c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 --2- 172.21.15.99:0/387834369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f888000a3f0 tx=0x7f8880051000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- 172.21.15.99:0/387834369 shutdown_connections 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 --2- 172.21.15.99:0/387834369 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x5583926868c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- 172.21.15.99:0/387834369 >> 172.21.15.99:0/387834369 conn(0x558392591dd0 msgr2=0x558392682280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- 172.21.15.99:0/387834369 shutdown_connections 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- 172.21.15.99:0/387834369 wait complete. 2024-09-13T23:25:38.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f8892126800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55839259e660 con 0x55839250b5e0 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f888dde3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f888dde3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57158/0 (socket says 172.21.15.99:57158) 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f888dde3640 1 -- 172.21.15.99:0/1124601157 learned_addr learned my addr 172.21.15.99:0/1124601157 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.262+0000 7f888dde3640 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558392444fe0 con 0x55839250b5e0 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f888dde3640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8880065040 tx=0x7f8880003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f877a604640 1 -- 172.21.15.99:0/1124601157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880063650 con 0x55839250b5e0 2024-09-13T23:25:38.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f877a604640 1 -- 172.21.15.99:0/1124601157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88800637f0 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f877a604640 1 -- 172.21.15.99:0/1124601157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8880063af0 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55839268e740 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.263+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839268ec60 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f877a604640 1 -- 172.21.15.99:0/1124601157 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8880074020 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f877a604640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 0x7f8774039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f877a604640 1 -- 172.21.15.99:0/1124601157 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f88800907d0 con 0x55839250b5e0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f888d5e2640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 0x7f8774039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 0x558392695270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926957b0 con 0x55839259a7c0 2024-09-13T23:25:38.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f888e5e4640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 0x558392695270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f888d5e2640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 0x7f8774039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f88840012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.264+0000 7f888e5e4640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 0x558392695270 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f888e5e4640 1 -- 172.21.15.99:0/1124601157 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f88880083e0 con 0x55839259a7c0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558392692820 con 0x55839259a7c0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f888e5e4640 1 -- 172.21.15.99:0/1124601157 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f88880083e0 con 0x55839259a7c0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 0x558392699e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55839269a560 con 0x558392697a80 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f888dde3640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 0x558392699e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.265+0000 7f888dde3640 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 0x558392699e70 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.266+0000 7f888dde3640 1 -- 172.21.15.99:0/1124601157 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f888006c450 con 0x558392697a80 2024-09-13T23:25:38.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.266+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558392696920 con 0x55839259a7c0 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.266+0000 7f888e5e4640 1 -- 172.21.15.99:0/1124601157 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f88880083e0 con 0x55839259a7c0 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.266+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x558392696de0 con 0x558392697a80 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.266+0000 7f888dde3640 1 -- 172.21.15.99:0/1124601157 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f888006c450 con 0x558392697a80 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f8892126800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f8892126800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558392432580 con 0x5583926a8ed0 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57168/0 (socket says 172.21.15.99:57168) 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f888e5e4640 1 -- 172.21.15.99:0/2190087425 learned_addr learned my addr 172.21.15.99:0/2190087425 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f888e5e4640 1 -- 172.21.15.99:0/2190087425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583926a9830 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.267+0000 7f888e5e4640 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55839268f600 tx=0x7f888800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f87737fe640 1 -- 172.21.15.99:0/2190087425 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888801c020 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f87737fe640 1 -- 172.21.15.99:0/2190087425 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888007c30 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f87737fe640 1 -- 172.21.15.99:0/2190087425 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8888018440 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583926a9ac0 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583926ac7a0 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f87737fe640 1 -- 172.21.15.99:0/2190087425 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f888801f020 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.268+0000 7f87737fe640 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 0x7f8768039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f87737fe640 1 -- 172.21.15.99:0/2190087425 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f888804e0e0 con 0x5583926a8ed0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f888dde3640 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 0x7f8768039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f888dde3640 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 0x7f8768039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f888008ee50 tx=0x7f8880063df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f8892126800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f8892126800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558392686fb0 con 0x5583925974a0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57170/0 (socket says 172.21.15.99:57170) 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.269+0000 7f888e5e4640 1 -- 172.21.15.99:0/194899449 learned_addr learned my addr 172.21.15.99:0/194899449 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f888e5e4640 1 -- 172.21.15.99:0/194899449 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558392597e70 con 0x5583925974a0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f888e5e4640 1 --2- 172.21.15.99:0/194899449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f888804c5c0 tx=0x7f8888016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee17dfeb0a7f7fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f87717fa640 1 -- 172.21.15.99:0/194899449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8888045070 con 0x5583925974a0 2024-09-13T23:25:38.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f87717fa640 1 -- 172.21.15.99:0/194899449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888021400 con 0x5583925974a0 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f87717fa640 1 -- 172.21.15.99:0/194899449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888803f070 con 0x5583925974a0 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 -- 172.21.15.99:0/194899449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 msgr2=0x5583925978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 --2- 172.21.15.99:0/194899449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f888804c5c0 tx=0x7f8888016630 comp rx=0 tx=0).stop 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 -- 172.21.15.99:0/194899449 shutdown_connections 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 --2- 172.21.15.99:0/194899449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583925978a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 -- 172.21.15.99:0/194899449 >> 172.21.15.99:0/194899449 conn(0x5583926b1e70 msgr2=0x5583926affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 -- 172.21.15.99:0/194899449 shutdown_connections 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.270+0000 7f8892126800 1 -- 172.21.15.99:0/194899449 wait complete. 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f8892126800 1 Processor -- start 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f8892126800 1 -- start start 2024-09-13T23:25:38.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f8892126800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583926bf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f8892126800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5583925961e0 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583926bf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f888e5e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583926bf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57184/0 (socket says 172.21.15.99:57184) 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 learned_addr learned my addr 172.21.15.99:0/2484276839 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.271+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583926bf6f0 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f888e5e4640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583926bf1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f888804b4e0 tx=0x7f888804c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f875f7fe640 1 -- 172.21.15.99:0/2484276839 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8888045030 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f875f7fe640 1 -- 172.21.15.99:0/2484276839 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888803fe50 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583926bf980 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f875f7fe640 1 -- 172.21.15.99:0/2484276839 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f888804cbe0 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583926c2630 con 0x5583925974a0 2024-09-13T23:25:38.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.272+0000 7f875f7fe640 1 -- 172.21.15.99:0/2484276839 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8888016040 con 0x5583925974a0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f875f7fe640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8758036b90 0x7f8758039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f875f7fe640 1 -- 172.21.15.99:0/2484276839 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f8888046070 con 0x5583925974a0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f888dde3640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8758036b90 0x7f8758039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5583926cad00 0x5583926cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926cd910 con 0x5583926cad00 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f888d5e2640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5583926cad00 0x5583926cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f888dde3640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8758036b90 0x7f8758039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8880045c50 tx=0x7f8880095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.273+0000 7f888d5e2640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5583926cad00 0x5583926cd1c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8884009050 con 0x5583926cad00 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 realm 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926ca150 con 0x5583926cad00 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8884009050 con 0x5583926cad00 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926ce3f0 con 0x5583926cad00 2024-09-13T23:25:38.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8884009050 con 0x5583926cad00 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926cecc0 con 0x5583926cad00 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8884009050 con 0x5583926cad00 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5583926cf570 0x5583926d1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d20c0 con 0x5583926cf570 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.274+0000 7f888e5e4640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5583926cf570 0x5583926d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f888e5e4640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5583926cf570 0x5583926d1960 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f8892126800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f8892126800 20 searching for the correct realm 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5583926d4170 0x5583926d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f888dde3640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5583926d4170 0x5583926d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.275+0000 7f888dde3640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5583926d4170 0x5583926d6630 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888e5e4640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f88880203b0 0x7f8888047420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888d5e2640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f88880203b0 0x7f8888047420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.276+0000 7f888d5e2640 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f88880203b0 0x7f8888047420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884009050 con 0x7f88880203b0 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884009050 con 0x5583926cad00 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.277+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.278+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.279+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.280+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.281+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.282+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926d4170 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x7f88880203b0 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cad00 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d6d00 con 0x5583926cf570 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:38.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.283+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d2ba0 con 0x5583926cad00 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d27b0 con 0x5583926cad00 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 zone default found 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 4 Realm: () 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 zonegroup default 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d7630 con 0x7f88880203b0 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.284+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d9440 con 0x5583926d4170 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926d9890 con 0x5583926d4170 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 20 started sync module instance, tier type = 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.285+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d8850 con 0x5583926cf570 2024-09-13T23:25:38.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.286+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.286+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94023585729904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d8850 con 0x5583926cf570 2024-09-13T23:25:38.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.286+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926da410 con 0x5583926cad00 2024-09-13T23:25:38.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.287+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94023585729904] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.287+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.287+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94023585734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926da3d0 con 0x5583926cad00 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.287+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926daea0 con 0x5583926d4170 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.288+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.288+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94023585737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926db770 con 0x5583926d4170 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.288+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dc230 con 0x5583926cf570 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.288+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94023585734368] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.289+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94023585737104] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.289+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.289+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94023585739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d83a0 con 0x5583926cf570 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.289+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dcb00 con 0x5583926cad00 2024-09-13T23:25:38.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.290+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.290+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94023585744464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dca70 con 0x5583926cad00 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.290+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94023585739456] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.290+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dbda0 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.291+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94023585744464] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.291+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.291+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94023585746576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dbda0 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.291+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926ddf10 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.292+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.292+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94023585749536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dde80 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.292+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dee40 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94023585746576] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94023585749536] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94023585753424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926de270 con 0x7f88880203b0 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=0 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=1 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=2 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=3 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=4 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=5 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.293+0000 7f8892126800 20 add_watcher() i=6 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.294+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94023585753424] v31'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.294+0000 7f8892126800 20 add_watcher() i=7 2024-09-13T23:25:38.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.294+0000 7f8892126800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.294+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x5583926e1e70 con 0x5583926cad00 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.295+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.295+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94023585748336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926df2f0 con 0x5583926cad00 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94023585748336] v31'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f873f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f8892126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f8892126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f8892126800 5 note: GC not initialized 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f873e7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f8892126800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f8892126800 20 Filter name: none 2024-09-13T23:25:38.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.296+0000 7f86affff640 20 reqs_thread_entry: start 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.297+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x558392714640 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.297+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(62 [pgnls start_epoch 31 out=254b] v31'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.297+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d7630 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(63 [pgnls start_epoch 31 out=131b] v31'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d7630 con 0x5583926d4170 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926db770 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(65 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.298+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926db770 con 0x5583926cad00 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(66 [pgnls start_epoch 31 out=335b] v31'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926db770 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(69 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.299+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(70 [pgnls start_epoch 31 out=213b] v31'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(71 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 [pgnls start_epoch 31 out=336b] v31'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.300+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 [pgnls start_epoch 31 out=131b] v31'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(74 [pgnls start_epoch 31 out=254b] v31'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(75 [pgnls start_epoch 31 out=90b] v31'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cad00 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(76 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.301+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(77 [pgnls start_epoch 31 out=254b] v31'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cad00 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(78 [pgnls start_epoch 31 out=254b] v31'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(79 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(80 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.302+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cad00 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(81 [pgnls start_epoch 31 out=295b] v31'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(82 [pgnls start_epoch 31 out=276b] v31'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(83 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cad00 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(84 [pgnls start_epoch 31 out=295b] v31'26 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.303+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x7f88880203b0 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(85 [pgnls start_epoch 31 out=172b] v31'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(86 [pgnls start_epoch 31 out=213b] v31'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x7f88880203b0 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(87 [pgnls start_epoch 31 out=172b] v31'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.304+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(88 [pgnls start_epoch 31 out=172b] v31'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(89 [pgnls start_epoch 31 out=90b] v31'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(90 [pgnls start_epoch 31 out=90b] v31'38 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cad00 2024-09-13T23:25:38.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(91 [pgnls start_epoch 31 out=131b] v31'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.305+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x5583926cf570 2024-09-13T23:25:38.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.306+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(92 [pgnls start_epoch 31 out=295b] v31'24 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.306+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x5583926d3510 con 0x7f88880203b0 2024-09-13T23:25:38.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.306+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(93 [pgnls start_epoch 31 out=213b] v31'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.330 INFO:teuthology.orchestra.run.smithi099.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.308+0000 7f873f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.308+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94023585748336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558392714600 con 0x5583926cad00 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.309+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94023585748336] v31'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.309+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94023585729904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558392714600 con 0x5583926cf570 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.310+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94023585729904] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.310+0000 7f8892126800 20 remove_watcher() i=0 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.310+0000 7f8892126800 2 removed watcher, disabling cache 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.310+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94023585734368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558392712ab0 con 0x5583926cad00 2024-09-13T23:25:38.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.311+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94023585734368] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.311+0000 7f8892126800 20 remove_watcher() i=1 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.311+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94023585737104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x558392712ab0 con 0x5583926d4170 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.312+0000 7f888dde3640 1 -- 172.21.15.99:0/2484276839 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94023585737104] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f88800a4040 con 0x5583926d4170 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.312+0000 7f8892126800 20 remove_watcher() i=2 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.312+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94023585739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d9ee0 con 0x5583926cf570 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.313+0000 7f888e5e4640 1 -- 172.21.15.99:0/2484276839 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94023585739456] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f888803b020 con 0x5583926cf570 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.314+0000 7f8892126800 20 remove_watcher() i=3 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.314+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94023585744464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d9ee0 con 0x5583926cad00 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.315+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94023585744464] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x5583926cad00 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.315+0000 7f8892126800 20 remove_watcher() i=4 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.315+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94023585746576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926d9ee0 con 0x7f88880203b0 2024-09-13T23:25:38.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.316+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94023585746576] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.316+0000 7f8892126800 20 remove_watcher() i=5 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.316+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94023585749536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dce90 con 0x7f88880203b0 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.317+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94023585749536] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.317+0000 7f8892126800 20 remove_watcher() i=6 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.317+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94023585753424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x5583926dce90 con 0x7f88880203b0 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94023585753424] v31'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8884029040 con 0x7f88880203b0 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 20 remove_watcher() i=7 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f88880203b0 msgr2=0x7f8888047420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f88880203b0 0x7f8888047420 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5583926cad00 msgr2=0x5583926cd1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5583926cad00 0x5583926cd1c0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5583926cf570 msgr2=0x5583926d1960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5583926cf570 0x5583926d1960 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5583926d4170 msgr2=0x5583926d6630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5583926d4170 0x5583926d6630 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8758036b90 msgr2=0x7f8758039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8758036b90 0x7f8758039050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8880045c50 tx=0x7f8880095000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 msgr2=0x5583926bf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2484276839 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583925974a0 0x5583926bf1b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f888804b4e0 tx=0x7f888804c550 comp rx=0 tx=0).stop 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 reap_dead start 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f888d5e2640 1 -- 172.21.15.99:0/2484276839 reap_dead start 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 shutdown_connections 2024-09-13T23:25:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 >> 172.21.15.99:0/2484276839 conn(0x5583926b1e70 msgr2=0x5583926aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 shutdown_connections 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2484276839 wait complete. 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 msgr2=0x7f8768039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 0x7f8768039050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f888008ee50 tx=0x7f8880063df0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 msgr2=0x5583926a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x55839268f600 tx=0x7f888800beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 shutdown_connections 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8768036b90 0x7f8768039050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 --2- 172.21.15.99:0/2190087425 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5583926a8ed0 0x5583926a92f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.318+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 >> 172.21.15.99:0/2190087425 conn(0x55839269de60 msgr2=0x5583926a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 shutdown_connections 2024-09-13T23:25:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/2190087425 wait complete. 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 msgr2=0x558392695270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 0x558392695270 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 msgr2=0x558392699e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 0x558392699e70 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 msgr2=0x7f8774039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 0x7f8774039050 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f88840012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 msgr2=0x55839268e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8880065040 tx=0x7f8880003330 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 shutdown_connections 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558392697a80 0x558392699e70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55839259a7c0 0x558392695270 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8774036b90 0x7f8774039050 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 --2- 172.21.15.99:0/1124601157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55839250b5e0 0x55839268e200 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 >> 172.21.15.99:0/1124601157 conn(0x558392591dd0 msgr2=0x558392680af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 shutdown_connections 2024-09-13T23:25:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.319+0000 7f8892126800 1 -- 172.21.15.99:0/1124601157 wait complete. 2024-09-13T23:25:38.342 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T23:25:38.342 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T23:25:38.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T23:25:38.343 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T23:25:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8334610800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557b5569f860 0x557b556a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8334610800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b5555ab30 con 0x557b5560ee90 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8334610800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x557b5553c360 con 0x557b5569f860 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8327fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557b5569f860 0x557b556a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f832fcf7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x557b5560ee90 0x557b5569e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42078/0 (socket says 172.21.15.99:42078) 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f832fcf7640 1 -- 172.21.15.99:0/1087691401 learned_addr learned my addr 172.21.15.99:0/1087691401 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:38.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8327fff640 1 -- 172.21.15.99:0/1087691401 >> v1:172.21.15.43:6789/0 conn(0x557b5560ee90 legacy=0x557b5569e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f832f4f6640 1 -- 172.21.15.99:0/1087691401 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904914814 0 0) 0x557b5555ab30 con 0x557b5560ee90 2024-09-13T23:25:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.422+0000 7f8327fff640 1 -- 172.21.15.99:0/1087691401 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b55562e00 con 0x557b5569f860 2024-09-13T23:25:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.424+0000 7f8327fff640 1 --2- 172.21.15.99:0/1087691401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5569f860 0x557b556a1c70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f831800a470 tx=0x7f8318045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737985ac10896669 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.424+0000 7f832f4f6640 1 -- 172.21.15.99:0/1087691401 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8318053570 con 0x557b5569f860 2024-09-13T23:25:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.424+0000 7f832f4f6640 1 -- 172.21.15.99:0/1087691401 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8318058070 con 0x557b5569f860 2024-09-13T23:25:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.424+0000 7f832f4f6640 1 -- 172.21.15.99:0/1087691401 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8318053880 con 0x557b5569f860 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 -- 172.21.15.99:0/1087691401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5569f860 msgr2=0x557b556a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 --2- 172.21.15.99:0/1087691401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5569f860 0x557b556a1c70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f831800a470 tx=0x7f8318045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 -- 172.21.15.99:0/1087691401 shutdown_connections 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 --2- 172.21.15.99:0/1087691401 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5569f860 0x557b556a1c70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 -- 172.21.15.99:0/1087691401 >> 172.21.15.99:0/1087691401 conn(0x557b55695df0 msgr2=0x557b55698210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 -- 172.21.15.99:0/1087691401 shutdown_connections 2024-09-13T23:25:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.425+0000 7f8334610800 1 -- 172.21.15.99:0/1087691401 wait complete. 2024-09-13T23:25:38.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.438+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f8334610800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f8334610800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b555e7330 con 0x557b5560ee90 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f832fcf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f832fcf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57202/0 (socket says 172.21.15.99:57202) 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f832fcf7640 1 -- 172.21.15.99:0/2078206160 learned_addr learned my addr 172.21.15.99:0/2078206160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f832fcf7640 1 -- 172.21.15.99:0/2078206160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b55534bc0 con 0x557b5560ee90 2024-09-13T23:25:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.439+0000 7f832fcf7640 1 --2- 172.21.15.99:0/2078206160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f832000b240 tx=0x7f832000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c7b0c71330ab7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f821de0b640 1 -- 172.21.15.99:0/2078206160 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8320008070 con 0x557b5560ee90 2024-09-13T23:25:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f821de0b640 1 -- 172.21.15.99:0/2078206160 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832000d500 con 0x557b5560ee90 2024-09-13T23:25:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f821de0b640 1 -- 172.21.15.99:0/2078206160 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f832000d860 con 0x557b5560ee90 2024-09-13T23:25:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 -- 172.21.15.99:0/2078206160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 msgr2=0x557b5569ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 --2- 172.21.15.99:0/2078206160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f832000b240 tx=0x7f832000b700 comp rx=0 tx=0).stop 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 -- 172.21.15.99:0/2078206160 shutdown_connections 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 --2- 172.21.15.99:0/2078206160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b5569ba70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 -- 172.21.15.99:0/2078206160 >> 172.21.15.99:0/2078206160 conn(0x557b55695df0 msgr2=0x557b55785ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 -- 172.21.15.99:0/2078206160 shutdown_connections 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.440+0000 7f8334610800 1 -- 172.21.15.99:0/2078206160 wait complete. 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f8334610800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f8334610800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b556a25f0 con 0x557b5560ee90 2024-09-13T23:25:38.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f832fcf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f832fcf7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57216/0 (socket says 172.21.15.99:57216) 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.441+0000 7f832fcf7640 1 -- 172.21.15.99:0/3919727865 learned_addr learned my addr 172.21.15.99:0/3919727865 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f832fcf7640 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b55548fe0 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x557b5569b170 tx=0x7f8320000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f8217fff640 1 -- 172.21.15.99:0/3919727865 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8320019870 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f8217fff640 1 -- 172.21.15.99:0/3919727865 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8320019a10 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b55794800 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f8217fff640 1 -- 172.21.15.99:0/3919727865 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8320019d30 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.442+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b55794d20 con 0x557b5560ee90 2024-09-13T23:25:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8217fff640 1 -- 172.21.15.99:0/3919727865 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8320017040 con 0x557b5560ee90 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8217fff640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8217fff640 1 -- 172.21.15.99:0/3919727865 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f8320015020 con 0x557b5560ee90 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8327fff640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 0x557b5579b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b5579b870 con 0x557b5569f860 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f83304f8640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 0x557b5579b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f8327fff640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 0x7f8218039000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8318057000 tx=0x7f8318052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.443+0000 7f83304f8640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 0x557b5579b330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f83304f8640 1 -- 172.21.15.99:0/3919727865 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b5569f860 2024-09-13T23:25:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b55798900 con 0x557b5569f860 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f83304f8640 1 -- 172.21.15.99:0/3919727865 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f832800a4a0 con 0x557b5569f860 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 0x557b5579ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557a0610 con 0x557b5579db80 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 0x557b5579ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.444+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 0x557b5579ff70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.445+0000 7f832fcf7640 1 -- 172.21.15.99:0/3919727865 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f832002d070 con 0x557b5579db80 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.445+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b5579ca20 con 0x557b5569f860 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.445+0000 7f83304f8640 1 -- 172.21.15.99:0/3919727865 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f832800a4a0 con 0x557b5569f860 2024-09-13T23:25:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.445+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b5579cf00 con 0x557b5579db80 2024-09-13T23:25:38.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.445+0000 7f832fcf7640 1 -- 172.21.15.99:0/3919727865 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f832002d070 con 0x557b5579db80 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f8334610800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f8334610800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b55536580 con 0x557b557aefa0 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57222/0 (socket says 172.21.15.99:57222) 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f83304f8640 1 -- 172.21.15.99:0/2755030057 learned_addr learned my addr 172.21.15.99:0/2755030057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.446+0000 7f83304f8640 1 -- 172.21.15.99:0/2755030057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b557af900 con 0x557b557aefa0 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f83304f8640 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x557b55795370 tx=0x7f83280167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f82157fa640 1 -- 172.21.15.99:0/2755030057 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8328013640 con 0x557b557aefa0 2024-09-13T23:25:38.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f82157fa640 1 -- 172.21.15.99:0/2755030057 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83280137e0 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f82157fa640 1 -- 172.21.15.99:0/2755030057 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8328013ae0 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b557afb90 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.447+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b557b2870 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f82157fa640 1 -- 172.21.15.99:0/2755030057 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8328011040 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f82157fa640 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 0x7f8208039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f82157fa640 1 -- 172.21.15.99:0/2755030057 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f832800e040 con 0x557b557aefa0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f832fcf7640 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 0x7f8208039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f832fcf7640 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 0x7f8208039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557b55798820 tx=0x7f832001b540 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f8334610800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f8334610800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b5569a140 con 0x557b557bbc60 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57234/0 (socket says 172.21.15.99:57234) 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.448+0000 7f83304f8640 1 -- 172.21.15.99:0/688123639 learned_addr learned my addr 172.21.15.99:0/688123639 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f83304f8640 1 -- 172.21.15.99:0/688123639 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b557bc630 con 0x557b557bbc60 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f83304f8640 1 --2- 172.21.15.99:0/688123639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f832800afb0 tx=0x7f832801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdf95a522360625 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f820effd640 1 -- 172.21.15.99:0/688123639 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8328021570 con 0x557b557bbc60 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f820effd640 1 -- 172.21.15.99:0/688123639 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832801f340 con 0x557b557bbc60 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f820effd640 1 -- 172.21.15.99:0/688123639 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8328014cc0 con 0x557b557bbc60 2024-09-13T23:25:38.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 -- 172.21.15.99:0/688123639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 msgr2=0x557b557bc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 --2- 172.21.15.99:0/688123639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f832800afb0 tx=0x7f832801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 -- 172.21.15.99:0/688123639 shutdown_connections 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 --2- 172.21.15.99:0/688123639 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557bc060 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 -- 172.21.15.99:0/688123639 >> 172.21.15.99:0/688123639 conn(0x557b557b7fc0 msgr2=0x557b557b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 -- 172.21.15.99:0/688123639 shutdown_connections 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.449+0000 7f8334610800 1 -- 172.21.15.99:0/688123639 wait complete. 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f8334610800 1 Processor -- start 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f8334610800 1 -- start start 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f8334610800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f8334610800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557b557bcca0 con 0x557b557bbc60 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f83304f8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57246/0 (socket says 172.21.15.99:57246) 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 learned_addr learned my addr 172.21.15.99:0/3007680802 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.450+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b557c3610 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f83304f8640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f832804cd60 tx=0x7f832804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f820d7fa640 1 -- 172.21.15.99:0/3007680802 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8328040360 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f820d7fa640 1 -- 172.21.15.99:0/3007680802 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832804e2b0 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f820d7fa640 1 -- 172.21.15.99:0/3007680802 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f832804e590 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b557c38a0 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b557c6550 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.451+0000 7f820d7fa640 1 -- 172.21.15.99:0/3007680802 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f832803b020 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f820d7fa640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f81f8036b90 0x7f81f8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f820d7fa640 1 -- 172.21.15.99:0/3007680802 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7f8328039020 con 0x557b557bbc60 2024-09-13T23:25:38.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f81f8036b90 0x7f81f8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f81f8036b90 0x7f81f8039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f832004d0b0 tx=0x7f8320031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b557ceb70 0x557b557d1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.452+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d1780 con 0x557b557ceb70 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8327fff640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b557ceb70 0x557b557d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8327fff640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b557ceb70 0x557b557d1030 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 20 realm 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d1bb0 con 0x557b557ceb70 2024-09-13T23:25:38.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.453+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d2480 con 0x557b557ceb70 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d2820 con 0x557b557ceb70 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b557d3580 0x557b557d5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d5f80 con 0x557b557d3580 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f83304f8640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b557d3580 0x557b557d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f83304f8640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b557d3580 0x557b557d5970 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.454+0000 7f8334610800 20 searching for the correct realm 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557b557d7f10 0x557b557da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557b557d7f10 0x557b557da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f832fcf7640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557b557d7f10 0x557b557da3d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f83304f8640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8328044070 0x7f8328044450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.455+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8328044070 0x7f8328044450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8328044070 0x7f8328044450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.456+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.457+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.458+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.459+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.460+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.461+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d7f10 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.462+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x7f8328044070 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557ceb70 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x557b557daaa0 con 0x557b557d3580 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d7460 con 0x557b557ceb70 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.463+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d6cd0 con 0x557b557ceb70 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557daf20 con 0x557b557d3580 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 zone default found 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 4 Realm: () 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 zonegroup default 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557d68e0 con 0x7f8328044070 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557dd650 con 0x557b557d7f10 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.464+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557dd9f0 con 0x557b557d7f10 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 20 started sync module instance, tier type = 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:38.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.465+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557dcae0 con 0x557b557d3580 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.466+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.466+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93988203646672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557dc740 con 0x557b557d3580 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.466+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557de750 con 0x557b557ceb70 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.467+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.467+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93988203646672] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.467+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93988203651648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557de710 con 0x557b557ceb70 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.467+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557df240 con 0x557b557d7f10 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.468+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.468+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93988203654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557dfae0 con 0x557b557d7f10 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.468+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e05b0 con 0x557b557d3580 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.468+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93988203651648] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.469+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93988203654496] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.469+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.469+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93988203656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557ddd90 con 0x557b557d3580 2024-09-13T23:25:38.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.469+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e0e80 con 0x557b557ceb70 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.470+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.470+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93988203661776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e0df0 con 0x557b557ceb70 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.470+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e1e50 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.470+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93988203656752] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.471+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93988203661776] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.471+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.471+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93988203665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e1e10 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.471+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e26f0 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.472+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93988203665728] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.472+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.472+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93988203659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e1e10 con 0x7f8328044070 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.472+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e2d10 con 0x7f8328044070 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v31'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93988203669600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e3130 con 0x7f8328044070 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=0 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=1 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=2 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=3 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=4 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=5 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93988203659424] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.473+0000 7f8334610800 20 add_watcher() i=6 2024-09-13T23:25:38.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93988203669600] v31'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8318051070 con 0x7f8328044070 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8334610800 20 add_watcher() i=7 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8334610800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b557e3130 con 0x557b557ceb70 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.474+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93988203670656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e30a0 con 0x557b557ceb70 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.475+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93988203670656] v31'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f81e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 5 note: GC not initialized 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f81e4fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:38.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 20 Filter name: none 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f815e7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.476+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b558194f0 con 0x557b557ceb70 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8318051070 con 0x557b557ceb70 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b55818fd0 con 0x557b557d3580 2024-09-13T23:25:38.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 20 disabling bucket name=myfoo 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b55819f60 con 0x557b557d3580 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.477+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b5581b840 con 0x7f8328044070 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(65 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.478+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b558243c0 con 0x7f8328044070 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8334610800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8334610800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8334610800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8334610800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:38.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93988203914528 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b5581edf0 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== watch-notify(notify (1) cookie 93988203659424 notify 133143986193 ret 0) ==== 794+0+0 (crc 0 0 0) 0x557b5581bc30 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f820effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986193 cookie 93988203659424 notifier 4598 bl.length()=752 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f820effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f820effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f820effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(67 notify.6 [notify cookie 93988203914528 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.479+0000 7f820effd640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f81f4003ea0 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== watch-notify(notify_complete (2) cookie 93988203914528 notify 133143986193 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b55819c10 con 0x7f8328044070 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8334610800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8334610800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8334610800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:38.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8334610800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.480+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b5581f4b0 con 0x557b557ceb70 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8334610800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8334610800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8334610800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93988203887344 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x557b55820fb0 con 0x557b557ceb70 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 93988203661776 notify 133143986196 ret 0) ==== 609+0+0 (crc 0 0 0) 0x557b55819c10 con 0x557b557ceb70 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f820e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986196 cookie 93988203661776 notifier 4598 bl.length()=567 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f820e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f820e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f820e7fc640 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7f8164003430 con 0x557b557ceb70 2024-09-13T23:25:38.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.481+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(70 notify.4 [notify cookie 93988203887344 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.482+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.482+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 93988203887344 notify 133143986196 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b55562e00 con 0x557b557ceb70 2024-09-13T23:25:38.503 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:38.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.483+0000 7f81e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.483+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93988203670656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b55817240 con 0x557b557ceb70 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.484+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93988203670656] v31'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.484+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93988203646672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b55817240 con 0x557b557d3580 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.485+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93988203646672] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.485+0000 7f8334610800 20 remove_watcher() i=0 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.485+0000 7f8334610800 2 removed watcher, disabling cache 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.485+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93988203651648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b55817240 con 0x557b557ceb70 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.486+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93988203651648] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.486+0000 7f8334610800 20 remove_watcher() i=1 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.486+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93988203654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b55817240 con 0x557b557d7f10 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.487+0000 7f832fcf7640 1 -- 172.21.15.99:0/3007680802 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93988203654496] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8320044d70 con 0x557b557d7f10 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.487+0000 7f8334610800 20 remove_watcher() i=2 2024-09-13T23:25:38.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.487+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93988203656752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557dced0 con 0x557b557d3580 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.488+0000 7f83304f8640 1 -- 172.21.15.99:0/3007680802 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93988203656752] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f832800a4a0 con 0x557b557d3580 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.488+0000 7f8334610800 20 remove_watcher() i=3 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.488+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93988203661776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557df630 con 0x557b557ceb70 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.489+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93988203661776] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x557b557ceb70 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.489+0000 7f8334610800 20 remove_watcher() i=4 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.489+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93988203665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557dced0 con 0x7f8328044070 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.490+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93988203665728] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.490+0000 7f8334610800 20 remove_watcher() i=5 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.490+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93988203659424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557e09d0 con 0x7f8328044070 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.491+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93988203659424] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.491+0000 7f8334610800 20 remove_watcher() i=6 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.491+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93988203669600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x557b557df630 con 0x7f8328044070 2024-09-13T23:25:38.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93988203669600] v31'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f831807f2a0 con 0x7f8328044070 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 20 remove_watcher() i=7 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8328044070 msgr2=0x7f8328044450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8328044070 0x7f8328044450 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b557ceb70 msgr2=0x557b557d1030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b557ceb70 0x557b557d1030 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b557d3580 msgr2=0x557b557d5970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b557d3580 0x557b557d5970 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557b557d7f10 msgr2=0x557b557da3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x557b557d7f10 0x557b557da3d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f81f8036b90 msgr2=0x7f81f8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f81f8036b90 0x7f81f8039050 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f832004d0b0 tx=0x7f8320031000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 msgr2=0x557b557c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f832804cd60 tx=0x7f832804cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8327fff640 1 -- 172.21.15.99:0/3007680802 reap_dead start 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 shutdown_connections 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/3007680802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557bbc60 0x557b557c30d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 >> 172.21.15.99:0/3007680802 conn(0x557b557b7fc0 msgr2=0x557b557b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 shutdown_connections 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/3007680802 wait complete. 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 msgr2=0x7f8208039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 0x7f8208039050 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557b55798820 tx=0x7f832001b540 comp rx=0 tx=0).stop 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 msgr2=0x557b557af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x557b55795370 tx=0x7f83280167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 shutdown_connections 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8208036b90 0x7f8208039050 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 --2- 172.21.15.99:0/2755030057 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b557aefa0 0x557b557af3c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 >> 172.21.15.99:0/2755030057 conn(0x557b557a3f30 msgr2=0x557b557a6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 shutdown_connections 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.493+0000 7f8334610800 1 -- 172.21.15.99:0/2755030057 wait complete. 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 msgr2=0x557b5579b330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 0x557b5579b330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 msgr2=0x557b5579ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 0x557b5579ff70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 msgr2=0x7f8218039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 0x7f8218039000 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8318057000 tx=0x7f8318052000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 msgr2=0x557b557942c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x557b5569b170 tx=0x7f8320000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 shutdown_connections 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x557b5579db80 0x557b5579ff70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557b5569f860 0x557b5579b330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8218036b40 0x7f8218039000 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 --2- 172.21.15.99:0/3919727865 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557b5560ee90 0x557b557942c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 >> 172.21.15.99:0/3919727865 conn(0x557b55695df0 msgr2=0x557b55785bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 shutdown_connections 2024-09-13T23:25:38.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.494+0000 7f8334610800 1 -- 172.21.15.99:0/3919727865 wait complete. 2024-09-13T23:25:38.514 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:38.516 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T23:25:38.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T23:25:38.517 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T23:25:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:38.561 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.560+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.560+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.560+0000 7fc7b592c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b16543b8e0 0x55b16543dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.560+0000 7fc7b592c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1652f6b30 con 0x55b1653aae10 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7b592c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b1652d8360 con 0x55b16543b8e0 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7a8e58640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b16543b8e0 0x55b16543dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7a8e58640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b16543b8e0 0x55b16543dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57252/0 (socket says 172.21.15.99:57252) 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7a8e58640 1 -- 172.21.15.99:0/205849381 learned_addr learned my addr 172.21.15.99:0/205849381 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7b1659640 1 --1- 172.21.15.99:0/205849381 >> v1:172.21.15.43:6789/0 conn(0x55b1653aae10 0x55b16543a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42092/0 (socket says 172.21.15.99:42092) 2024-09-13T23:25:38.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7a8e58640 1 -- 172.21.15.99:0/205849381 >> v1:172.21.15.43:6789/0 conn(0x55b1653aae10 legacy=0x55b16543a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7b0e58640 1 -- 172.21.15.99:0/205849381 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096031241 0 0) 0x55b1652f6b30 con 0x55b1653aae10 2024-09-13T23:25:38.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.561+0000 7fc7a8e58640 1 -- 172.21.15.99:0/205849381 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1652fee00 con 0x55b16543b8e0 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.563+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/205849381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b16543b8e0 0x55b16543dcd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00a520 tx=0x7fc79c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77805cf9bab09117 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.563+0000 7fc7b0e58640 1 -- 172.21.15.99:0/205849381 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79c055070 con 0x55b16543b8e0 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.563+0000 7fc7b0e58640 1 -- 172.21.15.99:0/205849381 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc79c0515b0 con 0x55b16543b8e0 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.563+0000 7fc7b0e58640 1 -- 172.21.15.99:0/205849381 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc79c0518d0 con 0x55b16543b8e0 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 -- 172.21.15.99:0/205849381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b16543b8e0 msgr2=0x55b16543dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 --2- 172.21.15.99:0/205849381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b16543b8e0 0x55b16543dcd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc79c00a520 tx=0x7fc79c045ba0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 -- 172.21.15.99:0/205849381 shutdown_connections 2024-09-13T23:25:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 --2- 172.21.15.99:0/205849381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b16543b8e0 0x55b16543dcd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 -- 172.21.15.99:0/205849381 >> 172.21.15.99:0/205849381 conn(0x55b165431df0 msgr2=0x55b165434210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 -- 172.21.15.99:0/205849381 shutdown_connections 2024-09-13T23:25:38.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.564+0000 7fc7b592c800 1 -- 172.21.15.99:0/205849381 wait complete. 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.577+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b592c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b592c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b165383330 con 0x55b1653aae10 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b1659640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b1659640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57266/0 (socket says 172.21.15.99:57266) 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b1659640 1 -- 172.21.15.99:0/736463436 learned_addr learned my addr 172.21.15.99:0/736463436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b1659640 1 -- 172.21.15.99:0/736463436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1652d0bc0 con 0x55b1653aae10 2024-09-13T23:25:38.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.578+0000 7fc7b1659640 1 --2- 172.21.15.99:0/736463436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400b240 tx=0x7fc7a400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee7cb1fcbf4e843 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc69f606640 1 -- 172.21.15.99:0/736463436 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4008070 con 0x55b1653aae10 2024-09-13T23:25:38.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc69f606640 1 -- 172.21.15.99:0/736463436 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a400d500 con 0x55b1653aae10 2024-09-13T23:25:38.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc69f606640 1 -- 172.21.15.99:0/736463436 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a400d860 con 0x55b1653aae10 2024-09-13T23:25:38.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 -- 172.21.15.99:0/736463436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 msgr2=0x55b165526600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 --2- 172.21.15.99:0/736463436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400b240 tx=0x7fc7a400b700 comp rx=0 tx=0).stop 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 -- 172.21.15.99:0/736463436 shutdown_connections 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 --2- 172.21.15.99:0/736463436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b165526600 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 -- 172.21.15.99:0/736463436 >> 172.21.15.99:0/736463436 conn(0x55b165431df0 msgr2=0x55b165521fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 -- 172.21.15.99:0/736463436 shutdown_connections 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.579+0000 7fc7b592c800 1 -- 172.21.15.99:0/736463436 wait complete. 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b592c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b592c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b16543e600 con 0x55b1653aae10 2024-09-13T23:25:38.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b1659640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b1659640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57268/0 (socket says 172.21.15.99:57268) 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b1659640 1 -- 172.21.15.99:0/842574413 learned_addr learned my addr 172.21.15.99:0/842574413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b1659640 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1652e4fe0 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b1659640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55b165527460 tx=0x7fc7a4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc69de03640 1 -- 172.21.15.99:0/842574413 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4019870 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc69de03640 1 -- 172.21.15.99:0/842574413 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a4019a10 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc69de03640 1 -- 172.21.15.99:0/842574413 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7a4019d30 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.580+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b16552e5c0 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.581+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16552eae0 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.581+0000 7fc69de03640 1 -- 172.21.15.99:0/842574413 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7a4017040 con 0x55b1653aae10 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.581+0000 7fc69de03640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc69de03640 1 -- 172.21.15.99:0/842574413 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc7a4015020 con 0x55b1653aae10 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 0x55b1655350f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165535670 con 0x55b16543b8e0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 0x55b1655350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 0x7fc698039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc79c057000 tx=0x7fc79c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 0x55b1655350f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/842574413 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16543b8e0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.582+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655326c0 con 0x55b16543b8e0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/842574413 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16543b8e0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 0x55b165539d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b16553a430 con 0x55b1655379a0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b1659640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 0x55b165539d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b1659640 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 0x55b165539d90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b1659640 1 -- 172.21.15.99:0/842574413 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7a402d070 con 0x55b1655379a0 2024-09-13T23:25:38.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.583+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165536840 con 0x55b16543b8e0 2024-09-13T23:25:38.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/842574413 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16543b8e0 2024-09-13T23:25:38.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165536d20 con 0x55b1655379a0 2024-09-13T23:25:38.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b1659640 1 -- 172.21.15.99:0/842574413 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7a402d070 con 0x55b1655379a0 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b592c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.584+0000 7fc7b592c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b1652d2580 con 0x55b165437b50 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57278/0 (socket says 172.21.15.99:57278) 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3213703809 learned_addr learned my addr 172.21.15.99:0/3213703809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3213703809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b165437f70 con 0x55b165437b50 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55b16552f130 tx=0x7fc7ac0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc696ffd640 1 -- 172.21.15.99:0/3213703809 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac013640 con 0x55b165437b50 2024-09-13T23:25:38.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc696ffd640 1 -- 172.21.15.99:0/3213703809 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0137e0 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b165436740 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc696ffd640 1 -- 172.21.15.99:0/3213703809 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac013ae0 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.585+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b165436c40 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.586+0000 7fc696ffd640 1 -- 172.21.15.99:0/3213703809 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7ac011040 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.586+0000 7fc696ffd640 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 0x7fc68c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.586+0000 7fc696ffd640 1 -- 172.21.15.99:0/3213703809 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc7ac00e040 con 0x55b165437b50 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.586+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 0x7fc68c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 0x7fc68c039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55b1655325e0 tx=0x7fc7a401b520 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b592c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b592c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b165526db0 con 0x55b165557c40 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57286/0 (socket says 172.21.15.99:57286) 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/1834430255 learned_addr learned my addr 172.21.15.99:0/1834430255 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/1834430255 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b165558610 con 0x55b165557c40 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/1834430255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00a120 tx=0x7fc7ac020e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd6bcf378c5012f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc694ff9640 1 -- 172.21.15.99:0/1834430255 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac021440 con 0x55b165557c40 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.587+0000 7fc694ff9640 1 -- 172.21.15.99:0/1834430255 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac01f340 con 0x55b165557c40 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc694ff9640 1 -- 172.21.15.99:0/1834430255 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac0215e0 con 0x55b165557c40 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- 172.21.15.99:0/1834430255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 msgr2=0x55b165558040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 --2- 172.21.15.99:0/1834430255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00a120 tx=0x7fc7ac020e60 comp rx=0 tx=0).stop 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- 172.21.15.99:0/1834430255 shutdown_connections 2024-09-13T23:25:38.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 --2- 172.21.15.99:0/1834430255 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b165558040 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- 172.21.15.99:0/1834430255 >> 172.21.15.99:0/1834430255 conn(0x55b165553fe0 msgr2=0x55b1655520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- 172.21.15.99:0/1834430255 shutdown_connections 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- 172.21.15.99:0/1834430255 wait complete. 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 Processor -- start 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- start start 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b16555f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.588+0000 7fc7b592c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b165558c30 con 0x55b165557c40 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b16555f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b1e5a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b16555f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57300/0 (socket says 172.21.15.99:57300) 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 learned_addr learned my addr 172.21.15.99:0/3450525188 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16555f640 con 0x55b165557c40 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b16555f100 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac016cd0 tx=0x7fc7ac04cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc682ffd640 1 -- 172.21.15.99:0/3450525188 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac03a070 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc682ffd640 1 -- 172.21.15.99:0/3450525188 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac040360 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc682ffd640 1 -- 172.21.15.99:0/3450525188 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac04e2d0 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b16555f8d0 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.589+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16555f8d0 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.590+0000 7fc682ffd640 1 -- 172.21.15.99:0/3450525188 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc7ac04e470 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.590+0000 7fc682ffd640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc67c036b90 0x7fc67c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.590+0000 7fc682ffd640 1 -- 172.21.15.99:0/3450525188 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5706+0+0 (secure 0 0 0) 0x7fc7ac036b30 con 0x55b165557c40 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.590+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc67c036b90 0x7fc67c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc67c036b90 0x7fc67c039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400e6d0 tx=0x7fc7a4027000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16556a9f0 0x55b16556ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b16556d600 con 0x55b16556a9f0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16556a9f0 0x55b16556ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.591+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16556a9f0 0x55b16556ceb0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 realm 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b16556da30 con 0x55b16556a9f0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b16556e300 con 0x55b16556a9f0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b16556e6a0 con 0x55b16556a9f0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b16556f400 0x55b1655717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165571e00 con 0x55b16556f400 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.592+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b16556f400 0x55b1655717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b16556f400 0x55b1655717f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b592c800 20 searching for the correct realm 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b165573d90 0x55b165576250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b165573d90 0x55b165576250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.593+0000 7fc7b1659640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b165573d90 0x55b165576250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7b1e5a640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc7ac0205b0 0x7fc7ac012850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.594+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc7ac0205b0 0x7fc7ac012850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc7ac0205b0 0x7fc7ac012850 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.595+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(12 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 31 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.596+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(15 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(16 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(17 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 31 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.597+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(21 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.598+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(24 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(25 [pgnls start_epoch 31 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(26 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.599+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(29 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(30 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.600+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(32 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b165573d90 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x7fc7ac0205b0 2024-09-13T23:25:38.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(35 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.601+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556a9f0 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(36 [pgnls start_epoch 31 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 31 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e31) -- 0x55b165576920 con 0x55b16556f400 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 31 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655732e0 con 0x55b16556a9f0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165572b50 con 0x55b16556a9f0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.602+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165572290 con 0x55b16556f400 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:38.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 zone default found 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 4 Realm: () 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 zonegroup default 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165577250 con 0x7fc7ac0205b0 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165579480 con 0x55b165573d90 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.603+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165579820 con 0x55b165573d90 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.604+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.604+0000 7fc7b592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.604+0000 7fc7b592c800 20 started sync module instance, tier type = 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.604+0000 7fc7b592c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.604+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655788c0 con 0x55b16556f400 2024-09-13T23:25:38.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.605+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.605+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94220397809088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655788c0 con 0x55b16556f400 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.605+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557a220 con 0x55b16556a9f0 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.606+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94220397809088] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.606+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(46 notify.1 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.606+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94220397806608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b165578830 con 0x55b16556a9f0 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.606+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557b0e0 con 0x55b165573d90 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.607+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.607+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94220397806608] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.607+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94220397815312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557b480 con 0x55b165573d90 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.607+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557be40 con 0x55b16556f400 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.608+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94220397815312] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.608+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.608+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94220397820304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557bdb0 con 0x55b16556f400 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.608+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557cd30 con 0x55b16556a9f0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.609+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(52 notify.4 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.609+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94220397824128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557d150 con 0x55b16556a9f0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.609+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557dbd0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.609+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94220397820304] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.610+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94220397824128] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.610+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(54 notify.5 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.610+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94220397827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557cca0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.610+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557e4a0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.611+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94220397827776] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.611+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(56 notify.6 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.611+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94220397822560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557cca0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.611+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557ea40 con 0x7fc7ac0205b0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.612+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94220397822560] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(58 notify.7 [create] v31'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94220397829936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557ea00 con 0x7fc7ac0205b0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=1 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=2 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=3 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=4 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=5 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=6 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94220397829936] v31'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x7fc7ac0205b0 2024-09-13T23:25:38.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 20 add_watcher() i=7 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.613+0000 7fc7b592c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.614+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b165581e30 con 0x55b16556a9f0 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.614+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.614+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94220397831968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b16557f2f0 con 0x55b16556a9f0 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94220397831968] v31'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc6677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7b592c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7b592c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7b592c800 5 note: GC not initialized 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc6667e4640 20 reqs_thread_entry: start 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7b592c800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:38.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.615+0000 7fc7b592c800 20 Filter name: none 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc5d7fff640 20 reqs_thread_entry: start 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b5220 con 0x55b16556a9f0 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc79c057030 con 0x55b16556a9f0 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b7cb0 con 0x55b16556f400 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 20 enabling bucket name=myfoo 2024-09-13T23:25:38.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.616+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b5c90 con 0x55b16556f400 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 : miss 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 20 rados->read ofs=0 len=0 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.617+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b8570 con 0x7fc7ac0205b0 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(65 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.618+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 8.1d 8:bac19301:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655c00d0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(66 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v31'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1, ofs0, ns] 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94220398098800 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655ba1d0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== watch-notify(notify (1) cookie 94220397822560 notify 133143986194 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55b1655b8960 con 0x7fc7ac0205b0 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc694ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986194 cookie 94220397822560 notifier 4605 bl.length()=752 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc694ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 info.flags=0x17 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc694ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1 to cache LRU end 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc694ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(67 notify.6 [notify cookie 94220398098800 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc694ff9640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc674003ea0 con 0x7fc7ac0205b0 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== watch-notify(notify_complete (2) cookie 94220398098800 notify 133143986194 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1655b7a90 con 0x7fc7ac0205b0 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_sources= new_sources= 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential sources added=[] removed=[] 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): orig_dests= new_dests= 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.619+0000 7fc7b592c800 20 handle_bi_update(): bucket=:myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1]): potential dests added=[] removed=[] 2024-09-13T23:25:38.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.620+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655bb250 con 0x55b16556a9f0 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v31'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7b592c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7b592c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7b592c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94220398049312 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x55b1655bb250 con 0x55b16556a9f0 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94220397824128 notify 133143986197 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b1655b7a90 con 0x55b16556a9f0 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc683fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 133143986197 cookie 94220397824128 notifier 4605 bl.length()=567 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc683fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc683fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc683fff640 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31) -- 0x7fc5e4003430 con 0x55b16556a9f0 2024-09-13T23:25:38.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(70 notify.4 [notify cookie 94220398049312 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.621+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94220398049312 notify 133143986197 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1652fee00 con 0x55b16556a9f0 2024-09-13T23:25:38.638 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.622+0000 7fc6677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.622+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94220397831968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b16556a9f0 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.623+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94220397831968] v31'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.623+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94220397809088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b16556f400 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.624+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94220397809088] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.624+0000 7fc7b592c800 20 remove_watcher() i=0 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.624+0000 7fc7b592c800 2 removed watcher, disabling cache 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.624+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94220397806608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b16556a9f0 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.625+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94220397806608] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.625+0000 7fc7b592c800 20 remove_watcher() i=1 2024-09-13T23:25:38.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.625+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94220397815312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b165573d90 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.626+0000 7fc7b1659640 1 -- 172.21.15.99:0/3450525188 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94220397815312] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7a402d070 con 0x55b165573d90 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.626+0000 7fc7b592c800 20 remove_watcher() i=2 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.626+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94220397820304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b16556f400 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.627+0000 7fc7b1e5a640 1 -- 172.21.15.99:0/3450525188 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94220397820304] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac00a4a0 con 0x55b16556f400 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.627+0000 7fc7b592c800 20 remove_watcher() i=3 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.627+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94220397824128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x55b16556a9f0 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.629+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94220397824128] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x55b16556a9f0 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.629+0000 7fc7b592c800 20 remove_watcher() i=4 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.629+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94220397827776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x7fc7ac0205b0 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.630+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94220397827776] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.630+0000 7fc7b592c800 20 remove_watcher() i=5 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.630+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94220397822560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x7fc7ac0205b0 2024-09-13T23:25:38.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.631+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94220397822560] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.631+0000 7fc7b592c800 20 remove_watcher() i=6 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.631+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94220397829936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55b1655b2f70 con 0x7fc7ac0205b0 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94220397829936] v31'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc79c080040 con 0x7fc7ac0205b0 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 20 remove_watcher() i=7 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc7ac0205b0 msgr2=0x7fc7ac012850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc7ac0205b0 0x7fc7ac012850 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16556a9f0 msgr2=0x55b16556ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16556a9f0 0x55b16556ceb0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b16556f400 msgr2=0x55b1655717f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b16556f400 0x55b1655717f0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b165573d90 msgr2=0x55b165576250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b165573d90 0x55b165576250 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc67c036b90 msgr2=0x7fc67c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc67c036b90 0x7fc67c039050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400e6d0 tx=0x7fc7a4027000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 msgr2=0x55b16555f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3450525188 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165557c40 0x55b16555f100 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac016cd0 tx=0x7fc7ac04cdb0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 reap_dead start 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7a8e58640 1 -- 172.21.15.99:0/3450525188 reap_dead start 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 shutdown_connections 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 >> 172.21.15.99:0/3450525188 conn(0x55b165553fe0 msgr2=0x55b1655520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 shutdown_connections 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3450525188 wait complete. 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 msgr2=0x7fc68c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 0x7fc68c039050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55b1655325e0 tx=0x7fc7a401b520 comp rx=0 tx=0).stop 2024-09-13T23:25:38.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 msgr2=0x55b1654361a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x55b16552f130 tx=0x7fc7ac0167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 shutdown_connections 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc68c036b90 0x7fc68c039050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 --2- 172.21.15.99:0/3213703809 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b165437b50 0x55b1654361a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 >> 172.21.15.99:0/3213703809 conn(0x55b16553dd70 msgr2=0x55b1655408f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 shutdown_connections 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.632+0000 7fc7b592c800 1 -- 172.21.15.99:0/3213703809 wait complete. 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 msgr2=0x55b1655350f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 0x55b1655350f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 msgr2=0x55b165539d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 0x55b165539d90 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 msgr2=0x7fc698039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 0x7fc698039050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc79c057000 tx=0x7fc79c052000 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 msgr2=0x55b16552e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x55b165527460 tx=0x7fc7a4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 shutdown_connections 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b1655379a0 0x55b165539d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b16543b8e0 0x55b1655350f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc698036b90 0x7fc698039050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 --2- 172.21.15.99:0/842574413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b1653aae10 0x55b16552e080 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 >> 172.21.15.99:0/842574413 conn(0x55b165431df0 msgr2=0x55b165520930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 shutdown_connections 2024-09-13T23:25:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:38.633+0000 7fc7b592c800 1 -- 172.21.15.99:0/842574413 wait complete. 2024-09-13T23:25:38.649 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:38.664 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:25:38.902 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T23:25:38.909 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:53.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:25:53.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:25:53.911 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:25:53.962 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:53.963 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:53.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:53.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f070020e800 1 -- start start 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f070020e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560694afcd20 0x560694aff110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f070020e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606949b5b30 con 0x560694a69dd0 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f070020e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x560694997360 con 0x560694afcd20 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f06f3fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560694afcd20 0x560694aff110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f06fb90c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x560694a69dd0 0x560694afb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:33146/0 (socket says 172.21.15.99:33146) 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.962+0000 7f06fb90c640 1 -- 172.21.15.99:0/2584149326 learned_addr learned my addr 172.21.15.99:0/2584149326 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.963+0000 7f06f3fff640 1 -- 172.21.15.99:0/2584149326 >> v1:172.21.15.43:6789/0 conn(0x560694a69dd0 legacy=0x560694afb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.963+0000 7f06f3fff640 1 -- 172.21.15.99:0/2584149326 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606949bde00 con 0x560694afcd20 2024-09-13T23:25:53.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f06f3fff640 1 --2- 172.21.15.99:0/2584149326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694aff110 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a470 tx=0x7f06e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2851e619937060 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f06fb10b640 1 -- 172.21.15.99:0/2584149326 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e4053570 con 0x560694afcd20 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f06fb10b640 1 -- 172.21.15.99:0/2584149326 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e4058070 con 0x560694afcd20 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f06fb10b640 1 -- 172.21.15.99:0/2584149326 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06e4053880 con 0x560694afcd20 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 -- 172.21.15.99:0/2584149326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 msgr2=0x560694aff110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 --2- 172.21.15.99:0/2584149326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694aff110 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f06e400a470 tx=0x7f06e4045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 -- 172.21.15.99:0/2584149326 shutdown_connections 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 --2- 172.21.15.99:0/2584149326 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694aff110 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 -- 172.21.15.99:0/2584149326 >> 172.21.15.99:0/2584149326 conn(0x560694af0df0 msgr2=0x560694af3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 -- 172.21.15.99:0/2584149326 shutdown_connections 2024-09-13T23:25:53.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.965+0000 7f070020e800 1 -- 172.21.15.99:0/2584149326 wait complete. 2024-09-13T23:25:53.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.981+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:53.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.981+0000 7f070020e800 1 -- start start 2024-09-13T23:25:53.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.981+0000 7f070020e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.981+0000 7f070020e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560694a42330 con 0x560694a69dd0 2024-09-13T23:25:53.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f06fb90c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f06fb90c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34828/0 (socket says 172.21.15.99:34828) 2024-09-13T23:25:53.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f06fb90c640 1 -- 172.21.15.99:0/303781202 learned_addr learned my addr 172.21.15.99:0/303781202 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:53.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f06fb90c640 1 -- 172.21.15.99:0/303781202 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56069498fbc0 con 0x560694a69dd0 2024-09-13T23:25:53.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f06fb90c640 1 --2- 172.21.15.99:0/303781202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001e10 tx=0x7f06ec00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5162669ee28d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f05e9e0b640 1 -- 172.21.15.99:0/303781202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec012020 con 0x560694a69dd0 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f05e9e0b640 1 -- 172.21.15.99:0/303781202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec00e5a0 con 0x560694a69dd0 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.982+0000 7f05e9e0b640 1 -- 172.21.15.99:0/303781202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec00e8e0 con 0x560694a69dd0 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- 172.21.15.99:0/303781202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 msgr2=0x560694be7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 --2- 172.21.15.99:0/303781202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001e10 tx=0x7f06ec00b780 comp rx=0 tx=0).stop 2024-09-13T23:25:53.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- 172.21.15.99:0/303781202 shutdown_connections 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 --2- 172.21.15.99:0/303781202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694a69dd0 0x560694be7a50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- 172.21.15.99:0/303781202 >> 172.21.15.99:0/303781202 conn(0x560694af0df0 msgr2=0x560694be3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- 172.21.15.99:0/303781202 shutdown_connections 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- 172.21.15.99:0/303781202 wait complete. 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.983+0000 7f070020e800 1 -- start start 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f070020e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f070020e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560694aff8f0 con 0x560694afcd20 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f06fb90c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f06fb90c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34832/0 (socket says 172.21.15.99:34832) 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f06fb90c640 1 -- 172.21.15.99:0/503629799 learned_addr learned my addr 172.21.15.99:0/503629799 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f06fb90c640 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606949a3fe0 con 0x560694afcd20 2024-09-13T23:25:53.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.984+0000 7f06fb90c640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00b7c0 tx=0x7f06ec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.985+0000 7f05e3fff640 1 -- 172.21.15.99:0/503629799 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec012030 con 0x560694afcd20 2024-09-13T23:25:53.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.985+0000 7f05e3fff640 1 -- 172.21.15.99:0/503629799 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec001470 con 0x560694afcd20 2024-09-13T23:25:53.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.985+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560694befb90 con 0x560694afcd20 2024-09-13T23:25:53.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.985+0000 7f05e3fff640 1 -- 172.21.15.99:0/503629799 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06ec01a700 con 0x560694afcd20 2024-09-13T23:25:53.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.985+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560694bf00b0 con 0x560694afcd20 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f05e3fff640 1 -- 172.21.15.99:0/503629799 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06ec015020 con 0x560694afcd20 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f05e3fff640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 0x7f05e4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f05e3fff640 1 -- 172.21.15.99:0/503629799 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f06ec020030 con 0x560694afcd20 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f06f3fff640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 0x7f05e4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 0x560694bf6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694bf6fe0 con 0x560694bf46b0 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f06fc10d640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 0x560694bf6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f06f3fff640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 0x7f05e4039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06e4057000 tx=0x7f06e4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.986+0000 7f06fc10d640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 0x560694bf6aa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f06fc10d640 1 -- 172.21.15.99:0/503629799 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06f400a4a0 con 0x560694bf46b0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694bf3c90 con 0x560694bf46b0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f06fc10d640 1 -- 172.21.15.99:0/503629799 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06f400a4a0 con 0x560694bf46b0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 0x560694bfb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694bfbe10 con 0x560694bf9330 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.987+0000 7f06fb90c640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 0x560694bfb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.988+0000 7f06fb90c640 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 0x560694bfb720 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.988+0000 7f06fb90c640 1 -- 172.21.15.99:0/503629799 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694bf9330 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.988+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694bf81d0 con 0x560694bf46b0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.988+0000 7f06fc10d640 1 -- 172.21.15.99:0/503629799 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06f400a4a0 con 0x560694bf46b0 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.988+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694bf8640 con 0x560694bf9330 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f06fb90c640 1 -- 172.21.15.99:0/503629799 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694bf9330 2024-09-13T23:25:53.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f070020e800 1 -- start start 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f070020e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f070020e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560694991580 con 0x560694c0a7d0 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34838/0 (socket says 172.21.15.99:34838) 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.989+0000 7f06fc10d640 1 -- 172.21.15.99:0/14566155 learned_addr learned my addr 172.21.15.99:0/14566155 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:53.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f06fc10d640 1 -- 172.21.15.99:0/14566155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560694c0b130 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f06fc10d640 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x560694bf0a50 tx=0x7f06f40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f05e17fa640 1 -- 172.21.15.99:0/14566155 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4021440 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f05e17fa640 1 -- 172.21.15.99:0/14566155 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f40215e0 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560694c0b3c0 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f05e17fa640 1 -- 172.21.15.99:0/14566155 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f40218c0 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.990+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560694c0e0a0 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.991+0000 7f05e17fa640 1 -- 172.21.15.99:0/14566155 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06f4011040 con 0x560694c0a7d0 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.991+0000 7f05e17fa640 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 0x7f05d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.991+0000 7f05e17fa640 1 -- 172.21.15.99:0/14566155 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f06f400e040 con 0x560694c0a7d0 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.991+0000 7f06fb90c640 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 0x7f05d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f070020e800 1 -- start start 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f06fb90c640 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 0x7f05d4039050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x560694bf78e0 tx=0x7f06ec0184f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f070020e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f070020e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560694be8200 con 0x560694c17460 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34850/0 (socket says 172.21.15.99:34850) 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f06fc10d640 1 -- 172.21.15.99:0/1472882966 learned_addr learned my addr 172.21.15.99:0/1472882966 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.992+0000 7f06fc10d640 1 -- 172.21.15.99:0/1472882966 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560694c17e30 con 0x560694c17460 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f06fc10d640 1 --2- 172.21.15.99:0/1472882966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f06f404cb90 tx=0x7f06f4013ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1489bb986ad3317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f05daffd640 1 -- 172.21.15.99:0/1472882966 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f403f070 con 0x560694c17460 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f05daffd640 1 -- 172.21.15.99:0/1472882966 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f4029c20 con 0x560694c17460 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f05daffd640 1 -- 172.21.15.99:0/1472882966 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4029560 con 0x560694c17460 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 -- 172.21.15.99:0/1472882966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 msgr2=0x560694c17860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 --2- 172.21.15.99:0/1472882966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f06f404cb90 tx=0x7f06f4013ee0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 -- 172.21.15.99:0/1472882966 shutdown_connections 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 --2- 172.21.15.99:0/1472882966 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c17860 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 -- 172.21.15.99:0/1472882966 >> 172.21.15.99:0/1472882966 conn(0x560694c137c0 msgr2=0x560694c118c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 -- 172.21.15.99:0/1472882966 shutdown_connections 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.993+0000 7f070020e800 1 -- 172.21.15.99:0/1472882966 wait complete. 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f070020e800 1 Processor -- start 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f070020e800 1 -- start start 2024-09-13T23:25:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f070020e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f070020e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560694c184a0 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f06fc10d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34860/0 (socket says 172.21.15.99:34860) 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 learned_addr learned my addr 172.21.15.99:0/2699681114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560694c1ede0 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.994+0000 7f06fc10d640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06f4013fd0 tx=0x7f06f404cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f05d97fa640 1 -- 172.21.15.99:0/2699681114 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f4029dd0 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f05d97fa640 1 -- 172.21.15.99:0/2699681114 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f404e2e0 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560694c1f070 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f05d97fa640 1 -- 172.21.15.99:0/2699681114 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06f401f980 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560694c21d20 con 0x560694c17460 2024-09-13T23:25:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.995+0000 7f05d97fa640 1 -- 172.21.15.99:0/2699681114 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06f401fb20 con 0x560694c17460 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f05d97fa640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05c4036b40 0x7f05c4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f05d97fa640 1 -- 172.21.15.99:0/2699681114 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f06f404bb30 con 0x560694c17460 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f06fb90c640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05c4036b40 0x7f05c4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694c2a3c0 0x560694c2c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c2cfd0 con 0x560694c2a3c0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f06f3fff640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694c2a3c0 0x560694c2c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.996+0000 7f06fb90c640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05c4036b40 0x7f05c4039000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06ec018fd0 tx=0x7f06ec032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f06f3fff640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694c2a3c0 0x560694c2c880 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 realm 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c2d400 con 0x560694c2a3c0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c2dcd0 con 0x560694c2a3c0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.997+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c2e070 con 0x560694c2a3c0 2024-09-13T23:25:54.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694c2edd0 0x560694c311c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c31700 con 0x560694c2edd0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f06fc10d640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694c2edd0 0x560694c311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f06fc10d640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694c2edd0 0x560694c311c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 20 searching for the correct realm 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560694c33770 0x560694c35c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.998+0000 7f06fb90c640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560694c33770 0x560694c35c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fb90c640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560694c33770 0x560694c35c30 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fc10d640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f06f4024120 0x7f06f404f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:53.999+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.000+0000 7f06f3fff640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f06f4024120 0x7f06f404f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.000+0000 7f06f3fff640 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f06f4024120 0x7f06f404f820 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.000+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.000+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.001+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.002+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.003+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.004+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.005+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.006+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c33770 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.007+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2a3c0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560694c36300 con 0x560694c2edd0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.008+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c32170 con 0x560694c2a3c0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c31d80 con 0x560694c2a3c0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c32ae0 con 0x560694c2edd0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 zone default found 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 4 Realm: () 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:54.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 zonegroup default 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.009+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c36c30 con 0x7f06f4024120 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c38a10 con 0x560694c33770 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c38ea0 con 0x560694c33770 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 started sync module instance, tier type = 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.010+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c37e50 con 0x560694c2edd0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.011+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.011+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586265633344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c37ab0 con 0x560694c2edd0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.011+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39dd0 con 0x560694c2a3c0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.012+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586265633344] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.013+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.013+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586265637632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39dd0 con 0x560694c2a3c0 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.013+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3a880 con 0x560694c33770 2024-09-13T23:25:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.014+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586265637632] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.014+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.014+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586265639200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39d40 con 0x560694c33770 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.014+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3b740 con 0x560694c2edd0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.015+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586265639200] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.015+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.015+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586265645712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3b6b0 con 0x560694c2edd0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.015+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3c600 con 0x560694c2a3c0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.017+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586265645712] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.017+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.017+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586265647920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3c600 con 0x560694c2a3c0 2024-09-13T23:25:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.017+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3cfc0 con 0x7f06f4024120 2024-09-13T23:25:54.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.018+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.018+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586265647920] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.018+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586265651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3cf30 con 0x7f06f4024120 2024-09-13T23:25:54.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.018+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3c190 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.019+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586265651984] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.019+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.019+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586265649552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3da30 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.019+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e3f0 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586265649552] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586265657152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e810 con 0x7f06f4024120 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=0 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=1 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=2 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=3 2024-09-13T23:25:54.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=4 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=5 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.020+0000 7f070020e800 20 add_watcher() i=6 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586265657152] v33'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f070020e800 20 add_watcher() i=7 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f070020e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e810 con 0x560694c2a3c0 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.022+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586265658208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e780 con 0x560694c2a3c0 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.023+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586265658208] v33'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.023+0000 7f05b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.023+0000 7f070020e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.023+0000 7f070020e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:54.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.023+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c49f70 con 0x560694c2a3c0 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.025+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.025+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4a530 con 0x7f06f4024120 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.027+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.027+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4aaa0 con 0x560694c33770 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.028+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.028+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4b4c0 con 0x560694c2a3c0 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.029+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'153 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.029+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4b4c0 con 0x560694c2edd0 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.030+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'44 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.030+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4b4c0 con 0x560694c33770 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.031+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.031+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c45ef0 con 0x560694c2a3c0 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.032+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.032+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c45ef0 con 0x7f06f4024120 2024-09-13T23:25:54.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.033+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.033+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c45f70 con 0x560694c2edd0 2024-09-13T23:25:54.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.034+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.034+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.035+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.035+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c2edd0 2024-09-13T23:25:54.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.036+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'45 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.036+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x7f06f4024120 2024-09-13T23:25:54.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.038+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.038+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c2edd0 2024-09-13T23:25:54.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.039+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.039+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x7f06f4024120 2024-09-13T23:25:54.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.040+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.040+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c2a3c0 2024-09-13T23:25:54.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.041+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'154 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.041+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c33770 2024-09-13T23:25:54.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.042+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.042+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c2edd0 2024-09-13T23:25:54.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.043+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'46 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.043+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c33770 2024-09-13T23:25:54.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.044+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.044+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c4be50 con 0x560694c2a3c0 2024-09-13T23:25:54.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.046+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'27 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.046+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c2a3c0 2024-09-13T23:25:54.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.047+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'155 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.047+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.048+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.048+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c2edd0 2024-09-13T23:25:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.049+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.049+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.050+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.050+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.051+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.051+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.052+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.052+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.053+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.053+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x7f06f4024120 2024-09-13T23:25:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.054+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.054+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.055+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.055+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x7f06f4024120 2024-09-13T23:25:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.056+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.056+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c33770 2024-09-13T23:25:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.057+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.058+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x7f06f4024120 2024-09-13T23:25:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.059+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'37 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.059+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c460a0 con 0x560694c2edd0 2024-09-13T23:25:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.060+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.060+0000 7f05b0fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:54.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.060+0000 7f070020e800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.060+0000 7f070020e800 20 Filter name: none 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f052a7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.061+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.062+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.062+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.062+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.062+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.063+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv13 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv13 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.064+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.065+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.066+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.067+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.068+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.069+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.070+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.071+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.071+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.071+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.071+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.072+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.073+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.073+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.074+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.075+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.076+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.077+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.078+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2a3c0 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.079+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.080+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c2edd0 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.081+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.082+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.083+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.084+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.085+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.086+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.087+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.088+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.088+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.088+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.088+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c45870 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(186 gc.30 [call out=1701b] v0'0 uv35 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c77e70 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c76e60 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.089+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560694c77e70 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.090+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.090+0000 7f05b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.090+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586265658208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c45860 con 0x560694c2a3c0 2024-09-13T23:25:54.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.091+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94586265658208] v33'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.091+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586265633344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e360 con 0x560694c2edd0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.092+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94586265633344] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.092+0000 7f070020e800 20 remove_watcher() i=0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.092+0000 7f070020e800 2 removed watcher, disabling cache 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.092+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586265637632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e360 con 0x560694c2a3c0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.093+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94586265637632] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.093+0000 7f070020e800 20 remove_watcher() i=1 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.093+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586265639200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39300 con 0x560694c33770 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.095+0000 7f06fb90c640 1 -- 172.21.15.99:0/2699681114 <== osd.3 v2:172.21.15.99:6816/1212313328 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94586265639200] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06ec0187b0 con 0x560694c33770 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.095+0000 7f070020e800 20 remove_watcher() i=2 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.095+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586265645712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e360 con 0x560694c2edd0 2024-09-13T23:25:54.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.096+0000 7f06fc10d640 1 -- 172.21.15.99:0/2699681114 <== osd.2 v2:172.21.15.99:6800/2157953423 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94586265645712] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06f403a020 con 0x560694c2edd0 2024-09-13T23:25:54.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.096+0000 7f070020e800 20 remove_watcher() i=3 2024-09-13T23:25:54.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.096+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586265647920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39920 con 0x560694c2a3c0 2024-09-13T23:25:54.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.097+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.1 v2:172.21.15.99:6801/642925376 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94586265647920] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x560694c2a3c0 2024-09-13T23:25:54.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.097+0000 7f070020e800 20 remove_watcher() i=4 2024-09-13T23:25:54.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.097+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586265651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c39300 con 0x7f06f4024120 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.098+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94586265651984] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.098+0000 7f070020e800 20 remove_watcher() i=5 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.098+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586265649552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3b290 con 0x7f06f4024120 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.099+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94586265649552] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.099+0000 7f070020e800 20 remove_watcher() i=6 2024-09-13T23:25:54.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.099+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586265657152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560694c3e360 con 0x7f06f4024120 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94586265657152] v33'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f06e4051070 con 0x7f06f4024120 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 20 remove_watcher() i=7 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f06f4024120 msgr2=0x7f06f404f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f06f4024120 0x7f06f404f820 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694c2a3c0 msgr2=0x560694c2c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694c2a3c0 0x560694c2c880 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694c2edd0 msgr2=0x560694c311c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694c2edd0 0x560694c311c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560694c33770 msgr2=0x560694c35c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560694c33770 0x560694c35c30 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05c4036b40 msgr2=0x7f05c4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05c4036b40 0x7f05c4039000 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f06ec018fd0 tx=0x7f06ec032000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 msgr2=0x560694c1e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f06f4013fd0 tx=0x7f06f404cb20 comp rx=0 tx=0).stop 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.100+0000 7f06f3fff640 1 -- 172.21.15.99:0/2699681114 reap_dead start 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 shutdown_connections 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/2699681114 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c17460 0x560694c1e8a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 >> 172.21.15.99:0/2699681114 conn(0x560694c137c0 msgr2=0x560694c11890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 shutdown_connections 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/2699681114 wait complete. 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 msgr2=0x7f05d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 0x7f05d4039050 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x560694bf78e0 tx=0x7f06ec0184f0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 msgr2=0x560694c0abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x560694bf0a50 tx=0x7f06f40167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 shutdown_connections 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05d4036b90 0x7f05d4039050 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/14566155 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694c0a7d0 0x560694c0abf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 >> 172.21.15.99:0/14566155 conn(0x560694bff760 msgr2=0x560694c022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 shutdown_connections 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/14566155 wait complete. 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 msgr2=0x560694bf6aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 0x560694bf6aa0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 msgr2=0x560694bfb720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 0x560694bfb720 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 msgr2=0x7f05e4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 0x7f05e4039000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f06e4057000 tx=0x7f06e4052000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 msgr2=0x560694bef650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00b7c0 tx=0x7f06ec000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 shutdown_connections 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560694bf9330 0x560694bfb720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560694bf46b0 0x560694bf6aa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f05e4036b40 0x7f05e4039000 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 --2- 172.21.15.99:0/503629799 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560694afcd20 0x560694bef650 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.101+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 >> 172.21.15.99:0/503629799 conn(0x560694af0df0 msgr2=0x560694be1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.102+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 shutdown_connections 2024-09-13T23:25:54.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.102+0000 7f070020e800 1 -- 172.21.15.99:0/503629799 wait complete. 2024-09-13T23:25:54.111 INFO:teuthology.orchestra.run.smithi099.stdout:[{"tag":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5447866091059939642\u0000","time":"2024-09-13T23:25:53.908154+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_7","key":"","instance":""}]}] 2024-09-13T23:25:54.111 DEBUG:tasks.util.rgw: json result: [{'tag': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5447866091059939642\x00', 'time': '2024-09-13T23:25:53.908154+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_7', 'key': '', 'instance': ''}]}] 2024-09-13T23:25:54.112 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T23:25:54.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T23:25:54.112 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T23:25:54.154 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:54.154 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.153+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.153+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.153+0000 7f5dcd687800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x564da98ad600 0x564da993e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.153+0000 7f5dcd687800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564da97f8b30 con 0x564da993eba0 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.153+0000 7f5dcd687800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x564da97da360 con 0x564da98ad600 2024-09-13T23:25:54.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.154+0000 7f5dcb17b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x564da98ad600 0x564da993e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.154+0000 7f5dc3fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x564da993eba0 0x564da9940f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:33154/0 (socket says 172.21.15.99:33154) 2024-09-13T23:25:54.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.154+0000 7f5dc3fff640 1 -- 172.21.15.99:0/1822476380 learned_addr learned my addr 172.21.15.99:0/1822476380 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:54.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.154+0000 7f5dcb17b640 1 -- 172.21.15.99:0/1822476380 >> v1:172.21.15.43:6789/0 conn(0x564da993eba0 legacy=0x564da9940f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.154+0000 7f5dcb17b640 1 -- 172.21.15.99:0/1822476380 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da9800e00 con 0x564da98ad600 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/1822476380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da993e660 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a470 tx=0x7f5dbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4ff2a358468eed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dca97a640 1 -- 172.21.15.99:0/1822476380 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc053570 con 0x564da98ad600 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dca97a640 1 -- 172.21.15.99:0/1822476380 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc058070 con 0x564da98ad600 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dca97a640 1 -- 172.21.15.99:0/1822476380 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc053880 con 0x564da98ad600 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 -- 172.21.15.99:0/1822476380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 msgr2=0x564da993e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 --2- 172.21.15.99:0/1822476380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da993e660 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00a470 tx=0x7f5dbc045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 -- 172.21.15.99:0/1822476380 shutdown_connections 2024-09-13T23:25:54.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 --2- 172.21.15.99:0/1822476380 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da993e660 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 -- 172.21.15.99:0/1822476380 >> 172.21.15.99:0/1822476380 conn(0x564da9933dd0 msgr2=0x564da99361f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 -- 172.21.15.99:0/1822476380 shutdown_connections 2024-09-13T23:25:54.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.156+0000 7f5dcd687800 1 -- 172.21.15.99:0/1822476380 wait complete. 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.170+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.170+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.170+0000 7f5dcd687800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.170+0000 7f5dcd687800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564da9885320 con 0x564da98ad600 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5dcb17b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5dcb17b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34886/0 (socket says 172.21.15.99:34886) 2024-09-13T23:25:54.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3204389350 learned_addr learned my addr 172.21.15.99:0/3204389350 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3204389350 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da97d2bc0 con 0x564da98ad600 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/3204389350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc025c20 tx=0x7f5dbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e255d6c759c397f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5cb960a640 1 -- 172.21.15.99:0/3204389350 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc05c580 con 0x564da98ad600 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5cb960a640 1 -- 172.21.15.99:0/3204389350 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc063030 con 0x564da98ad600 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.171+0000 7f5cb960a640 1 -- 172.21.15.99:0/3204389350 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc05c850 con 0x564da98ad600 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 -- 172.21.15.99:0/3204389350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 msgr2=0x564da9a2aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3204389350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc025c20 tx=0x7f5dbc051000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 -- 172.21.15.99:0/3204389350 shutdown_connections 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3204389350 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a2aa70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 -- 172.21.15.99:0/3204389350 >> 172.21.15.99:0/3204389350 conn(0x564da9933dd0 msgr2=0x564da9a26430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 -- 172.21.15.99:0/3204389350 shutdown_connections 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 -- 172.21.15.99:0/3204389350 wait complete. 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.172+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcd687800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcd687800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564da9942980 con 0x564da98ad600 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcb17b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcb17b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34892/0 (socket says 172.21.15.99:34892) 2024-09-13T23:25:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcb17b640 1 -- 172.21.15.99:0/2052663315 learned_addr learned my addr 172.21.15.99:0/2052663315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcb17b640 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da97e6fe0 con 0x564da98ad600 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.173+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x564da9a2b8d0 tx=0x7f5dbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5cb7e07640 1 -- 172.21.15.99:0/2052663315 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc054ad0 con 0x564da98ad600 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5cb7e07640 1 -- 172.21.15.99:0/2052663315 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc054c70 con 0x564da98ad600 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da9a32920 con 0x564da98ad600 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5cb7e07640 1 -- 172.21.15.99:0/2052663315 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dbc068420 con 0x564da98ad600 2024-09-13T23:25:54.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da9a32e40 con 0x564da98ad600 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.174+0000 7f5cb7e07640 1 -- 172.21.15.99:0/2052663315 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5dbc0685c0 con 0x564da98ad600 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5cb7e07640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 0x7f5cb0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5cb7e07640 1 -- 172.21.15.99:0/2052663315 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5dbc070030 con 0x564da98ad600 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 0x7f5cb0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 0x564da9a39450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a399d0 con 0x564da993eba0 2024-09-13T23:25:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 0x564da9a39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 0x7f5cb0039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5db4000f60 tx=0x7f5db40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 0x564da9a39450 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.175+0000 7f5dcb97c640 1 -- 172.21.15.99:0/2052663315 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da993eba0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a36a00 con 0x564da993eba0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcb97c640 1 -- 172.21.15.99:0/2052663315 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da993eba0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 0x564da9a3e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a3e810 con 0x564da9a3bd30 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 0x564da9a3e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 0x564da9a3e120 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcb17b640 1 -- 172.21.15.99:0/2052663315 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a3bd30 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.176+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a3abd0 con 0x564da993eba0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.177+0000 7f5dcb97c640 1 -- 172.21.15.99:0/2052663315 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da993eba0 2024-09-13T23:25:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.177+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a3b070 con 0x564da9a3bd30 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.177+0000 7f5dcb17b640 1 -- 172.21.15.99:0/2052663315 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a3bd30 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.177+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.177+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcd687800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcd687800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564da97d4580 con 0x564da9a4d180 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34906/0 (socket says 172.21.15.99:34906) 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcb97c640 1 -- 172.21.15.99:0/476062808 learned_addr learned my addr 172.21.15.99:0/476062808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcb97c640 1 -- 172.21.15.99:0/476062808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da9a4dae0 con 0x564da9a4d180 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x564da9a33030 tx=0x7f5dc40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.178+0000 7f5cb5602640 1 -- 172.21.15.99:0/476062808 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc4013640 con 0x564da9a4d180 2024-09-13T23:25:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5cb5602640 1 -- 172.21.15.99:0/476062808 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc40137e0 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da9a4dd70 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5cb5602640 1 -- 172.21.15.99:0/476062808 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc4013ae0 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da9a50a50 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5cb5602640 1 -- 172.21.15.99:0/476062808 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5dc4011040 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.179+0000 7f5cb5602640 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 0x7f5ca4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5cb5602640 1 -- 172.21.15.99:0/476062808 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5dc400e040 con 0x564da9a4d180 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 0x7f5ca4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 0x7f5ca4039050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564da9a3aba0 tx=0x7f5dbc045e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcd687800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcd687800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564da9a2b1c0 con 0x564da9a59e00 2024-09-13T23:25:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34916/0 (socket says 172.21.15.99:34916) 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.180+0000 7f5dcb97c640 1 -- 172.21.15.99:0/272442340 learned_addr learned my addr 172.21.15.99:0/272442340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcb97c640 1 -- 172.21.15.99:0/272442340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da9a5a7d0 con 0x564da9a59e00 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/272442340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b010 tx=0x7f5dc4020460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919200ba4a960646 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5caeffd640 1 -- 172.21.15.99:0/272442340 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc402a910 con 0x564da9a59e00 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5caeffd640 1 -- 172.21.15.99:0/272442340 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc402a3f0 con 0x564da9a59e00 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5caeffd640 1 -- 172.21.15.99:0/272442340 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc402aab0 con 0x564da9a59e00 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 -- 172.21.15.99:0/272442340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 msgr2=0x564da9a5a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 --2- 172.21.15.99:0/272442340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b010 tx=0x7f5dc4020460 comp rx=0 tx=0).stop 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 -- 172.21.15.99:0/272442340 shutdown_connections 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 --2- 172.21.15.99:0/272442340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a5a200 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 -- 172.21.15.99:0/272442340 >> 172.21.15.99:0/272442340 conn(0x564da9a56160 msgr2=0x564da9a54260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 -- 172.21.15.99:0/272442340 shutdown_connections 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.181+0000 7f5dcd687800 1 -- 172.21.15.99:0/272442340 wait complete. 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcd687800 1 Processor -- start 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcd687800 1 -- start start 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcd687800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a61290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcd687800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564da9a5ae80 con 0x564da9a59e00 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a61290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcb97c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a61290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34928/0 (socket says 172.21.15.99:34928) 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 learned_addr learned my addr 172.21.15.99:0/3305440262 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564da9a617d0 con 0x564da9a59e00 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.182+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a61290 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b010 tx=0x7f5dc404cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5cad7fa640 1 -- 172.21.15.99:0/3305440262 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc402e070 con 0x564da9a59e00 2024-09-13T23:25:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5cad7fa640 1 -- 172.21.15.99:0/3305440262 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc4040140 con 0x564da9a59e00 2024-09-13T23:25:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564da9a61a60 con 0x564da9a59e00 2024-09-13T23:25:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5cad7fa640 1 -- 172.21.15.99:0/3305440262 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5dc4040420 con 0x564da9a59e00 2024-09-13T23:25:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564da9a64710 con 0x564da9a59e00 2024-09-13T23:25:54.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.183+0000 7f5cad7fa640 1 -- 172.21.15.99:0/3305440262 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5dc4039060 con 0x564da9a59e00 2024-09-13T23:25:54.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5cad7fa640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5c94036b40 0x7f5c94039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5cad7fa640 1 -- 172.21.15.99:0/3305440262 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5dc4033bb0 con 0x564da9a59e00 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5c94036b40 0x7f5c94039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5c94036b40 0x7f5c94039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc000c00 tx=0x7f5dbc082000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da9a6cd70 0x564da9a6f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a6f980 con 0x564da9a6cd70 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.184+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da9a6cd70 0x564da9a6f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da9a6cd70 0x564da9a6f230 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5db4009050 con 0x564da9a6cd70 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 realm 2024-09-13T23:25:54.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a6c1c0 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5db4009050 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a70470 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5db4009050 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.185+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a70d40 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5db4009050 con 0x564da9a6cd70 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a71680 0x564da9a73a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a74200 con 0x564da9a71680 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a71680 0x564da9a73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a71680 0x564da9a73a70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 20 searching for the correct realm 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564da9a761b0 0x564da9a78670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.186+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564da9a761b0 0x564da9a78670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb17b640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564da9a761b0 0x564da9a78670 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb97c640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5dc4032020 0x7f5dc4040630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.187+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.188+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5dc4032020 0x7f5dc4040630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.188+0000 7f5dc3fff640 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5dc4032020 0x7f5dc4040630 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.188+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4009050 con 0x7f5dc4032020 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.188+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4009050 con 0x564da9a6cd70 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.189+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.190+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.191+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.192+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.193+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.194+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a761b0 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.195+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a6cd70 2024-09-13T23:25:54.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x564da9a78d40 con 0x564da9a71680 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a74bc0 con 0x564da9a6cd70 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.196+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a75460 con 0x564da9a6cd70 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a791c0 con 0x564da9a71680 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 zone default found 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 4 Realm: () 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:54.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 zonegroup default 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a79a10 con 0x7f5dc4032020 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.197+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7b790 con 0x564da9a761b0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7bbc0 con 0x564da9a761b0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 20 started sync module instance, tier type = 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.198+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7ac30 con 0x564da9a71680 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.199+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.199+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94891558809632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7a890 con 0x564da9a71680 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.199+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7caf0 con 0x564da9a6cd70 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.200+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94891558809632] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.200+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.200+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94891558813728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7caf0 con 0x564da9a6cd70 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.200+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7d4f0 con 0x564da9a761b0 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.201+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.201+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94891558817792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7ddc0 con 0x564da9a761b0 2024-09-13T23:25:54.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.201+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7e8c0 con 0x564da9a71680 2024-09-13T23:25:54.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.201+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94891558813728] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.202+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94891558817792] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.202+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.202+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94891558820112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7c640 con 0x564da9a71680 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.202+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7f2d0 con 0x564da9a6cd70 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.203+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.203+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94891558825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7f6f0 con 0x564da9a6cd70 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.203+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a800f0 con 0x7f5dc4032020 2024-09-13T23:25:54.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.203+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94891558820112] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.204+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94891558825504] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.205+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.205+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94891558822832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7f240 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.205+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a809c0 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.206+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94891558822832] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.206+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.206+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94891558829056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7f240 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.206+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80fe0 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94891558829056] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94891558831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80fe0 con 0x7f5dc4032020 2024-09-13T23:25:54.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=0 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=1 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=2 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=3 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=4 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=5 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.207+0000 7f5dcd687800 20 add_watcher() i=6 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94891558831296] v33'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dcd687800 20 add_watcher() i=7 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dcd687800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9a842d0 con 0x564da9a6cd70 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.208+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94891558833312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a81570 con 0x564da9a6cd70 2024-09-13T23:25:54.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.209+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94891558833312] v33'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.209+0000 7f5c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.210+0000 7f5dcd687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.210+0000 7f5dcd687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.210+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a83c10 con 0x564da9a6cd70 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.211+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.211+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8d470 con 0x7f5dc4032020 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.212+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.212+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8d8d0 con 0x564da9a761b0 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.213+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.213+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8e2f0 con 0x564da9a6cd70 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.214+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'158 uv13 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.214+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ca90 con 0x564da9a71680 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.215+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.215+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ca90 con 0x564da9a761b0 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.216+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.216+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ca90 con 0x564da9a6cd70 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.217+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.217+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x7f5dc4032020 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.218+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.218+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x564da9a71680 2024-09-13T23:25:54.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.219+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.219+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x564da9a761b0 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.220+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.220+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x564da9a71680 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.220+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.220+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x7f5dc4032020 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.222+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.222+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8cb60 con 0x564da9a71680 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.223+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.223+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ec80 con 0x7f5dc4032020 2024-09-13T23:25:54.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.224+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.224+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ec80 con 0x564da9a6cd70 2024-09-13T23:25:54.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.227+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'159 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.227+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8ec80 con 0x564da9a761b0 2024-09-13T23:25:54.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.228+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.228+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a71680 2024-09-13T23:25:54.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.229+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'49 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.229+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.230+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.230+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a6cd70 2024-09-13T23:25:54.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.231+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'28 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.231+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a6cd70 2024-09-13T23:25:54.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.232+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'160 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.232+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.233+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.233+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a71680 2024-09-13T23:25:54.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.234+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'29 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.234+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.235+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.235+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.236+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.236+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.237+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.237+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.238+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.238+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x7f5dc4032020 2024-09-13T23:25:54.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.239+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.239+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.240+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.240+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x7f5dc4032020 2024-09-13T23:25:54.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.241+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.241+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a761b0 2024-09-13T23:25:54.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.242+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.242+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x7f5dc4032020 2024-09-13T23:25:54.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.243+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.243+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a8f0e0 con 0x564da9a71680 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.244+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.244+0000 7f5c80fe1640 20 reqs_thread_entry: start 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.244+0000 7f5dcd687800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.244+0000 7f5dcd687800 20 Filter name: none 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.245+0000 7f5bfa7fc640 20 reqs_thread_entry: start 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.245+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T23:25:54.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.245+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:94 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(94 gc.23 [call] v33'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:95 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(95 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(96 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(97 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.246+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(98 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(99 gc.23 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.247+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.248+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(100 gc.24 [call] v33'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.248+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:101 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.248+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(101 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.248+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.248+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:102 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(102 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(103 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:104 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(104 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.249+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.250+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(105 gc.24 [call] v33'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.250+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.250+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(106 gc.25 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:107 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(107 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(108 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.251+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(109 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.252+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:111 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.253+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(111 gc.25 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.253+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.253+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(112 gc.26 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:114 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(114 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.254+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:115 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(115 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:116 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(116 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.255+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:117 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.256+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(117 gc.26 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.256+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.256+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:118 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(118 gc.27 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:119 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(119 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:120 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(120 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.257+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:121 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(121 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(122 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.258+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:123 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.259+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(123 gc.27 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.259+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.259+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:124 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.260+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(124 gc.28 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.260+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:125 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.260+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(125 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.260+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.260+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:126 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x7f5dc4032020 2024-09-13T23:25:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(126 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:127 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(127 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:128 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(128 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.261+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:129 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.262+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(129 gc.28 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.262+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T23:25:54.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.262+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:130 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.263+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(130 gc.29 [call] v33'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.263+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:131 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.263+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(131 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.263+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.263+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:132 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(132 gc.29 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:133 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(133 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:134 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(134 gc.29 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.264+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:135 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x564da9a761b0 2024-09-13T23:25:54.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.265+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(135 gc.29 [call] v33'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.265+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T23:25:54.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.265+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:136 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.266+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(136 gc.30 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.266+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:137 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(137 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9fc0 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(138 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.267+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abafd0 con 0x7f5dc4032020 2024-09-13T23:25:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(140 gc.30 [call out=1701b] v0'0 uv40 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 20 garbage collection: RGWGC::process iterating over entry tag='08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5447866091059939642', time=2024-09-13T23:25:53.908154+0000, chain.objs.size()=7 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_1 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:141 3.25 3:a6192eda:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab9320 con 0x564da9a6cd70 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_2 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:142 3.3 3:c3eea343:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9abe1d0 con 0x564da9a71680 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_3 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:143 3.1a 3:5864dca5:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ac0b30 con 0x564da9a6cd70 2024-09-13T23:25:54.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_4 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:144 3.2c 3:357fb17e:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ac33a0 con 0x564da9a761b0 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_5 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:145 3.35 3:aebbe018:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ac5c10 con 0x564da9a6cd70 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_6 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:146 3.3f 3:fe0ce040:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ac8480 con 0x564da9a71680 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_7 2024-09-13T23:25:54.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.268+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:147 3.3e 3:7ced02b5:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ac5c10 con 0x7f5dc4032020 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.271+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(143 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_3 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.271+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(147 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_7 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.271+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(145 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_5 [call] v33'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.271+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(142 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_2 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.272+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(141 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_1 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.272+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(144 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_4 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.273+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(146 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.1__shadow_.kWiq-YXrrrvxhU9HjNgfUfU71HgiKc1_6 [call] v33'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.273+0000 7f5dcd687800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T23:25:54.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.273+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:148 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8cf0 con 0x7f5dc4032020 2024-09-13T23:25:54.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.274+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(148 gc.30 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.274+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:149 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8cf0 con 0x7f5dc4032020 2024-09-13T23:25:54.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.275+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(149 gc.30 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.275+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T23:25:54.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.275+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:150 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.276+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(150 gc.31 [call] v33'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.276+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:151 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.276+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(151 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.276+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.276+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:152 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(152 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:153 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(153 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:154 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(154 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.277+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:155 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.278+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(155 gc.31 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.278+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T23:25:54.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.278+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:156 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.279+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(156 gc.0 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.279+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:157 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.279+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(157 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.279+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:158 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abf650 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(158 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:159 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(159 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:160 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(160 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.280+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:161 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.281+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(161 gc.0 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.281+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T23:25:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.281+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:162 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.282+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(162 gc.1 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.282+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:163 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.282+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(163 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.282+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.282+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:164 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(164 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:165 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== osd_op_reply(165 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:166 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 47 ==== osd_op_reply(166 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.283+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:167 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.284+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 48 ==== osd_op_reply(167 gc.1 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.284+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T23:25:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.284+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(168 gc.2 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:169 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(169 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:170 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(170 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.285+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:171 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(171 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:172 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 61 ==== osd_op_reply(172 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.286+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:173 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.287+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 62 ==== osd_op_reply(173 gc.2 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.287+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T23:25:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.287+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:174 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(174 gc.3 [call] v33'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:175 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(175 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:176 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(176 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:177 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(177 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.288+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:178 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.289+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(178 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.289+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.289+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:179 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.290+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(179 gc.3 [call] v33'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.290+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T23:25:54.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.290+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:180 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(180 gc.4 [call] v33'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:181 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(181 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:182 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(182 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:183 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(183 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.291+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:184 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.292+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(184 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.292+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.292+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:185 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.293+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(185 gc.4 [call] v33'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.293+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T23:25:54.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.293+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:186 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.293+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 63 ==== osd_op_reply(186 gc.5 [call] v33'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.293+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:187 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 64 ==== osd_op_reply(187 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:188 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 65 ==== osd_op_reply(188 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:189 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 66 ==== osd_op_reply(189 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:190 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 67 ==== osd_op_reply(190 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.294+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:191 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.295+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 68 ==== osd_op_reply(191 gc.5 [call] v33'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.295+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T23:25:54.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.295+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:192 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(192 gc.6 [call] v33'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:193 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(193 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:194 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abf650 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 45 ==== osd_op_reply(194 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:195 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 46 ==== osd_op_reply(195 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.297+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:196 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.298+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 47 ==== osd_op_reply(196 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.298+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.298+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:197 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.299+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 48 ==== osd_op_reply(197 gc.6 [call] v33'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.299+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.299+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:198 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 49 ==== osd_op_reply(198 gc.7 [call] v33'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:199 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 50 ==== osd_op_reply(199 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:200 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 51 ==== osd_op_reply(200 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:201 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 52 ==== osd_op_reply(201 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.300+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:202 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.301+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 53 ==== osd_op_reply(202 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.301+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.301+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:203 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.302+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 54 ==== osd_op_reply(203 gc.7 [call] v33'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.302+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.302+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:204 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== osd_op_reply(204 gc.8 [call] v33'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:205 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== osd_op_reply(205 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:206 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(206 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:207 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== osd_op_reply(207 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.303+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:208 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(208 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:209 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(209 gc.8 [call] v33'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.304+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:210 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.305+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 69 ==== osd_op_reply(210 gc.9 [call] v33'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.305+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:211 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 70 ==== osd_op_reply(211 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:212 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 71 ==== osd_op_reply(212 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:213 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 72 ==== osd_op_reply(213 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:214 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 73 ==== osd_op_reply(214 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.306+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:215 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.307+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 74 ==== osd_op_reply(215 gc.9 [call] v33'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.307+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.307+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:216 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.308+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 40 ==== osd_op_reply(216 gc.10 [call] v33'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.308+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:217 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.308+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 41 ==== osd_op_reply(217 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.308+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.308+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:218 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 42 ==== osd_op_reply(218 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:219 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 43 ==== osd_op_reply(219 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:220 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 44 ==== osd_op_reply(220 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.309+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:221 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.310+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 45 ==== osd_op_reply(221 gc.10 [call] v33'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.310+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T23:25:54.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.310+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:222 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.311+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 55 ==== osd_op_reply(222 gc.11 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.311+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:223 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.311+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 56 ==== osd_op_reply(223 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.311+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.311+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:224 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 57 ==== osd_op_reply(224 gc.11 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:225 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 58 ==== osd_op_reply(225 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:226 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 59 ==== osd_op_reply(226 gc.11 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.312+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:227 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.313+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 60 ==== osd_op_reply(227 gc.11 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.313+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.313+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:228 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.314+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 46 ==== osd_op_reply(228 gc.12 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.314+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:229 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.314+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 47 ==== osd_op_reply(229 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.314+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.314+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:230 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 48 ==== osd_op_reply(230 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:231 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 49 ==== osd_op_reply(231 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:232 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 50 ==== osd_op_reply(232 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.315+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:233 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.316+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 51 ==== osd_op_reply(233 gc.12 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.316+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.316+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:234 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.317+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 61 ==== osd_op_reply(234 gc.13 [call] v33'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.317+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:235 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.317+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 62 ==== osd_op_reply(235 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.317+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.317+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:236 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 63 ==== osd_op_reply(236 gc.13 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:237 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 64 ==== osd_op_reply(237 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:238 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 65 ==== osd_op_reply(238 gc.13 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.318+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:239 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.320+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 66 ==== osd_op_reply(239 gc.13 [call] v33'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.320+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T23:25:54.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.320+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:240 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.321+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 49 ==== osd_op_reply(240 gc.14 [call] v33'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.321+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:241 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.321+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 50 ==== osd_op_reply(241 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.321+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.321+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:242 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 51 ==== osd_op_reply(242 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:243 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 52 ==== osd_op_reply(243 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:244 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 53 ==== osd_op_reply(244 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.322+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:245 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.323+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 54 ==== osd_op_reply(245 gc.14 [call] v33'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.323+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T23:25:54.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.323+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:246 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.324+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 75 ==== osd_op_reply(246 gc.15 [call] v33'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.324+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:247 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.324+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 76 ==== osd_op_reply(247 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.324+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.324+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:248 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abf650 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 77 ==== osd_op_reply(248 gc.15 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:249 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 78 ==== osd_op_reply(249 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:250 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 79 ==== osd_op_reply(250 gc.15 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.325+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:251 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.326+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 80 ==== osd_op_reply(251 gc.15 [call] v33'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.326+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.326+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:252 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.327+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 52 ==== osd_op_reply(252 gc.16 [call] v33'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.327+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:253 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.327+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 53 ==== osd_op_reply(253 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.327+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.327+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:254 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abf650 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 54 ==== osd_op_reply(254 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:255 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 55 ==== osd_op_reply(255 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:256 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 56 ==== osd_op_reply(256 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.328+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:257 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.329+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 57 ==== osd_op_reply(257 gc.16 [call] v33'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.329+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T23:25:54.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.329+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:258 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 81 ==== osd_op_reply(258 gc.17 [call] v33'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:259 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 82 ==== osd_op_reply(259 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:260 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 83 ==== osd_op_reply(260 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:261 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 84 ==== osd_op_reply(261 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.330+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:262 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 85 ==== osd_op_reply(262 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:263 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 86 ==== osd_op_reply(263 gc.17 [call] v33'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.331+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:264 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 55 ==== osd_op_reply(264 gc.18 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:265 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 56 ==== osd_op_reply(265 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:266 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 57 ==== osd_op_reply(266 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:267 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 58 ==== osd_op_reply(267 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.333+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:268 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 59 ==== osd_op_reply(268 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:269 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 60 ==== osd_op_reply(269 gc.18 [call] v33'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.334+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:270 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.335+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 61 ==== osd_op_reply(270 gc.19 [call] v33'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.335+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:271 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.335+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 62 ==== osd_op_reply(271 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.335+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:272 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 63 ==== osd_op_reply(272 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:273 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 64 ==== osd_op_reply(273 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:274 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 65 ==== osd_op_reply(274 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.336+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:275 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.337+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 66 ==== osd_op_reply(275 gc.19 [call] v33'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.337+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.337+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:276 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.338+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 87 ==== osd_op_reply(276 gc.20 [call] v33'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.338+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:277 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.338+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 88 ==== osd_op_reply(277 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.338+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.338+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:278 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9abf650 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 89 ==== osd_op_reply(278 gc.20 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:279 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 90 ==== osd_op_reply(279 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:280 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 91 ==== osd_op_reply(280 gc.20 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.339+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:281 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.340+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 92 ==== osd_op_reply(281 gc.20 [call] v33'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.340+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.340+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:282 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 58 ==== osd_op_reply(282 gc.21 [call] v33'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:283 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 59 ==== osd_op_reply(283 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:284 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 60 ==== osd_op_reply(284 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.341+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:285 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 61 ==== osd_op_reply(285 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:286 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 62 ==== osd_op_reply(286 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.342+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:287 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a71680 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.343+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 63 ==== osd_op_reply(287 gc.21 [call] v33'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.343+0000 7f5dcd687800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.343+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:288 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 93 ==== osd_op_reply(288 gc.22 [call] v33'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:289 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 94 ==== osd_op_reply(289 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:290 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 95 ==== osd_op_reply(290 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:291 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 96 ==== osd_op_reply(291 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.344+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:292 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.345+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 97 ==== osd_op_reply(292 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.345+0000 7f5dcd687800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.345+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:293 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab8ca0 con 0x564da9a761b0 2024-09-13T23:25:54.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.346+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 98 ==== osd_op_reply(293 gc.22 [call] v33'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.347+0000 7f5c81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.347+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94891558833312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9ab84f0 con 0x564da9a6cd70 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.348+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 67 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94891558833312] v33'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.348+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94891558809632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80ca0 con 0x564da9a71680 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.349+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94891558809632] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.349+0000 7f5dcd687800 20 remove_watcher() i=0 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.349+0000 7f5dcd687800 2 removed watcher, disabling cache 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.349+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94891558813728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80ca0 con 0x564da9a6cd70 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.350+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 68 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94891558813728] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.350+0000 7f5dcd687800 20 remove_watcher() i=1 2024-09-13T23:25:54.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.350+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94891558817792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7c020 con 0x564da9a761b0 2024-09-13T23:25:54.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.351+0000 7f5dcb17b640 1 -- 172.21.15.99:0/3305440262 <== osd.3 v2:172.21.15.99:6816/1212313328 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94891558817792] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dbc051070 con 0x564da9a761b0 2024-09-13T23:25:54.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.351+0000 7f5dcd687800 20 remove_watcher() i=2 2024-09-13T23:25:54.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.351+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94891558820112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80ca0 con 0x564da9a71680 2024-09-13T23:25:54.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.352+0000 7f5dcb97c640 1 -- 172.21.15.99:0/3305440262 <== osd.2 v2:172.21.15.99:6800/2157953423 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94891558820112] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dc400a4a0 con 0x564da9a71680 2024-09-13T23:25:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.352+0000 7f5dcd687800 20 remove_watcher() i=3 2024-09-13T23:25:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.352+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94891558825504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7d910 con 0x564da9a6cd70 2024-09-13T23:25:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.353+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.1 v2:172.21.15.99:6801/642925376 69 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94891558825504] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x564da9a6cd70 2024-09-13T23:25:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.353+0000 7f5dcd687800 20 remove_watcher() i=4 2024-09-13T23:25:54.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.353+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94891558822832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a80ca0 con 0x7f5dc4032020 2024-09-13T23:25:54.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.354+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94891558822832] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.354+0000 7f5dcd687800 20 remove_watcher() i=5 2024-09-13T23:25:54.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.354+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94891558829056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7ee20 con 0x7f5dc4032020 2024-09-13T23:25:54.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.355+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94891558829056] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.355+0000 7f5dcd687800 20 remove_watcher() i=6 2024-09-13T23:25:54.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.355+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94891558831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564da9a7e3b0 con 0x7f5dc4032020 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.356+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 <== osd.0 v2:172.21.15.43:6800/3849931173 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94891558831296] v33'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5db4029040 con 0x7f5dc4032020 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.356+0000 7f5dcd687800 20 remove_watcher() i=7 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5dc4032020 msgr2=0x7f5dc4040630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5dc4032020 0x7f5dc4040630 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da9a6cd70 msgr2=0x564da9a6f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da9a6cd70 0x564da9a6f230 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a71680 msgr2=0x564da9a73a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a71680 0x564da9a73a70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564da9a761b0 msgr2=0x564da9a78670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564da9a761b0 0x564da9a78670 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5c94036b40 msgr2=0x7f5c94039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5c94036b40 0x7f5c94039000 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc000c00 tx=0x7f5dbc082000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 msgr2=0x564da9a61290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/3305440262 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a59e00 0x564da9a61290 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400b010 tx=0x7f5dc404cd30 comp rx=0 tx=0).stop 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 reap_dead start 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dc3fff640 1 -- 172.21.15.99:0/3305440262 reap_dead start 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 shutdown_connections 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 >> 172.21.15.99:0/3305440262 conn(0x564da9a56160 msgr2=0x564da9a54230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 shutdown_connections 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/3305440262 wait complete. 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 msgr2=0x7f5ca4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 0x7f5ca4039050 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564da9a3aba0 tx=0x7f5dbc045e60 comp rx=0 tx=0).stop 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 msgr2=0x564da9a4d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x564da9a33030 tx=0x7f5dc40167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 shutdown_connections 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ca4036b90 0x7f5ca4039050 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 --2- 172.21.15.99:0/476062808 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da9a4d180 0x564da9a4d5a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 >> 172.21.15.99:0/476062808 conn(0x564da9a42110 msgr2=0x564da9a44c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 shutdown_connections 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.357+0000 7f5dcd687800 1 -- 172.21.15.99:0/476062808 wait complete. 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 msgr2=0x564da9a39450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 0x564da9a39450 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 msgr2=0x564da9a3e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 0x564da9a3e120 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 msgr2=0x7f5cb0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 0x7f5cb0039050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5db4000f60 tx=0x7f5db40012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 msgr2=0x564da9a323e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x564da9a2b8d0 tx=0x7f5dbc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 shutdown_connections 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x564da9a3bd30 0x564da9a3e120 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564da993eba0 0x564da9a39450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cb0036b90 0x7f5cb0039050 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 --2- 172.21.15.99:0/2052663315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564da98ad600 0x564da9a323e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 >> 172.21.15.99:0/2052663315 conn(0x564da9933dd0 msgr2=0x564da9a24ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 shutdown_connections 2024-09-13T23:25:54.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.358+0000 7f5dcd687800 1 -- 172.21.15.99:0/2052663315 wait complete. 2024-09-13T23:25:54.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T23:25:54.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T23:25:54.368 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T23:25:54.451 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:54.452 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:54.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87f0e11800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55805e515860 0x55805e517c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87f0e11800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55805e3d0b30 con 0x55805e484e90 2024-09-13T23:25:54.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87f0e11800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55805e3b2360 con 0x55805e515860 2024-09-13T23:25:54.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.451+0000 7f87e3fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55805e515860 0x55805e517c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87ec52c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55805e484e90 0x55805e514140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46014/0 (socket says 172.21.15.99:46014) 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87ec52c640 1 -- 172.21.15.99:0/929374387 learned_addr learned my addr 172.21.15.99:0/929374387 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87ebd2b640 1 -- 172.21.15.99:0/929374387 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880458244 0 0) 0x55805e3d0b30 con 0x55805e484e90 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87ebd2b640 1 -- 172.21.15.99:0/929374387 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d8001e10 con 0x55805e484e90 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87e3fff640 1 -- 172.21.15.99:0/929374387 >> v1:172.21.15.43:6789/0 conn(0x55805e484e90 legacy=0x55805e514140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.452+0000 7f87e3fff640 1 -- 172.21.15.99:0/929374387 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e3d8e00 con 0x55805e515860 2024-09-13T23:25:54.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87e3fff640 1 --2- 172.21.15.99:0/929374387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e515860 0x55805e517c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f87d400a470 tx=0x7f87d4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899487efc6813265 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87ebd2b640 1 -- 172.21.15.99:0/929374387 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d4059070 con 0x55805e515860 2024-09-13T23:25:54.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87ebd2b640 1 -- 172.21.15.99:0/929374387 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87d4054570 con 0x55805e515860 2024-09-13T23:25:54.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87ebd2b640 1 -- 172.21.15.99:0/929374387 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87d4054870 con 0x55805e515860 2024-09-13T23:25:54.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 -- 172.21.15.99:0/929374387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e515860 msgr2=0x55805e517c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 --2- 172.21.15.99:0/929374387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e515860 0x55805e517c70 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f87d400a470 tx=0x7f87d4045920 comp rx=0 tx=0).stop 2024-09-13T23:25:54.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 -- 172.21.15.99:0/929374387 shutdown_connections 2024-09-13T23:25:54.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 --2- 172.21.15.99:0/929374387 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e515860 0x55805e517c70 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 -- 172.21.15.99:0/929374387 >> 172.21.15.99:0/929374387 conn(0x55805e50bdf0 msgr2=0x55805e50e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 -- 172.21.15.99:0/929374387 shutdown_connections 2024-09-13T23:25:54.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.454+0000 7f87f0e11800 1 -- 172.21.15.99:0/929374387 wait complete. 2024-09-13T23:25:54.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.468+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.468+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.468+0000 7f87f0e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.468+0000 7f87f0e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55805e45d330 con 0x55805e484e90 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f87ec52c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f87ec52c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:33968/0 (socket says 172.21.15.99:33968) 2024-09-13T23:25:54.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f87ec52c640 1 -- 172.21.15.99:0/1182129597 learned_addr learned my addr 172.21.15.99:0/1182129597 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f87ec52c640 1 -- 172.21.15.99:0/1182129597 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e3aabc0 con 0x55805e484e90 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f87ec52c640 1 --2- 172.21.15.99:0/1182129597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001e30 tx=0x7f87dc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f9fbb150105818 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f86da60c640 1 -- 172.21.15.99:0/1182129597 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87dc012020 con 0x55805e484e90 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f86da60c640 1 -- 172.21.15.99:0/1182129597 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87dc00e5a0 con 0x55805e484e90 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.469+0000 7f86da60c640 1 -- 172.21.15.99:0/1182129597 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87dc00e8e0 con 0x55805e484e90 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- 172.21.15.99:0/1182129597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 msgr2=0x55805e6006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1182129597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001e30 tx=0x7f87dc00b780 comp rx=0 tx=0).stop 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- 172.21.15.99:0/1182129597 shutdown_connections 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1182129597 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6006a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- 172.21.15.99:0/1182129597 >> 172.21.15.99:0/1182129597 conn(0x55805e50bdf0 msgr2=0x55805e5fc060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- 172.21.15.99:0/1182129597 shutdown_connections 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- 172.21.15.99:0/1182129597 wait complete. 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.470+0000 7f87f0e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55805e5185f0 con 0x55805e484e90 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87ec52c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87ec52c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:33972/0 (socket says 172.21.15.99:33972) 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87ec52c640 1 -- 172.21.15.99:0/3234666887 learned_addr learned my addr 172.21.15.99:0/3234666887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87ec52c640 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e3befe0 con 0x55805e484e90 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87ec52c640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001e30 tx=0x7f87dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f86d8e09640 1 -- 172.21.15.99:0/3234666887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87dc012030 con 0x55805e484e90 2024-09-13T23:25:54.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f86d8e09640 1 -- 172.21.15.99:0/3234666887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87dc001490 con 0x55805e484e90 2024-09-13T23:25:54.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55805e6085e0 con 0x55805e484e90 2024-09-13T23:25:54.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f86d8e09640 1 -- 172.21.15.99:0/3234666887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87dc01a8f0 con 0x55805e484e90 2024-09-13T23:25:54.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.471+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805e608b00 con 0x55805e484e90 2024-09-13T23:25:54.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f86d8e09640 1 -- 172.21.15.99:0/3234666887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87dc015020 con 0x55805e484e90 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f86d8e09640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 0x7f86d4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f86d8e09640 1 -- 172.21.15.99:0/3234666887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f87dc020030 con 0x55805e484e90 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f87e3fff640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 0x7f86d4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 0x55805e60f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.472+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e60f690 con 0x55805e515860 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 0x55805e60f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87e3fff640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 0x7f86d4039050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55805e4845d0 tx=0x7f87d4050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 0x55805e60f110 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87ecd2d640 1 -- 172.21.15.99:0/3234666887 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87e400a4a0 con 0x55805e515860 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e60c630 con 0x55805e515860 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87ecd2d640 1 -- 172.21.15.99:0/3234666887 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87e400a4a0 con 0x55805e515860 2024-09-13T23:25:54.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 0x55805e613be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.473+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e614370 con 0x55805e611720 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.474+0000 7f87ec52c640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 0x55805e613be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.474+0000 7f87ec52c640 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 0x55805e613be0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.474+0000 7f87ec52c640 1 -- 172.21.15.99:0/3234666887 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e611720 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.474+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e60ff30 con 0x55805e515860 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.474+0000 7f87ecd2d640 1 -- 172.21.15.99:0/3234666887 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87e400a4a0 con 0x55805e515860 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e610350 con 0x55805e611720 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87ec52c640 1 -- 172.21.15.99:0/3234666887 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e611720 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87f0e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87f0e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55805e3ac580 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.475+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:33978/0 (socket says 172.21.15.99:33978) 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87ecd2d640 1 -- 172.21.15.99:0/1742329840 learned_addr learned my addr 172.21.15.99:0/1742329840 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87ecd2d640 1 -- 172.21.15.99:0/1742329840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e623690 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55805e609150 tx=0x7f87e40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f86d1ffb640 1 -- 172.21.15.99:0/1742329840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e4013640 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f86d1ffb640 1 -- 172.21.15.99:0/1742329840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e40137e0 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f86d1ffb640 1 -- 172.21.15.99:0/1742329840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e4013ae0 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55805e623920 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.476+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805e626600 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f86d1ffb640 1 -- 172.21.15.99:0/1742329840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87e4011040 con 0x55805e622d30 2024-09-13T23:25:54.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f86d1ffb640 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 0x7f86c4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f86d1ffb640 1 -- 172.21.15.99:0/1742329840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f87e400e040 con 0x55805e622d30 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f87ec52c640 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 0x7f86c4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f87ec52c640 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 0x7f86c4039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55805e60c600 tx=0x7f87dc041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.477+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87f0e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87f0e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55805e600e50 con 0x55805e62f9f0 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:33982/0 (socket says 172.21.15.99:33982) 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87ecd2d640 1 -- 172.21.15.99:0/1169833525 learned_addr learned my addr 172.21.15.99:0/1169833525 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87ecd2d640 1 -- 172.21.15.99:0/1169833525 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e6303c0 con 0x55805e62f9f0 2024-09-13T23:25:54.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/1169833525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f87e400afb0 tx=0x7f87e401fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984cd61757c6510f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f86c37fe640 1 -- 172.21.15.99:0/1169833525 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e4021570 con 0x55805e62f9f0 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f86c37fe640 1 -- 172.21.15.99:0/1169833525 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e401f340 con 0x55805e62f9f0 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.478+0000 7f86c37fe640 1 -- 172.21.15.99:0/1169833525 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e4014cc0 con 0x55805e62f9f0 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- 172.21.15.99:0/1169833525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 msgr2=0x55805e62fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1169833525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f87e400afb0 tx=0x7f87e401fcc0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- 172.21.15.99:0/1169833525 shutdown_connections 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1169833525 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e62fdf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- 172.21.15.99:0/1169833525 >> 172.21.15.99:0/1169833525 conn(0x55805e62bd50 msgr2=0x55805e629e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- 172.21.15.99:0/1169833525 shutdown_connections 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- 172.21.15.99:0/1169833525 wait complete. 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 Processor -- start 2024-09-13T23:25:54.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- start start 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87f0e11800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55805e630a30 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87ecd2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:33988/0 (socket says 172.21.15.99:33988) 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.479+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 learned_addr learned my addr 172.21.15.99:0/34624398 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805e6373a0 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e4048010 tx=0x7f87e404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f86c1ffb640 1 -- 172.21.15.99:0/34624398 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e4013e60 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f86c1ffb640 1 -- 172.21.15.99:0/34624398 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e4040360 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55805e637630 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f86c1ffb640 1 -- 172.21.15.99:0/34624398 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e404e2b0 con 0x55805e62f9f0 2024-09-13T23:25:54.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.480+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805e63a2e0 con 0x55805e62f9f0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f86c1ffb640 1 -- 172.21.15.99:0/34624398 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f87e404e470 con 0x55805e62f9f0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f86c1ffb640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86b4036b90 0x7f86b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f86c1ffb640 1 -- 172.21.15.99:0/34624398 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f87e4007050 con 0x55805e62f9f0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87ec52c640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86b4036b90 0x7f86b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e6426d0 0x55805e644b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e6452e0 con 0x55805e6426d0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87e3fff640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e6426d0 0x55805e644b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.481+0000 7f87ec52c640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86b4036b90 0x7f86b4039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00deb0 tx=0x7f87dc04b3c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87e3fff640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e6426d0 0x55805e644b90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 realm 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e645710 con 0x55805e6426d0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e645fb0 con 0x55805e6426d0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.482+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e646350 con 0x55805e6426d0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e6470b0 0x55805e6494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e6499e0 con 0x55805e6470b0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e6470b0 0x55805e6494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e6470b0 0x55805e6494a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 20 searching for the correct realm 2024-09-13T23:25:54.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55805e64ba40 0x55805e64df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.483+0000 7f87ec52c640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55805e64ba40 0x55805e64df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ec52c640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55805e64ba40 0x55805e64df00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ecd2d640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f87e4044070 0x7f87e404b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.484+0000 7f87e3fff640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f87e4044070 0x7f87e404b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.485+0000 7f87e3fff640 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f87e4044070 0x7f87e404b250 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.485+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.485+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.485+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.485+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.486+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.487+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.488+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.489+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.490+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e64ba40 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.491+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x7f87e4044070 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6426d0 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55805e64e5d0 con 0x55805e6470b0 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e64a4c0 con 0x55805e6426d0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.492+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e64ad60 con 0x55805e6426d0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e64a100 con 0x55805e6470b0 2024-09-13T23:25:54.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 zone default found 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 4 Realm: () 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 zonegroup default 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e64ef00 con 0x7f87e4044070 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.493+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e650a00 con 0x55805e64ba40 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e650ee0 con 0x55805e64ba40 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 20 started sync module instance, tier type = 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.494+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e64f900 con 0x55805e6470b0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.495+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.495+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009827851552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6517f0 con 0x55805e6470b0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.495+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e652040 con 0x55805e6426d0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.496+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.496+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009827858416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e652260 con 0x55805e6426d0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.496+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009827851552] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.496+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e652d80 con 0x55805e64ba40 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.497+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.497+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009827862608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e653170 con 0x55805e64ba40 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.497+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e653bc0 con 0x55805e6470b0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.497+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009827858416] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.498+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009827862608] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.498+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.498+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009827857216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e651cb0 con 0x55805e6470b0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.498+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6545d0 con 0x55805e6426d0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.499+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009827857216] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.499+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.499+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009827866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6545d0 con 0x55805e6426d0 2024-09-13T23:25:54.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.499+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e654ea0 con 0x7f87e4044070 2024-09-13T23:25:54.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.500+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.500+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009827866288] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.500+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009827870160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6549f0 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.500+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6558e0 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.501+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.501+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009827868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e655d90 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.501+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6567d0 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.501+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009827870160] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009827868960] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009827877536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6558e0 con 0x7f87e4044070 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=0 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=1 2024-09-13T23:25:54.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=2 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=3 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=4 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=5 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.502+0000 7f87f0e11800 20 add_watcher() i=6 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.503+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009827877536] v33'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d405c040 con 0x7f87e4044070 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.503+0000 7f87f0e11800 20 add_watcher() i=7 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.503+0000 7f87f0e11800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.503+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e6598d0 con 0x55805e6426d0 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.504+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87d405c040 con 0x55805e6426d0 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.504+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009827873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e656d50 con 0x55805e6426d0 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.505+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009827873392] v33'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.505+0000 7f86a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.505+0000 7f87f0e11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.505+0000 7f87f0e11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.505+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e661e20 con 0x55805e6426d0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.506+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.506+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e662410 con 0x7f87e4044070 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.507+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.507+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e662810 con 0x55805e64ba40 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.508+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.508+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663060 con 0x55805e6426d0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.509+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.509+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663060 con 0x55805e6470b0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.510+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.510+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663060 con 0x55805e64ba40 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.511+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.511+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6630f0 con 0x55805e6426d0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.512+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.512+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6631e0 con 0x7f87e4044070 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.513+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.513+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6631e0 con 0x55805e6470b0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.514+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.514+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x55805e64ba40 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.515+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.515+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x55805e6470b0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.516+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.516+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x7f87e4044070 2024-09-13T23:25:54.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.517+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.517+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x55805e6470b0 2024-09-13T23:25:54.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.518+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.518+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x7f87e4044070 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.519+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'45 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.519+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x55805e6426d0 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.520+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.520+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663720 con 0x55805e64ba40 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.521+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.521+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e6470b0 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.522+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.522+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.523+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.523+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e6426d0 2024-09-13T23:25:54.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.524+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'31 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.524+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e6426d0 2024-09-13T23:25:54.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.525+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.525+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.526+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'52 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.526+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e6470b0 2024-09-13T23:25:54.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.527+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.527+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.528+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.528+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.529+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.529+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.530+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.530+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.531+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.531+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x7f87e4044070 2024-09-13T23:25:54.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.532+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.532+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.533+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.533+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x7f87e4044070 2024-09-13T23:25:54.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.533+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.533+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e64ba40 2024-09-13T23:25:54.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.534+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'53 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.534+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x7f87e4044070 2024-09-13T23:25:54.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.535+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.535+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e663ae0 con 0x55805e6470b0 2024-09-13T23:25:54.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.536+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'29 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f86a17e2640 20 reqs_thread_entry: start 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f87f0e11800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f87f0e11800 20 Filter name: none 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f8612ffd640 20 reqs_thread_entry: start 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.537+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.538+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.538+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.538+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.538+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.539+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.540+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.541+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.542+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.543+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.544+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.545+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.546+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.547+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.548+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.549+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.550+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.551+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.552+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.553+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.554+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.555+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.556+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.557+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.558+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.559+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.560+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.561+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.562+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.562+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.562+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.562+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x7f87e4044070 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.563+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.564+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.564+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.564+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e100 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.564+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.565+0000 7f86a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.565+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009827873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e65e0a0 con 0x55805e6426d0 2024-09-13T23:25:54.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.566+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94009827873392] v33'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.566+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009827851552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e65da10 con 0x55805e6470b0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.567+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94009827851552] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.567+0000 7f87f0e11800 20 remove_watcher() i=0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.567+0000 7f87f0e11800 2 removed watcher, disabling cache 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.567+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009827858416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e64fd20 con 0x55805e6426d0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.568+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94009827858416] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.568+0000 7f87f0e11800 20 remove_watcher() i=1 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.568+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009827862608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e64fd20 con 0x55805e64ba40 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.569+0000 7f87ec52c640 1 -- 172.21.15.99:0/34624398 <== osd.3 v2:172.21.15.99:6816/1212313328 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94009827862608] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87dc01ac70 con 0x55805e64ba40 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.569+0000 7f87f0e11800 20 remove_watcher() i=2 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.569+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009827857216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e652850 con 0x55805e6470b0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.570+0000 7f87ecd2d640 1 -- 172.21.15.99:0/34624398 <== osd.2 v2:172.21.15.99:6800/2157953423 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94009827857216] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87e4055070 con 0x55805e6470b0 2024-09-13T23:25:54.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.570+0000 7f87f0e11800 20 remove_watcher() i=3 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.570+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009827866288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e64fd20 con 0x55805e6426d0 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.571+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.1 v2:172.21.15.99:6801/642925376 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94009827866288] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x55805e6426d0 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.571+0000 7f87f0e11800 20 remove_watcher() i=4 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.571+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009827870160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e652850 con 0x7f87e4044070 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.572+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94009827870160] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.572+0000 7f87f0e11800 20 remove_watcher() i=5 2024-09-13T23:25:54.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.572+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009827868960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e6536b0 con 0x7f87e4044070 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.573+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94009827868960] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.573+0000 7f87f0e11800 20 remove_watcher() i=6 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.573+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009827877536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55805e64fd20 con 0x7f87e4044070 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94009827877536] v33'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87d4082040 con 0x7f87e4044070 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 20 remove_watcher() i=7 2024-09-13T23:25:54.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f87e4044070 msgr2=0x7f87e404b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f87e4044070 0x7f87e404b250 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e6426d0 msgr2=0x55805e644b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e6426d0 0x55805e644b90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e6470b0 msgr2=0x55805e6494a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e6470b0 0x55805e6494a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55805e64ba40 msgr2=0x55805e64df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55805e64ba40 0x55805e64df00 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86b4036b90 msgr2=0x7f86b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86b4036b90 0x7f86b4039050 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00deb0 tx=0x7f87dc04b3c0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 msgr2=0x55805e636e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f87e4048010 tx=0x7f87e404cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:54.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.574+0000 7f87e3fff640 1 -- 172.21.15.99:0/34624398 reap_dead start 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 shutdown_connections 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/34624398 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e62f9f0 0x55805e636e60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 >> 172.21.15.99:0/34624398 conn(0x55805e62bd50 msgr2=0x55805e629e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 shutdown_connections 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/34624398 wait complete. 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 msgr2=0x7f86c4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 0x7f86c4039050 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55805e60c600 tx=0x7f87dc041040 comp rx=0 tx=0).stop 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 msgr2=0x55805e623150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55805e609150 tx=0x7f87e40167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 shutdown_connections 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86c4036b90 0x7f86c4039050 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/1742329840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e622d30 0x55805e623150 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 >> 172.21.15.99:0/1742329840 conn(0x55805e617cc0 msgr2=0x55805e61a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 shutdown_connections 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/1742329840 wait complete. 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 msgr2=0x55805e60f110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 0x55805e60f110 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 msgr2=0x55805e613be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 0x55805e613be0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 msgr2=0x7f86d4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 0x7f86d4039050 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55805e4845d0 tx=0x7f87d4050000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 msgr2=0x55805e6080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f87dc001e30 tx=0x7f87dc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 shutdown_connections 2024-09-13T23:25:54.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55805e611720 0x55805e613be0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.575+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55805e515860 0x55805e60f110 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.576+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f86d4036b90 0x7f86d4039050 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.576+0000 7f87f0e11800 1 --2- 172.21.15.99:0/3234666887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55805e484e90 0x55805e6080a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.576+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 >> 172.21.15.99:0/3234666887 conn(0x55805e50bdf0 msgr2=0x55805e5fa910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.576+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 shutdown_connections 2024-09-13T23:25:54.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.576+0000 7f87f0e11800 1 -- 172.21.15.99:0/3234666887 wait complete. 2024-09-13T23:25:54.585 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-09-13T23:25:54.585 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T23:25:54.585 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:54.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:54.586 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:25:54.669 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:54.669 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3b0132a800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55aae8f3e860 0x55aae8f40c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3b0132a800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aae8df9b30 con 0x55aae8eade90 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3b0132a800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55aae8ddb360 con 0x55aae8f3e860 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3afc820640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55aae8f3e860 0x55aae8f40c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3afd021640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55aae8eade90 0x55aae8f3d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46022/0 (socket says 172.21.15.99:46022) 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3afc820640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55aae8f3e860 0x55aae8f40c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34004/0 (socket says 172.21.15.99:34004) 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.669+0000 7f3afd021640 1 -- 172.21.15.99:0/1327135506 learned_addr learned my addr 172.21.15.99:0/1327135506 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:54.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.670+0000 7f3afc820640 1 -- 172.21.15.99:0/1327135506 >> v1:172.21.15.43:6789/0 conn(0x55aae8eade90 legacy=0x55aae8f3d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.670+0000 7f3afc820640 1 -- 172.21.15.99:0/1327135506 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae8e01e00 con 0x55aae8f3e860 2024-09-13T23:25:54.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.670+0000 7f3af7fff640 1 -- 172.21.15.99:0/1327135506 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410662329 0 0) 0x55aae8df9b30 con 0x55aae8eade90 2024-09-13T23:25:54.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.671+0000 7f3afc820640 1 --2- 172.21.15.99:0/1327135506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f40c70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3af000a470 tx=0x7f3af0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c54439eaf0d0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3af7fff640 1 -- 172.21.15.99:0/1327135506 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af0053570 con 0x55aae8f3e860 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3af7fff640 1 -- 172.21.15.99:0/1327135506 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af0058070 con 0x55aae8f3e860 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3af7fff640 1 -- 172.21.15.99:0/1327135506 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af0053880 con 0x55aae8f3e860 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 -- 172.21.15.99:0/1327135506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 msgr2=0x55aae8f40c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 --2- 172.21.15.99:0/1327135506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f40c70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3af000a470 tx=0x7f3af0045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 -- 172.21.15.99:0/1327135506 shutdown_connections 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 --2- 172.21.15.99:0/1327135506 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f40c70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 -- 172.21.15.99:0/1327135506 >> 172.21.15.99:0/1327135506 conn(0x55aae8f34df0 msgr2=0x55aae8f37210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 -- 172.21.15.99:0/1327135506 shutdown_connections 2024-09-13T23:25:54.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.672+0000 7f3b0132a800 1 -- 172.21.15.99:0/1327135506 wait complete. 2024-09-13T23:25:54.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.686+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.686+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.686+0000 7f3b0132a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.686+0000 7f3b0132a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aae8e86330 con 0x55aae8eade90 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.687+0000 7f3afd021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.687+0000 7f3afd021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34018/0 (socket says 172.21.15.99:34018) 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.687+0000 7f3afd021640 1 -- 172.21.15.99:0/1801134505 learned_addr learned my addr 172.21.15.99:0/1801134505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.687+0000 7f3afd021640 1 -- 172.21.15.99:0/1801134505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae8dd3bc0 con 0x55aae8eade90 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.687+0000 7f3afd021640 1 --2- 172.21.15.99:0/1801134505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800b240 tx=0x7f3ae800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b732328da5ac4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f39eb606640 1 -- 172.21.15.99:0/1801134505 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae8008070 con 0x55aae8eade90 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f39eb606640 1 -- 172.21.15.99:0/1801134505 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae800d500 con 0x55aae8eade90 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f39eb606640 1 -- 172.21.15.99:0/1801134505 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae800d860 con 0x55aae8eade90 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 -- 172.21.15.99:0/1801134505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 msgr2=0x55aae9029690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 --2- 172.21.15.99:0/1801134505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800b240 tx=0x7f3ae800b700 comp rx=0 tx=0).stop 2024-09-13T23:25:54.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 -- 172.21.15.99:0/1801134505 shutdown_connections 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 --2- 172.21.15.99:0/1801134505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8eade90 0x55aae9029690 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 -- 172.21.15.99:0/1801134505 >> 172.21.15.99:0/1801134505 conn(0x55aae8f34df0 msgr2=0x55aae9025050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 -- 172.21.15.99:0/1801134505 shutdown_connections 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.688+0000 7f3b0132a800 1 -- 172.21.15.99:0/1801134505 wait complete. 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3b0132a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3b0132a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aae8f415f0 con 0x55aae8f3e860 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3afd021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3afd021640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34034/0 (socket says 172.21.15.99:34034) 2024-09-13T23:25:54.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3afd021640 1 -- 172.21.15.99:0/2099903070 learned_addr learned my addr 172.21.15.99:0/2099903070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.689+0000 7f3afd021640 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae8de7fe0 con 0x55aae8f3e860 2024-09-13T23:25:54.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f3afd021640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55aae902a4f0 tx=0x7f3ae8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f39e9e03640 1 -- 172.21.15.99:0/2099903070 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae80197b0 con 0x55aae8f3e860 2024-09-13T23:25:54.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f39e9e03640 1 -- 172.21.15.99:0/2099903070 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae8019950 con 0x55aae8f3e860 2024-09-13T23:25:54.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f39e9e03640 1 -- 172.21.15.99:0/2099903070 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ae8019c30 con 0x55aae8f3e860 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aae8f39160 con 0x55aae8f3e860 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.690+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae8f39680 con 0x55aae8f3e860 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f39e9e03640 1 -- 172.21.15.99:0/2099903070 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3ae8017040 con 0x55aae8f3e860 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f39e9e03640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 0x7f39e4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f39e9e03640 1 -- 172.21.15.99:0/2099903070 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f3ae8015020 con 0x55aae8f3e860 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f3afc820640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 0x7f39e4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 0x55aae903aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae903afe0 con 0x55aae90386b0 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f3afd822640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 0x55aae903aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.691+0000 7f3afc820640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 0x7f39e4039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3af0057000 tx=0x7f3af0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3afd822640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 0x55aae903aaa0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3afd822640 1 -- 172.21.15.99:0/2099903070 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af800a4a0 con 0x55aae90386b0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae903b830 con 0x55aae90386b0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3afd822640 1 -- 172.21.15.99:0/2099903070 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3af800a4a0 con 0x55aae90386b0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 0x55aae903f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae903fde0 con 0x55aae903d260 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3afd021640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 0x55aae903f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.692+0000 7f3afd021640 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 0x55aae903f650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.693+0000 7f3afd021640 1 -- 172.21.15.99:0/2099903070 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae903d260 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.693+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae903c080 con 0x55aae90386b0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.693+0000 7f3afd822640 1 -- 172.21.15.99:0/2099903070 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3af800a4a0 con 0x55aae90386b0 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.693+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae903c460 con 0x55aae903d260 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.693+0000 7f3afd021640 1 -- 172.21.15.99:0/2099903070 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae903d260 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3b0132a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3b0132a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aae8f3afb0 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34042/0 (socket says 172.21.15.99:34042) 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3afd822640 1 -- 172.21.15.99:0/589438667 learned_addr learned my addr 172.21.15.99:0/589438667 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3afd822640 1 -- 172.21.15.99:0/589438667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae904f0c0 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.694+0000 7f3afd822640 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55aae8f3a090 tx=0x7f3af80163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f39e2ffd640 1 -- 172.21.15.99:0/589438667 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af8013450 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f39e2ffd640 1 -- 172.21.15.99:0/589438667 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af80135f0 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f39e2ffd640 1 -- 172.21.15.99:0/589438667 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af80138d0 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aae904f350 con 0x55aae904e760 2024-09-13T23:25:54.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae9052030 con 0x55aae904e760 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.695+0000 7f39e2ffd640 1 -- 172.21.15.99:0/589438667 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3af8011040 con 0x55aae904e760 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f39e2ffd640 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f39e2ffd640 1 -- 172.21.15.99:0/589438667 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f3af800e040 con 0x55aae904e760 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3afd021640 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3afd021640 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 0x7f39d8039050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55aae8f39a70 tx=0x7f3ae801bf10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3b0132a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3b0132a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aae8dd5580 con 0x55aae905b4b0 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34044/0 (socket says 172.21.15.99:34044) 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.696+0000 7f3afd822640 1 -- 172.21.15.99:0/294507153 learned_addr learned my addr 172.21.15.99:0/294507153 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3afd822640 1 -- 172.21.15.99:0/294507153 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae905be80 con 0x55aae905b4b0 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3afd822640 1 --2- 172.21.15.99:0/294507153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3af804cd90 tx=0x7f3af804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212553612e756256 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f39e0ff9640 1 -- 172.21.15.99:0/294507153 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af804a070 con 0x55aae905b4b0 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f39e0ff9640 1 -- 172.21.15.99:0/294507153 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af802a570 con 0x55aae905b4b0 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f39e0ff9640 1 -- 172.21.15.99:0/294507153 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af801f4c0 con 0x55aae905b4b0 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 -- 172.21.15.99:0/294507153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 msgr2=0x55aae905b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 --2- 172.21.15.99:0/294507153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3af804cd90 tx=0x7f3af804cf90 comp rx=0 tx=0).stop 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 -- 172.21.15.99:0/294507153 shutdown_connections 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 --2- 172.21.15.99:0/294507153 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae905b8b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 -- 172.21.15.99:0/294507153 >> 172.21.15.99:0/294507153 conn(0x55aae9057810 msgr2=0x55aae9055910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 -- 172.21.15.99:0/294507153 shutdown_connections 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.697+0000 7f3b0132a800 1 -- 172.21.15.99:0/294507153 wait complete. 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3b0132a800 1 Processor -- start 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3b0132a800 1 -- start start 2024-09-13T23:25:54.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3b0132a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae90627a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3b0132a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aae905c370 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae90627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3afd822640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae90627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34060/0 (socket says 172.21.15.99:34060) 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 learned_addr learned my addr 172.21.15.99:0/3645729345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.698+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aae9062ce0 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f3afd822640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae90627a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3af802ac70 tx=0x7f3af804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f39ceffd640 1 -- 172.21.15.99:0/3645729345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af801f710 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f39ceffd640 1 -- 172.21.15.99:0/3645729345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af8039070 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f39ceffd640 1 -- 172.21.15.99:0/3645729345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3af801f9e0 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aae9062f70 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.699+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aae9065c20 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f39ceffd640 1 -- 172.21.15.99:0/3645729345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3af8033070 con 0x55aae905b4b0 2024-09-13T23:25:54.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f39ceffd640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39c8036b40 0x7f39c8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f39ceffd640 1 -- 172.21.15.99:0/3645729345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f3af8015420 con 0x55aae905b4b0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3afd021640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39c8036b40 0x7f39c8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3afd021640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39c8036b40 0x7f39c8039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800bc50 tx=0x7f3ae8032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae906e260 0x55aae9070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9070e70 con 0x55aae906e260 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.700+0000 7f3afc820640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae906e260 0x55aae9070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3afc820640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae906e260 0x55aae9070720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 realm 2024-09-13T23:25:54.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae90712a0 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9071b70 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.701+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9071f10 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae9072c70 0x55aae9075060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9075670 con 0x55aae9072c70 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3afd822640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae9072c70 0x55aae9075060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3afd822640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae9072c70 0x55aae9075060 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 20 searching for the correct realm 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aae9077600 0x55aae9079ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.702+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd021640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aae9077600 0x55aae9079ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd021640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aae9077600 0x55aae9079ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd822640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3af8059040 0x7f3af804ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.703+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3af8059040 0x7f3af804ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3af8059040 0x7f3af804ea50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.704+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.705+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.706+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.707+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.708+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.709+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9077600 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.710+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x7f3af8059040 2024-09-13T23:25:54.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae906e260 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a190 con 0x55aae9072c70 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9076b50 con 0x55aae906e260 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.711+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae90763c0 con 0x55aae906e260 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae907a610 con 0x55aae9072c70 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 zone default found 2024-09-13T23:25:54.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 4 Realm: () 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 zonegroup default 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae907aa40 con 0x7f3af8059040 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae907cd10 con 0x55aae9077600 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.712+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae907d0b0 con 0x55aae9077600 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 20 started sync module instance, tier type = 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.713+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907c1a0 con 0x55aae9072c70 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.714+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.714+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94192542401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907d900 con 0x55aae9072c70 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.714+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907e150 con 0x55aae906e260 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.715+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94192542401984] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.715+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.715+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94192542405712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907e4f0 con 0x55aae906e260 2024-09-13T23:25:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.715+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907ed40 con 0x55aae9077600 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.716+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.716+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94192542410480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907f590 con 0x55aae9077600 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.716+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9080000 con 0x55aae9072c70 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.716+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94192542405712] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.717+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94192542410480] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.718+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.718+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94192542413024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907d870 con 0x55aae9072c70 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.718+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae90808e0 con 0x55aae906e260 2024-09-13T23:25:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.719+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.719+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94192542417904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9080850 con 0x55aae906e260 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.719+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081870 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.719+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94192542413024] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.719+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94192542417904] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.720+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.720+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94192542415568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081870 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.720+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9080de0 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.721+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.721+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94192542423664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9082340 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.721+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9082c10 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.721+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94192542415568] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94192542423664] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94192542421840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9082340 con 0x7f3af8059040 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=0 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=1 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=2 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=3 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=4 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=5 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.722+0000 7f3b0132a800 20 add_watcher() i=6 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94192542421840] v33'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3b0132a800 20 add_watcher() i=7 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3b0132a800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae9085d10 con 0x55aae906e260 2024-09-13T23:25:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.723+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94192542424720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9083190 con 0x55aae906e260 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.724+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94192542424720] v33'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.724+0000 7f39b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.724+0000 7f3b0132a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.724+0000 7f3b0132a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.724+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908e4f0 con 0x55aae906e260 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.725+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.725+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908ebc0 con 0x7f3af8059040 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.726+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.726+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908efe0 con 0x55aae9077600 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.727+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.727+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908f440 con 0x55aae906e260 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.728+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.728+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908f820 con 0x55aae9072c70 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.729+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.729+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908f820 con 0x55aae9077600 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.730+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.730+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908fc10 con 0x55aae906e260 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.731+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.731+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908fc10 con 0x7f3af8059040 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.732+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.732+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090030 con 0x55aae9072c70 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.733+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.733+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090030 con 0x55aae9077600 2024-09-13T23:25:54.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.734+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.734+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090030 con 0x55aae9072c70 2024-09-13T23:25:54.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.735+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.735+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090120 con 0x7f3af8059040 2024-09-13T23:25:54.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.736+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.736+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090200 con 0x55aae9072c70 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.737+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.737+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x7f3af8059040 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.738+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'47 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.738+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae906e260 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.739+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.739+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.741+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'54 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.741+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9072c70 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.741+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.741+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.742+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.742+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae906e260 2024-09-13T23:25:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.744+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'32 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.744+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae906e260 2024-09-13T23:25:54.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.745+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.745+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.746+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'55 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.746+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9072c70 2024-09-13T23:25:54.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.747+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.747+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.748+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.748+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.748+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.748+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.749+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.749+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.750+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.750+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x7f3af8059040 2024-09-13T23:25:54.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.752+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.752+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.752+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.752+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x7f3af8059040 2024-09-13T23:25:54.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.754+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.754+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9077600 2024-09-13T23:25:54.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.755+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.755+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x7f3af8059040 2024-09-13T23:25:54.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.756+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.756+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9090620 con 0x55aae9072c70 2024-09-13T23:25:54.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.757+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'30 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f39b27e4640 20 reqs_thread_entry: start 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 20 Filter name: none 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3923fff640 20 reqs_thread_entry: start 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae90bb2a0 con 0x55aae906e260 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.758+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aae908a6d0 con 0x55aae9072c70 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.759+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:25:54.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.759+0000 7f39b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:54.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.760+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94192542424720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae908d400 con 0x55aae906e260 2024-09-13T23:25:54.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.761+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94192542424720] v33'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.761+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94192542401984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081e90 con 0x55aae9072c70 2024-09-13T23:25:54.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.762+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94192542401984] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.762+0000 7f3b0132a800 20 remove_watcher() i=0 2024-09-13T23:25:54.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.762+0000 7f3b0132a800 2 removed watcher, disabling cache 2024-09-13T23:25:54.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.762+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94192542405712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081e90 con 0x55aae906e260 2024-09-13T23:25:54.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.763+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94192542405712] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.763+0000 7f3b0132a800 20 remove_watcher() i=1 2024-09-13T23:25:54.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.763+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94192542410480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081e90 con 0x55aae9077600 2024-09-13T23:25:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.764+0000 7f3afd021640 1 -- 172.21.15.99:0/3645729345 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94192542410480] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ae802d070 con 0x55aae9077600 2024-09-13T23:25:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.764+0000 7f3b0132a800 20 remove_watcher() i=2 2024-09-13T23:25:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.764+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94192542413024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907e6f0 con 0x55aae9072c70 2024-09-13T23:25:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.765+0000 7f3afd822640 1 -- 172.21.15.99:0/3645729345 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94192542413024] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af8027020 con 0x55aae9072c70 2024-09-13T23:25:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.765+0000 7f3b0132a800 20 remove_watcher() i=3 2024-09-13T23:25:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.765+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94192542417904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081e90 con 0x55aae906e260 2024-09-13T23:25:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.766+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94192542417904] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x55aae906e260 2024-09-13T23:25:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.766+0000 7f3b0132a800 20 remove_watcher() i=4 2024-09-13T23:25:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.766+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94192542415568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907f0e0 con 0x7f3af8059040 2024-09-13T23:25:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.767+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94192542415568] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.767+0000 7f3b0132a800 20 remove_watcher() i=5 2024-09-13T23:25:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.767+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94192542423664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae907e6f0 con 0x7f3af8059040 2024-09-13T23:25:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.768+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94192542423664] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.768+0000 7f3b0132a800 20 remove_watcher() i=6 2024-09-13T23:25:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.768+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94192542421840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aae9081f00 con 0x7f3af8059040 2024-09-13T23:25:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94192542421840] v33'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3af0051070 con 0x7f3af8059040 2024-09-13T23:25:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 20 remove_watcher() i=7 2024-09-13T23:25:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3af8059040 msgr2=0x7f3af804ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f3af8059040 0x7f3af804ea50 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae906e260 msgr2=0x55aae9070720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae906e260 0x55aae9070720 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae9072c70 msgr2=0x55aae9075060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae9072c70 0x55aae9075060 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aae9077600 msgr2=0x55aae9079ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aae9077600 0x55aae9079ac0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39c8036b40 msgr2=0x7f39c8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39c8036b40 0x7f39c8039000 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800bc50 tx=0x7f3ae8032000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 msgr2=0x55aae90627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/3645729345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae905b4b0 0x55aae90627a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3af802ac70 tx=0x7f3af804cd20 comp rx=0 tx=0).stop 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 reap_dead start 2024-09-13T23:25:54.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3afc820640 1 -- 172.21.15.99:0/3645729345 reap_dead start 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 shutdown_connections 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 >> 172.21.15.99:0/3645729345 conn(0x55aae9057810 msgr2=0x55aae90558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 shutdown_connections 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/3645729345 wait complete. 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 msgr2=0x7f39d8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 0x7f39d8039050 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55aae8f39a70 tx=0x7f3ae801bf10 comp rx=0 tx=0).stop 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 msgr2=0x55aae904eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.769+0000 7f3b0132a800 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55aae8f3a090 tx=0x7f3af80163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 shutdown_connections 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39d8036b90 0x7f39d8039050 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/589438667 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae904e760 0x55aae904eb80 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 >> 172.21.15.99:0/589438667 conn(0x55aae90436f0 msgr2=0x55aae9046270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 shutdown_connections 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/589438667 wait complete. 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 msgr2=0x55aae903aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 0x55aae903aaa0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 msgr2=0x55aae903f650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 0x55aae903f650 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 msgr2=0x7f39e4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 0x7f39e4039050 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3af0057000 tx=0x7f3af0052000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 msgr2=0x55aae8f3aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55aae902a4f0 tx=0x7f3ae8000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 shutdown_connections 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aae903d260 0x55aae903f650 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aae90386b0 0x55aae903aaa0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f39e4036b90 0x7f39e4039050 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 --2- 172.21.15.99:0/2099903070 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aae8f3e860 0x55aae8f3aa70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 >> 172.21.15.99:0/2099903070 conn(0x55aae8f34df0 msgr2=0x55aae9023920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 shutdown_connections 2024-09-13T23:25:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.770+0000 7f3b0132a800 1 -- 172.21.15.99:0/2099903070 wait complete. 2024-09-13T23:25:54.779 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:25:54.788 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T23:25:54.792 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:54.819 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:54.833 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:54.881 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:25:54.886 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:54.886 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:25:54.886 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:25:54.886 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:25:54.932 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:54.932 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:54.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.931+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.931+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.931+0000 7fc16f440800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f1dd87edf0 0x55f1dd910620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.931+0000 7fc16f440800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1dd7cab30 con 0x55f1dd910b60 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.931+0000 7fc16f440800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55f1dd7ac360 con 0x55f1dd87edf0 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16cf34640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55f1dd87edf0 0x55f1dd910620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16c733640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55f1dd910b60 0x55f1dd912f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46030/0 (socket says 172.21.15.99:46030) 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16c733640 1 -- 172.21.15.99:0/4019521147 learned_addr learned my addr 172.21.15.99:0/4019521147 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16bf32640 1 -- 172.21.15.99:0/4019521147 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362673418 0 0) 0x55f1dd7cab30 con 0x55f1dd910b60 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16bf32640 1 -- 172.21.15.99:0/4019521147 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc158001e10 con 0x55f1dd910b60 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16cf34640 1 -- 172.21.15.99:0/4019521147 >> v1:172.21.15.43:6789/0 conn(0x55f1dd910b60 legacy=0x55f1dd912f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.932+0000 7fc16cf34640 1 -- 172.21.15.99:0/4019521147 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dd7d2e00 con 0x55f1dd87edf0 2024-09-13T23:25:54.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16cf34640 1 --2- 172.21.15.99:0/4019521147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd910620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005fd0 tx=0x7fc15c045b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900fa10e23f1175c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16bf32640 1 -- 172.21.15.99:0/4019521147 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c055070 con 0x55f1dd87edf0 2024-09-13T23:25:54.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16bf32640 1 -- 172.21.15.99:0/4019521147 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c051540 con 0x55f1dd87edf0 2024-09-13T23:25:54.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16bf32640 1 -- 172.21.15.99:0/4019521147 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c051840 con 0x55f1dd87edf0 2024-09-13T23:25:54.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16f440800 1 -- 172.21.15.99:0/4019521147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 msgr2=0x55f1dd910620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16f440800 1 --2- 172.21.15.99:0/4019521147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd910620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc15c005fd0 tx=0x7fc15c045b30 comp rx=0 tx=0).stop 2024-09-13T23:25:54.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16f440800 1 -- 172.21.15.99:0/4019521147 shutdown_connections 2024-09-13T23:25:54.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16f440800 1 --2- 172.21.15.99:0/4019521147 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd910620 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.934+0000 7fc16f440800 1 -- 172.21.15.99:0/4019521147 >> 172.21.15.99:0/4019521147 conn(0x55f1dd905dd0 msgr2=0x55f1dd9081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.935+0000 7fc16f440800 1 -- 172.21.15.99:0/4019521147 shutdown_connections 2024-09-13T23:25:54.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.935+0000 7fc16f440800 1 -- 172.21.15.99:0/4019521147 wait complete. 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.948+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.948+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.948+0000 7fc16f440800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.948+0000 7fc16f440800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd857360 con 0x55f1dd87edf0 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc16cf34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc16cf34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34076/0 (socket says 172.21.15.99:34076) 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc16cf34640 1 -- 172.21.15.99:0/2703680552 learned_addr learned my addr 172.21.15.99:0/2703680552 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc16cf34640 1 -- 172.21.15.99:0/2703680552 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dd7a4bc0 con 0x55f1dd87edf0 2024-09-13T23:25:54.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2703680552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f80 tx=0x7fc15c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af32ba0199fd652 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc05ae0d640 1 -- 172.21.15.99:0/2703680552 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c055040 con 0x55f1dd87edf0 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc05ae0d640 1 -- 172.21.15.99:0/2703680552 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c051a00 con 0x55f1dd87edf0 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.949+0000 7fc05ae0d640 1 -- 172.21.15.99:0/2703680552 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c051ce0 con 0x55f1dd87edf0 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- 172.21.15.99:0/2703680552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 msgr2=0x55f1dd9fc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 --2- 172.21.15.99:0/2703680552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc15c000f80 tx=0x7fc15c051000 comp rx=0 tx=0).stop 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- 172.21.15.99:0/2703680552 shutdown_connections 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 --2- 172.21.15.99:0/2703680552 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dd9fc8d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- 172.21.15.99:0/2703680552 >> 172.21.15.99:0/2703680552 conn(0x55f1dd905dd0 msgr2=0x55f1dd9f8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- 172.21.15.99:0/2703680552 shutdown_connections 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- 172.21.15.99:0/2703680552 wait complete. 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.950+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16f440800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16f440800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd914910 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16cf34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16cf34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34092/0 (socket says 172.21.15.99:34092) 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16cf34640 1 -- 172.21.15.99:0/2732298121 learned_addr learned my addr 172.21.15.99:0/2732298121 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16cf34640 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dd7b8fe0 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc15c025960 tx=0x7fc15c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc05960a640 1 -- 172.21.15.99:0/2732298121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c071020 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc05960a640 1 -- 172.21.15.99:0/2732298121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c05a8c0 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1dda04740 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc05960a640 1 -- 172.21.15.99:0/2732298121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc15c055030 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.951+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dda04c60 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.952+0000 7fc05960a640 1 -- 172.21.15.99:0/2732298121 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc15c074020 con 0x55f1dd87edf0 2024-09-13T23:25:54.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.952+0000 7fc05960a640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 0x7fc054039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.952+0000 7fc05960a640 1 -- 172.21.15.99:0/2732298121 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fc15c06a040 con 0x55f1dd87edf0 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16c733640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 0x7fc054039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 0x55f1dda0b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda0b840 con 0x55f1dd910b60 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16d735640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 0x55f1dda0b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16c733640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 0x7fc054039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc154000f60 tx=0x7fc1540010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16d735640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 0x55f1dda0b270 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16d735640 1 -- 172.21.15.99:0/2732298121 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1640083e0 con 0x55f1dd910b60 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.953+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda08800 con 0x55f1dd910b60 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16d735640 1 -- 172.21.15.99:0/2732298121 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1640083e0 con 0x55f1dd910b60 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 0x55f1dda0ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda10610 con 0x55f1dda0db50 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 0x55f1dda0ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 0x55f1dda0ff40 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16cf34640 1 -- 172.21.15.99:0/2732298121 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda0db50 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.954+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda0c9f0 con 0x55f1dd910b60 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16d735640 1 -- 172.21.15.99:0/2732298121 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1640083e0 con 0x55f1dd910b60 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda0ce90 con 0x55f1dda0db50 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16cf34640 1 -- 172.21.15.99:0/2732298121 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda0db50 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16f440800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.955+0000 7fc16f440800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd7a6580 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34100/0 (socket says 172.21.15.99:34100) 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16d735640 1 -- 172.21.15.99:0/1014931649 learned_addr learned my addr 172.21.15.99:0/1014931649 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16d735640 1 -- 172.21.15.99:0/1014931649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dda1f890 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16d735640 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55f1dda052b0 tx=0x7fc16400beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc0527fc640 1 -- 172.21.15.99:0/1014931649 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16401c020 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc0527fc640 1 -- 172.21.15.99:0/1014931649 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc164007c30 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1dda1fb20 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc0527fc640 1 -- 172.21.15.99:0/1014931649 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164018440 con 0x55f1dda1ef30 2024-09-13T23:25:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.956+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dda22800 con 0x55f1dda1ef30 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.957+0000 7fc0527fc640 1 -- 172.21.15.99:0/1014931649 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc16401f020 con 0x55f1dda1ef30 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.957+0000 7fc0527fc640 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 0x7fc044039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.957+0000 7fc0527fc640 1 -- 172.21.15.99:0/1014931649 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fc16404e1f0 con 0x55f1dda1ef30 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.957+0000 7fc16cf34640 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 0x7fc044039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.957+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16cf34640 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 0x7fc044039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f1dda0c100 tx=0x7fc15c063f90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16f440800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16f440800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f1dd9fcfc0 con 0x55f1dda2bc00 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34110/0 (socket says 172.21.15.99:34110) 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16d735640 1 -- 172.21.15.99:0/1736023292 learned_addr learned my addr 172.21.15.99:0/1736023292 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16d735640 1 -- 172.21.15.99:0/1736023292 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dda2c5d0 con 0x55f1dda2bc00 2024-09-13T23:25:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc16d735640 1 --2- 172.21.15.99:0/1736023292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc16404c600 tx=0x7fc164016640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958e5e699579abf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc043fff640 1 -- 172.21.15.99:0/1736023292 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164045070 con 0x55f1dda2bc00 2024-09-13T23:25:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc043fff640 1 -- 172.21.15.99:0/1736023292 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1640188f0 con 0x55f1dda2bc00 2024-09-13T23:25:54.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.958+0000 7fc043fff640 1 -- 172.21.15.99:0/1736023292 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164021550 con 0x55f1dda2bc00 2024-09-13T23:25:54.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- 172.21.15.99:0/1736023292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 msgr2=0x55f1dda2c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 --2- 172.21.15.99:0/1736023292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc16404c600 tx=0x7fc164016640 comp rx=0 tx=0).stop 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- 172.21.15.99:0/1736023292 shutdown_connections 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 --2- 172.21.15.99:0/1736023292 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda2c000 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- 172.21.15.99:0/1736023292 >> 172.21.15.99:0/1736023292 conn(0x55f1dda27f60 msgr2=0x55f1dda26060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- 172.21.15.99:0/1736023292 shutdown_connections 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- 172.21.15.99:0/1736023292 wait complete. 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 Processor -- start 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- start start 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.959+0000 7fc16f440800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55f1dda2cc40 con 0x55f1dda2bc00 2024-09-13T23:25:54.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16d735640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34118/0 (socket says 172.21.15.99:34118) 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 learned_addr learned my addr 172.21.15.99:0/2912224737 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dda33600 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16d735640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc164043040 tx=0x7fc16404c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc0427fc640 1 -- 172.21.15.99:0/2912224737 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc164045030 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc0427fc640 1 -- 172.21.15.99:0/2912224737 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1640296e0 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc0427fc640 1 -- 172.21.15.99:0/2912224737 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16403fe60 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1dda33890 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.960+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1dda36540 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.961+0000 7fc0427fc640 1 -- 172.21.15.99:0/2912224737 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc164016040 con 0x55f1dda2bc00 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.961+0000 7fc0427fc640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc038036b90 0x7fc038039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.961+0000 7fc0427fc640 1 -- 172.21.15.99:0/2912224737 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fc164046070 con 0x55f1dda2bc00 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.961+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc038036b90 0x7fc038039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.961+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc038036b90 0x7fc038039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc15c06cdc0 tx=0x7fc15c08a000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dda3ebb0 0x55f1dda41070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda417c0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16c733640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dda3ebb0 0x55f1dda41070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16c733640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dda3ebb0 0x55f1dda41070 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc154009050 con 0x55f1dda3ebb0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 20 realm 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.962+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda3e000 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc154009050 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda422b0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc154009050 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda42b80 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc154009050 con 0x55f1dda3ebb0 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda435a0 0x55f1dda45990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda46080 con 0x55f1dda435a0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16d735640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda435a0 0x55f1dda45990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.963+0000 7fc16d735640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda435a0 0x55f1dda45990 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16f440800 20 searching for the correct realm 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f1dda48050 0x55f1dda4a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f1dda48050 0x55f1dda4a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16cf34640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f1dda48050 0x55f1dda4a510 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.964+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.965+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.965+0000 7fc16d735640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc164021020 0x7fc16402a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.965+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.965+0000 7fc16c733640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc164021020 0x7fc16402a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.965+0000 7fc16c733640 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc164021020 0x7fc16402a7d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154009050 con 0x7fc164021020 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154009050 con 0x55f1dda3ebb0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.966+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.967+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.968+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.969+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.970+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.971+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda48050 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.972+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4abe0 con 0x55f1dda435a0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda46a40 con 0x55f1dda3ebb0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda472e0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4b060 con 0x55f1dda435a0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.973+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 zone default found 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 4 Realm: () 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:54.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 zonegroup default 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4b490 con 0x7fc164021020 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4d760 con 0x55f1dda48050 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4db00 con 0x55f1dda48050 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 started sync module instance, tier type = 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.974+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4cbf0 con 0x55f1dda435a0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.975+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.975+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94497294045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4cbf0 con 0x55f1dda435a0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.975+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4e4c0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.976+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94497294045504] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.977+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.977+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94497294049808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4cbf0 con 0x55f1dda3ebb0 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.977+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4efb0 con 0x55f1dda48050 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.978+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.978+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94497294051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4f850 con 0x55f1dda48050 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.978+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda50340 con 0x55f1dda435a0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.978+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94497294049808] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.979+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94497294051968] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.979+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.979+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94497294054304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda4c740 con 0x55f1dda435a0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.979+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda50c20 con 0x55f1dda3ebb0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.980+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.980+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94497294059312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda50b90 con 0x55f1dda3ebb0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.980+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda51bf0 con 0x7fc164021020 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.980+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94497294054304] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.981+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94497294059312] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:54.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.981+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:54.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.981+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94497294063328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda51bb0 con 0x7fc164021020 2024-09-13T23:25:54.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.981+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda52490 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.982+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94497294063328] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.982+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.982+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94497294056976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda51bb0 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.982+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda52ab0 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94497294056976] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94497294065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda52ab0 con 0x7fc164021020 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=0 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=1 2024-09-13T23:25:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=2 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=3 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=4 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=5 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.983+0000 7fc16f440800 20 add_watcher() i=6 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94497294065552] v33'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16f440800 20 add_watcher() i=7 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16f440800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda55dd0 con 0x55f1dda3ebb0 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.984+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94497294067568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda53040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.985+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94497294067568] v33'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.985+0000 7fc022fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.985+0000 7fc16f440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.985+0000 7fc16f440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 5 note: GC not initialized 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc021fe3640 20 reqs_thread_entry: start 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 20 Filter name: none 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fbf937fe640 20 reqs_thread_entry: start 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda89700 con 0x55f1dda435a0 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.986+0000 7fc16f440800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 : miss 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.c 8:36440f57:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8b2c0 con 0x55f1dda3ebb0 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 info.flags=0x17 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 to cache LRU end 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 20 get_obj_state: octx=0x7fc164047cc0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f1dda8d988 s->prefetch_data=0 2024-09-13T23:25:55.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 3.7 3:e01cf261:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda48050 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 10 manifest: total_size = 5 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.987+0000 7fc16f440800 20 get_obj_state: setting s->obj_tag to _AtumlPk02lgSbGomtyHftscOlgToAJ2 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.988+0000 7fc022fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.988+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94497294067568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda3ebb0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.989+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94497294067568] v33'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.989+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94497294045504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda435a0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.990+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94497294045504] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.990+0000 7fc16f440800 20 remove_watcher() i=0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.990+0000 7fc16f440800 2 removed watcher, disabling cache 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.990+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94497294049808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda3ebb0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.991+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94497294049808] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.991+0000 7fc16f440800 20 remove_watcher() i=1 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.991+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94497294051968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda48050 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.992+0000 7fc16cf34640 1 -- 172.21.15.99:0/2912224737 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94497294051968] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc15c057030 con 0x55f1dda48050 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.992+0000 7fc16f440800 20 remove_watcher() i=2 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.992+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94497294054304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda435a0 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.993+0000 7fc16d735640 1 -- 172.21.15.99:0/2912224737 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94497294054304] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc164028070 con 0x55f1dda435a0 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.993+0000 7fc16f440800 20 remove_watcher() i=3 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.993+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94497294059312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x55f1dda3ebb0 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.994+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94497294059312] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x55f1dda3ebb0 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.995+0000 7fc16f440800 20 remove_watcher() i=4 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.995+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94497294063328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x7fc164021020 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.995+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94497294063328] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.995+0000 7fc16f440800 20 remove_watcher() i=5 2024-09-13T23:25:55.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.996+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94497294056976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x7fc164021020 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.996+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94497294056976] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.997+0000 7fc16f440800 20 remove_watcher() i=6 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.997+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94497294065552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55f1dda8ea90 con 0x7fc164021020 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.997+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94497294065552] v33'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc154029040 con 0x7fc164021020 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.997+0000 7fc16f440800 20 remove_watcher() i=7 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc164021020 msgr2=0x7fc16402a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fc164021020 0x7fc16402a7d0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dda3ebb0 msgr2=0x55f1dda41070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dda3ebb0 0x55f1dda41070 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda435a0 msgr2=0x55f1dda45990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda435a0 0x55f1dda45990 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f1dda48050 msgr2=0x55f1dda4a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55f1dda48050 0x55f1dda4a510 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc038036b90 msgr2=0x7fc038039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc038036b90 0x7fc038039050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc15c06cdc0 tx=0x7fc15c08a000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 msgr2=0x55f1dda330c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16c733640 1 -- 172.21.15.99:0/2912224737 reap_dead start 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc164043040 tx=0x7fc16404c560 comp rx=0 tx=0).stop 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 shutdown_connections 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/2912224737 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda2bc00 0x55f1dda330c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 >> 172.21.15.99:0/2912224737 conn(0x55f1dda27f60 msgr2=0x55f1dda26030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 shutdown_connections 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/2912224737 wait complete. 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 msgr2=0x7fc044039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 0x7fc044039050 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f1dda0c100 tx=0x7fc15c063f90 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 msgr2=0x55f1dda1f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55f1dda052b0 tx=0x7fc16400beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 shutdown_connections 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc044036b90 0x7fc044039050 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 --2- 172.21.15.99:0/1014931649 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dda1ef30 0x55f1dda1f350 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 >> 172.21.15.99:0/1014931649 conn(0x55f1dda13ec0 msgr2=0x55f1dda16a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 shutdown_connections 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.998+0000 7fc16f440800 1 -- 172.21.15.99:0/1014931649 wait complete. 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 msgr2=0x55f1dda0b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 0x55f1dda0b270 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 msgr2=0x55f1dda0ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 0x55f1dda0ff40 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 msgr2=0x7fc054039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 0x7fc054039050 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc154000f60 tx=0x7fc1540010a0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 msgr2=0x55f1dda04200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc15c025960 tx=0x7fc15c003330 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 shutdown_connections 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55f1dda0db50 0x55f1dda0ff40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55f1dd910b60 0x55f1dda0b270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc054036b90 0x7fc054039050 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 --2- 172.21.15.99:0/2732298121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55f1dd87edf0 0x55f1dda04200 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 >> 172.21.15.99:0/2732298121 conn(0x55f1dd905dd0 msgr2=0x55f1dd9f6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 shutdown_connections 2024-09-13T23:25:55.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:54.999+0000 7fc16f440800 1 -- 172.21.15.99:0/2732298121 wait complete. 2024-09-13T23:25:55.016 INFO:teuthology.orchestra.run.smithi099.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T23:25:55.017 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T23:25:55.019 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T23:25:55.023 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:55.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:25:55.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T23:25:55.023 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:25:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.067+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.067+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.067+0000 7f0c62863800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x558c7a655900 0x558c7a657cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.067+0000 7f0c62863800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558c7a510b30 con 0x558c7a5c5650 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.067+0000 7f0c62863800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x558c7a4f2360 con 0x558c7a655900 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c5fb5d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x558c7a655900 0x558c7a657cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c6035e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x558c7a5c5650 0x558c7a6541e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46036/0 (socket says 172.21.15.99:46036) 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c6035e640 1 -- 172.21.15.99:0/1537467802 learned_addr learned my addr 172.21.15.99:0/1537467802 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1537467802 >> v1:172.21.15.43:6789/0 conn(0x558c7a5c5650 legacy=0x558c7a6541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c5f35c640 1 -- 172.21.15.99:0/1537467802 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606609508 0 0) 0x558c7a510b30 con 0x558c7a5c5650 2024-09-13T23:25:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.068+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1537467802 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a518e00 con 0x558c7a655900 2024-09-13T23:25:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1537467802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a655900 0x558c7a657cf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400a470 tx=0x7f0c54045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494efc7b1c093e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c5f35c640 1 -- 172.21.15.99:0/1537467802 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c54053570 con 0x558c7a655900 2024-09-13T23:25:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c5f35c640 1 -- 172.21.15.99:0/1537467802 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c54058070 con 0x558c7a655900 2024-09-13T23:25:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c5f35c640 1 -- 172.21.15.99:0/1537467802 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c54053880 con 0x558c7a655900 2024-09-13T23:25:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c62863800 1 -- 172.21.15.99:0/1537467802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a655900 msgr2=0x558c7a657cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c62863800 1 --2- 172.21.15.99:0/1537467802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a655900 0x558c7a657cf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400a470 tx=0x7f0c54045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c62863800 1 -- 172.21.15.99:0/1537467802 shutdown_connections 2024-09-13T23:25:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c62863800 1 --2- 172.21.15.99:0/1537467802 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a655900 0x558c7a657cf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.070+0000 7f0c62863800 1 -- 172.21.15.99:0/1537467802 >> 172.21.15.99:0/1537467802 conn(0x558c7a64bdb0 msgr2=0x558c7a64e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.071+0000 7f0c62863800 1 -- 172.21.15.99:0/1537467802 shutdown_connections 2024-09-13T23:25:55.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.071+0000 7f0c62863800 1 -- 172.21.15.99:0/1537467802 wait complete. 2024-09-13T23:25:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c62863800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c62863800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c7a59d360 con 0x558c7a5c5650 2024-09-13T23:25:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c6035e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c6035e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34134/0 (socket says 172.21.15.99:34134) 2024-09-13T23:25:55.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c6035e640 1 -- 172.21.15.99:0/3351405334 learned_addr learned my addr 172.21.15.99:0/3351405334 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.085+0000 7f0c6035e640 1 -- 172.21.15.99:0/3351405334 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a4eabc0 con 0x558c7a5c5650 2024-09-13T23:25:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0c6035e640 1 --2- 172.21.15.99:0/3351405334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001660 tx=0x7f0c50001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4345e7e9b7e2d199 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0b4e60c640 1 -- 172.21.15.99:0/3351405334 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50003450 con 0x558c7a5c5650 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0b4e60c640 1 -- 172.21.15.99:0/3351405334 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c50003610 con 0x558c7a5c5650 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0b4e60c640 1 -- 172.21.15.99:0/3351405334 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c500039b0 con 0x558c7a5c5650 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0c62863800 1 -- 172.21.15.99:0/3351405334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 msgr2=0x558c7a651b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0c62863800 1 --2- 172.21.15.99:0/3351405334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001660 tx=0x7f0c50001b20 comp rx=0 tx=0).stop 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0c62863800 1 -- 172.21.15.99:0/3351405334 shutdown_connections 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.086+0000 7f0c62863800 1 --2- 172.21.15.99:0/3351405334 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a651b10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 -- 172.21.15.99:0/3351405334 >> 172.21.15.99:0/3351405334 conn(0x558c7a64bdb0 msgr2=0x558c7a73c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 -- 172.21.15.99:0/3351405334 shutdown_connections 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 -- 172.21.15.99:0/3351405334 wait complete. 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c62863800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c7a658620 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c6035e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c6035e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34150/0 (socket says 172.21.15.99:34150) 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.087+0000 7f0c6035e640 1 -- 172.21.15.99:0/1389786402 learned_addr learned my addr 172.21.15.99:0/1389786402 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0c6035e640 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a4fefe0 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x558c7a651210 tx=0x7f0c50001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0b4ce09640 1 -- 172.21.15.99:0/1389786402 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50025070 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0b4ce09640 1 -- 172.21.15.99:0/1389786402 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c50019040 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0b4ce09640 1 -- 172.21.15.99:0/1389786402 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50013950 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c7a74a7e0 con 0x558c7a5c5650 2024-09-13T23:25:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.088+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c7a74ad60 con 0x558c7a5c5650 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0b4ce09640 1 -- 172.21.15.99:0/1389786402 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c50010070 con 0x558c7a5c5650 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0b4ce09640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 0x7f0b48039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0b4ce09640 1 -- 172.21.15.99:0/1389786402 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c5004c060 con 0x558c7a5c5650 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 0x7f0b48039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 0x558c7a751310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a751890 con 0x558c7a655900 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.089+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 0x558c7a751310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 0x7f0b48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c54057000 tx=0x7f0c54052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 0x558c7a751310 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1389786402 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c580083e0 con 0x558c7a655900 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a74e8c0 con 0x558c7a655900 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1389786402 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c580083e0 con 0x558c7a655900 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 0x558c7a755fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7566a0 con 0x558c7a753bc0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.090+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 0x558c7a755fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 0x558c7a755fb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c6035e640 1 -- 172.21.15.99:0/1389786402 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c5000f030 con 0x558c7a753bc0 2024-09-13T23:25:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a752a30 con 0x558c7a655900 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1389786402 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c580083e0 con 0x558c7a655900 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a752ea0 con 0x558c7a753bc0 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.091+0000 7f0c6035e640 1 -- 172.21.15.99:0/1389786402 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c5000f030 con 0x558c7a753bc0 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c62863800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c62863800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c7a4ec580 con 0x558c7a765010 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34162/0 (socket says 172.21.15.99:34162) 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c60b5f640 1 -- 172.21.15.99:0/3862614436 learned_addr learned my addr 172.21.15.99:0/3862614436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c60b5f640 1 -- 172.21.15.99:0/3862614436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a765970 con 0x558c7a765010 2024-09-13T23:25:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.092+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x558c7a74b350 tx=0x7f0c5800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0b45ffb640 1 -- 172.21.15.99:0/3862614436 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5801c020 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0b45ffb640 1 -- 172.21.15.99:0/3862614436 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c58007c30 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0b45ffb640 1 -- 172.21.15.99:0/3862614436 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c58018440 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c7a765c00 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c7a7688e0 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.093+0000 7f0b45ffb640 1 -- 172.21.15.99:0/3862614436 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c5801f020 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0b45ffb640 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 0x7f0b38039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0b45ffb640 1 -- 172.21.15.99:0/3862614436 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c5804e1f0 con 0x558c7a765010 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c6035e640 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 0x7f0b38039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c6035e640 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 0x7f0b38039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x558c7a752170 tx=0x7f0c5004a3d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c62863800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c62863800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c7a650180 con 0x558c7a771cc0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34174/0 (socket says 172.21.15.99:34174) 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.094+0000 7f0c60b5f640 1 -- 172.21.15.99:0/2351251337 learned_addr learned my addr 172.21.15.99:0/2351251337 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c60b5f640 1 -- 172.21.15.99:0/2351251337 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a772690 con 0x558c7a771cc0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/2351251337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0c5804c5d0 tx=0x7f0c5804c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb63b9ef92fd1151 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0b377fe640 1 -- 172.21.15.99:0/2351251337 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c58045070 con 0x558c7a771cc0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0b377fe640 1 -- 172.21.15.99:0/2351251337 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c58021530 con 0x558c7a771cc0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0b377fe640 1 -- 172.21.15.99:0/2351251337 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c58018c70 con 0x558c7a771cc0 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 -- 172.21.15.99:0/2351251337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 msgr2=0x558c7a7720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 --2- 172.21.15.99:0/2351251337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0c5804c5d0 tx=0x7f0c5804c7d0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 -- 172.21.15.99:0/2351251337 shutdown_connections 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 --2- 172.21.15.99:0/2351251337 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a7720c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 -- 172.21.15.99:0/2351251337 >> 172.21.15.99:0/2351251337 conn(0x558c7a76e020 msgr2=0x558c7a76c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 -- 172.21.15.99:0/2351251337 shutdown_connections 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.095+0000 7f0c62863800 1 -- 172.21.15.99:0/2351251337 wait complete. 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c62863800 1 Processor -- start 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c62863800 1 -- start start 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c62863800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c62863800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x558c7a772d00 con 0x558c7a771cc0 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c60b5f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34176/0 (socket says 172.21.15.99:34176) 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 learned_addr learned my addr 172.21.15.99:0/1548996744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c7a779680 con 0x558c7a771cc0 2024-09-13T23:25:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.096+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0c58043040 tx=0x7f0c5804c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0b35ffb640 1 -- 172.21.15.99:0/1548996744 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c58045030 con 0x558c7a771cc0 2024-09-13T23:25:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0b35ffb640 1 -- 172.21.15.99:0/1548996744 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c58020a50 con 0x558c7a771cc0 2024-09-13T23:25:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0b35ffb640 1 -- 172.21.15.99:0/1548996744 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5803fe60 con 0x558c7a771cc0 2024-09-13T23:25:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558c7a779910 con 0x558c7a771cc0 2024-09-13T23:25:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c7a77c5c0 con 0x558c7a771cc0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.097+0000 7f0b35ffb640 1 -- 172.21.15.99:0/1548996744 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c58016040 con 0x558c7a771cc0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0b35ffb640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b28036b90 0x7f0b28039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0b35ffb640 1 -- 172.21.15.99:0/1548996744 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c58046070 con 0x558c7a771cc0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b28036b90 0x7f0b28039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b28036b90 0x7f0b28039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d010 tx=0x7f0c50034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a784be0 0x558c7a7870a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.098+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7877f0 con 0x558c7a784be0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a784be0 0x558c7a7870a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a784be0 0x558c7a7870a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 realm 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a787c20 con 0x558c7a784be0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7884f0 con 0x558c7a784be0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.099+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a788890 con 0x558c7a784be0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a7895f0 0x558c7a78b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a78bff0 con 0x558c7a7895f0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a7895f0 0x558c7a78b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a7895f0 0x558c7a78b9e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c58028070 con 0x558c7a7895f0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 20 searching for the correct realm 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558c7a78df60 0x558c7a790420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.100+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558c7a78df60 0x558c7a790420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c6035e640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558c7a78df60 0x558c7a790420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c58028070 con 0x558c7a7895f0 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c60b5f640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c58021020 0x7f0c58024120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.101+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c58021020 0x7f0c58024120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c58021020 0x7f0c58024120 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.102+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c58028070 con 0x558c7a7895f0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.103+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.104+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0c58028070 con 0x558c7a7895f0 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.105+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.106+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c58028070 con 0x558c7a7895f0 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.107+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.108+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a78df60 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x7f0c58021020 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a784be0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790af0 con 0x558c7a7895f0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:55.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.109+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a78c840 con 0x558c7a784be0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a78cc30 con 0x558c7a784be0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a790f70 con 0x558c7a7895f0 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 zone default found 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 4 Realm: () 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 zonegroup default 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7917c0 con 0x7f0c58021020 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.110+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a793570 con 0x558c7a78df60 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7939e0 con 0x558c7a78df60 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 started sync module instance, tier type = 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.111+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7929e0 con 0x558c7a7895f0 2024-09-13T23:25:55.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.112+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.112+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94061838544608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7929e0 con 0x558c7a7895f0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.112+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7944e0 con 0x558c7a784be0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.113+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94061838544608] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.113+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.113+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94061838548912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7929e0 con 0x558c7a784be0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.113+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a794f90 con 0x558c7a78df60 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.114+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.114+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94061838551664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a795830 con 0x558c7a78df60 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.114+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a796310 con 0x558c7a7895f0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.115+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94061838548912] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.115+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94061838551664] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.115+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.115+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94061838553984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a792530 con 0x558c7a7895f0 2024-09-13T23:25:55.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.115+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a796bf0 con 0x558c7a784be0 2024-09-13T23:25:55.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.116+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94061838553984] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.116+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.116+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94061838556704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a796bb0 con 0x558c7a784be0 2024-09-13T23:25:55.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.116+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a797600 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.117+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.117+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94061838556704] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.117+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94061838561616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a797570 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.118+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a798070 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.118+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94061838561616] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.119+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.119+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94061838558976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a798040 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.119+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a798a00 con 0x7f0c58021020 2024-09-13T23:25:55.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94061838558976] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94061838563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a798a00 con 0x7f0c58021020 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=0 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=1 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=2 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=3 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=4 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=5 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.120+0000 7f0c62863800 20 add_watcher() i=6 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94061838563872] v33'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c62863800 20 add_watcher() i=7 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c62863800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a79bd70 con 0x558c7a784be0 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.121+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94061838567104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a798f90 con 0x558c7a784be0 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94061838567104] v33'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0b16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0c62863800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0c62863800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0c62863800 5 note: GC not initialized 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.122+0000 7f0b15fdb640 20 reqs_thread_entry: start 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 Filter name: none 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0a877fe640 20 reqs_thread_entry: start 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:55.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7cf660 con 0x558c7a7895f0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 : miss 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.c 8:36440f57:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d1250 con 0x558c7a784be0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 info.flags=0x17 2024-09-13T23:25:55.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 to cache LRU end 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.123+0000 7f0c62863800 20 get_obj_state: octx=0x7f0c58035540 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558c7a7d3918 s->prefetch_data=0 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.124+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 3.7 3:e01cf261:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x558c7a78df60 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.124+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.124+0000 7f0c62863800 10 manifest: total_size = 5 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.124+0000 7f0c62863800 20 get_obj_state: setting s->obj_tag to _-M0lDY4KgMPGqzfRI1VpV4ibokg8_Ak 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.125+0000 7f0b16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.125+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94061838567104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7ccf50 con 0x558c7a784be0 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.126+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94061838567104] v33'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.126+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94061838544608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7ccf50 con 0x558c7a7895f0 2024-09-13T23:25:55.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.127+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94061838544608] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.127+0000 7f0c62863800 20 remove_watcher() i=0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.127+0000 7f0c62863800 2 removed watcher, disabling cache 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.127+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94061838548912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a792ee0 con 0x558c7a784be0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.128+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94061838548912] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.128+0000 7f0c62863800 20 remove_watcher() i=1 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.128+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94061838551664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x558c7a78df60 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.129+0000 7f0c6035e640 1 -- 172.21.15.99:0/1548996744 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94061838551664] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5003e050 con 0x558c7a78df60 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.129+0000 7f0c62863800 20 remove_watcher() i=2 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.129+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94061838553984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x558c7a7895f0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.130+0000 7f0c60b5f640 1 -- 172.21.15.99:0/1548996744 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94061838553984] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c58066040 con 0x558c7a7895f0 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.130+0000 7f0c62863800 20 remove_watcher() i=3 2024-09-13T23:25:55.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.130+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94061838556704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x558c7a784be0 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.131+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94061838556704] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x558c7a784be0 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.131+0000 7f0c62863800 20 remove_watcher() i=4 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.131+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94061838561616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.132+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94061838561616] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.132+0000 7f0c62863800 20 remove_watcher() i=5 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.132+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94061838558976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.133+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94061838558976] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.133+0000 7f0c62863800 20 remove_watcher() i=6 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.133+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94061838563872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x558c7a7d4a30 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94061838563872] v33'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c54051070 con 0x7f0c58021020 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 20 remove_watcher() i=7 2024-09-13T23:25:55.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c58021020 msgr2=0x7f0c58024120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c58021020 0x7f0c58024120 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a784be0 msgr2=0x558c7a7870a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a784be0 0x558c7a7870a0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a7895f0 msgr2=0x558c7a78b9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a7895f0 0x558c7a78b9e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558c7a78df60 msgr2=0x558c7a790420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x558c7a78df60 0x558c7a790420 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b28036b90 msgr2=0x7f0b28039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b28036b90 0x7f0b28039050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d010 tx=0x7f0c50034000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 msgr2=0x558c7a779140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c5fb5d640 1 -- 172.21.15.99:0/1548996744 reap_dead start 2024-09-13T23:25:55.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0c58043040 tx=0x7f0c5804c560 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 shutdown_connections 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/1548996744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a771cc0 0x558c7a779140 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 >> 172.21.15.99:0/1548996744 conn(0x558c7a76e020 msgr2=0x558c7a76c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 shutdown_connections 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/1548996744 wait complete. 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 msgr2=0x7f0b38039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 0x7f0b38039050 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x558c7a752170 tx=0x7f0c5004a3d0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 msgr2=0x558c7a765430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x558c7a74b350 tx=0x7f0c5800beb0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 shutdown_connections 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b38036b90 0x7f0b38039050 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 --2- 172.21.15.99:0/3862614436 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a765010 0x558c7a765430 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 >> 172.21.15.99:0/3862614436 conn(0x558c7a759fa0 msgr2=0x558c7a75cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 shutdown_connections 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.134+0000 7f0c62863800 1 -- 172.21.15.99:0/3862614436 wait complete. 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 msgr2=0x558c7a751310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 0x558c7a751310 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 msgr2=0x558c7a755fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 0x558c7a755fb0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 msgr2=0x7f0b48039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 0x7f0b48039050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c54057000 tx=0x7f0c54052000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 msgr2=0x558c7a74a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x558c7a651210 tx=0x7f0c50001250 comp rx=0 tx=0).stop 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 shutdown_connections 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x558c7a753bc0 0x558c7a755fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x558c7a655900 0x558c7a751310 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0b48036b90 0x7f0b48039050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 --2- 172.21.15.99:0/1389786402 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x558c7a5c5650 0x558c7a74a2a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 >> 172.21.15.99:0/1389786402 conn(0x558c7a64bdb0 msgr2=0x558c7a73bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 shutdown_connections 2024-09-13T23:25:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.135+0000 7f0c62863800 1 -- 172.21.15.99:0/1389786402 wait complete. 2024-09-13T23:25:55.151 INFO:teuthology.orchestra.run.smithi099.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:25:55.151 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T23:25:55.153 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T23:25:55.174 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:55.269 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T23:25:55.270 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T23:25:55.270 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T23:25:55.270 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:25:55.270 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:25:55.270 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T23:25:55.270 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T23:25:55.319 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:55.319 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.318+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.318+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.318+0000 7f5e1bd26800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x555b4a82a880 0x555b4a82cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.318+0000 7f5e1bd26800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b4a6e5b30 con 0x555b4a79a6d0 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.318+0000 7f5e1bd26800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x555b4a6c7360 con 0x555b4a82a880 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e0f1e2640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x555b4a82a880 0x555b4a82cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e179e3640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x555b4a79a6d0 0x555b4a829160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46052/0 (socket says 172.21.15.99:46052) 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e179e3640 1 -- 172.21.15.99:0/3455696828 learned_addr learned my addr 172.21.15.99:0/3455696828 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e171e2640 1 -- 172.21.15.99:0/3455696828 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027047863 0 0) 0x555b4a6e5b30 con 0x555b4a79a6d0 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e171e2640 1 -- 172.21.15.99:0/3455696828 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e04001e10 con 0x555b4a79a6d0 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/3455696828 >> v1:172.21.15.43:6789/0 conn(0x555b4a79a6d0 legacy=0x555b4a829160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.319+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/3455696828 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a6ede00 con 0x555b4a82a880 2024-09-13T23:25:55.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.321+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/3455696828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a82a880 0x555b4a82cc90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000a470 tx=0x7f5e00045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a0f849c196febf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.321+0000 7f5e171e2640 1 -- 172.21.15.99:0/3455696828 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e00059070 con 0x555b4a82a880 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.321+0000 7f5e171e2640 1 -- 172.21.15.99:0/3455696828 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e00054570 con 0x555b4a82a880 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.321+0000 7f5e171e2640 1 -- 172.21.15.99:0/3455696828 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e00054870 con 0x555b4a82a880 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3455696828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a82a880 msgr2=0x555b4a82cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3455696828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a82a880 0x555b4a82cc90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000a470 tx=0x7f5e00045920 comp rx=0 tx=0).stop 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3455696828 shutdown_connections 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3455696828 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a82a880 0x555b4a82cc90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3455696828 >> 172.21.15.99:0/3455696828 conn(0x555b4a820db0 msgr2=0x555b4a8231d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3455696828 shutdown_connections 2024-09-13T23:25:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.322+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3455696828 wait complete. 2024-09-13T23:25:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.335+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.335+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e1bd26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e1bd26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b4a772360 con 0x555b4a79a6d0 2024-09-13T23:25:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e179e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e179e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34198/0 (socket says 172.21.15.99:34198) 2024-09-13T23:25:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e179e3640 1 -- 172.21.15.99:0/3474808244 learned_addr learned my addr 172.21.15.99:0/3474808244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e179e3640 1 -- 172.21.15.99:0/3474808244 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a6bfbc0 con 0x555b4a79a6d0 2024-09-13T23:25:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.336+0000 7f5e179e3640 1 --2- 172.21.15.99:0/3474808244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5e08001e30 tx=0x7f5e0800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e8bd612630ab3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5d05e0b640 1 -- 172.21.15.99:0/3474808244 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e08012020 con 0x555b4a79a6d0 2024-09-13T23:25:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5d05e0b640 1 -- 172.21.15.99:0/3474808244 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0800e5a0 con 0x555b4a79a6d0 2024-09-13T23:25:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5d05e0b640 1 -- 172.21.15.99:0/3474808244 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0800e8e0 con 0x555b4a79a6d0 2024-09-13T23:25:55.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474808244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 msgr2=0x555b4a9156b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3474808244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5e08001e30 tx=0x7f5e0800b780 comp rx=0 tx=0).stop 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474808244 shutdown_connections 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3474808244 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a9156b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474808244 >> 172.21.15.99:0/3474808244 conn(0x555b4a820db0 msgr2=0x555b4a911070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474808244 shutdown_connections 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.337+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474808244 wait complete. 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e1bd26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e1bd26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b4a82d610 con 0x555b4a79a6d0 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e179e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e179e3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34214/0 (socket says 172.21.15.99:34214) 2024-09-13T23:25:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e179e3640 1 -- 172.21.15.99:0/467130127 learned_addr learned my addr 172.21.15.99:0/467130127 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.338+0000 7f5e179e3640 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a6d3fe0 con 0x555b4a79a6d0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5e179e3640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5e08001e30 tx=0x7f5e08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5cfffff640 1 -- 172.21.15.99:0/467130127 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e08012030 con 0x555b4a79a6d0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5cfffff640 1 -- 172.21.15.99:0/467130127 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e08001490 con 0x555b4a79a6d0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5cfffff640 1 -- 172.21.15.99:0/467130127 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e0801a8f0 con 0x555b4a79a6d0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a91d5e0 con 0x555b4a79a6d0 2024-09-13T23:25:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.339+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a91db00 con 0x555b4a79a6d0 2024-09-13T23:25:55.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5cfffff640 1 -- 172.21.15.99:0/467130127 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e08015020 con 0x555b4a79a6d0 2024-09-13T23:25:55.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5cfffff640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 0x7f5d00039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5cfffff640 1 -- 172.21.15.99:0/467130127 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5e08020030 con 0x555b4a79a6d0 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 0x7f5d00039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 0x555b4a924110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a924690 con 0x555b4a82a880 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e181e4640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 0x555b4a924110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 0x7f5d00039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555b4a799e10 tx=0x7f5e00050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.340+0000 7f5e181e4640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 0x555b4a924110 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e181e4640 1 -- 172.21.15.99:0/467130127 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e1000a4a0 con 0x555b4a82a880 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a921630 con 0x555b4a82a880 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e181e4640 1 -- 172.21.15.99:0/467130127 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e1000a4a0 con 0x555b4a82a880 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 0x555b4a928be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a929370 con 0x555b4a926720 2024-09-13T23:25:55.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e179e3640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 0x555b4a928be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.341+0000 7f5e179e3640 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 0x555b4a928be0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e179e3640 1 -- 172.21.15.99:0/467130127 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a926720 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a924f30 con 0x555b4a82a880 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e181e4640 1 -- 172.21.15.99:0/467130127 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e1000a4a0 con 0x555b4a82a880 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a925350 con 0x555b4a926720 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e179e3640 1 -- 172.21.15.99:0/467130127 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a926720 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.342+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e1bd26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e1bd26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b4a6c1580 con 0x555b4a826b30 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34230/0 (socket says 172.21.15.99:34230) 2024-09-13T23:25:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e181e4640 1 -- 172.21.15.99:0/4179246672 learned_addr learned my addr 172.21.15.99:0/4179246672 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.343+0000 7f5e181e4640 1 -- 172.21.15.99:0/4179246672 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a826f50 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5e181e4640 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x555b4a91e150 tx=0x7f5e100167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5cfd7fa640 1 -- 172.21.15.99:0/4179246672 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10013640 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5cfd7fa640 1 -- 172.21.15.99:0/4179246672 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e100137e0 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a825780 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5cfd7fa640 1 -- 172.21.15.99:0/4179246672 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10013ae0 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a825c80 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.344+0000 7f5cfd7fa640 1 -- 172.21.15.99:0/4179246672 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e10011040 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5cfd7fa640 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 0x7f5cf0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5cfd7fa640 1 -- 172.21.15.99:0/4179246672 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5e1000e040 con 0x555b4a826b30 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e179e3640 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 0x7f5cf0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e179e3640 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 0x7f5cf0039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555b4a921600 tx=0x7f5e08041040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e1bd26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e1bd26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b4a915e60 con 0x555b4a946c70 2024-09-13T23:25:55.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.345+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34242/0 (socket says 172.21.15.99:34242) 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e181e4640 1 -- 172.21.15.99:0/3474348742 learned_addr learned my addr 172.21.15.99:0/3474348742 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e181e4640 1 -- 172.21.15.99:0/3474348742 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a947640 con 0x555b4a946c70 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e181e4640 1 --2- 172.21.15.99:0/3474348742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5e1004cde0 tx=0x7f5e100203a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb12d868b88acb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5cf6ffd640 1 -- 172.21.15.99:0/3474348742 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10012c00 con 0x555b4a946c70 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5cf6ffd640 1 -- 172.21.15.99:0/3474348742 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e10021960 con 0x555b4a946c70 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5cf6ffd640 1 -- 172.21.15.99:0/3474348742 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10021440 con 0x555b4a946c70 2024-09-13T23:25:55.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474348742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 msgr2=0x555b4a947070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3474348742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5e1004cde0 tx=0x7f5e100203a0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474348742 shutdown_connections 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/3474348742 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a947070 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.346+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474348742 >> 172.21.15.99:0/3474348742 conn(0x555b4a942fd0 msgr2=0x555b4a9410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474348742 shutdown_connections 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 -- 172.21.15.99:0/3474348742 wait complete. 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 Processor -- start 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 -- start start 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e1bd26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x555b4a947cb0 con 0x555b4a946c70 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e181e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34258/0 (socket says 172.21.15.99:34258) 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 learned_addr learned my addr 172.21.15.99:0/2850958744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.347+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a94e5f0 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5e181e4640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5e1004cd40 tx=0x7f5e1000af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5cf57fa640 1 -- 172.21.15.99:0/2850958744 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10039070 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5cf57fa640 1 -- 172.21.15.99:0/2850958744 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e1001f480 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4a94e880 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4a951530 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5cf57fa640 1 -- 172.21.15.99:0/2850958744 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e10021570 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.348+0000 7f5cf57fa640 1 -- 172.21.15.99:0/2850958744 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5e1001f6c0 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5cf57fa640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ce0036af0 0x7f5ce0038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5cf57fa640 1 -- 172.21.15.99:0/2850958744 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5e10031050 con 0x555b4a946c70 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e179e3640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ce0036af0 0x7f5ce0038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e179e3640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ce0036af0 0x7f5ce0038fb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800deb0 tx=0x7f5e0804b3c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a959c50 0x555b4a95c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a95c860 con 0x555b4a959c50 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.349+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a959c50 0x555b4a95c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a959c50 0x555b4a95c110 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 realm 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a95cc90 con 0x555b4a959c50 2024-09-13T23:25:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a95d560 con 0x555b4a959c50 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.350+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a95d900 con 0x555b4a959c50 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a95e660 0x555b4a960a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9610a0 con 0x555b4a95e660 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e181e4640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a95e660 0x555b4a960a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e181e4640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a95e660 0x555b4a960a50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 20 searching for the correct realm 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x555b4a963050 0x555b4a965510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.351+0000 7f5e179e3640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x555b4a963050 0x555b4a965510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e179e3640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x555b4a963050 0x555b4a965510 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e181e4640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5e1004b6e0 0x7f5e10040a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.352+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5e1004b6e0 0x7f5e10040a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5e1004b6e0 0x7f5e10040a00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.353+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.354+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.355+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.356+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.357+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.358+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a963050 2024-09-13T23:25:55.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a959c50 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.359+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x555b4a965be0 con 0x555b4a95e660 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:55.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a961a60 con 0x555b4a959c50 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a962300 con 0x555b4a959c50 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9616a0 con 0x555b4a95e660 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:55.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 zone default found 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 4 Realm: () 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 zonegroup default 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.360+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a966510 con 0x7f5e1004b6e0 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a968310 con 0x555b4a963050 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9686b0 con 0x555b4a963050 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 started sync module instance, tier type = 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.361+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9677b0 con 0x555b4a95e660 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.362+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.362+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93850581760928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a967410 con 0x555b4a95e660 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.362+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a969590 con 0x555b4a959c50 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.363+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93850581760928] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.363+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.363+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93850581764800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a969590 con 0x555b4a959c50 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.363+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a969f50 con 0x555b4a963050 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.364+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93850581764800] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.364+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.364+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93850581768864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96a2f0 con 0x555b4a963050 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.364+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96ada0 con 0x555b4a95e660 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.366+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93850581768864] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.366+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.366+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93850581772368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96b190 con 0x555b4a95e660 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.366+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96bbd0 con 0x555b4a959c50 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.367+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.367+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93850581776032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96bb90 con 0x555b4a959c50 2024-09-13T23:25:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.367+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96cb90 con 0x7f5e1004b6e0 2024-09-13T23:25:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.367+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93850581772368] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.368+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.368+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93850581780160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96cb90 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.368+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96d5a0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.368+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93850581776032] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.369+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.369+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93850581778224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96d5a0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.369+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96df60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.369+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93850581780160] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93850581766368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96df60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=0 2024-09-13T23:25:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=1 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=2 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=3 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=4 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=5 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93850581778224] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e1bd26800 20 add_watcher() i=6 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.370+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93850581766368] v33'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0005c040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.371+0000 7f5e1bd26800 20 add_watcher() i=7 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.371+0000 7f5e1bd26800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.371+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96d0f0 con 0x555b4a959c50 2024-09-13T23:25:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.371+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5e0005c040 con 0x555b4a959c50 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.371+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93850581785264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96d0f0 con 0x555b4a959c50 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.372+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93850581785264] v33'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.372+0000 7f5ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.372+0000 7f5e1bd26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.372+0000 7f5e1bd26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.372+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9798d0 con 0x555b4a959c50 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.373+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.373+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979f20 con 0x7f5e1004b6e0 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.374+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.374+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97a380 con 0x555b4a963050 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.375+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.375+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97abd0 con 0x555b4a959c50 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.376+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.376+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97abd0 con 0x555b4a95e660 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.377+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.377+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97af90 con 0x555b4a963050 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.378+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.378+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97af90 con 0x555b4a959c50 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.379+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.379+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97af90 con 0x7f5e1004b6e0 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.380+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.380+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97b020 con 0x555b4a95e660 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.381+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.381+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a97b440 con 0x555b4a963050 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.382+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.382+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a95e660 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.383+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.383+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x7f5e1004b6e0 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.384+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.384+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a95e660 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.385+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.385+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x7f5e1004b6e0 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.386+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'49 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.386+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a959c50 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.387+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.387+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.388+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.388+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a95e660 2024-09-13T23:25:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.389+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.389+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.390+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.390+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a959c50 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.392+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'33 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.392+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a959c50 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.393+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.393+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.394+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'58 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.394+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a95e660 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.395+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.395+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.396+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.396+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.396+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.396+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.397+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.397+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.398+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.398+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x7f5e1004b6e0 2024-09-13T23:25:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.399+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.399+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.400+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.400+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x7f5e1004b6e0 2024-09-13T23:25:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.401+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.401+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a963050 2024-09-13T23:25:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.402+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'59 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.402+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x7f5e1004b6e0 2024-09-13T23:25:55.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.403+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.403+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a979290 con 0x555b4a95e660 2024-09-13T23:25:55.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.404+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'31 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5cccfe1640 20 reqs_thread_entry: start 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 20 Filter name: none 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5c467fc640 20 reqs_thread_entry: start 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9a6330 con 0x555b4a95e660 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 : miss 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.405+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 8.c 8:36440f57:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9a7de0 con 0x555b4a959c50 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(95 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 info.flags=0x17 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 to cache LRU end 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:25:55.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 4.8 4:11efe895:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a963050 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(96 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 4.13 4:cba5086c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a95e660 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(97 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.406+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a959c50 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(98 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e1bd26800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:25:55.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 4.e 4:72fd4b57:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a95e660 2024-09-13T23:25:55.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(99 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 4.3d 4:be50a773:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a963050 2024-09-13T23:25:55.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(100 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.407+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:101 4.2 4:41c2d3f6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a959c50 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.408+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(101 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.408+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x7f5e1004b6e0 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.408+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(102 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.408+0000 7f5e1bd26800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.408+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 4.30 4:0c95ff9f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a963050 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(103 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:104 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a963050 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(104 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e1bd26800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:25:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:105 4.0 4:00d0d6b6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25610 con 0x555b4a963050 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(105 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0801ac70 con 0x555b4a963050 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.409+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa25d30 con 0x555b4a963050 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(106 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [call out=696b] v0'0 uv11 ondisk = 0) ==== 195+0+696 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555b4aa24c48 s->prefetch_data=0 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:107 3.b 3:d22e3c89:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa23140 con 0x7f5e1004b6e0 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(107 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 10 manifest: total_size = 6 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.16203385668621859091 2024-09-13T23:25:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x555b4aa24c48 s->prefetch_data=0 2024-09-13T23:25:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 20 prepare_atomic_modification: state is not atomic. state=0x555b4aa24c48 2024-09-13T23:25:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 2024-09-13T23:25:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.410+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:108 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ad810 con 0x555b4a959c50 2024-09-13T23:25:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.412+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(108 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.412+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:109 3.b 3:d22e3c89:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ad810 con 0x7f5e1004b6e0 2024-09-13T23:25:55.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(109 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_9c8454ddf7aa50116496bac348d7550d [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:110 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae2a0 con 0x555b4a959c50 2024-09-13T23:25:55.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555b4a9aebc8 s->prefetch_data=0 2024-09-13T23:25:55.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 3.27 3:e6a18e90:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae2a0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(111 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 10 manifest: total_size = 3 2024-09-13T23:25:55.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.3651973462591606128 2024-09-13T23:25:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x555b4a9aebc8 s->prefetch_data=0 2024-09-13T23:25:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 20 prepare_atomic_modification: state is not atomic. state=0x555b4a9aebc8 2024-09-13T23:25:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 2024-09-13T23:25:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.413+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:112 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae2a0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.414+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(110 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.414+0000 7f5cf6ffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T23:25:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.415+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(112 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.415+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:113 3.27 3:e6a18e90:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9addf0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(113 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_b1b9a972ccd8c962a473909b97007eb4 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:114 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae240 con 0x7f5e1004b6e0 2024-09-13T23:25:55.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555b4a9aebc8 s->prefetch_data=0 2024-09-13T23:25:55.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:115 3.0 3:015aef1f:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae240 con 0x7f5e1004b6e0 2024-09-13T23:25:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(115 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 10 manifest: total_size = 4 2024-09-13T23:25:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.12287880188968891202 2024-09-13T23:25:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x555b4a9aebc8 s->prefetch_data=0 2024-09-13T23:25:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 20 prepare_atomic_modification: state is not atomic. state=0x555b4a9aebc8 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.416+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:116 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae240 con 0x555b4a963050 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.417+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(114 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.417+0000 7f5cf67fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.417+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(116 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [stat,call,call] v33'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.417+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:117 3.0 3:015aef1f:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ae240 con 0x7f5e1004b6e0 2024-09-13T23:25:55.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.418+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(117 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.418+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:118 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9af540 con 0x555b4a963050 2024-09-13T23:25:55.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.418+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555b4a9aeaa8 s->prefetch_data=0 2024-09-13T23:25:55.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.418+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:119 3.2b 3:d7f0e315:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b0350 con 0x555b4a959c50 2024-09-13T23:25:55.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(119 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 10 manifest: total_size = 5 2024-09-13T23:25:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.746548482557340297 2024-09-13T23:25:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x555b4a9aeaa8 s->prefetch_data=0 2024-09-13T23:25:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 20 prepare_atomic_modification: state is not atomic. state=0x555b4a9aeaa8 2024-09-13T23:25:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:120 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.419+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(118 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.420+0000 7f5cf6ffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.420+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(120 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [stat,call,call] v33'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.420+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:121 3.2b 3:d7f0e315:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b1ec0 con 0x555b4a959c50 2024-09-13T23:25:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(121 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_24d27c169c2c881eb09a065116f2aa5c [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555b4a9aea68 s->prefetch_data=0 2024-09-13T23:25:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:123 3.7 3:e01cf261:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(123 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 10 manifest: total_size = 5 2024-09-13T23:25:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 20 get_obj_state: setting s->obj_tag to _-M0lDY4KgMPGqzfRI1VpV4ibokg8_Ak 2024-09-13T23:25:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 20 get_obj_state: octx=0x7f5e1001f340 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555b4a9aea68 s->prefetch_data=0 2024-09-13T23:25:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 20 prepare_atomic_modification: state is not atomic. state=0x555b4a9aea68 2024-09-13T23:25:55.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 2024-09-13T23:25:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.421+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:124 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.422+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(122 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [stat,call,call] v33'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.422+0000 7f5cf67fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T23:25:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.422+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(124 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [stat,call,call] v33'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.422+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:125 3.7 3:e01cf261:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b0eb0 con 0x555b4a963050 2024-09-13T23:25:55.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(125 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5_bb3aec0fdcdbc2974890f805c585d432 [call] v33'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:126 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:25:55.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:25:55.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:127 4.8 4:11efe895:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b3380 con 0x555b4a963050 2024-09-13T23:25:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:128 4.13 4:cba5086c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9aed30 con 0x555b4a95e660 2024-09-13T23:25:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:129 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b77b0 con 0x555b4a959c50 2024-09-13T23:25:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:130 4.e 4:72fd4b57:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9ba0f0 con 0x555b4a95e660 2024-09-13T23:25:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.423+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:131 4.3d 4:be50a773:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bc960 con 0x555b4a963050 2024-09-13T23:25:55.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:132 4.2 4:41c2d3f6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bf570 con 0x555b4a959c50 2024-09-13T23:25:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:133 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c2380 con 0x7f5e1004b6e0 2024-09-13T23:25:55.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:134 4.30 4:0c95ff9f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c5200 con 0x555b4a963050 2024-09-13T23:25:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:135 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x555b4a963050 2024-09-13T23:25:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(127 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:136 4.0 4:00d0d6b6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24b40 con 0x555b4a963050 2024-09-13T23:25:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(131 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:137 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9cb450 con 0x555b4a963050 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(129 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(128 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(130 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(134 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(132 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.424+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(135 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(136 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(133 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(126 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [stat,call,call] v33'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5cf67fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(137 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5])"; uploads.size()=0; is_truncated=0 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:138 4.8 4:11efe895:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x555b4a963050 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:139 4.13 4:cba5086c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a95e660 2024-09-13T23:25:55.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:140 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c4bb0 con 0x555b4a959c50 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:141 4.e 4:72fd4b57:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x555b4a95e660 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:142 4.3d 4:be50a773:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:143 4.2 4:41c2d3f6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b7300 con 0x555b4a959c50 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:144 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:145 4.30 4:0c95ff9f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:146 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b7720 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:147 4.0 4:00d0d6b6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bee10 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:148 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b9c40 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(138 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(139 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(142 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.425+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(140 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(143 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(141 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(144 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(145 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(146 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(147 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(148 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [call out=124b] v0'0 uv15 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.426+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a95e660 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.427+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(149 foo.buckets [call] v33'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.427+0000 7f5e1bd26800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T23:25:55.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.427+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a95e660 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(150 myfoo [call,call,delete] v33'40 uv40 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e1bd26800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e1bd26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93850582131424 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== watch-notify(notify (1) cookie 93850581778224 notify 141733920793 ret 0) ==== 191+0+0 (crc 0 0 0) 0x555b4a9a62b0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5cf6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 93850581778224 notifier 4654 bl.length()=149 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(151 notify.6 [notify cookie 93850582131424 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.428+0000 7f5cf6ffd640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5cdc003d60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.429+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.429+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== watch-notify(notify_complete (2) cookie 93850582131424 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b4a979890 con 0x7f5e1004b6e0 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.429+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:153 8.c 8:36440f57:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a959c50 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(153 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [call,call,delete] v33'5 uv5 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e1bd26800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 from cache 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e1bd26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5, ofs0, ns] 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93850582025376 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== watch-notify(notify (1) cookie 93850581778224 notify 141733920794 ret 0) ==== 248+0+0 (crc 0 0 0) 0x555b4a979890 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5cf67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 93850581778224 notifier 4654 bl.length()=206 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(154 notify.6 [notify cookie 93850582025376 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5cf67fc640 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5c4c0032c0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.430+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== watch-notify(notify_complete (2) cookie 93850582025376 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555b4a979c70 con 0x7f5e1004b6e0 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:156 4.8 4:11efe895:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a963050 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:157 4.13 4:cba5086c:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x555b4a95e660 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:158 4.20 4:04db46c9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bf2e0 con 0x555b4a959c50 2024-09-13T23:25:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:159 4.e 4:72fd4b57:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9aecf0 con 0x555b4a95e660 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:160 4.3d 4:be50a773:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:161 4.2 4:41c2d3f6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9a57d0 con 0x555b4a959c50 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:162 4.21 4:86e259fb:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9c7c10 con 0x7f5e1004b6e0 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:163 4.30 4:0c95ff9f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9b44f0 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:164 4.16 4:6a1dc642:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bf2e0 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:165 4.0 4:00d0d6b6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.431+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:166 4.2e 4:769ebb47:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9aecf0 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.432+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(158 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.2 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(162 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.6 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(156 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.0 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(164 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.8 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(163 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.7 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(165 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.9 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(160 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.4 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(161 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.5 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.433+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(157 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.1 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(166 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.10 [delete] v33'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(159 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5.3 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 : miss 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:167 6.7 6:e74564cb:::pubsub..bucket.myfoo%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bf2e0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(167 pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 info.flags=0x0 2024-09-13T23:25:55.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 10 adding default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 to cache LRU end 2024-09-13T23:25:55.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.436+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 6.7 6:e74564cb:::pubsub..bucket.myfoo%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9bf2e0 con 0x555b4a963050 2024-09-13T23:25:55.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.437+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(168 pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.5 [delete] v33'60 uv50 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.437+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4aa24a60 con 0x555b4a95e660 2024-09-13T23:25:55.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.438+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(169 foo.buckets [call] v33'41 uv41 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.439+0000 7f5ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.439+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93850581785264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a9a8480 con 0x555b4a959c50 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.440+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 93850581785264] v33'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.440+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93850581760928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96dab0 con 0x555b4a95e660 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.441+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 93850581760928] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.441+0000 7f5e1bd26800 20 remove_watcher() i=0 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.441+0000 7f5e1bd26800 2 removed watcher, disabling cache 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.441+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93850581764800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96dab0 con 0x555b4a959c50 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.442+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 93850581764800] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.442+0000 7f5e1bd26800 20 remove_watcher() i=1 2024-09-13T23:25:55.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.442+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93850581768864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a968ac0 con 0x555b4a963050 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.443+0000 7f5e179e3640 1 -- 172.21.15.99:0/2850958744 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 93850581768864] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e0805e2c0 con 0x555b4a963050 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.443+0000 7f5e1bd26800 20 remove_watcher() i=2 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.443+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93850581772368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96dab0 con 0x555b4a95e660 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.444+0000 7f5e181e4640 1 -- 172.21.15.99:0/2850958744 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 93850581772368] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e1003b030 con 0x555b4a95e660 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.444+0000 7f5e1bd26800 20 remove_watcher() i=3 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.444+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93850581776032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a969aa0 con 0x555b4a959c50 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.445+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 93850581776032] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x555b4a959c50 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.445+0000 7f5e1bd26800 20 remove_watcher() i=4 2024-09-13T23:25:55.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.445+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93850581780160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96a850 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.446+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 93850581780160] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.446+0000 7f5e1bd26800 20 remove_watcher() i=5 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.446+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93850581778224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a96dab0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.447+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 93850581778224] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.447+0000 7f5e1bd26800 20 remove_watcher() i=6 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.447+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93850581766368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x555b4a969aa0 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.447+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 93850581766368] v33'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5e00082040 con 0x7f5e1004b6e0 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.447+0000 7f5e1bd26800 20 remove_watcher() i=7 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5e1004b6e0 msgr2=0x7f5e10040a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5e1004b6e0 0x7f5e10040a00 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a959c50 msgr2=0x555b4a95c110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a959c50 0x555b4a95c110 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a95e660 msgr2=0x555b4a960a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a95e660 0x555b4a960a50 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x555b4a963050 msgr2=0x555b4a965510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x555b4a963050 0x555b4a965510 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ce0036af0 msgr2=0x7f5ce0038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ce0036af0 0x7f5ce0038fb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800deb0 tx=0x7f5e0804b3c0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e0f1e2640 1 -- 172.21.15.99:0/2850958744 reap_dead start 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 msgr2=0x555b4a94e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5e1004cd40 tx=0x7f5e1000af70 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 shutdown_connections 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/2850958744 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a946c70 0x555b4a94e0b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 >> 172.21.15.99:0/2850958744 conn(0x555b4a942fd0 msgr2=0x555b4a9410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 shutdown_connections 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/2850958744 wait complete. 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 msgr2=0x7f5cf0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 0x7f5cf0039050 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x555b4a921600 tx=0x7f5e08041040 comp rx=0 tx=0).stop 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 msgr2=0x555b4a825180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x555b4a91e150 tx=0x7f5e100167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 shutdown_connections 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5cf0036b90 0x7f5cf0039050 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/4179246672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a826b30 0x555b4a825180 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 >> 172.21.15.99:0/4179246672 conn(0x555b4a92ccc0 msgr2=0x555b4a92f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 shutdown_connections 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.448+0000 7f5e1bd26800 1 -- 172.21.15.99:0/4179246672 wait complete. 2024-09-13T23:25:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 msgr2=0x555b4a924110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 0x555b4a924110 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 msgr2=0x555b4a928be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 0x555b4a928be0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 msgr2=0x7f5d00039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 0x7f5d00039050 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555b4a799e10 tx=0x7f5e00050000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 msgr2=0x555b4a91d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5e08001e30 tx=0x7f5e08000ed0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 shutdown_connections 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x555b4a926720 0x555b4a928be0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x555b4a82a880 0x555b4a924110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d00036b90 0x7f5d00039050 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 --2- 172.21.15.99:0/467130127 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x555b4a79a6d0 0x555b4a91d0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 >> 172.21.15.99:0/467130127 conn(0x555b4a820db0 msgr2=0x555b4a90f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 shutdown_connections 2024-09-13T23:25:55.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.449+0000 7f5e1bd26800 1 -- 172.21.15.99:0/467130127 wait complete. 2024-09-13T23:25:55.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:25:55.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:25:55.477 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T23:25:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:55.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f4d92a800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bbd39ba4e0 0x55bbd39ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f4d92a800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bbd387ab30 con 0x55bbd39bae20 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f4d92a800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55bbd385c360 con 0x55bbd39ba4e0 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f49621640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bbd39ba4e0 0x55bbd39ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f43fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55bbd39bae20 0x55bbd39bf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46060/0 (socket says 172.21.15.99:46060) 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.523+0000 7f5f43fff640 1 -- 172.21.15.99:0/3936882157 learned_addr learned my addr 172.21.15.99:0/3936882157 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.524+0000 7f5f49621640 1 -- 172.21.15.99:0/3936882157 >> v1:172.21.15.43:6789/0 conn(0x55bbd39bae20 legacy=0x55bbd39bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.524+0000 7f5f49621640 1 -- 172.21.15.99:0/3936882157 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3882e00 con 0x55bbd39ba4e0 2024-09-13T23:25:55.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.525+0000 7f5f49621640 1 --2- 172.21.15.99:0/3936882157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd39ba8e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a470 tx=0x7f5f3c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfe2b3f719d7207 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.525+0000 7f5f48e20640 1 -- 172.21.15.99:0/3936882157 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c053570 con 0x55bbd39ba4e0 2024-09-13T23:25:55.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f48e20640 1 -- 172.21.15.99:0/3936882157 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c058070 con 0x55bbd39ba4e0 2024-09-13T23:25:55.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f48e20640 1 -- 172.21.15.99:0/3936882157 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c053880 con 0x55bbd39ba4e0 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 -- 172.21.15.99:0/3936882157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 msgr2=0x55bbd39ba8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/3936882157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd39ba8e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a470 tx=0x7f5f3c045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 -- 172.21.15.99:0/3936882157 shutdown_connections 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/3936882157 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd39ba8e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 -- 172.21.15.99:0/3936882157 >> 172.21.15.99:0/3936882157 conn(0x55bbd39b5dd0 msgr2=0x55bbd39b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 -- 172.21.15.99:0/3936882157 shutdown_connections 2024-09-13T23:25:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.526+0000 7f5f4d92a800 1 -- 172.21.15.99:0/3936882157 wait complete. 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f4d92a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f4d92a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bbd3907360 con 0x55bbd39ba4e0 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f49621640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f49621640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34288/0 (socket says 172.21.15.99:34288) 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.540+0000 7f5f49621640 1 -- 172.21.15.99:0/2946785314 learned_addr learned my addr 172.21.15.99:0/2946785314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.541+0000 7f5f49621640 1 -- 172.21.15.99:0/2946785314 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3854bc0 con 0x55bbd39ba4e0 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.541+0000 7f5f49621640 1 --2- 172.21.15.99:0/2946785314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c025c20 tx=0x7f5f3c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8968919b3abec04b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.541+0000 7f5e37606640 1 -- 172.21.15.99:0/2946785314 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c05c580 con 0x55bbd39ba4e0 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.541+0000 7f5e37606640 1 -- 172.21.15.99:0/2946785314 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c063030 con 0x55bbd39ba4e0 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.541+0000 7f5e37606640 1 -- 172.21.15.99:0/2946785314 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c05c850 con 0x55bbd39ba4e0 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2946785314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 msgr2=0x55bbd392eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2946785314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c025c20 tx=0x7f5f3c051000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2946785314 shutdown_connections 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2946785314 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd392eda0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2946785314 >> 172.21.15.99:0/2946785314 conn(0x55bbd39b5dd0 msgr2=0x55bbd3aa5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2946785314 shutdown_connections 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2946785314 wait complete. 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.542+0000 7f5f4d92a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bbd39c1500 con 0x55bbd39ba4e0 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f49621640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f49621640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34300/0 (socket says 172.21.15.99:34300) 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f49621640 1 -- 172.21.15.99:0/768254096 learned_addr learned my addr 172.21.15.99:0/768254096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f49621640 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3868fe0 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f49621640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55bbd392e4a0 tx=0x7f5f3c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5e35e03640 1 -- 172.21.15.99:0/768254096 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c054ad0 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5e35e03640 1 -- 172.21.15.99:0/768254096 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c054c70 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5e35e03640 1 -- 172.21.15.99:0/768254096 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c068420 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.543+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbd3ab2770 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.544+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd3ab2c90 con 0x55bbd39ba4e0 2024-09-13T23:25:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.544+0000 7f5e35e03640 1 -- 172.21.15.99:0/768254096 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5f3c0685c0 con 0x55bbd39ba4e0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.544+0000 7f5e35e03640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 0x7f5e30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5e35e03640 1 -- 172.21.15.99:0/768254096 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5f3c070030 con 0x55bbd39ba4e0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f43fff640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 0x7f5e30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 0x55bbd3ab92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3ab9820 con 0x55bbd39bae20 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f49e22640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 0x55bbd3ab92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f43fff640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 0x7f5e30039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000f60 tx=0x7f5f340012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f49e22640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 0x55bbd3ab92a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f49e22640 1 -- 172.21.15.99:0/768254096 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd39bae20 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.545+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3ab6870 con 0x55bbd39bae20 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f49e22640 1 -- 172.21.15.99:0/768254096 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd39bae20 2024-09-13T23:25:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 0x55bbd3abdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3abe600 con 0x55bbd3abbb70 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f49621640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 0x55bbd3abdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f49621640 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 0x55bbd3abdf60 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f49621640 1 -- 172.21.15.99:0/768254096 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f3c051070 con 0x55bbd3abbb70 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.546+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3abaa10 con 0x55bbd39bae20 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f49e22640 1 -- 172.21.15.99:0/768254096 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd39bae20 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3abaef0 con 0x55bbd3abbb70 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f49621640 1 -- 172.21.15.99:0/768254096 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f3c051070 con 0x55bbd3abbb70 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f4d92a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.547+0000 7f5f4d92a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bbd3856580 con 0x55bbd3accf60 2024-09-13T23:25:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34312/0 (socket says 172.21.15.99:34312) 2024-09-13T23:25:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f49e22640 1 -- 172.21.15.99:0/2104810288 learned_addr learned my addr 172.21.15.99:0/2104810288 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f49e22640 1 -- 172.21.15.99:0/2104810288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3acd8c0 con 0x55bbd3accf60 2024-09-13T23:25:55.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f49e22640 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55bbd3ab3450 tx=0x7f5f440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5e2effd640 1 -- 172.21.15.99:0/2104810288 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f44013640 con 0x55bbd3accf60 2024-09-13T23:25:55.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5e2effd640 1 -- 172.21.15.99:0/2104810288 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f440137e0 con 0x55bbd3accf60 2024-09-13T23:25:55.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbd3acdb50 con 0x55bbd3accf60 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.548+0000 7f5e2effd640 1 -- 172.21.15.99:0/2104810288 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f44013ae0 con 0x55bbd3accf60 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.549+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd3ad0830 con 0x55bbd3accf60 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.549+0000 7f5e2effd640 1 -- 172.21.15.99:0/2104810288 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5f44011040 con 0x55bbd3accf60 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.549+0000 7f5e2effd640 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 0x7f5e24039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.549+0000 7f5e2effd640 1 -- 172.21.15.99:0/2104810288 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5f4400e040 con 0x55bbd3accf60 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.549+0000 7f5f49621640 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 0x7f5e24039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49621640 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 0x7f5e24039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c08f210 tx=0x7f5f3c060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f4d92a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f4d92a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bbd3aad730 con 0x55bbd3aaa810 2024-09-13T23:25:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34320/0 (socket says 172.21.15.99:34320) 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49e22640 1 -- 172.21.15.99:0/1471244514 learned_addr learned my addr 172.21.15.99:0/1471244514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49e22640 1 -- 172.21.15.99:0/1471244514 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3aab1e0 con 0x55bbd3aaa810 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.550+0000 7f5f49e22640 1 --2- 172.21.15.99:0/1471244514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400afb0 tx=0x7f5f4401fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a9607a31580be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5e2cff9640 1 -- 172.21.15.99:0/1471244514 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f44021440 con 0x55bbd3aaa810 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5e2cff9640 1 -- 172.21.15.99:0/1471244514 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4401f340 con 0x55bbd3aaa810 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5e2cff9640 1 -- 172.21.15.99:0/1471244514 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f440215e0 con 0x55bbd3aaa810 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1471244514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 msgr2=0x55bbd3aaac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1471244514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400afb0 tx=0x7f5f4401fce0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1471244514 shutdown_connections 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1471244514 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3aaac10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1471244514 >> 172.21.15.99:0/1471244514 conn(0x55bbd3ad5f80 msgr2=0x55bbd3ad4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1471244514 shutdown_connections 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1471244514 wait complete. 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 Processor -- start 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.551+0000 7f5f4d92a800 1 -- start start 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f4d92a800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f4d92a800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bbd3aa9540 con 0x55bbd3aaa810 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f49e22640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34324/0 (socket says 172.21.15.99:34324) 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 learned_addr learned my addr 172.21.15.99:0/1014883286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd3ae3800 con 0x55bbd3aaa810 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f49e22640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f4404cd60 tx=0x7f5f4404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5e1affd640 1 -- 172.21.15.99:0/1014883286 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f44013e60 con 0x55bbd3aaa810 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5e1affd640 1 -- 172.21.15.99:0/1014883286 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f44040360 con 0x55bbd3aaa810 2024-09-13T23:25:55.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bbd3ae3a90 con 0x55bbd3aaa810 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5e1affd640 1 -- 172.21.15.99:0/1014883286 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4404e2b0 con 0x55bbd3aaa810 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.552+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd3ae6740 con 0x55bbd3aaa810 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.553+0000 7f5e1affd640 1 -- 172.21.15.99:0/1014883286 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5f4403b060 con 0x55bbd3aaa810 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.553+0000 7f5e1affd640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e14036b90 0x7f5e14039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.553+0000 7f5e1affd640 1 -- 172.21.15.99:0/1014883286 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5f44035bb0 con 0x55bbd3aaa810 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.553+0000 7f5f49621640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e14036b90 0x7f5e14039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f49621640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e14036b90 0x7f5e14039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0547e0 tx=0x7f5f3c094000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd3aeedc0 0x55bbd3af1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af19d0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f43fff640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd3aeedc0 0x55bbd3af1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.554+0000 7f5f43fff640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd3aeedc0 0x55bbd3af1280 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f34009050 con 0x55bbd3aeedc0 2024-09-13T23:25:55.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 realm 2024-09-13T23:25:55.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3aee210 con 0x55bbd3aeedc0 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f34009050 con 0x55bbd3aeedc0 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af24c0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f34009050 con 0x55bbd3aeedc0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af2d90 con 0x55bbd3aeedc0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f34009050 con 0x55bbd3aeedc0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3af36d0 0x55bbd3af5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af6250 con 0x55bbd3af36d0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.555+0000 7f5f49e22640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3af36d0 0x55bbd3af5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f49e22640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3af36d0 0x55bbd3af5ac0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f4d92a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f4d92a800 20 searching for the correct realm 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bbd3af8220 0x55bbd3afa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f49621640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bbd3af8220 0x55bbd3afa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.556+0000 7f5f49621640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bbd3af8220 0x55bbd3afa6e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f49e22640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5f44044070 0x7f5f4404e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f43fff640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5f44044070 0x7f5f4404e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.557+0000 7f5f43fff640 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5f44044070 0x7f5f4404e450 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34009050 con 0x7f5f44044070 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34009050 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.558+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.559+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.560+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.561+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.562+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.563+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.563+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.563+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.563+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.564+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af8220 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x7f5f44044070 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afadb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.565+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af6c10 con 0x55bbd3aeedc0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3af74b0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afb230 con 0x55bbd3af36d0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:55.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 zone default found 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 4 Realm: () 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 zonegroup default 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afb680 con 0x7f5f44044070 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.566+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afd950 con 0x55bbd3af8220 2024-09-13T23:25:55.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afdcf0 con 0x55bbd3af8220 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 started sync module instance, tier type = 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.567+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afcde0 con 0x55bbd3af36d0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.568+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.568+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94265198760448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afca40 con 0x55bbd3af36d0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.568+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afea70 con 0x55bbd3aeedc0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.569+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94265198760448] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.569+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.569+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94265198764176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3afea30 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.569+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3aff520 con 0x55bbd3af8220 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.570+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.570+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94265198768080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3affdc0 con 0x55bbd3af8220 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.570+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b008c0 con 0x55bbd3af36d0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.570+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94265198764176] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.571+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.571+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94265198768080] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.571+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94265198773168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b00cb0 con 0x55bbd3af36d0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.571+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3aff950 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.572+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.572+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94265198776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3aff950 con 0x55bbd3aeedc0 2024-09-13T23:25:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.572+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b02120 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.573+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94265198773168] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.573+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94265198776816] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.574+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.574+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94265198777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b01c30 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.574+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b029c0 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.575+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.575+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94265198781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b01c30 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.575+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b034f0 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.575+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94265198777872] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94265198781712] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94265198782768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b034f0 con 0x7f5f44044070 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=0 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=1 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=2 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=3 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=4 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=5 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.576+0000 7f5f4d92a800 20 add_watcher() i=6 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94265198782768] v33'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f4d92a800 20 add_watcher() i=7 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f4d92a800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b02fd0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.577+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94265198765232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b02fd0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.578+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94265198765232] v33'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.578+0000 7f5dff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.578+0000 7f5f4d92a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.578+0000 7f5f4d92a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.578+0000 7f5f4d92a800 5 note: GC not initialized 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5dfe7e4640 20 reqs_thread_entry: start 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 20 Filter name: none 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5d6ffff640 20 reqs_thread_entry: start 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b39800 con 0x55bbd3aeedc0 2024-09-13T23:25:55.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.579+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b3f9e0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.580+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.580+0000 7f5f4d92a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.580+0000 7f5f4d92a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.580+0000 7f5f4d92a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94265199031200 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b3b280 con 0x55bbd3aeedc0 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== watch-notify(notify (1) cookie 94265198776816 notify 141733920790 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55bbd387ab30 con 0x55bbd3aeedc0 2024-09-13T23:25:55.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5e2cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920790 cookie 94265198776816 notifier 4661 bl.length()=579 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5e2cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5e2cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5e2cff9640 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5e0c003ea0 con 0x55bbd3aeedc0 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(64 notify.4 [notify cookie 94265199031200 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 94265199031200 notify 141733920790 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5f3402f890 con 0x55bbd3aeedc0 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.581+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.598 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:55.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.582+0000 7f5dff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.582+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94265198765232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3aeedc0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.583+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94265198765232] v33'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.583+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94265198760448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3af36d0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.584+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94265198760448] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.584+0000 7f5f4d92a800 20 remove_watcher() i=0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.584+0000 7f5f4d92a800 2 removed watcher, disabling cache 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.584+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94265198764176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3aeedc0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.585+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94265198764176] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.585+0000 7f5f4d92a800 20 remove_watcher() i=1 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.585+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94265198768080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3af8220 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.586+0000 7f5f49621640 1 -- 172.21.15.99:0/1014883286 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94265198768080] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c09a040 con 0x55bbd3af8220 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.586+0000 7f5f4d92a800 20 remove_watcher() i=2 2024-09-13T23:25:55.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.586+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94265198773168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3af36d0 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.587+0000 7f5f49e22640 1 -- 172.21.15.99:0/1014883286 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94265198773168] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4400a4a0 con 0x55bbd3af36d0 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.587+0000 7f5f4d92a800 20 remove_watcher() i=3 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.587+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94265198776816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x55bbd3aeedc0 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.588+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94265198776816] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x55bbd3aeedc0 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.588+0000 7f5f4d92a800 20 remove_watcher() i=4 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.588+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94265198777872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x7f5f44044070 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.589+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94265198777872] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.589+0000 7f5f4d92a800 20 remove_watcher() i=5 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.589+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94265198781712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x7f5f44044070 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.590+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94265198781712] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.590+0000 7f5f4d92a800 20 remove_watcher() i=6 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.590+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94265198782768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bbd3b37550 con 0x7f5f44044070 2024-09-13T23:25:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94265198782768] v33'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f34029040 con 0x7f5f44044070 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 20 remove_watcher() i=7 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5f44044070 msgr2=0x7f5f4404e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5f44044070 0x7f5f4404e450 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd3aeedc0 msgr2=0x55bbd3af1280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd3aeedc0 0x55bbd3af1280 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3af36d0 msgr2=0x55bbd3af5ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3af36d0 0x55bbd3af5ac0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bbd3af8220 msgr2=0x55bbd3afa6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bbd3af8220 0x55bbd3afa6e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e14036b90 msgr2=0x7f5e14039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e14036b90 0x7f5e14039050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0547e0 tx=0x7f5f3c094000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 msgr2=0x55bbd3ae32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5f4404cd60 tx=0x7f5f4404cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f43fff640 1 -- 172.21.15.99:0/1014883286 reap_dead start 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 shutdown_connections 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/1014883286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3aaa810 0x55bbd3ae32c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 >> 172.21.15.99:0/1014883286 conn(0x55bbd3ad5f80 msgr2=0x55bbd3ad4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 shutdown_connections 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.591+0000 7f5f4d92a800 1 -- 172.21.15.99:0/1014883286 wait complete. 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 msgr2=0x7f5e24039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 0x7f5e24039050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c08f210 tx=0x7f5f3c060ee0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 msgr2=0x55bbd3acd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x55bbd3ab3450 tx=0x7f5f440167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 shutdown_connections 2024-09-13T23:25:55.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e24036b90 0x7f5e24039050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/2104810288 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd3accf60 0x55bbd3acd380 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 >> 172.21.15.99:0/2104810288 conn(0x55bbd3ac1ef0 msgr2=0x55bbd3ac4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 shutdown_connections 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/2104810288 wait complete. 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 msgr2=0x55bbd3ab92a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 0x55bbd3ab92a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 msgr2=0x55bbd3abdf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 0x55bbd3abdf60 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 msgr2=0x7f5e30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 0x7f5e30039000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f34000f60 tx=0x7f5f340012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 msgr2=0x55bbd3ab2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x55bbd392e4a0 tx=0x7f5f3c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 shutdown_connections 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bbd3abbb70 0x55bbd3abdf60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bbd39bae20 0x55bbd3ab92a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5e30036b40 0x7f5e30039000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 --2- 172.21.15.99:0/768254096 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bbd39ba4e0 0x55bbd3ab2230 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 >> 172.21.15.99:0/768254096 conn(0x55bbd39b5dd0 msgr2=0x55bbd3aa39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 shutdown_connections 2024-09-13T23:25:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.592+0000 7f5f4d92a800 1 -- 172.21.15.99:0/768254096 wait complete. 2024-09-13T23:25:55.609 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:55.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:25:55.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T23:25:55.610 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T23:25:55.656 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:55.656 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.655+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.655+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66fad42800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5628b258ce10 0x5628b261c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66fad42800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5628b24d8b30 con 0x5628b261c740 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66fad42800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5628b24ba360 con 0x5628b258ce10 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66f6a97640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5628b258ce10 0x5628b261c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66ee296640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5628b261c740 0x5628b261eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46070/0 (socket says 172.21.15.99:46070) 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66ee296640 1 -- 172.21.15.99:0/368112971 learned_addr learned my addr 172.21.15.99:0/368112971 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66f6a97640 1 -- 172.21.15.99:0/368112971 >> v1:172.21.15.43:6789/0 conn(0x5628b261c740 legacy=0x5628b261eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.656+0000 7f66f6a97640 1 -- 172.21.15.99:0/368112971 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b24e0e00 con 0x5628b258ce10 2024-09-13T23:25:55.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.658+0000 7f66f6a97640 1 --2- 172.21.15.99:0/368112971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b261c200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f66e800a470 tx=0x7f66e8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafc7d85413dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.658+0000 7f66f6296640 1 -- 172.21.15.99:0/368112971 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e8053570 con 0x5628b258ce10 2024-09-13T23:25:55.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.658+0000 7f66f6296640 1 -- 172.21.15.99:0/368112971 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8058070 con 0x5628b258ce10 2024-09-13T23:25:55.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.658+0000 7f66f6296640 1 -- 172.21.15.99:0/368112971 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e8053880 con 0x5628b258ce10 2024-09-13T23:25:55.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 -- 172.21.15.99:0/368112971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 msgr2=0x5628b261c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 --2- 172.21.15.99:0/368112971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b261c200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f66e800a470 tx=0x7f66e8045a20 comp rx=0 tx=0).stop 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 -- 172.21.15.99:0/368112971 shutdown_connections 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 --2- 172.21.15.99:0/368112971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b261c200 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 -- 172.21.15.99:0/368112971 >> 172.21.15.99:0/368112971 conn(0x5628b2613dd0 msgr2=0x5628b26161f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 -- 172.21.15.99:0/368112971 shutdown_connections 2024-09-13T23:25:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.659+0000 7f66fad42800 1 -- 172.21.15.99:0/368112971 wait complete. 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.672+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.672+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66fad42800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66fad42800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5628b2565360 con 0x5628b258ce10 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66f6a97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66f6a97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34346/0 (socket says 172.21.15.99:34346) 2024-09-13T23:25:55.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66f6a97640 1 -- 172.21.15.99:0/1123121055 learned_addr learned my addr 172.21.15.99:0/1123121055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66f6a97640 1 -- 172.21.15.99:0/1123121055 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b24b2bc0 con 0x5628b258ce10 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f66f6a97640 1 --2- 172.21.15.99:0/1123121055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f66e8025c20 tx=0x7f66e8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97aedf3854f2e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f65e4e09640 1 -- 172.21.15.99:0/1123121055 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e805c580 con 0x5628b258ce10 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f65e4e09640 1 -- 172.21.15.99:0/1123121055 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8063030 con 0x5628b258ce10 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.673+0000 7f65e4e09640 1 -- 172.21.15.99:0/1123121055 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e805c850 con 0x5628b258ce10 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 -- 172.21.15.99:0/1123121055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 msgr2=0x5628b2708880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 --2- 172.21.15.99:0/1123121055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f66e8025c20 tx=0x7f66e8051000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 -- 172.21.15.99:0/1123121055 shutdown_connections 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 --2- 172.21.15.99:0/1123121055 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2708880 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 -- 172.21.15.99:0/1123121055 >> 172.21.15.99:0/1123121055 conn(0x5628b2613dd0 msgr2=0x5628b2704240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 -- 172.21.15.99:0/1123121055 shutdown_connections 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 -- 172.21.15.99:0/1123121055 wait complete. 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.674+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66fad42800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66fad42800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5628b2620610 con 0x5628b258ce10 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66f6a97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66f6a97640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34362/0 (socket says 172.21.15.99:34362) 2024-09-13T23:25:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66f6a97640 1 -- 172.21.15.99:0/3780177679 learned_addr learned my addr 172.21.15.99:0/3780177679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.675+0000 7f66f6a97640 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b24c6fe0 con 0x5628b258ce10 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f66f6a97640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x5628b27096e0 tx=0x7f66e8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f65e3606640 1 -- 172.21.15.99:0/3780177679 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e8054ad0 con 0x5628b258ce10 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f65e3606640 1 -- 172.21.15.99:0/3780177679 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e8054c70 con 0x5628b258ce10 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b2618220 con 0x5628b258ce10 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f65e3606640 1 -- 172.21.15.99:0/3780177679 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e8068420 con 0x5628b258ce10 2024-09-13T23:25:55.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b2618740 con 0x5628b258ce10 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.676+0000 7f65e3606640 1 -- 172.21.15.99:0/3780177679 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66e80685c0 con 0x5628b258ce10 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f65e3606640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 0x7f65dc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f65e3606640 1 -- 172.21.15.99:0/3780177679 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f66e8070030 con 0x5628b258ce10 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66ee296640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 0x7f65dc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 0x5628b27195d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2719b10 con 0x5628b261c740 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66f7298640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 0x5628b27195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66ee296640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 0x7f65dc039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66e0000f60 tx=0x7f66e00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.677+0000 7f66f7298640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 0x5628b27195d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66f7298640 1 -- 172.21.15.99:0/3780177679 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66f000a4a0 con 0x5628b261c740 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b271a360 con 0x5628b261c740 2024-09-13T23:25:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66f7298640 1 -- 172.21.15.99:0/3780177679 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66f000a4a0 con 0x5628b261c740 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 0x5628b271e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b271e990 con 0x5628b271bd90 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66f6a97640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 0x5628b271e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66f6a97640 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 0x5628b271e200 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.678+0000 7f66f6a97640 1 -- 172.21.15.99:0/3780177679 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66e8051070 con 0x5628b271bd90 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.679+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b271abb0 con 0x5628b261c740 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.679+0000 7f66f7298640 1 -- 172.21.15.99:0/3780177679 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66f000a4a0 con 0x5628b261c740 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.679+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b271af90 con 0x5628b271bd90 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.679+0000 7f66f6a97640 1 -- 172.21.15.99:0/3780177679 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66e8051070 con 0x5628b271bd90 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.679+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66fad42800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66fad42800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5628b261a070 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34376/0 (socket says 172.21.15.99:34376) 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66f7298640 1 -- 172.21.15.99:0/2941352734 learned_addr learned my addr 172.21.15.99:0/2941352734 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.680+0000 7f66f7298640 1 -- 172.21.15.99:0/2941352734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b272dca0 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f66f7298640 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5628b2618930 tx=0x7f66f00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f65e0e01640 1 -- 172.21.15.99:0/2941352734 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0013450 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f65e0e01640 1 -- 172.21.15.99:0/2941352734 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f00135f0 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b272df30 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f65e0e01640 1 -- 172.21.15.99:0/2941352734 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0013910 con 0x5628b272d340 2024-09-13T23:25:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.681+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b2730c10 con 0x5628b272d340 2024-09-13T23:25:55.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f65e0e01640 1 -- 172.21.15.99:0/2941352734 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66f0011040 con 0x5628b272d340 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f65e0e01640 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 0x7f65d0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f65e0e01640 1 -- 172.21.15.99:0/2941352734 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f66f000e040 con 0x5628b272d340 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 0x7f65d0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.682+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 0x7f65d0039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5628b2618bc0 tx=0x7f66e8060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66fad42800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66fad42800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5628b24b4580 con 0x5628b273a000 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34378/0 (socket says 172.21.15.99:34378) 2024-09-13T23:25:55.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f7298640 1 -- 172.21.15.99:0/3714459381 learned_addr learned my addr 172.21.15.99:0/3714459381 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f7298640 1 -- 172.21.15.99:0/3714459381 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b273a9d0 con 0x5628b273a000 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f66f7298640 1 --2- 172.21.15.99:0/3714459381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f66f004ce00 tx=0x7f66f004d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd785590d894be74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f65da7fc640 1 -- 172.21.15.99:0/3714459381 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0046250 con 0x5628b273a000 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f65da7fc640 1 -- 172.21.15.99:0/3714459381 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f002a440 con 0x5628b273a000 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.683+0000 7f65da7fc640 1 -- 172.21.15.99:0/3714459381 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f001f390 con 0x5628b273a000 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- 172.21.15.99:0/3714459381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 msgr2=0x5628b273a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 --2- 172.21.15.99:0/3714459381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f66f004ce00 tx=0x7f66f004d0b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- 172.21.15.99:0/3714459381 shutdown_connections 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 --2- 172.21.15.99:0/3714459381 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b273a400 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- 172.21.15.99:0/3714459381 >> 172.21.15.99:0/3714459381 conn(0x5628b27363f0 msgr2=0x5628b27344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- 172.21.15.99:0/3714459381 shutdown_connections 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- 172.21.15.99:0/3714459381 wait complete. 2024-09-13T23:25:55.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 Processor -- start 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- start start 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66fad42800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5628b273aea0 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.684+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66f7298640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34384/0 (socket says 172.21.15.99:34384) 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 learned_addr learned my addr 172.21.15.99:0/2205012277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628b27418c0 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66f7298640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66f004cd60 tx=0x7f66f004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f65d8ff9640 1 -- 172.21.15.99:0/2205012277 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0039070 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f65d8ff9640 1 -- 172.21.15.99:0/2205012277 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f004e290 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5628b2741b50 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f65d8ff9640 1 -- 172.21.15.99:0/2205012277 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f004e5b0 con 0x5628b273a000 2024-09-13T23:25:55.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.685+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628b2744800 con 0x5628b273a000 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.686+0000 7f65d8ff9640 1 -- 172.21.15.99:0/2205012277 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f66f003c070 con 0x5628b273a000 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.686+0000 7f65d8ff9640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65c0036b90 0x7f65c0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.686+0000 7f65d8ff9640 1 -- 172.21.15.99:0/2205012277 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f66f003fc00 con 0x5628b273a000 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.686+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65c0036b90 0x7f65c0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65c0036b90 0x7f65c0039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5628b2618cb0 tx=0x7f66e8088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b274cef0 0x5628b274f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b274fb00 con 0x5628b274cef0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66ee296640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b274cef0 0x5628b274f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.687+0000 7f66ee296640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b274cef0 0x5628b274f3b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66e0009050 con 0x5628b274cef0 2024-09-13T23:25:55.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 realm 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b274c340 con 0x5628b274cef0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66e0009050 con 0x5628b274cef0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b27505f0 con 0x5628b274cef0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66e0009050 con 0x5628b274cef0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2750ec0 con 0x5628b274cef0 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66e0009050 con 0x5628b274cef0 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b2751800 0x5628b2753bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2754380 con 0x5628b2751800 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.688+0000 7f66f7298640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b2751800 0x5628b2753bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66f7298640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b2751800 0x5628b2753bf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66fad42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66fad42800 20 searching for the correct realm 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5628b2756350 0x5628b2758810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5628b2756350 0x5628b2758810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.689+0000 7f66f6a97640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5628b2756350 0x5628b2758810 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66f7298640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f66f003e070 0x7f66f004a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66ee296640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f66f003e070 0x7f66f004a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.690+0000 7f66ee296640 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f66f003e070 0x7f66f004a0d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0009050 con 0x7f66f003e070 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0009050 con 0x5628b274cef0 2024-09-13T23:25:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.691+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.692+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.693+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.694+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.695+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2756350 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.696+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x7f66f003e070 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b274cef0 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5628b2758ee0 con 0x5628b2751800 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:55.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.697+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2754da0 con 0x5628b274cef0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2755640 con 0x5628b274cef0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2759360 con 0x5628b2751800 2024-09-13T23:25:55.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 zone default found 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 4 Realm: () 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 zonegroup default 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b2759bb0 con 0x7f66f003e070 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.698+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b275b960 con 0x5628b2756350 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b275bda0 con 0x5628b2756350 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 20 started sync module instance, tier type = 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.699+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275add0 con 0x5628b2751800 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.700+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.700+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94732792738544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275add0 con 0x5628b2751800 2024-09-13T23:25:55.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.700+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275c8d0 con 0x5628b274cef0 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.701+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94732792738544] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.701+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.701+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94732792742816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275add0 con 0x5628b274cef0 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.701+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275d350 con 0x5628b2756350 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.702+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94732792742816] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.702+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.702+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94732792736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275ad40 con 0x5628b2756350 2024-09-13T23:25:55.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.702+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275e140 con 0x5628b2751800 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.703+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94732792736032] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.703+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.703+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94732792747888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275e530 con 0x5628b2751800 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.703+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275ef70 con 0x5628b274cef0 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.704+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.704+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94732792752704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275ef30 con 0x5628b274cef0 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.704+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94732792747888] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.704+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275fee0 con 0x7f66f003e070 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.705+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94732792752704] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.705+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.705+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94732792749024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b275fa30 con 0x7f66f003e070 2024-09-13T23:25:55.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.705+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b27603f0 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.706+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94732792749024] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.706+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.706+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94732792754960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b27603f0 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.706+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2760db0 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94732792754960] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94732792758560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2760db0 con 0x7f66f003e070 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=0 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=1 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=2 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=3 2024-09-13T23:25:55.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=4 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=5 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.707+0000 7f66fad42800 20 add_watcher() i=6 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.708+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94732792758560] v33'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.708+0000 7f66fad42800 20 add_watcher() i=7 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.708+0000 7f66fad42800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.708+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b27641b0 con 0x5628b274cef0 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.709+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.709+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94732792761040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b27616d0 con 0x5628b274cef0 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94732792761040] v33'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f65ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 5 note: GC not initialized 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f6527fff640 20 reqs_thread_entry: start 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 20 Filter name: none 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f6525ffb640 20 reqs_thread_entry: start 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.710+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b27975b0 con 0x5628b274cef0 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66fad42800 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66fad42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66fad42800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66fad42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.711+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b279d870 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66fad42800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66fad42800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66fad42800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94732793008688 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5628b279c310 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== watch-notify(notify (1) cookie 94732792752704 notify 141733920791 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5628b24d8b30 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f65da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 94732792752704 notifier 4668 bl.length()=567 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f65da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(64 notify.4 [notify cookie 94732793008688 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f65da7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.712+0000 7f65da7fc640 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f65bc003ea0 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.713+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.713+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== watch-notify(notify_complete (2) cookie 94732793008688 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f66e002f670 con 0x5628b274cef0 2024-09-13T23:25:55.728 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T23:25:32.106847Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:25:32.106836Z","tags":[],"group_ids":[]} 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.714+0000 7f65ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.714+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94732792761040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b274cef0 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.715+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94732792761040] v33'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.715+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94732792738544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b2751800 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.716+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94732792738544] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.716+0000 7f66fad42800 20 remove_watcher() i=0 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.716+0000 7f66fad42800 2 removed watcher, disabling cache 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.716+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94732792742816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b274cef0 2024-09-13T23:25:55.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.717+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94732792742816] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.717+0000 7f66fad42800 20 remove_watcher() i=1 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.717+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94732792736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b2756350 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.718+0000 7f66f6a97640 1 -- 172.21.15.99:0/2205012277 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94732792736032] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e8051070 con 0x5628b2756350 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.718+0000 7f66fad42800 20 remove_watcher() i=2 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.718+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94732792747888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b2751800 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.719+0000 7f66f7298640 1 -- 172.21.15.99:0/2205012277 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94732792747888] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66f003b030 con 0x5628b2751800 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.719+0000 7f66fad42800 20 remove_watcher() i=3 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.719+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94732792752704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x5628b274cef0 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.720+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94732792752704] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x5628b274cef0 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.720+0000 7f66fad42800 20 remove_watcher() i=4 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.720+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94732792749024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x7f66f003e070 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.721+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94732792749024] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.721+0000 7f66fad42800 20 remove_watcher() i=5 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.721+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94732792754960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x7f66f003e070 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.722+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94732792754960] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.722+0000 7f66fad42800 20 remove_watcher() i=6 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.722+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94732792758560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5628b2795320 con 0x7f66f003e070 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94732792758560] v33'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66e0029040 con 0x7f66f003e070 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 20 remove_watcher() i=7 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f66f003e070 msgr2=0x7f66f004a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f66f003e070 0x7f66f004a0d0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b274cef0 msgr2=0x5628b274f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b274cef0 0x5628b274f3b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b2751800 msgr2=0x5628b2753bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b2751800 0x5628b2753bf0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5628b2756350 msgr2=0x5628b2758810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5628b2756350 0x5628b2758810 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65c0036b90 msgr2=0x7f65c0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65c0036b90 0x7f65c0039050 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5628b2618cb0 tx=0x7f66e8088000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 msgr2=0x5628b2741380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f66f004cd60 tx=0x7f66f004cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66ee296640 1 -- 172.21.15.99:0/2205012277 reap_dead start 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 shutdown_connections 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2205012277 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b273a000 0x5628b2741380 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 >> 172.21.15.99:0/2205012277 conn(0x5628b27363f0 msgr2=0x5628b27344c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 shutdown_connections 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2205012277 wait complete. 2024-09-13T23:25:55.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 msgr2=0x7f65d0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 0x7f65d0039050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5628b2618bc0 tx=0x7f66e8060ee0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 msgr2=0x5628b272d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x5628b2618930 tx=0x7f66f00163e0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 shutdown_connections 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65d0036b90 0x7f65d0039050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 --2- 172.21.15.99:0/2941352734 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b272d340 0x5628b272d760 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 >> 172.21.15.99:0/2941352734 conn(0x5628b27222d0 msgr2=0x5628b2724e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 shutdown_connections 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.723+0000 7f66fad42800 1 -- 172.21.15.99:0/2941352734 wait complete. 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 msgr2=0x5628b27195d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 0x5628b27195d0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 msgr2=0x5628b271e200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 0x5628b271e200 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 msgr2=0x7f65dc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 0x7f65dc039050 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66e0000f60 tx=0x7f66e00012b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 msgr2=0x5628b2619b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x5628b27096e0 tx=0x7f66e8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 shutdown_connections 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5628b271bd90 0x5628b271e200 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5628b261c740 0x5628b27195d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f65dc036b90 0x7f65dc039050 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 --2- 172.21.15.99:0/3780177679 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5628b258ce10 0x5628b2619b30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 >> 172.21.15.99:0/3780177679 conn(0x5628b2613dd0 msgr2=0x5628b2702af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 shutdown_connections 2024-09-13T23:25:55.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.724+0000 7f66fad42800 1 -- 172.21.15.99:0/3780177679 wait complete. 2024-09-13T23:25:55.739 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T23:25:32.106847Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:25:32.106836Z', 'tags': [], 'group_ids': []} 2024-09-13T23:25:55.751 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:55.752 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:55.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T23:25:55.752 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T23:25:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:25:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f764d815800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bf6e2364c0 0x55bf6e2368c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f764d815800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bf6e0f6b30 con 0x55bf6e236e00 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f764d815800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55bf6e0d8360 con 0x55bf6e2364c0 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f7648f9c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55bf6e2364c0 0x55bf6e2368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f7643fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55bf6e236e00 0x55bf6e23b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46082/0 (socket says 172.21.15.99:46082) 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f7643fff640 1 -- 172.21.15.99:0/780931230 learned_addr learned my addr 172.21.15.99:0/780931230 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f76437fe640 1 -- 172.21.15.99:0/780931230 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125186556 0 0) 0x55bf6e0f6b30 con 0x55bf6e236e00 2024-09-13T23:25:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f76437fe640 1 -- 172.21.15.99:0/780931230 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7638001e10 con 0x55bf6e236e00 2024-09-13T23:25:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f7648f9c640 1 -- 172.21.15.99:0/780931230 >> v1:172.21.15.43:6789/0 conn(0x55bf6e236e00 legacy=0x55bf6e23b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.796+0000 7f7648f9c640 1 -- 172.21.15.99:0/780931230 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e0fee00 con 0x55bf6e2364c0 2024-09-13T23:25:55.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.798+0000 7f7648f9c640 1 --2- 172.21.15.99:0/780931230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e2368c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f763c00a470 tx=0x7f763c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e806169e31a62f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.798+0000 7f76437fe640 1 -- 172.21.15.99:0/780931230 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c059070 con 0x55bf6e2364c0 2024-09-13T23:25:55.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.798+0000 7f76437fe640 1 -- 172.21.15.99:0/780931230 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c054570 con 0x55bf6e2364c0 2024-09-13T23:25:55.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.798+0000 7f76437fe640 1 -- 172.21.15.99:0/780931230 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c054850 con 0x55bf6e2364c0 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 -- 172.21.15.99:0/780931230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 msgr2=0x55bf6e2368c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 --2- 172.21.15.99:0/780931230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e2368c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f763c00a470 tx=0x7f763c045920 comp rx=0 tx=0).stop 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 -- 172.21.15.99:0/780931230 shutdown_connections 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 --2- 172.21.15.99:0/780931230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e2368c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 -- 172.21.15.99:0/780931230 >> 172.21.15.99:0/780931230 conn(0x55bf6e231df0 msgr2=0x55bf6e234210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 -- 172.21.15.99:0/780931230 shutdown_connections 2024-09-13T23:25:55.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.799+0000 7f764d815800 1 -- 172.21.15.99:0/780931230 wait complete. 2024-09-13T23:25:55.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.812+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.812+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f764d815800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f764d815800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf6e183330 con 0x55bf6e2364c0 2024-09-13T23:25:55.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7648f9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7648f9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34404/0 (socket says 172.21.15.99:34404) 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7648f9c640 1 -- 172.21.15.99:0/4081739956 learned_addr learned my addr 172.21.15.99:0/4081739956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7648f9c640 1 -- 172.21.15.99:0/4081739956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e0d0bc0 con 0x55bf6e2364c0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7648f9c640 1 --2- 172.21.15.99:0/4081739956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f763c025b20 tx=0x7f763c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cd6c30d5bfc936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7536e05640 1 -- 172.21.15.99:0/4081739956 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c062070 con 0x55bf6e2364c0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7536e05640 1 -- 172.21.15.99:0/4081739956 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c00a230 con 0x55bf6e2364c0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.813+0000 7f7536e05640 1 -- 172.21.15.99:0/4081739956 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c059040 con 0x55bf6e2364c0 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 -- 172.21.15.99:0/4081739956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 msgr2=0x55bf6e324480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 --2- 172.21.15.99:0/4081739956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f763c025b20 tx=0x7f763c04e000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 -- 172.21.15.99:0/4081739956 shutdown_connections 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 --2- 172.21.15.99:0/4081739956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e324480 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 -- 172.21.15.99:0/4081739956 >> 172.21.15.99:0/4081739956 conn(0x55bf6e231df0 msgr2=0x55bf6e31fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 -- 172.21.15.99:0/4081739956 shutdown_connections 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.814+0000 7f764d815800 1 -- 172.21.15.99:0/4081739956 wait complete. 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f764d815800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f764d815800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf6e23d4e0 con 0x55bf6e2364c0 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f7648f9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f7648f9c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34408/0 (socket says 172.21.15.99:34408) 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f7648f9c640 1 -- 172.21.15.99:0/3178352239 learned_addr learned my addr 172.21.15.99:0/3178352239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f7648f9c640 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e0e4fe0 con 0x55bf6e2364c0 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.815+0000 7f7648f9c640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f763c045960 tx=0x7f763c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f7535602640 1 -- 172.21.15.99:0/3178352239 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c062070 con 0x55bf6e2364c0 2024-09-13T23:25:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f7535602640 1 -- 172.21.15.99:0/3178352239 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763c054910 con 0x55bf6e2364c0 2024-09-13T23:25:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf6e330780 con 0x55bf6e2364c0 2024-09-13T23:25:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f7535602640 1 -- 172.21.15.99:0/3178352239 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f763c059040 con 0x55bf6e2364c0 2024-09-13T23:25:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6e330ca0 con 0x55bf6e2364c0 2024-09-13T23:25:55.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.816+0000 7f7535602640 1 -- 172.21.15.99:0/3178352239 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f763c065040 con 0x55bf6e2364c0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f7535602640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 0x7f7530039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f7535602640 1 -- 172.21.15.99:0/3178352239 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f763c08fa10 con 0x55bf6e2364c0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f7643fff640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 0x7f7530039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 0x55bf6e3372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3377f0 con 0x55bf6e236e00 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764979d640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 0x55bf6e3372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f7643fff640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 0x7f7530039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f60 tx=0x7f76340010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764979d640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 0x55bf6e3372b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764979d640 1 -- 172.21.15.99:0/3178352239 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e236e00 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.817+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e334860 con 0x55bf6e236e00 2024-09-13T23:25:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f764979d640 1 -- 172.21.15.99:0/3178352239 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e236e00 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 0x55bf6e33beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e33c550 con 0x55bf6e339ac0 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f7648f9c640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 0x55bf6e33beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f7648f9c640 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 0x55bf6e33beb0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f7648f9c640 1 -- 172.21.15.99:0/3178352239 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f763c05c040 con 0x55bf6e339ac0 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.818+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e338960 con 0x55bf6e236e00 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764979d640 1 -- 172.21.15.99:0/3178352239 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e236e00 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e338e40 con 0x55bf6e339ac0 2024-09-13T23:25:55.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f7648f9c640 1 -- 172.21.15.99:0/3178352239 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f763c05c040 con 0x55bf6e339ac0 2024-09-13T23:25:55.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764d815800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.819+0000 7f764d815800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf6e0d2580 con 0x55bf6e34aed0 2024-09-13T23:25:55.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34418/0 (socket says 172.21.15.99:34418) 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764979d640 1 -- 172.21.15.99:0/1499392805 learned_addr learned my addr 172.21.15.99:0/1499392805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764979d640 1 -- 172.21.15.99:0/1499392805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e34b830 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764979d640 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55bf6e3312f0 tx=0x7f76440167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f752e7fc640 1 -- 172.21.15.99:0/1499392805 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7644013640 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f752e7fc640 1 -- 172.21.15.99:0/1499392805 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76440137e0 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f752e7fc640 1 -- 172.21.15.99:0/1499392805 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7644013ae0 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf6e34bac0 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.820+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6e34e7a0 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.821+0000 7f752e7fc640 1 -- 172.21.15.99:0/1499392805 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7644011040 con 0x55bf6e34aed0 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.821+0000 7f752e7fc640 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 0x7f75200390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.821+0000 7f752e7fc640 1 -- 172.21.15.99:0/1499392805 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f764400e040 con 0x55bf6e34aed0 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.821+0000 7f7648f9c640 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 0x7f75200390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.821+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f7648f9c640 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 0x7f75200390c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f763c06ffd0 tx=0x7f763c08dd80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764d815800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764d815800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf6e324b70 con 0x55bf6e357b40 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34434/0 (socket says 172.21.15.99:34434) 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764979d640 1 -- 172.21.15.99:0/1639247952 learned_addr learned my addr 172.21.15.99:0/1639247952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764979d640 1 -- 172.21.15.99:0/1639247952 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e358510 con 0x55bf6e357b40 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f764979d640 1 --2- 172.21.15.99:0/1639247952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f764400afb0 tx=0x7f764401fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a41597627acf358 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f751ffff640 1 -- 172.21.15.99:0/1639247952 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7644021440 con 0x55bf6e357b40 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f751ffff640 1 -- 172.21.15.99:0/1639247952 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764401f340 con 0x55bf6e357b40 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.822+0000 7f751ffff640 1 -- 172.21.15.99:0/1639247952 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76440215e0 con 0x55bf6e357b40 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- 172.21.15.99:0/1639247952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 msgr2=0x55bf6e357f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 --2- 172.21.15.99:0/1639247952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f764400afb0 tx=0x7f764401fce0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- 172.21.15.99:0/1639247952 shutdown_connections 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 --2- 172.21.15.99:0/1639247952 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e357f40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- 172.21.15.99:0/1639247952 >> 172.21.15.99:0/1639247952 conn(0x55bf6e353ef0 msgr2=0x55bf6e351ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- 172.21.15.99:0/1639247952 shutdown_connections 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- 172.21.15.99:0/1639247952 wait complete. 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 Processor -- start 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- start start 2024-09-13T23:25:55.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.823+0000 7f764d815800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55bf6e358b20 con 0x55bf6e357b40 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764979d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34448/0 (socket says 172.21.15.99:34448) 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 learned_addr learned my addr 172.21.15.99:0/751691978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf6e35f600 con 0x55bf6e357b40 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764979d640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f764404cd60 tx=0x7f764404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f751e7fc640 1 -- 172.21.15.99:0/751691978 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7644040360 con 0x55bf6e357b40 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f751e7fc640 1 -- 172.21.15.99:0/751691978 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764404e270 con 0x55bf6e357b40 2024-09-13T23:25:55.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bf6e35f890 con 0x55bf6e357b40 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f751e7fc640 1 -- 172.21.15.99:0/751691978 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f764404e570 con 0x55bf6e357b40 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.824+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf6e362540 con 0x55bf6e357b40 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.825+0000 7f751e7fc640 1 -- 172.21.15.99:0/751691978 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f764403b060 con 0x55bf6e357b40 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.825+0000 7f751e7fc640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7514036be0 0x7f75140390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.825+0000 7f751e7fc640 1 -- 172.21.15.99:0/751691978 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f764404e070 con 0x55bf6e357b40 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.825+0000 7f7648f9c640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7514036be0 0x7f75140390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f7648f9c640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7514036be0 0x7f75140390a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f763c08e110 tx=0x7f763c087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e36aac0 0x55bf6e36cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e36d6d0 con 0x55bf6e36aac0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f7643fff640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e36aac0 0x55bf6e36cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.826+0000 7f7643fff640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e36aac0 0x55bf6e36cf80 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 realm 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e369f10 con 0x55bf6e36aac0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e36e1c0 con 0x55bf6e36aac0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e36ea90 con 0x55bf6e36aac0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e36f4b0 0x55bf6e3718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.827+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e371f90 con 0x55bf6e36f4b0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764979d640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e36f4b0 0x55bf6e3718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764979d640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e36f4b0 0x55bf6e3718a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764d815800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764d815800 20 searching for the correct realm 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf6e373f60 0x55bf6e376420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f7648f9c640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf6e373f60 0x55bf6e376420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.828+0000 7f7648f9c640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf6e373f60 0x55bf6e376420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f764979d640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7644044070 0x7f7644012760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.829+0000 7f7643fff640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7644044070 0x7f7644012760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7644044070 0x7f7644012760 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.830+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.831+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.832+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.833+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.834+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.835+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f764400a4a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e373f60 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x7f7644044070 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36aac0 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.836+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376af0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e372950 con 0x55bf6e36aac0 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3731f0 con 0x55bf6e36aac0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7634009050 con 0x55bf6e36aac0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e376f70 con 0x55bf6e36f4b0 2024-09-13T23:25:55.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 20 zone default found 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 4 Realm: () 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.837+0000 7f764d815800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:25:55.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 zonegroup default 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3777c0 con 0x7f7644044070 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7634009050 con 0x7f7644044070 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e379540 con 0x55bf6e373f60 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3799a0 con 0x55bf6e373f60 2024-09-13T23:25:55.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 started sync module instance, tier type = 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.838+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3789e0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.839+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.839+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94280676249040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e378640 con 0x55bf6e36f4b0 2024-09-13T23:25:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.839+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37a7c0 con 0x55bf6e36aac0 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.840+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94280676249040] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.841+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.841+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94280676253184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37a780 con 0x55bf6e36aac0 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.841+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37b270 con 0x55bf6e373f60 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.842+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94280676253184] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.842+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.842+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94280676257056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37b660 con 0x55bf6e373f60 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.842+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37c0a0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.843+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.843+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94280676257056] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.843+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94280676254240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37c490 con 0x55bf6e36f4b0 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.843+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ceb0 con 0x55bf6e36aac0 2024-09-13T23:25:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.844+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94280676254240] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.844+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.844+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94280676264352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ce70 con 0x55bf6e36aac0 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.844+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37d8e0 con 0x7f7644044070 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.845+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.845+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94280676264352] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.845+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94280676267024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37d8e0 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.845+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37bbb0 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.846+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94280676267024] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.846+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.846+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94280676260784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37e2f0 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.846+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ecb0 con 0x7f7644044070 2024-09-13T23:25:55.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94280676272128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37f0d0 con 0x7f7644044070 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=0 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=1 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=2 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=3 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=4 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=5 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94280676260784] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.847+0000 7f764d815800 20 add_watcher() i=6 2024-09-13T23:25:55.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.848+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94280676272128] v33'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.848+0000 7f764d815800 20 add_watcher() i=7 2024-09-13T23:25:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.848+0000 7f764d815800 2 all 8 watchers are set, enabling cache 2024-09-13T23:25:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.848+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37f0d0 con 0x55bf6e36aac0 2024-09-13T23:25:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.848+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.849+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94280676273184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37f040 con 0x55bf6e36aac0 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.849+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94280676273184] v33'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.849+0000 7f74fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.850+0000 7f764d815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.850+0000 7f764d815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.850+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38abc0 con 0x55bf6e36aac0 2024-09-13T23:25:55.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.851+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.851+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38b210 con 0x7f7644044070 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.852+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.852+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38b670 con 0x55bf6e373f60 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.853+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.853+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38bbe0 con 0x55bf6e36aac0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.854+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.854+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c090 con 0x55bf6e36f4b0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.855+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.855+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c090 con 0x55bf6e373f60 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.856+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.856+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c4d0 con 0x55bf6e36aac0 2024-09-13T23:25:55.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.857+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.857+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c4d0 con 0x7f7644044070 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.858+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.858+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c4d0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.859+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.859+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c4d0 con 0x55bf6e373f60 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.860+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.860+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c4d0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.861+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.861+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x7f7644044070 2024-09-13T23:25:55.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.862+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.862+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e36f4b0 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.863+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.863+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x7f7644044070 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.864+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'51 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.864+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e36aac0 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.865+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.865+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e373f60 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.866+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.866+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e36f4b0 2024-09-13T23:25:55.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.867+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.867+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e373f60 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.868+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.868+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e36aac0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.869+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'34 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.869+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e36aac0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.870+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.870+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38c580 con 0x55bf6e373f60 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.871+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'62 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.871+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.872+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.872+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.873+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.873+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.874+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.874+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.875+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.875+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.876+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.876+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x7f7644044070 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.877+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.877+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.878+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.878+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x7f7644044070 2024-09-13T23:25:55.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.879+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.879+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e373f60 2024-09-13T23:25:55.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.881+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'63 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.881+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x7f7644044070 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.882+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.882+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e38cae0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'32 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f74fdfe3640 20 reqs_thread_entry: start 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764d815800 20 init_complete bucket index max shards: 11 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764d815800 20 Filter name: none 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f746f7fe640 20 reqs_thread_entry: start 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764d815800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764d815800 20 rados->read ofs=0 len=0 2024-09-13T23:25:55.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.883+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3b7770 con 0x55bf6e36aac0 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764d815800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764d815800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764d815800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764d815800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:25:55.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3b76c0 con 0x55bf6e36f4b0 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.884+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.885+0000 7f74fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.885+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94280676273184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e3899c0 con 0x55bf6e36aac0 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.886+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94280676273184] v33'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.886+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94280676249040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ec20 con 0x55bf6e36f4b0 2024-09-13T23:25:55.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.887+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94280676249040] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.887+0000 7f764d815800 20 remove_watcher() i=0 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.887+0000 7f764d815800 2 removed watcher, disabling cache 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.887+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94280676253184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ec20 con 0x55bf6e36aac0 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.888+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94280676253184] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.888+0000 7f764d815800 20 remove_watcher() i=1 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.888+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94280676257056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e379e00 con 0x55bf6e373f60 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.889+0000 7f7648f9c640 1 -- 172.21.15.99:0/751691978 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94280676257056] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f763c081040 con 0x55bf6e373f60 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.889+0000 7f764d815800 20 remove_watcher() i=2 2024-09-13T23:25:55.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.889+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94280676254240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ec20 con 0x55bf6e36f4b0 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.890+0000 7f764979d640 1 -- 172.21.15.99:0/751691978 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94280676254240] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7644060040 con 0x55bf6e36f4b0 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.890+0000 7f764d815800 20 remove_watcher() i=3 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.890+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94280676264352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ec20 con 0x55bf6e36aac0 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.891+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94280676264352] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x55bf6e36aac0 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.891+0000 7f764d815800 20 remove_watcher() i=4 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.891+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94280676267024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37c9a0 con 0x7f7644044070 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.892+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94280676267024] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.892+0000 7f764d815800 20 remove_watcher() i=5 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.892+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94280676260784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37ec20 con 0x7f7644044070 2024-09-13T23:25:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.893+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94280676260784] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.893+0000 7f764d815800 20 remove_watcher() i=6 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.893+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94280676272128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55bf6e37bbb0 con 0x7f7644044070 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94280676272128] v33'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7634038040 con 0x7f7644044070 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 20 remove_watcher() i=7 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7644044070 msgr2=0x7f7644012760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7644044070 0x7f7644012760 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e36aac0 msgr2=0x55bf6e36cf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e36aac0 0x55bf6e36cf80 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e36f4b0 msgr2=0x55bf6e3718a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e36f4b0 0x55bf6e3718a0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf6e373f60 msgr2=0x55bf6e376420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.894+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55bf6e373f60 0x55bf6e376420 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7514036be0 msgr2=0x7f75140390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7514036be0 0x7f75140390a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f763c08e110 tx=0x7f763c087000 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 msgr2=0x55bf6e35f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f7643fff640 1 -- 172.21.15.99:0/751691978 reap_dead start 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f764404cd60 tx=0x7f764404cd90 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 shutdown_connections 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/751691978 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e357b40 0x55bf6e35f0c0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 >> 172.21.15.99:0/751691978 conn(0x55bf6e353ef0 msgr2=0x55bf6e359280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 shutdown_connections 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/751691978 wait complete. 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 msgr2=0x7f75200390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 0x7f75200390c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f763c06ffd0 tx=0x7f763c08dd80 comp rx=0 tx=0).stop 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 msgr2=0x55bf6e34b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55bf6e3312f0 tx=0x7f76440167b0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 shutdown_connections 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7520036c00 0x7f75200390c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/1499392805 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e34aed0 0x55bf6e34b2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 >> 172.21.15.99:0/1499392805 conn(0x55bf6e33fe60 msgr2=0x55bf6e3429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 shutdown_connections 2024-09-13T23:25:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/1499392805 wait complete. 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 msgr2=0x55bf6e3372b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 0x55bf6e3372b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 msgr2=0x55bf6e33beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.895+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 0x55bf6e33beb0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 msgr2=0x7f7530039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 0x7f7530039050 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7634000f60 tx=0x7f76340010a0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 msgr2=0x55bf6e330240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f763c045960 tx=0x7f763c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 shutdown_connections 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55bf6e339ac0 0x55bf6e33beb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55bf6e236e00 0x55bf6e3372b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7530036b90 0x7f7530039050 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 --2- 172.21.15.99:0/3178352239 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55bf6e2364c0 0x55bf6e330240 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:25:55.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 >> 172.21.15.99:0/3178352239 conn(0x55bf6e231df0 msgr2=0x55bf6e31e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:25:55.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 shutdown_connections 2024-09-13T23:25:55.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:25:55.896+0000 7f764d815800 1 -- 172.21.15.99:0/3178352239 wait complete. 2024-09-13T23:25:55.905 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:25:55.921 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:25:55.927 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T23:26:30.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:26:30.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T23:26:30.928 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T23:26:30.982 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.979+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.979+0000 7f4862506800 1 -- start start 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f4862506800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e339949dd0 0x55e3399db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f4862506800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e339895b30 con 0x55e3399dbb40 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f4862506800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55e339877360 con 0x55e339949dd0 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f485fffa640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e339949dd0 0x55e3399db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f485f7f9640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55e3399dbb40 0x55e3399ddf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46892/0 (socket says 172.21.15.99:46892) 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.980+0000 7f485f7f9640 1 -- 172.21.15.99:0/1882927132 learned_addr learned my addr 172.21.15.99:0/1882927132 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.981+0000 7f485fffa640 1 -- 172.21.15.99:0/1882927132 >> v1:172.21.15.43:6789/0 conn(0x55e3399dbb40 legacy=0x55e3399ddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:30.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.981+0000 7f485fffa640 1 -- 172.21.15.99:0/1882927132 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33989de00 con 0x55e339949dd0 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.982+0000 7f485fffa640 1 --2- 172.21.15.99:0/1882927132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e3399db600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4850005fd0 tx=0x7f4850045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682ffe9c2d2b2035 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f485eff8640 1 -- 172.21.15.99:0/1882927132 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4850058530 con 0x55e339949dd0 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f485eff8640 1 -- 172.21.15.99:0/1882927132 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48500586d0 con 0x55e339949dd0 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f485eff8640 1 -- 172.21.15.99:0/1882927132 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48500589d0 con 0x55e339949dd0 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 -- 172.21.15.99:0/1882927132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 msgr2=0x55e3399db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 --2- 172.21.15.99:0/1882927132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e3399db600 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f4850005fd0 tx=0x7f4850045c30 comp rx=0 tx=0).stop 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 -- 172.21.15.99:0/1882927132 shutdown_connections 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 --2- 172.21.15.99:0/1882927132 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e3399db600 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 -- 172.21.15.99:0/1882927132 >> 172.21.15.99:0/1882927132 conn(0x55e3399d0df0 msgr2=0x55e3399d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:30.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 -- 172.21.15.99:0/1882927132 shutdown_connections 2024-09-13T23:26:30.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.983+0000 7f4862506800 1 -- 172.21.15.99:0/1882927132 wait complete. 2024-09-13T23:26:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.999+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.999+0000 7f4862506800 1 -- start start 2024-09-13T23:26:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:30.999+0000 7f4862506800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f4862506800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e339922330 con 0x55e339949dd0 2024-09-13T23:26:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f485fffa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f485fffa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56274/0 (socket says 172.21.15.99:56274) 2024-09-13T23:26:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f485fffa640 1 -- 172.21.15.99:0/1526856429 learned_addr learned my addr 172.21.15.99:0/1526856429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f485fffa640 1 -- 172.21.15.99:0/1526856429 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33986fbc0 con 0x55e339949dd0 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.000+0000 7f485fffa640 1 --2- 172.21.15.99:0/1526856429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f485000a3f0 tx=0x7f4850051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d8f8da56102a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f474de0b640 1 -- 172.21.15.99:0/1526856429 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48500589b0 con 0x55e339949dd0 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f474de0b640 1 -- 172.21.15.99:0/1526856429 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4850068070 con 0x55e339949dd0 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f474de0b640 1 -- 172.21.15.99:0/1526856429 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4850058c80 con 0x55e339949dd0 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 -- 172.21.15.99:0/1526856429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 msgr2=0x55e339ac7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 --2- 172.21.15.99:0/1526856429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f485000a3f0 tx=0x7f4850051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 -- 172.21.15.99:0/1526856429 shutdown_connections 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 --2- 172.21.15.99:0/1526856429 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339ac7ae0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 -- 172.21.15.99:0/1526856429 >> 172.21.15.99:0/1526856429 conn(0x55e3399d0df0 msgr2=0x55e339ac34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 -- 172.21.15.99:0/1526856429 shutdown_connections 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.001+0000 7f4862506800 1 -- 172.21.15.99:0/1526856429 wait complete. 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f4862506800 1 -- start start 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f4862506800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f4862506800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3399df8f0 con 0x55e339949dd0 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f485fffa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f485fffa640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56282/0 (socket says 172.21.15.99:56282) 2024-09-13T23:26:31.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f485fffa640 1 -- 172.21.15.99:0/2676794612 learned_addr learned my addr 172.21.15.99:0/2676794612 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.002+0000 7f485fffa640 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e339883fe0 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f485fffa640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4850065040 tx=0x7f4850003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f4747fff640 1 -- 172.21.15.99:0/2676794612 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4850063650 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f4747fff640 1 -- 172.21.15.99:0/2676794612 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48500637f0 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e339acf950 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f4747fff640 1 -- 172.21.15.99:0/2676794612 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4850063af0 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.003+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e339acfe70 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f4747fff640 1 -- 172.21.15.99:0/2676794612 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4850074020 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f4747fff640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 0x7f4748039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f4747fff640 1 -- 172.21.15.99:0/2676794612 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f48500908c0 con 0x55e339949dd0 2024-09-13T23:26:31.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f485f7f9640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 0x7f4748039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 0x55e339ad6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339ad69c0 con 0x55e3399dbb40 2024-09-13T23:26:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f48607fb640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 0x55e339ad6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.004+0000 7f485f7f9640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 0x7f4748039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4854000f60 tx=0x7f48540012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f48607fb640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 0x55e339ad6480 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f48607fb640 1 -- 172.21.15.99:0/2676794612 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48580083e0 con 0x55e3399dbb40 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339ad3a30 con 0x55e3399dbb40 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f48607fb640 1 -- 172.21.15.99:0/2676794612 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48580083e0 con 0x55e3399dbb40 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 0x55e339adb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339adb770 con 0x55e339ad8c90 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.005+0000 7f485fffa640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 0x55e339adb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.006+0000 7f485fffa640 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 0x55e339adb080 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.006+0000 7f485fffa640 1 -- 172.21.15.99:0/2676794612 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f485006c450 con 0x55e339ad8c90 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.006+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339ad7b30 con 0x55e3399dbb40 2024-09-13T23:26:31.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.006+0000 7f48607fb640 1 -- 172.21.15.99:0/2676794612 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48580083e0 con 0x55e3399dbb40 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.006+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339ad7f90 con 0x55e339ad8c90 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.007+0000 7f485fffa640 1 -- 172.21.15.99:0/2676794612 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f485006c450 con 0x55e339ad8c90 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.007+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.007+0000 7f4862506800 1 -- start start 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.007+0000 7f4862506800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.007+0000 7f4862506800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e339871580 con 0x55e339aea0f0 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56290/0 (socket says 172.21.15.99:56290) 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f48607fb640 1 -- 172.21.15.99:0/2063628073 learned_addr learned my addr 172.21.15.99:0/2063628073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f48607fb640 1 -- 172.21.15.99:0/2063628073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e339aeaa50 con 0x55e339aea0f0 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f48607fb640 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55e339ad04c0 tx=0x7f485800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f47457fa640 1 -- 172.21.15.99:0/2063628073 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f485801c020 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f47457fa640 1 -- 172.21.15.99:0/2063628073 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858007c30 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e339aeace0 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.008+0000 7f47457fa640 1 -- 172.21.15.99:0/2063628073 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858018440 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.009+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e339aed9c0 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.009+0000 7f47457fa640 1 -- 172.21.15.99:0/2063628073 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f485801f020 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.009+0000 7f47457fa640 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 0x7f4738039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f47457fa640 1 -- 172.21.15.99:0/2063628073 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f485804e1c0 con 0x55e339aea0f0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f485fffa640 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 0x7f4738039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f4862506800 1 -- start start 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f485fffa640 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 0x7f4738039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e339ad7240 tx=0x7f485004e350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f4862506800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.010+0000 7f4862506800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e339ac81d0 con 0x55e339af6d50 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56302/0 (socket says 172.21.15.99:56302) 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f48607fb640 1 -- 172.21.15.99:0/1456470675 learned_addr learned my addr 172.21.15.99:0/1456470675 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f48607fb640 1 -- 172.21.15.99:0/1456470675 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e339af7690 con 0x55e339af6d50 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f48607fb640 1 --2- 172.21.15.99:0/1456470675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f485804c690 tx=0x7f48580216d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c2adc6d3368db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f473effd640 1 -- 172.21.15.99:0/1456470675 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858029480 con 0x55e339af6d50 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f473effd640 1 -- 172.21.15.99:0/1456470675 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858029c70 con 0x55e339af6d50 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.011+0000 7f473effd640 1 -- 172.21.15.99:0/1456470675 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858018670 con 0x55e339af6d50 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- 172.21.15.99:0/1456470675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 msgr2=0x55e339af7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 --2- 172.21.15.99:0/1456470675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f485804c690 tx=0x7f48580216d0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- 172.21.15.99:0/1456470675 shutdown_connections 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 --2- 172.21.15.99:0/1456470675 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339af7150 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- 172.21.15.99:0/1456470675 >> 172.21.15.99:0/1456470675 conn(0x55e339af3100 msgr2=0x55e339af1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- 172.21.15.99:0/1456470675 shutdown_connections 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- 172.21.15.99:0/1456470675 wait complete. 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 Processor -- start 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- start start 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339afe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.012+0000 7f4862506800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e339af7d30 con 0x55e339af6d50 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339afe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f48607fb640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339afe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56320/0 (socket says 172.21.15.99:56320) 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 learned_addr learned my addr 172.21.15.99:0/728714187 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e339afe680 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f48607fb640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339afe140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f48580168b0 tx=0x7f485804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f473d7fa640 1 -- 172.21.15.99:0/728714187 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48580296e0 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f473d7fa640 1 -- 172.21.15.99:0/728714187 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858029880 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e339afe910 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f473d7fa640 1 -- 172.21.15.99:0/728714187 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4858020a50 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.013+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e339afe910 con 0x55e339af6d50 2024-09-13T23:26:31.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.014+0000 7f473d7fa640 1 -- 172.21.15.99:0/728714187 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4858016040 con 0x55e339af6d50 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.014+0000 7f473d7fa640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4728036b40 0x7f4728039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.014+0000 7f473d7fa640 1 -- 172.21.15.99:0/728714187 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f485804fd10 con 0x55e339af6d50 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.014+0000 7f485fffa640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4728036b40 0x7f4728039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e339b09a70 0x55e339b0bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b0c680 con 0x55e339b09a70 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f485f7f9640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e339b09a70 0x55e339b0bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f485fffa640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4728036b40 0x7f4728039000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f485004e440 tx=0x7f4850095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f485f7f9640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e339b09a70 0x55e339b0bf30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4854009050 con 0x55e339b09a70 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 20 realm 2024-09-13T23:26:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.015+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b08ec0 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4854009050 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b0d160 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4854009050 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b0da30 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4854009050 con 0x55e339b09a70 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339b0e2e0 0x55e339b106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b10e10 con 0x55e339b0e2e0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f48607fb640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339b0e2e0 0x55e339b106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.016+0000 7f48607fb640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339b0e2e0 0x55e339b106d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4858057040 con 0x55e339b0e2e0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f4862506800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f4862506800 20 searching for the correct realm 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e339b12ee0 0x55e339b153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f485fffa640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e339b12ee0 0x55e339b153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.017+0000 7f485fffa640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e339b12ee0 0x55e339b153a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4858057040 con 0x55e339b0e2e0 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f48607fb640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4858021020 0x7f48580203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f485f7f9640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4858021020 0x7f48580203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.018+0000 7f485f7f9640 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4858021020 0x7f48580203b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854009050 con 0x7f4858021020 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854009050 con 0x55e339b09a70 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.019+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4858057040 con 0x55e339b0e2e0 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.020+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.021+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4858057040 con 0x55e339b0e2e0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.022+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.023+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4858057040 con 0x55e339b0e2e0 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.024+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.025+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b12ee0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.026+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b09a70 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15a70 con 0x55e339b0e2e0 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b11910 con 0x55e339b09a70 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b11520 con 0x55e339b09a70 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.027+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b12280 con 0x55e339b0e2e0 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 zone default found 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 4 Realm: () 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 zonegroup default 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b163a0 con 0x7f4858021020 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b15fb0 con 0x55e339b12ee0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.028+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b186a0 con 0x55e339b12ee0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.029+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.029+0000 7f4862506800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.029+0000 7f4862506800 20 started sync module instance, tier type = 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.029+0000 7f4862506800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.029+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b17a60 con 0x55e339b0e2e0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.030+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.030+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434413871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b17a60 con 0x55e339b0e2e0 2024-09-13T23:26:31.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.030+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b191d0 con 0x55e339b09a70 2024-09-13T23:26:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.031+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434413871024] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.031+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.031+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434413874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b17a60 con 0x55e339b09a70 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.031+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b19c50 con 0x55e339b12ee0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.033+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434413874336] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.033+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.033+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434413868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b179d0 con 0x55e339b12ee0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.033+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1ab40 con 0x55e339b0e2e0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.034+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434413868464] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.034+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.034+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434413880976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1af60 con 0x55e339b0e2e0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.034+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1b920 con 0x55e339b09a70 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.035+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434413880976] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.035+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.035+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434413882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1b920 con 0x55e339b09a70 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.035+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1c2e0 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.036+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.036+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434413887024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1c250 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.036+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434413882512] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.036+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1d290 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.038+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434413887024] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.038+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.038+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434413889232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1d290 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.038+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1d730 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434413889232] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434413884528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1d6f0 con 0x7f4858021020 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=0 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=1 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=2 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=3 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=4 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=5 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.039+0000 7f4862506800 20 add_watcher() i=6 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434413884528] v33'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f4862506800 20 add_watcher() i=7 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f4862506800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b20b50 con 0x55e339b09a70 2024-09-13T23:26:31.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.040+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434413890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1e040 con 0x55e339b09a70 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.041+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434413890928] v33'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 5 note: GC not initialized 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4714fe1640 20 reqs_thread_entry: start 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 20 Filter name: none 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f468e7fc640 20 reqs_thread_entry: start 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.042+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b54410 con 0x55e339b09a70 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b54410 con 0x55e339b0e2e0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b09a70 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.043+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b09a70 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b09a70 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b12ee0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.044+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x55e339b12ee0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.045+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.045+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b543d0 con 0x7f4858021020 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.045+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.045+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b0e2e0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.046+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.047+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b0e2e0 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.048+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.049+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b09a70 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.050+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e339b56260 con 0x7f4858021020 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.051+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.051+0000 7f4715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.051+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434413890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b20480 con 0x55e339b09a70 2024-09-13T23:26:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.052+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94434413890928] v33'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.053+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434413871024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1cd70 con 0x55e339b0e2e0 2024-09-13T23:26:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.054+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94434413871024] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.054+0000 7f4862506800 20 remove_watcher() i=0 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.054+0000 7f4862506800 2 removed watcher, disabling cache 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.054+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434413874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1cd70 con 0x55e339b09a70 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.055+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94434413874336] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.055+0000 7f4862506800 20 remove_watcher() i=1 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.055+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434413868464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1cd70 con 0x55e339b12ee0 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.056+0000 7f485fffa640 1 -- 172.21.15.99:0/728714187 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94434413868464] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f485006c450 con 0x55e339b12ee0 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.056+0000 7f4862506800 20 remove_watcher() i=2 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.056+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434413880976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b175b0 con 0x55e339b0e2e0 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.057+0000 7f48607fb640 1 -- 172.21.15.99:0/728714187 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94434413880976] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4858062040 con 0x55e339b0e2e0 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.057+0000 7f4862506800 20 remove_watcher() i=3 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.057+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434413882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1cd70 con 0x55e339b09a70 2024-09-13T23:26:31.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.058+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94434413882512] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x55e339b09a70 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.058+0000 7f4862506800 20 remove_watcher() i=4 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.058+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434413887024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1a690 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.059+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94434413887024] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.059+0000 7f4862506800 20 remove_watcher() i=5 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.059+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434413889232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b175b0 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.060+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94434413889232] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.060+0000 7f4862506800 20 remove_watcher() i=6 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.060+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434413884528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e339b1ac90 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.061+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94434413884528] v33'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4854029040 con 0x7f4858021020 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.061+0000 7f4862506800 20 remove_watcher() i=7 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4858021020 msgr2=0x7f48580203b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f4858021020 0x7f48580203b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e339b09a70 msgr2=0x55e339b0bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e339b09a70 0x55e339b0bf30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339b0e2e0 msgr2=0x55e339b106d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339b0e2e0 0x55e339b106d0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e339b12ee0 msgr2=0x55e339b153a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e339b12ee0 0x55e339b153a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4728036b40 msgr2=0x7f4728039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4728036b40 0x7f4728039000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f485004e440 tx=0x7f4850095000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 msgr2=0x55e339afe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/728714187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339af6d50 0x55e339afe140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f48580168b0 tx=0x7f485804b000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 reap_dead start 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f485f7f9640 1 -- 172.21.15.99:0/728714187 reap_dead start 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 shutdown_connections 2024-09-13T23:26:31.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 >> 172.21.15.99:0/728714187 conn(0x55e339af3100 msgr2=0x55e339af8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 shutdown_connections 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/728714187 wait complete. 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 msgr2=0x7f4738039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 0x7f4738039000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x55e339ad7240 tx=0x7f485004e350 comp rx=0 tx=0).stop 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 msgr2=0x55e339aea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x55e339ad04c0 tx=0x7f485800beb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 shutdown_connections 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4738036b40 0x7f4738039000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 --2- 172.21.15.99:0/2063628073 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339aea0f0 0x55e339aea510 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 >> 172.21.15.99:0/2063628073 conn(0x55e339adf080 msgr2=0x55e339ae1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 shutdown_connections 2024-09-13T23:26:31.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.062+0000 7f4862506800 1 -- 172.21.15.99:0/2063628073 wait complete. 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 msgr2=0x55e339ad6480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 0x55e339ad6480 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 msgr2=0x55e339adb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 0x55e339adb080 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 msgr2=0x7f4748039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 0x7f4748039050 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4854000f60 tx=0x7f48540012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 msgr2=0x55e339acf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4850065040 tx=0x7f4850003330 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 shutdown_connections 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e339ad8c90 0x55e339adb080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3399dbb40 0x55e339ad6480 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4748036b90 0x7f4748039050 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 --2- 172.21.15.99:0/2676794612 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e339949dd0 0x55e339acf410 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 >> 172.21.15.99:0/2676794612 conn(0x55e3399d0df0 msgr2=0x55e339ac1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 shutdown_connections 2024-09-13T23:26:31.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.063+0000 7f4862506800 1 -- 172.21.15.99:0/2676794612 wait complete. 2024-09-13T23:26:31.074 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T23:26:31.074 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:26:31.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T23:26:31.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T23:26:31.075 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T23:26:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.117 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.116+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.116+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.116+0000 7fd23b430800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d6f22254b0 0x55d6f22258b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.116+0000 7fd23b430800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6f20e5b30 con 0x55d6f2225df0 2024-09-13T23:26:31.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.116+0000 7fd23b430800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d6f20c7360 con 0x55d6f22254b0 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd236760640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d6f22254b0 0x55d6f22258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd235f5f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55d6f2225df0 0x55d6f222a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46908/0 (socket says 172.21.15.99:46908) 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd235f5f640 1 -- 172.21.15.99:0/832319979 learned_addr learned my addr 172.21.15.99:0/832319979 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd236760640 1 --2- 172.21.15.99:0/832319979 >> v2:172.21.15.43:3300/0 conn(0x55d6f22254b0 0x55d6f22258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56332/0 (socket says 172.21.15.99:56332) 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd236760640 1 -- 172.21.15.99:0/832319979 >> v1:172.21.15.43:6789/0 conn(0x55d6f2225df0 legacy=0x55d6f222a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.117+0000 7fd236760640 1 -- 172.21.15.99:0/832319979 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f20ede00 con 0x55d6f22254b0 2024-09-13T23:26:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.119+0000 7fd236760640 1 --2- 172.21.15.99:0/832319979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f22258b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c6b0 tx=0x7fd2280482f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a3f02adb4acad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.119+0000 7fd23575e640 1 -- 172.21.15.99:0/832319979 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22804fb70 con 0x55d6f22254b0 2024-09-13T23:26:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.119+0000 7fd23575e640 1 -- 172.21.15.99:0/832319979 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228053070 con 0x55d6f22254b0 2024-09-13T23:26:31.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.119+0000 7fd23575e640 1 -- 172.21.15.99:0/832319979 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd22804fe60 con 0x55d6f22254b0 2024-09-13T23:26:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 -- 172.21.15.99:0/832319979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 msgr2=0x55d6f22258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 --2- 172.21.15.99:0/832319979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f22258b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c6b0 tx=0x7fd2280482f0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 -- 172.21.15.99:0/832319979 shutdown_connections 2024-09-13T23:26:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 --2- 172.21.15.99:0/832319979 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f22258b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 -- 172.21.15.99:0/832319979 >> 172.21.15.99:0/832319979 conn(0x55d6f2220de0 msgr2=0x55d6f2223200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 -- 172.21.15.99:0/832319979 shutdown_connections 2024-09-13T23:26:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.120+0000 7fd23b430800 1 -- 172.21.15.99:0/832319979 wait complete. 2024-09-13T23:26:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.133+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd23b430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd23b430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6f2172320 con 0x55d6f22254b0 2024-09-13T23:26:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd236760640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd236760640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56340/0 (socket says 172.21.15.99:56340) 2024-09-13T23:26:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd236760640 1 -- 172.21.15.99:0/2985963582 learned_addr learned my addr 172.21.15.99:0/2985963582 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd236760640 1 -- 172.21.15.99:0/2985963582 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f20bfbc0 con 0x55d6f22254b0 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.134+0000 7fd236760640 1 --2- 172.21.15.99:0/2985963582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd228000f80 tx=0x7fd228051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c00cfb48286cca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd124608640 1 -- 172.21.15.99:0/2985963582 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228057540 con 0x55d6f22254b0 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd124608640 1 -- 172.21.15.99:0/2985963582 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228065070 con 0x55d6f22254b0 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd124608640 1 -- 172.21.15.99:0/2985963582 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228057810 con 0x55d6f22254b0 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 -- 172.21.15.99:0/2985963582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 msgr2=0x55d6f2317a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 --2- 172.21.15.99:0/2985963582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd228000f80 tx=0x7fd228051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 -- 172.21.15.99:0/2985963582 shutdown_connections 2024-09-13T23:26:31.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 --2- 172.21.15.99:0/2985963582 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f2317a70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 -- 172.21.15.99:0/2985963582 >> 172.21.15.99:0/2985963582 conn(0x55d6f2220de0 msgr2=0x55d6f230f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 -- 172.21.15.99:0/2985963582 shutdown_connections 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.135+0000 7fd23b430800 1 -- 172.21.15.99:0/2985963582 wait complete. 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd23b430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd23b430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6f222c4d0 con 0x55d6f22254b0 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd236760640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd236760640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56350/0 (socket says 172.21.15.99:56350) 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd236760640 1 -- 172.21.15.99:0/1994013467 learned_addr learned my addr 172.21.15.99:0/1994013467 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.136+0000 7fd236760640 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f20d3fe0 con 0x55d6f22254b0 2024-09-13T23:26:31.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd236760640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd228062040 tx=0x7fd228003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd122e05640 1 -- 172.21.15.99:0/1994013467 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228060d80 con 0x55d6f22254b0 2024-09-13T23:26:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd122e05640 1 -- 172.21.15.99:0/1994013467 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd228057410 con 0x55d6f22254b0 2024-09-13T23:26:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6f231f8e0 con 0x55d6f22254b0 2024-09-13T23:26:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd122e05640 1 -- 172.21.15.99:0/1994013467 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd228057730 con 0x55d6f22254b0 2024-09-13T23:26:31.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.137+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f231fe00 con 0x55d6f22254b0 2024-09-13T23:26:31.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd122e05640 1 -- 172.21.15.99:0/1994013467 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd228055030 con 0x55d6f22254b0 2024-09-13T23:26:31.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd122e05640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 0x7fd11c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd122e05640 1 -- 172.21.15.99:0/1994013467 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd22805d040 con 0x55d6f22254b0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 0x7fd11c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 0x55d6f2326410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2326950 con 0x55d6f2225df0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd236f61640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 0x55d6f2326410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 0x7fd11c039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd220000f60 tx=0x7fd2200012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.138+0000 7fd236f61640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 0x55d6f2326410 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd236f61640 1 -- 172.21.15.99:0/1994013467 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2300083e0 con 0x55d6f2225df0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23239c0 con 0x55d6f2225df0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd236f61640 1 -- 172.21.15.99:0/1994013467 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2300083e0 con 0x55d6f2225df0 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 0x55d6f232b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f232b760 con 0x55d6f2328c80 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd236760640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 0x55d6f232b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.139+0000 7fd236760640 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 0x55d6f232b070 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.140+0000 7fd236760640 1 -- 172.21.15.99:0/1994013467 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd228072780 con 0x55d6f2328c80 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.140+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2327b20 con 0x55d6f2225df0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.140+0000 7fd236f61640 1 -- 172.21.15.99:0/1994013467 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2300083e0 con 0x55d6f2225df0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.140+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2327fc0 con 0x55d6f2328c80 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.140+0000 7fd236760640 1 -- 172.21.15.99:0/1994013467 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd228072780 con 0x55d6f2328c80 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd23b430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd23b430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6f20c1580 con 0x55d6f233a0c0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56366/0 (socket says 172.21.15.99:56366) 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.141+0000 7fd236f61640 1 -- 172.21.15.99:0/4041804134 learned_addr learned my addr 172.21.15.99:0/4041804134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd236f61640 1 -- 172.21.15.99:0/4041804134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f233aa20 con 0x55d6f233a0c0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd236f61640 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55d6f2320450 tx=0x7fd23000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd11bfff640 1 -- 172.21.15.99:0/4041804134 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23001c020 con 0x55d6f233a0c0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd11bfff640 1 -- 172.21.15.99:0/4041804134 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd230007cf0 con 0x55d6f233a0c0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6f233acb0 con 0x55d6f233a0c0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd11bfff640 1 -- 172.21.15.99:0/4041804134 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd230018440 con 0x55d6f233a0c0 2024-09-13T23:26:31.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.142+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f233d990 con 0x55d6f233a0c0 2024-09-13T23:26:31.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd11bfff640 1 -- 172.21.15.99:0/4041804134 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd23001f020 con 0x55d6f233a0c0 2024-09-13T23:26:31.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd11bfff640 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 0x7fd110039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd11bfff640 1 -- 172.21.15.99:0/4041804134 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd23004e260 con 0x55d6f233a0c0 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd236760640 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 0x7fd110039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.143+0000 7fd236760640 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 0x7fd110039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55d6f2327230 tx=0x7fd228069450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd23b430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd23b430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6f2318160 con 0x55d6f2346d90 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56368/0 (socket says 172.21.15.99:56368) 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd236f61640 1 -- 172.21.15.99:0/3979337422 learned_addr learned my addr 172.21.15.99:0/3979337422 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd236f61640 1 -- 172.21.15.99:0/3979337422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f2347760 con 0x55d6f2346d90 2024-09-13T23:26:31.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd236f61640 1 --2- 172.21.15.99:0/3979337422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd23004c670 tx=0x7fd230016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43457d680178140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd119ffb640 1 -- 172.21.15.99:0/3979337422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd230045070 con 0x55d6f2346d90 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd119ffb640 1 -- 172.21.15.99:0/3979337422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd23004b290 con 0x55d6f2346d90 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.144+0000 7fd119ffb640 1 -- 172.21.15.99:0/3979337422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd230021550 con 0x55d6f2346d90 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- 172.21.15.99:0/3979337422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 msgr2=0x55d6f2347190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 --2- 172.21.15.99:0/3979337422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd23004c670 tx=0x7fd230016630 comp rx=0 tx=0).stop 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- 172.21.15.99:0/3979337422 shutdown_connections 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 --2- 172.21.15.99:0/3979337422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f2347190 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- 172.21.15.99:0/3979337422 >> 172.21.15.99:0/3979337422 conn(0x55d6f23430f0 msgr2=0x55d6f23411f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- 172.21.15.99:0/3979337422 shutdown_connections 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- 172.21.15.99:0/3979337422 wait complete. 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 Processor -- start 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- start start 2024-09-13T23:26:31.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f234e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.145+0000 7fd23b430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d6f2347dd0 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f234e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd236f61640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f234e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56374/0 (socket says 172.21.15.99:56374) 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 learned_addr learned my addr 172.21.15.99:0/1972967249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f234e780 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd236f61640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f234e240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd2300168b0 tx=0x7fd23004c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd107fff640 1 -- 172.21.15.99:0/1972967249 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd230045030 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd107fff640 1 -- 172.21.15.99:0/1972967249 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd230016b50 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd107fff640 1 -- 172.21.15.99:0/1972967249 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd23003f070 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6f234ea10 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.146+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f23516c0 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.147+0000 7fd107fff640 1 -- 172.21.15.99:0/1972967249 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd230016040 con 0x55d6f2346d90 2024-09-13T23:26:31.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.147+0000 7fd107fff640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd100036b40 0x7fd100039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.147+0000 7fd107fff640 1 -- 172.21.15.99:0/1972967249 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd230046070 con 0x55d6f2346d90 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.147+0000 7fd236760640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd100036b40 0x7fd100039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.147+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2359bf0 0x55d6f235c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f235c800 con 0x55d6f2359bf0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd236760640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd100036b40 0x7fd100039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55d6f2326df0 tx=0x7fd228091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2359bf0 0x55d6f235c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2359bf0 0x55d6f235c0b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd220009050 con 0x55d6f2359bf0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 20 realm 2024-09-13T23:26:31.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2359040 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd220009050 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.148+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f235d2e0 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd220009050 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f235dbb0 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd220009050 con 0x55d6f2359bf0 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f235e460 0x55d6f2360850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2360f90 con 0x55d6f235e460 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd236f61640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f235e460 0x55d6f2360850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.149+0000 7fd236f61640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f235e460 0x55d6f2360850 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd23b430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd23b430800 20 searching for the correct realm 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6f2363040 0x55d6f2365500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236760640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6f2363040 0x55d6f2365500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236760640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6f2363040 0x55d6f2365500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236f61640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd230021020 0x7fd230010240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.150+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.151+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd230021020 0x7fd230010240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.151+0000 7fd235f5f640 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd230021020 0x7fd230010240 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.151+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220009050 con 0x7fd230021020 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.151+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220009050 con 0x55d6f2359bf0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.152+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.153+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.154+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.155+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.156+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.157+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2363040 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.158+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f2359bf0 2024-09-13T23:26:31.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2365bd0 con 0x55d6f235e460 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2361aa0 con 0x55d6f2359bf0 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23616b0 con 0x55d6f2359bf0 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.159+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2362410 con 0x55d6f235e460 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 zone default found 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 4 Realm: () 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 zonegroup default 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2366500 con 0x7fd230021020 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2366110 con 0x55d6f2363040 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23687b0 con 0x55d6f2363040 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 started sync module instance, tier type = 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.160+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2367bc0 con 0x55d6f235e460 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.161+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.161+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94381675020480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2367bc0 con 0x55d6f235e460 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.161+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2369360 con 0x55d6f2359bf0 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.162+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94381675020480] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.163+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.163+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94381675023920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2367bc0 con 0x55d6f2359bf0 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.163+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2369e10 con 0x55d6f2363040 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.164+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.164+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94381675023920] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.164+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94381675018000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2367b30 con 0x55d6f2363040 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.164+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236acd0 con 0x55d6f235e460 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.165+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94381675018000] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.165+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.165+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94381675030560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236b0f0 con 0x55d6f235e460 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.165+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236bab0 con 0x55d6f2359bf0 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.166+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94381675030560] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.166+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.166+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94381675034592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236b0f0 con 0x55d6f2359bf0 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.166+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236c4c0 con 0x7fd230021020 2024-09-13T23:26:31.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.168+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94381675034592] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.168+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.168+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94381675037168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236b0f0 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.168+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236cf00 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.169+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.169+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94381675039312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236d320 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.169+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236de40 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.169+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94381675037168] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94381675039312] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94381675043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236ce70 con 0x7fd230021020 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=0 2024-09-13T23:26:31.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=1 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=2 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=3 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=4 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=5 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.170+0000 7fd23b430800 20 add_watcher() i=6 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94381675043088] v33'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd23b430800 20 add_watcher() i=7 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd23b430800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f2370f40 con 0x55d6f2359bf0 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.171+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94381675031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f236e3c0 con 0x55d6f2359bf0 2024-09-13T23:26:31.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94381675031616] v33'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd0ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 5 note: GC not initialized 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd0677fe640 20 reqs_thread_entry: start 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 20 Filter name: none 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd0657fa640 20 reqs_thread_entry: start 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.173+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4550 con 0x55d6f2359bf0 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4550 con 0x55d6f235e460 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4550 con 0x55d6f2359bf0 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4510 con 0x55d6f2363040 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a60 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.174+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a60 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a60 con 0x55d6f2359bf0 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a60 con 0x55d6f2359bf0 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a10 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a10 con 0x55d6f2363040 2024-09-13T23:26:31.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.175+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.176+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a4a10 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.176+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.176+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6510 con 0x55d6f2359bf0 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.176+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.176+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6510 con 0x55d6f235e460 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6510 con 0x55d6f2363040 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6510 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a64c0 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.177+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a64c0 con 0x55d6f2363040 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6470 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6440 con 0x55d6f2359bf0 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6440 con 0x55d6f2363040 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.178+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6440 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6440 con 0x55d6f235e460 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.179+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2363040 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2363040 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.180+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2363040 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.181+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.181+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x55d6f2363040 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.181+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.181+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a6420 con 0x7fd230021020 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.181+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.182+0000 7fd0ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.182+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94381675031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a2440 con 0x55d6f2359bf0 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.183+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94381675031616] v33'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.183+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94381675020480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x55d6f235e460 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.184+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94381675020480] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.184+0000 7fd23b430800 20 remove_watcher() i=0 2024-09-13T23:26:31.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.184+0000 7fd23b430800 2 removed watcher, disabling cache 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.184+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94381675023920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x55d6f2359bf0 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.185+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94381675023920] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.185+0000 7fd23b430800 20 remove_watcher() i=1 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.185+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94381675018000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x55d6f2363040 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.187+0000 7fd236760640 1 -- 172.21.15.99:0/1972967249 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94381675018000] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd228086050 con 0x55d6f2363040 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.187+0000 7fd23b430800 20 remove_watcher() i=2 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.187+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94381675030560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x55d6f235e460 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.188+0000 7fd236f61640 1 -- 172.21.15.99:0/1972967249 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94381675030560] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd230028070 con 0x55d6f235e460 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.188+0000 7fd23b430800 20 remove_watcher() i=3 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.188+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94381675034592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x55d6f2359bf0 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.189+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94381675034592] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x55d6f2359bf0 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.189+0000 7fd23b430800 20 remove_watcher() i=4 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.189+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94381675037168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x7fd230021020 2024-09-13T23:26:31.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.190+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94381675037168] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.190+0000 7fd23b430800 20 remove_watcher() i=5 2024-09-13T23:26:31.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.190+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94381675039312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x7fd230021020 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.191+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94381675039312] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.191+0000 7fd23b430800 20 remove_watcher() i=6 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.191+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94381675043088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d6f23a1a40 con 0x7fd230021020 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94381675043088] v33'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd220029040 con 0x7fd230021020 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 20 remove_watcher() i=7 2024-09-13T23:26:31.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd230021020 msgr2=0x7fd230010240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd230021020 0x7fd230010240 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2359bf0 msgr2=0x55d6f235c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2359bf0 0x55d6f235c0b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f235e460 msgr2=0x55d6f2360850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f235e460 0x55d6f2360850 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6f2363040 msgr2=0x55d6f2365500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d6f2363040 0x55d6f2365500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd100036b40 msgr2=0x7fd100039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd100036b40 0x7fd100039000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55d6f2326df0 tx=0x7fd228091000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 msgr2=0x55d6f234e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 --2- 172.21.15.99:0/1972967249 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f2346d90 0x55d6f234e240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd2300168b0 tx=0x7fd23004c5d0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 reap_dead start 2024-09-13T23:26:31.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd235f5f640 1 -- 172.21.15.99:0/1972967249 reap_dead start 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 shutdown_connections 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 >> 172.21.15.99:0/1972967249 conn(0x55d6f23430f0 msgr2=0x55d6f23411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 shutdown_connections 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.192+0000 7fd23b430800 1 -- 172.21.15.99:0/1972967249 wait complete. 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 msgr2=0x7fd110039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 0x7fd110039000 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55d6f2327230 tx=0x7fd228069450 comp rx=0 tx=0).stop 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 msgr2=0x55d6f233a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x55d6f2320450 tx=0x7fd23000beb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 shutdown_connections 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd110036b40 0x7fd110039000 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/4041804134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f233a0c0 0x55d6f233a4e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 >> 172.21.15.99:0/4041804134 conn(0x55d6f232f050 msgr2=0x55d6f2331bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 shutdown_connections 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/4041804134 wait complete. 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 msgr2=0x55d6f2326410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 0x55d6f2326410 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 msgr2=0x55d6f232b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 0x55d6f232b070 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 msgr2=0x7fd11c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 0x7fd11c039000 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd220000f60 tx=0x7fd2200012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 msgr2=0x55d6f231f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd228062040 tx=0x7fd228003330 comp rx=0 tx=0).stop 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 shutdown_connections 2024-09-13T23:26:31.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d6f2328c80 0x55d6f232b070 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d6f2225df0 0x55d6f2326410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd11c036b40 0x7fd11c039000 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 --2- 172.21.15.99:0/1994013467 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d6f22254b0 0x55d6f231f3a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 >> 172.21.15.99:0/1994013467 conn(0x55d6f2220de0 msgr2=0x55d6f230d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 shutdown_connections 2024-09-13T23:26:31.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.193+0000 7fd23b430800 1 -- 172.21.15.99:0/1994013467 wait complete. 2024-09-13T23:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T23:26:31.207 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:26:31.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:26:31.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:26:31.208 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:26:31.291 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.292 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2656139800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55aa69459a90 0x55aa69459e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2656139800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa6931ab30 con 0x55aa6945a3d0 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2656139800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55aa692fc360 con 0x55aa69459a90 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f2651dd1640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55aa69459a90 0x55aa69459e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f26515d0640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55aa6945a3d0 0x55aa69460b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46914/0 (socket says 172.21.15.99:46914) 2024-09-13T23:26:31.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.291+0000 7f26515d0640 1 -- 172.21.15.99:0/778861643 learned_addr learned my addr 172.21.15.99:0/778861643 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:31.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.292+0000 7f2651dd1640 1 -- 172.21.15.99:0/778861643 >> v1:172.21.15.43:6789/0 conn(0x55aa6945a3d0 legacy=0x55aa69460b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.292+0000 7f2651dd1640 1 -- 172.21.15.99:0/778861643 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa69322e00 con 0x55aa69459a90 2024-09-13T23:26:31.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2651dd1640 1 --2- 172.21.15.99:0/778861643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa69459e90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f264400a470 tx=0x7f2644045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38507854f4d704a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2650dcf640 1 -- 172.21.15.99:0/778861643 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2644053570 con 0x55aa69459a90 2024-09-13T23:26:31.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2650dcf640 1 -- 172.21.15.99:0/778861643 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2644058070 con 0x55aa69459a90 2024-09-13T23:26:31.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2650dcf640 1 -- 172.21.15.99:0/778861643 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2644053880 con 0x55aa69459a90 2024-09-13T23:26:31.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 -- 172.21.15.99:0/778861643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 msgr2=0x55aa69459e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 --2- 172.21.15.99:0/778861643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa69459e90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f264400a470 tx=0x7f2644045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 -- 172.21.15.99:0/778861643 shutdown_connections 2024-09-13T23:26:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 --2- 172.21.15.99:0/778861643 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa69459e90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 -- 172.21.15.99:0/778861643 >> 172.21.15.99:0/778861643 conn(0x55aa694555c0 msgr2=0x55aa694579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 -- 172.21.15.99:0/778861643 shutdown_connections 2024-09-13T23:26:31.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.294+0000 7f2656139800 1 -- 172.21.15.99:0/778861643 wait complete. 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2656139800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2656139800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa693a7330 con 0x55aa69459a90 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2651dd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2651dd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56400/0 (socket says 172.21.15.99:56400) 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.309+0000 7f2651dd1640 1 -- 172.21.15.99:0/891486383 learned_addr learned my addr 172.21.15.99:0/891486383 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.310+0000 7f2651dd1640 1 -- 172.21.15.99:0/891486383 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa692f4bc0 con 0x55aa69459a90 2024-09-13T23:26:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.310+0000 7f2651dd1640 1 --2- 172.21.15.99:0/891486383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2644025c20 tx=0x7f2644051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233b40898127abaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.310+0000 7f253fe07640 1 -- 172.21.15.99:0/891486383 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264405c580 con 0x55aa69459a90 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.310+0000 7f253fe07640 1 -- 172.21.15.99:0/891486383 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2644063030 con 0x55aa69459a90 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.310+0000 7f253fe07640 1 -- 172.21.15.99:0/891486383 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264405c850 con 0x55aa69459a90 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- 172.21.15.99:0/891486383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 msgr2=0x55aa6954a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 --2- 172.21.15.99:0/891486383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f2644025c20 tx=0x7f2644051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- 172.21.15.99:0/891486383 shutdown_connections 2024-09-13T23:26:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 --2- 172.21.15.99:0/891486383 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6954a850 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- 172.21.15.99:0/891486383 >> 172.21.15.99:0/891486383 conn(0x55aa694555c0 msgr2=0x55aa69546210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- 172.21.15.99:0/891486383 shutdown_connections 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- 172.21.15.99:0/891486383 wait complete. 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.311+0000 7f2656139800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa69462670 con 0x55aa69459a90 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2651dd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2651dd1640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56404/0 (socket says 172.21.15.99:56404) 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2651dd1640 1 -- 172.21.15.99:0/2320839884 learned_addr learned my addr 172.21.15.99:0/2320839884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2651dd1640 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa69308fe0 con 0x55aa69459a90 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f264400a330 tx=0x7f2644002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f253e604640 1 -- 172.21.15.99:0/2320839884 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264406c030 con 0x55aa69459a90 2024-09-13T23:26:31.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f253e604640 1 -- 172.21.15.99:0/2320839884 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264405c580 con 0x55aa69459a90 2024-09-13T23:26:31.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa6945ab40 con 0x55aa69459a90 2024-09-13T23:26:31.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f253e604640 1 -- 172.21.15.99:0/2320839884 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264405c860 con 0x55aa69459a90 2024-09-13T23:26:31.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.312+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6945b0c0 con 0x55aa69459a90 2024-09-13T23:26:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.313+0000 7f253e604640 1 -- 172.21.15.99:0/2320839884 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f2644053440 con 0x55aa69459a90 2024-09-13T23:26:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f253e604640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 0x7f2538039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f253e604640 1 -- 172.21.15.99:0/2320839884 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f2644070020 con 0x55aa69459a90 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f26515d0640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 0x7f2538039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 0x55aa6955b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6955bac0 con 0x55aa6945a3d0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f26525d2640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 0x55aa6955b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f26515d0640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 0x7f2538039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2648000f60 tx=0x7f26480012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f26525d2640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 0x55aa6955b580 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.314+0000 7f26525d2640 1 -- 172.21.15.99:0/2320839884 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f264c00a4a0 con 0x55aa6945a3d0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6955c310 con 0x55aa6945a3d0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f26525d2640 1 -- 172.21.15.99:0/2320839884 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f264c00a4a0 con 0x55aa6945a3d0 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 0x55aa695601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa69560940 con 0x55aa6955dd40 2024-09-13T23:26:31.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 0x55aa695601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 0x55aa695601b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2651dd1640 1 -- 172.21.15.99:0/2320839884 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f264407b070 con 0x55aa6955dd40 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.315+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6955cb60 con 0x55aa6945a3d0 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.316+0000 7f26525d2640 1 -- 172.21.15.99:0/2320839884 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f264c00a4a0 con 0x55aa6945a3d0 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.316+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6955cf40 con 0x55aa6955dd40 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.316+0000 7f2651dd1640 1 -- 172.21.15.99:0/2320839884 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f264407b070 con 0x55aa6955dd40 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.316+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.316+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f2656139800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f2656139800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa6945c990 con 0x55aa6956f290 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56410/0 (socket says 172.21.15.99:56410) 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f26525d2640 1 -- 172.21.15.99:0/1146785985 learned_addr learned my addr 172.21.15.99:0/1146785985 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f26525d2640 1 -- 172.21.15.99:0/1146785985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6956fbf0 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.317+0000 7f26525d2640 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55aa6945bfb0 tx=0x7f264c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f25377fe640 1 -- 172.21.15.99:0/1146785985 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c013450 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f25377fe640 1 -- 172.21.15.99:0/1146785985 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0135f0 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f25377fe640 1 -- 172.21.15.99:0/1146785985 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c013910 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa6956fe80 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa69572b60 con 0x55aa6956f290 2024-09-13T23:26:31.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.318+0000 7f25377fe640 1 -- 172.21.15.99:0/1146785985 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f264c011040 con 0x55aa6956f290 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f25377fe640 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 0x7f252c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f25377fe640 1 -- 172.21.15.99:0/1146785985 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f264c00e040 con 0x55aa6956f290 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2651dd1640 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 0x7f252c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2656139800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2656139800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa692f6580 con 0x55aa69551ff0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f2651dd1640 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 0x7f252c039050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55aa6945b720 tx=0x7f2644008310 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56412/0 (socket says 172.21.15.99:56412) 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.319+0000 7f26525d2640 1 -- 172.21.15.99:0/4094493120 learned_addr learned my addr 172.21.15.99:0/4094493120 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f26525d2640 1 -- 172.21.15.99:0/4094493120 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa69552910 con 0x55aa69551ff0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f26525d2640 1 --2- 172.21.15.99:0/4094493120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f264c04ce00 tx=0x7f264c04d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddee400311c9720 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f25357fa640 1 -- 172.21.15.99:0/4094493120 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c046250 con 0x55aa69551ff0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f25357fa640 1 -- 172.21.15.99:0/4094493120 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c02a440 con 0x55aa69551ff0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f25357fa640 1 -- 172.21.15.99:0/4094493120 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c01f390 con 0x55aa69551ff0 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 -- 172.21.15.99:0/4094493120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 msgr2=0x55aa695523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 --2- 172.21.15.99:0/4094493120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f264c04ce00 tx=0x7f264c04d0b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 -- 172.21.15.99:0/4094493120 shutdown_connections 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 --2- 172.21.15.99:0/4094493120 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa695523d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 -- 172.21.15.99:0/4094493120 >> 172.21.15.99:0/4094493120 conn(0x55aa69578340 msgr2=0x55aa69576440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 -- 172.21.15.99:0/4094493120 shutdown_connections 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.320+0000 7f2656139800 1 -- 172.21.15.99:0/4094493120 wait complete. 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f2656139800 1 Processor -- start 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f2656139800 1 -- start start 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f2656139800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa69587710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f2656139800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55aa69552e50 con 0x55aa69551ff0 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa69587710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f26525d2640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa69587710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56424/0 (socket says 172.21.15.99:56424) 2024-09-13T23:26:31.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 learned_addr learned my addr 172.21.15.99:0/2304811947 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.321+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa69587c50 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f26525d2640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa69587710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f264c04d0f0 tx=0x7f264c04cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f25237fe640 1 -- 172.21.15.99:0/2304811947 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c03a020 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f25237fe640 1 -- 172.21.15.99:0/2304811947 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c04e290 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa69587ee0 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f25237fe640 1 -- 172.21.15.99:0/2304811947 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c04e590 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.322+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6958ab90 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f25237fe640 1 -- 172.21.15.99:0/2304811947 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f264c03d020 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f25237fe640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f251c036b40 0x7f251c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f25237fe640 1 -- 172.21.15.99:0/2304811947 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f264c0023c0 con 0x55aa69551ff0 2024-09-13T23:26:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f251c036b40 0x7f251c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa695931e0 0x55aa69595670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa69595dc0 con 0x55aa695931e0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.323+0000 7f26515d0640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa695931e0 0x55aa69595670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f251c036b40 0x7f251c039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55aa6945b6f0 tx=0x7f2644087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f26515d0640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa695931e0 0x55aa69595670 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2648009050 con 0x55aa695931e0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 20 realm 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695926f0 con 0x55aa695931e0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2648009050 con 0x55aa695931e0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.324+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695968a0 con 0x55aa695931e0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2648009050 con 0x55aa695931e0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa69597170 con 0x55aa695931e0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2648009050 con 0x55aa695931e0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa69597a20 0x55aa69599e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959a550 con 0x55aa69597a20 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f26525d2640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa69597a20 0x55aa69599e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.325+0000 7f26525d2640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa69597a20 0x55aa69599e10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2656139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2656139800 20 searching for the correct realm 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aa6959c600 0x55aa6959eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aa6959c600 0x55aa6959eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2651dd1640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aa6959c600 0x55aa6959eac0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f26525d2640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f264c058040 0x7f264c040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.326+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.327+0000 7f26515d0640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f264c058040 0x7f264c040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.327+0000 7f26515d0640 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f264c058040 0x7f264c040040 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.327+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648009050 con 0x7f264c058040 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.327+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648009050 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.328+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.329+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.330+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.331+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.332+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.333+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa6959c600 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x7f264c058040 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa695931e0 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.334+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959f190 con 0x55aa69597a20 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959b060 con 0x55aa695931e0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959ac70 con 0x55aa695931e0 2024-09-13T23:26:31.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959b9d0 con 0x55aa69597a20 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.335+0000 7f2656139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 zone default found 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 4 Realm: () 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 zonegroup default 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa6959fac0 con 0x7f264c058040 2024-09-13T23:26:31.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a18d0 con 0x55aa6959c600 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a1d40 con 0x55aa6959c600 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 started sync module instance, tier type = 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.336+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a0ce0 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.337+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.338+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94190400311808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a0ce0 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.338+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a2870 con 0x55aa695931e0 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.339+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94190400311808] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.339+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.339+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94190400316224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a0ce0 con 0x55aa695931e0 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.339+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a3320 con 0x55aa6959c600 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.341+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94190400316224] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.341+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.341+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94190400309296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a0c50 con 0x55aa6959c600 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.341+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a41e0 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.342+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.342+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94190400322864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a4150 con 0x55aa69597a20 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.342+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a51d0 con 0x55aa695931e0 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.342+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94190400309296] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.343+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.343+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94190400326816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a5190 con 0x55aa695931e0 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.343+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a5c30 con 0x7f264c058040 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.343+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94190400322864] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.344+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.344+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94190400329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a5bf0 con 0x7f264c058040 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.344+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a6660 con 0x7f264c058040 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.344+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94190400326816] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.345+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94190400329472] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.345+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.345+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94190400325072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a3710 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.345+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a6b10 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94190400325072] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94190400332176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a6b10 con 0x7f264c058040 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=0 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=1 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=2 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=3 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=4 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=5 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.346+0000 7f2656139800 20 add_watcher() i=6 2024-09-13T23:26:31.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94190400332176] v33'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f2656139800 20 add_watcher() i=7 2024-09-13T23:26:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f2656139800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a9e70 con 0x55aa695931e0 2024-09-13T23:26:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.347+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94190400333776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a70a0 con 0x55aa695931e0 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94190400333776] v33'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f25037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 5 note: GC not initialized 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f25027fc640 20 reqs_thread_entry: start 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 20 Filter name: none 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2473fff640 20 reqs_thread_entry: start 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.349+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695dce40 con 0x55aa695931e0 2024-09-13T23:26:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.350+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.350+0000 7f2656139800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.350+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55aa695de390 con 0x7f264c058040 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.350+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.351+0000 7f25037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.351+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94190400333776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a8d80 con 0x55aa695931e0 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.352+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94190400333776] v33'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.352+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94190400311808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a67d0 con 0x55aa69597a20 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.353+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94190400311808] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.353+0000 7f2656139800 20 remove_watcher() i=0 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.353+0000 7f2656139800 2 removed watcher, disabling cache 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.353+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94190400316224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a67d0 con 0x55aa695931e0 2024-09-13T23:26:31.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.354+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94190400316224] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.354+0000 7f2656139800 20 remove_watcher() i=1 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.354+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94190400309296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a2340 con 0x55aa6959c600 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.356+0000 7f2651dd1640 1 -- 172.21.15.99:0/2304811947 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94190400309296] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264407b070 con 0x55aa6959c600 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.356+0000 7f2656139800 20 remove_watcher() i=2 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.356+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94190400322864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a67d0 con 0x55aa69597a20 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.357+0000 7f26525d2640 1 -- 172.21.15.99:0/2304811947 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94190400322864] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c032040 con 0x55aa69597a20 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.357+0000 7f2656139800 20 remove_watcher() i=3 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.357+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94190400326816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a0830 con 0x55aa695931e0 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.358+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94190400326816] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x55aa695931e0 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.358+0000 7f2656139800 20 remove_watcher() i=4 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.358+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94190400329472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a2340 con 0x7f264c058040 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.359+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94190400329472] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.359+0000 7f2656139800 20 remove_watcher() i=5 2024-09-13T23:26:31.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.359+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94190400325072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a3d30 con 0x7f264c058040 2024-09-13T23:26:31.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.360+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94190400325072] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.360+0000 7f2656139800 20 remove_watcher() i=6 2024-09-13T23:26:31.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.360+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94190400332176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55aa695a67d0 con 0x7f264c058040 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94190400332176] v33'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2648029040 con 0x7f264c058040 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 20 remove_watcher() i=7 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f264c058040 msgr2=0x7f264c040040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f264c058040 0x7f264c040040 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa695931e0 msgr2=0x55aa69595670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa695931e0 0x55aa69595670 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa69597a20 msgr2=0x55aa69599e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa69597a20 0x55aa69599e10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aa6959c600 msgr2=0x55aa6959eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55aa6959c600 0x55aa6959eac0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f251c036b40 msgr2=0x7f251c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f251c036b40 0x7f251c039000 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55aa6945b6f0 tx=0x7f2644087000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 msgr2=0x55aa69587710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 --2- 172.21.15.99:0/2304811947 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69551ff0 0x55aa69587710 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f264c04d0f0 tx=0x7f264c04cd90 comp rx=0 tx=0).stop 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 reap_dead start 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f26515d0640 1 -- 172.21.15.99:0/2304811947 reap_dead start 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 shutdown_connections 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 >> 172.21.15.99:0/2304811947 conn(0x55aa69578340 msgr2=0x55aa69576410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 shutdown_connections 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.361+0000 7f2656139800 1 -- 172.21.15.99:0/2304811947 wait complete. 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 msgr2=0x7f252c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 0x7f252c039050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55aa6945b720 tx=0x7f2644008310 comp rx=0 tx=0).stop 2024-09-13T23:26:31.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 msgr2=0x55aa6956f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x55aa6945bfb0 tx=0x7f264c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 shutdown_connections 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f252c036b90 0x7f252c039050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/1146785985 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa6956f290 0x55aa6956f6b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 >> 172.21.15.99:0/1146785985 conn(0x55aa69564220 msgr2=0x55aa69566da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 shutdown_connections 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/1146785985 wait complete. 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 msgr2=0x55aa6955b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 0x55aa6955b580 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 msgr2=0x55aa695601b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 0x55aa695601b0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 msgr2=0x7f2538039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 0x7f2538039000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2648000f60 tx=0x7f26480012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 msgr2=0x55aa6945c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f264400a330 tx=0x7f2644002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 shutdown_connections 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55aa6955dd40 0x55aa695601b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55aa6945a3d0 0x55aa6955b580 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2538036b40 0x7f2538039000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 --2- 172.21.15.99:0/2320839884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55aa69459a90 0x55aa6945c450 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 >> 172.21.15.99:0/2320839884 conn(0x55aa694555c0 msgr2=0x55aa69544aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 shutdown_connections 2024-09-13T23:26:31.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.362+0000 7f2656139800 1 -- 172.21.15.99:0/2320839884 wait complete. 2024-09-13T23:26:31.372 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T23:26:31.373 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T23:26:31.373 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:26:31.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T23:26:31.373 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T23:26:31.421 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.418+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.418+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.418+0000 7f5ec630c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a8929805f0 0x55a892a11640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.418+0000 7f5ec630c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8928cbb30 con 0x55a892a11b80 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.418+0000 7f5ec630c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a8928ad360 con 0x55a8929805f0 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.419+0000 7f5ec3e00640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a8929805f0 0x55a892a11640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.419+0000 7f5ec35ff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55a892a11b80 0x55a892a13f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46930/0 (socket says 172.21.15.99:46930) 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.419+0000 7f5ec35ff640 1 -- 172.21.15.99:0/304949573 learned_addr learned my addr 172.21.15.99:0/304949573 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:31.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.419+0000 7f5ec3e00640 1 -- 172.21.15.99:0/304949573 >> v1:172.21.15.43:6789/0 conn(0x55a892a11b80 legacy=0x55a892a13f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.419+0000 7f5ec3e00640 1 -- 172.21.15.99:0/304949573 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8928d3e00 con 0x55a8929805f0 2024-09-13T23:26:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.421+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/304949573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892a11640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005fd0 tx=0x7f5eb4045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe0f79095b787bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.421+0000 7f5ec2dfe640 1 -- 172.21.15.99:0/304949573 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb4058530 con 0x55a8929805f0 2024-09-13T23:26:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.421+0000 7f5ec2dfe640 1 -- 172.21.15.99:0/304949573 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb40586d0 con 0x55a8929805f0 2024-09-13T23:26:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.421+0000 7f5ec2dfe640 1 -- 172.21.15.99:0/304949573 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb40589d0 con 0x55a8929805f0 2024-09-13T23:26:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 -- 172.21.15.99:0/304949573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 msgr2=0x55a892a11640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 --2- 172.21.15.99:0/304949573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892a11640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4005fd0 tx=0x7f5eb4045c30 comp rx=0 tx=0).stop 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 -- 172.21.15.99:0/304949573 shutdown_connections 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 --2- 172.21.15.99:0/304949573 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892a11640 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 -- 172.21.15.99:0/304949573 >> 172.21.15.99:0/304949573 conn(0x55a892a06db0 msgr2=0x55a892a091d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 -- 172.21.15.99:0/304949573 shutdown_connections 2024-09-13T23:26:31.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.422+0000 7f5ec630c800 1 -- 172.21.15.99:0/304949573 wait complete. 2024-09-13T23:26:31.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.435+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec630c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec630c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a892958360 con 0x55a8929805f0 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56454/0 (socket says 172.21.15.99:56454) 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec3e00640 1 -- 172.21.15.99:0/3970036187 learned_addr learned my addr 172.21.15.99:0/3970036187 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.436+0000 7f5ec3e00640 1 -- 172.21.15.99:0/3970036187 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8928a5bc0 con 0x55a8929805f0 2024-09-13T23:26:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.437+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/3970036187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400a3f0 tx=0x7f5eb4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9e6b2a34a32277 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.437+0000 7f5db1e0b640 1 -- 172.21.15.99:0/3970036187 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb40589b0 con 0x55a8929805f0 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.437+0000 7f5db1e0b640 1 -- 172.21.15.99:0/3970036187 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb4068070 con 0x55a8929805f0 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.437+0000 7f5db1e0b640 1 -- 172.21.15.99:0/3970036187 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb4058c80 con 0x55a8929805f0 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- 172.21.15.99:0/3970036187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 msgr2=0x55a892afdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3970036187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400a3f0 tx=0x7f5eb4051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- 172.21.15.99:0/3970036187 shutdown_connections 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3970036187 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892afdb10 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- 172.21.15.99:0/3970036187 >> 172.21.15.99:0/3970036187 conn(0x55a892a06db0 msgr2=0x55a892af94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- 172.21.15.99:0/3970036187 shutdown_connections 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- 172.21.15.99:0/3970036187 wait complete. 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec630c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a892a15930 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec3e00640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56460/0 (socket says 172.21.15.99:56460) 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.438+0000 7f5ec3e00640 1 -- 172.21.15.99:0/4160234647 learned_addr learned my addr 172.21.15.99:0/4160234647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5ec3e00640 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8928b9fe0 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4065040 tx=0x7f5eb4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5dabfff640 1 -- 172.21.15.99:0/4160234647 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb4063570 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5dabfff640 1 -- 172.21.15.99:0/4160234647 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb4063710 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a892b058b0 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5dabfff640 1 -- 172.21.15.99:0/4160234647 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5eb4063a10 con 0x55a8929805f0 2024-09-13T23:26:31.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.439+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a892b05dd0 con 0x55a8929805f0 2024-09-13T23:26:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5dabfff640 1 -- 172.21.15.99:0/4160234647 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5eb4075020 con 0x55a8929805f0 2024-09-13T23:26:31.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5dabfff640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 0x7f5dac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5dabfff640 1 -- 172.21.15.99:0/4160234647 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5eb4090c00 con 0x55a8929805f0 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 0x7f5dac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 0x55a892b0c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b0c960 con 0x55a892a11b80 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec4601640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 0x55a892b0c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 0x7f5dac039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000f60 tx=0x7f5eb80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.440+0000 7f5ec4601640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 0x55a892b0c3e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec4601640 1 -- 172.21.15.99:0/4160234647 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ebc0083e0 con 0x55a892a11b80 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b09990 con 0x55a892a11b80 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec4601640 1 -- 172.21.15.99:0/4160234647 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ebc0083e0 con 0x55a892a11b80 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 0x55a892b11040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b11730 con 0x55a892b0ec50 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 0x55a892b11040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.441+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 0x55a892b11040 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.442+0000 7f5ec3e00640 1 -- 172.21.15.99:0/4160234647 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b0ec50 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.442+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b0daf0 con 0x55a892a11b80 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.442+0000 7f5ec4601640 1 -- 172.21.15.99:0/4160234647 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ebc0083e0 con 0x55a892a11b80 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.442+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b0df90 con 0x55a892b0ec50 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.442+0000 7f5ec3e00640 1 -- 172.21.15.99:0/4160234647 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b0ec50 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec630c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec630c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a8928a7580 con 0x55a892b20060 2024-09-13T23:26:31.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56470/0 (socket says 172.21.15.99:56470) 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec4601640 1 -- 172.21.15.99:0/3760822124 learned_addr learned my addr 172.21.15.99:0/3760822124 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.443+0000 7f5ec4601640 1 -- 172.21.15.99:0/3760822124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a892b209c0 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5ec4601640 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55a892b06420 tx=0x7f5ebc00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5da97fa640 1 -- 172.21.15.99:0/3760822124 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc01c020 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5da97fa640 1 -- 172.21.15.99:0/3760822124 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc007c30 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5da97fa640 1 -- 172.21.15.99:0/3760822124 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc018440 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a892b20c50 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.444+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a892b23930 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5da97fa640 1 -- 172.21.15.99:0/3760822124 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ebc01f020 con 0x55a892b20060 2024-09-13T23:26:31.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5da97fa640 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 0x7f5d9c0390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5da97fa640 1 -- 172.21.15.99:0/3760822124 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5ebc04e130 con 0x55a892b20060 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 0x7f5d9c0390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 0x7f5d9c0390c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400a3f0 tx=0x7f5eb404ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec630c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.445+0000 7f5ec630c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a892afe200 con 0x55a892b2cca0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56486/0 (socket says 172.21.15.99:56486) 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5ec4601640 1 -- 172.21.15.99:0/1408674837 learned_addr learned my addr 172.21.15.99:0/1408674837 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5ec4601640 1 -- 172.21.15.99:0/1408674837 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a892b2d670 con 0x55a892b2cca0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5ec4601640 1 --2- 172.21.15.99:0/1408674837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc04c600 tx=0x7f5ebc029e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ecea6af0736fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5da2ffd640 1 -- 172.21.15.99:0/1408674837 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc045070 con 0x55a892b2cca0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5da2ffd640 1 -- 172.21.15.99:0/1408674837 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc021400 con 0x55a892b2cca0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.446+0000 7f5da2ffd640 1 -- 172.21.15.99:0/1408674837 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc018b40 con 0x55a892b2cca0 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- 172.21.15.99:0/1408674837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 msgr2=0x55a892b2d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 --2- 172.21.15.99:0/1408674837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc04c600 tx=0x7f5ebc029e70 comp rx=0 tx=0).stop 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- 172.21.15.99:0/1408674837 shutdown_connections 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 --2- 172.21.15.99:0/1408674837 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b2d0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- 172.21.15.99:0/1408674837 >> 172.21.15.99:0/1408674837 conn(0x55a892b29090 msgr2=0x55a892b27190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- 172.21.15.99:0/1408674837 shutdown_connections 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- 172.21.15.99:0/1408674837 wait complete. 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 Processor -- start 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- start start 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec630c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a892b2dcb0 con 0x55a892b2cca0 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec4601640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56496/0 (socket says 172.21.15.99:56496) 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.447+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 learned_addr learned my addr 172.21.15.99:0/547593961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a892b34790 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5ec4601640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc043040 tx=0x7f5ebc04c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5da17fa640 1 -- 172.21.15.99:0/547593961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc045030 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5da17fa640 1 -- 172.21.15.99:0/547593961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc0298f0 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a892b34a20 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5da17fa640 1 -- 172.21.15.99:0/547593961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ebc03fe60 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.448+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a892b376d0 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5da17fa640 1 -- 172.21.15.99:0/547593961 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ebc016040 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5da17fa640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d8c036b90 0x7f5d8c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5da17fa640 1 -- 172.21.15.99:0/547593961 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5ebc046070 con 0x55a892b2cca0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d8c036b90 0x7f5d8c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892b3fc30 0x55a892b420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b42840 con 0x55a892b3fc30 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892b3fc30 0x55a892b420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.449+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d8c036b90 0x7f5d8c039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4059f90 tx=0x7f5eb4098000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892b3fc30 0x55a892b420f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb8009050 con 0x55a892b3fc30 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 realm 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b3f080 con 0x55a892b3fc30 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb8009050 con 0x55a892b3fc30 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b43320 con 0x55a892b3fc30 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb8009050 con 0x55a892b3fc30 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.450+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b43bf0 con 0x55a892b3fc30 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5eb8009050 con 0x55a892b3fc30 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b444a0 0x55a892b46890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b46fd0 con 0x55a892b444a0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec4601640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b444a0 0x55a892b46890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec4601640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b444a0 0x55a892b46890 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ebc028070 con 0x55a892b444a0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 20 searching for the correct realm 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a892b49080 0x55a892b4b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.451+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a892b49080 0x55a892b4b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec3e00640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a892b49080 0x55a892b4b540 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ebc028070 con 0x55a892b444a0 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec4601640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ebc021020 0x7f5ebc04c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.452+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ebc021020 0x7f5ebc04c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ebc021020 0x7f5ebc04c8e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8009050 con 0x7f5ebc021020 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8009050 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.453+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ebc05d040 con 0x55a892b444a0 2024-09-13T23:26:31.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.454+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.455+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5ebc05d040 con 0x55a892b444a0 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.456+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.457+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ebc05d040 con 0x55a892b444a0 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.458+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ebc05d040 con 0x55a892b444a0 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b49080 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.459+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x7f5ebc021020 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b3fc30 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4bc10 con 0x55a892b444a0 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b47ab0 con 0x55a892b3fc30 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.460+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b476c0 con 0x55a892b3fc30 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b48420 con 0x55a892b444a0 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 zone default found 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 4 Realm: () 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 zonegroup default 2024-09-13T23:26:31.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4c540 con 0x7f5ebc021020 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.461+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4c150 con 0x55a892b49080 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4e7f0 con 0x55a892b49080 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 20 started sync module instance, tier type = 2024-09-13T23:26:31.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.462+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4dc00 con 0x55a892b444a0 2024-09-13T23:26:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.463+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.463+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182504194336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4dc00 con 0x55a892b444a0 2024-09-13T23:26:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.463+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4f300 con 0x55a892b3fc30 2024-09-13T23:26:31.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.464+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182504194336] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.464+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.464+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182504197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4dc00 con 0x55a892b3fc30 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.464+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4fdb0 con 0x55a892b49080 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.465+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.466+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182504200336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b50650 con 0x55a892b49080 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.466+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182504197584] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.466+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b51130 con 0x55a892b444a0 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.467+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.467+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182504205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b51520 con 0x55a892b444a0 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.467+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b51f60 con 0x55a892b3fc30 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.467+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182504205376] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.468+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.468+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182504208944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b51f20 con 0x55a892b3fc30 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.468+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b529b0 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.468+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182504200336] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.469+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.469+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182504211648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b529b0 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.469+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b533c0 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.469+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182504208944] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.470+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182504211648] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.470+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.470+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182504202656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b52f10 con 0x7f5ebc021020 2024-09-13T23:26:31.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.470+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b537e0 con 0x7f5ebc021020 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182504202656] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182504191824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b539c0 con 0x7f5ebc021020 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=0 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=1 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=2 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=3 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=4 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=5 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.471+0000 7f5ec630c800 20 add_watcher() i=6 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.472+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182504191824] v33'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.472+0000 7f5ec630c800 20 add_watcher() i=7 2024-09-13T23:26:31.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.472+0000 7f5ec630c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.472+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b56d90 con 0x55a892b3fc30 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.473+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.473+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182504216752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b54180 con 0x55a892b3fc30 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182504216752] v33'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 5 note: GC not initialized 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5d78fe1640 20 reqs_thread_entry: start 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 20 Filter name: none 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5cf27fc640 20 reqs_thread_entry: start 2024-09-13T23:26:31.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.474+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b89bd0 con 0x55a892b3fc30 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.475+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.475+0000 7f5ec630c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.475+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a892b8b120 con 0x7f5ebc021020 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.475+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.476+0000 7f5d79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.476+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182504216752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b88680 con 0x55a892b3fc30 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.477+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94182504216752] v33'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.477+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182504194336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b88680 con 0x55a892b444a0 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.478+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94182504194336] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.478+0000 7f5ec630c800 20 remove_watcher() i=0 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.478+0000 7f5ec630c800 2 removed watcher, disabling cache 2024-09-13T23:26:31.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.478+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182504197584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4e100 con 0x55a892b3fc30 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.480+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94182504197584] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.480+0000 7f5ec630c800 20 remove_watcher() i=1 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.480+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182504200336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4edd0 con 0x55a892b49080 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.481+0000 7f5ec3e00640 1 -- 172.21.15.99:0/547593961 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94182504200336] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb4077410 con 0x55a892b49080 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.481+0000 7f5ec630c800 20 remove_watcher() i=2 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.481+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182504205376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4edd0 con 0x55a892b444a0 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.482+0000 7f5ec4601640 1 -- 172.21.15.99:0/547593961 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94182504205376] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ebc065040 con 0x55a892b444a0 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.482+0000 7f5ec630c800 20 remove_watcher() i=3 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.482+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182504208944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b50c40 con 0x55a892b3fc30 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.483+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94182504208944] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x55a892b3fc30 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.483+0000 7f5ec630c800 20 remove_watcher() i=4 2024-09-13T23:26:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.483+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182504211648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4edd0 con 0x7f5ebc021020 2024-09-13T23:26:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.484+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94182504211648] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.484+0000 7f5ec630c800 20 remove_watcher() i=5 2024-09-13T23:26:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.484+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182504202656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b51a30 con 0x7f5ebc021020 2024-09-13T23:26:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.485+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94182504202656] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.485+0000 7f5ec630c800 20 remove_watcher() i=6 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.485+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182504191824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a892b4edd0 con 0x7f5ebc021020 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94182504191824] v33'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5eb8029040 con 0x7f5ebc021020 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 20 remove_watcher() i=7 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ebc021020 msgr2=0x7f5ebc04c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ebc021020 0x7f5ebc04c8e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892b3fc30 msgr2=0x55a892b420f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892b3fc30 0x55a892b420f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b444a0 msgr2=0x55a892b46890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b444a0 0x55a892b46890 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a892b49080 msgr2=0x55a892b4b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a892b49080 0x55a892b4b540 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d8c036b90 msgr2=0x7f5d8c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d8c036b90 0x7f5d8c039050 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4059f90 tx=0x7f5eb4098000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 msgr2=0x55a892b34250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc043040 tx=0x7f5ebc04c560 comp rx=0 tx=0).stop 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec35ff640 1 -- 172.21.15.99:0/547593961 reap_dead start 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 shutdown_connections 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/547593961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b2cca0 0x55a892b34250 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 >> 172.21.15.99:0/547593961 conn(0x55a892b29090 msgr2=0x55a892b27160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 shutdown_connections 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/547593961 wait complete. 2024-09-13T23:26:31.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 msgr2=0x7f5d9c0390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 0x7f5d9c0390c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400a3f0 tx=0x7f5eb404ff90 comp rx=0 tx=0).stop 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 msgr2=0x55a892b20480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55a892b06420 tx=0x7f5ebc00beb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 shutdown_connections 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5d9c036c00 0x7f5d9c0390c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 --2- 172.21.15.99:0/3760822124 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a892b20060 0x55a892b20480 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 >> 172.21.15.99:0/3760822124 conn(0x55a892b15020 msgr2=0x55a892b17ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 shutdown_connections 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.486+0000 7f5ec630c800 1 -- 172.21.15.99:0/3760822124 wait complete. 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 msgr2=0x55a892b0c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 0x55a892b0c3e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 msgr2=0x55a892b11040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 0x55a892b11040 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 msgr2=0x7f5dac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 0x7f5dac039000 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000f60 tx=0x7f5eb80012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 msgr2=0x55a892b05370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4065040 tx=0x7f5eb4003330 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 shutdown_connections 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a892b0ec50 0x55a892b11040 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a892a11b80 0x55a892b0c3e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5dac036b40 0x7f5dac039000 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 --2- 172.21.15.99:0/4160234647 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a8929805f0 0x55a892b05370 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 >> 172.21.15.99:0/4160234647 conn(0x55a892a06db0 msgr2=0x55a892af7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 shutdown_connections 2024-09-13T23:26:31.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.487+0000 7f5ec630c800 1 -- 172.21.15.99:0/4160234647 wait complete. 2024-09-13T23:26:31.499 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T23:26:31.500 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T23:26:31.500 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:26:31.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T23:26:31.500 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T23:26:31.547 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.547 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.546+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.546+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.546+0000 7f8f8ab0c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b057b0f4e0 0x55b057b0f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.546+0000 7f8f8ab0c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0579cfb30 con 0x55b057b0fe20 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.546+0000 7f8f8ab0c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b0579b1360 con 0x55b057b0f4e0 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.547+0000 7f8f88600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b057b0f4e0 0x55b057b0f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.547+0000 7f8f7ffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b057b0fe20 0x55b057b149a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46936/0 (socket says 172.21.15.99:46936) 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.547+0000 7f8f7ffff640 1 -- 172.21.15.99:0/3697445986 learned_addr learned my addr 172.21.15.99:0/3697445986 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.547+0000 7f8f88600640 1 -- 172.21.15.99:0/3697445986 >> v1:172.21.15.43:6789/0 conn(0x55b057b0fe20 legacy=0x55b057b149a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.547+0000 7f8f88600640 1 -- 172.21.15.99:0/3697445986 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0579d7e00 con 0x55b057b0f4e0 2024-09-13T23:26:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f88600640 1 --2- 172.21.15.99:0/3697445986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057b0f8e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800a470 tx=0x7f8f78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3928a1f8d0a1fae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f87dff640 1 -- 172.21.15.99:0/3697445986 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78053570 con 0x55b057b0f4e0 2024-09-13T23:26:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f87dff640 1 -- 172.21.15.99:0/3697445986 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f78058070 con 0x55b057b0f4e0 2024-09-13T23:26:31.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f87dff640 1 -- 172.21.15.99:0/3697445986 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78053880 con 0x55b057b0f4e0 2024-09-13T23:26:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/3697445986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 msgr2=0x55b057b0f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.549+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/3697445986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057b0f8e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800a470 tx=0x7f8f78045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:31.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.550+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/3697445986 shutdown_connections 2024-09-13T23:26:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.550+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/3697445986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057b0f8e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.550+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/3697445986 >> 172.21.15.99:0/3697445986 conn(0x55b057b0add0 msgr2=0x55b057b0d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.550+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/3697445986 shutdown_connections 2024-09-13T23:26:31.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.550+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/3697445986 wait complete. 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.563+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.563+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f8ab0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f8ab0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b057a5c360 con 0x55b057b0f4e0 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f88600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f88600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56508/0 (socket says 172.21.15.99:56508) 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f88600640 1 -- 172.21.15.99:0/2135047775 learned_addr learned my addr 172.21.15.99:0/2135047775 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f88600640 1 -- 172.21.15.99:0/2135047775 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0579a9bc0 con 0x55b057b0f4e0 2024-09-13T23:26:31.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.564+0000 7f8f88600640 1 --2- 172.21.15.99:0/2135047775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8f78025c20 tx=0x7f8f78051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20d62535131ea77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8e7660c640 1 -- 172.21.15.99:0/2135047775 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78053ba0 con 0x55b057b0f4e0 2024-09-13T23:26:31.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8e7660c640 1 -- 172.21.15.99:0/2135047775 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f78063030 con 0x55b057b0f4e0 2024-09-13T23:26:31.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8e7660c640 1 -- 172.21.15.99:0/2135047775 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78053440 con 0x55b057b0f4e0 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2135047775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 msgr2=0x55b057bfe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2135047775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8f78025c20 tx=0x7f8f78051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2135047775 shutdown_connections 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2135047775 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057bfe7f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2135047775 >> 172.21.15.99:0/2135047775 conn(0x55b057b0add0 msgr2=0x55b057bfa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2135047775 shutdown_connections 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.565+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2135047775 wait complete. 2024-09-13T23:26:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f8ab0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f8ab0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b057b16500 con 0x55b057b0f4e0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f88600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f88600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56518/0 (socket says 172.21.15.99:56518) 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f88600640 1 -- 172.21.15.99:0/852619464 learned_addr learned my addr 172.21.15.99:0/852619464 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.566+0000 7f8f88600640 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0579bdfe0 con 0x55b057b0f4e0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8f88600640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55b057bff650 tx=0x7f8f78002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8e74e09640 1 -- 172.21.15.99:0/852619464 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78078070 con 0x55b057b0f4e0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8e74e09640 1 -- 172.21.15.99:0/852619464 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f78053570 con 0x55b057b0f4e0 2024-09-13T23:26:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b057c09e80 con 0x55b057b0f4e0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8e74e09640 1 -- 172.21.15.99:0/852619464 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f78053850 con 0x55b057b0f4e0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.567+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b057c0a400 con 0x55b057b0f4e0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8e74e09640 1 -- 172.21.15.99:0/852619464 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f7807b070 con 0x55b057b0f4e0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8e74e09640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 0x7f8e70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8e74e09640 1 -- 172.21.15.99:0/852619464 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8f78070070 con 0x55b057b0f4e0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 0x7f8e70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 0x55b057c0e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c0e8b0 con 0x55b057b0fe20 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f88e01640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 0x55b057c0e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 0x7f8e70039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f70000f60 tx=0x7f8f700012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.568+0000 7f8f88e01640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 0x55b057c0e240 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f88e01640 1 -- 172.21.15.99:0/852619464 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f8000a4a0 con 0x55b057b0fe20 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c0b7f0 con 0x55b057b0fe20 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f88e01640 1 -- 172.21.15.99:0/852619464 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f8000a4a0 con 0x55b057b0fe20 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 0x55b057c13040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c13730 con 0x55b057c10c50 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f88600640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 0x55b057c13040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.569+0000 7f8f88600640 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 0x55b057c13040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f88600640 1 -- 172.21.15.99:0/852619464 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c10c50 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c0fa30 con 0x55b057b0fe20 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f88e01640 1 -- 172.21.15.99:0/852619464 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f8000a4a0 con 0x55b057b0fe20 2024-09-13T23:26:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c0ff10 con 0x55b057c10c50 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f88600640 1 -- 172.21.15.99:0/852619464 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c10c50 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.570+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f8ab0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f8ab0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b0579ab580 con 0x55b057c21f90 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56520/0 (socket says 172.21.15.99:56520) 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f88e01640 1 -- 172.21.15.99:0/2731265487 learned_addr learned my addr 172.21.15.99:0/2731265487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.571+0000 7f8f88e01640 1 -- 172.21.15.99:0/2731265487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b057c228f0 con 0x55b057c21f90 2024-09-13T23:26:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8f88e01640 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55b057c0ecb0 tx=0x7f8f800163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8e6dffb640 1 -- 172.21.15.99:0/2731265487 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f80013450 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8e6dffb640 1 -- 172.21.15.99:0/2731265487 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f800135f0 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8e6dffb640 1 -- 172.21.15.99:0/2731265487 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f800138d0 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b057c22b80 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b057c25860 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.572+0000 7f8e6dffb640 1 -- 172.21.15.99:0/2731265487 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f80011040 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8e6dffb640 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 0x7f8e60039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8e6dffb640 1 -- 172.21.15.99:0/2731265487 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8f8000e040 con 0x55b057c21f90 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f88600640 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 0x7f8e60039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f88600640 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 0x7f8e60039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b057c0f200 tx=0x7f8f7808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f8ab0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f8ab0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b057bfef40 con 0x55b057c070b0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.573+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56524/0 (socket says 172.21.15.99:56524) 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f88e01640 1 -- 172.21.15.99:0/1656090872 learned_addr learned my addr 172.21.15.99:0/1656090872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f88e01640 1 -- 172.21.15.99:0/1656090872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b057c07a80 con 0x55b057c070b0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f88e01640 1 --2- 172.21.15.99:0/1656090872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8f8004cdd0 tx=0x7f8f80029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5508dbc89d087f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8e5f7fe640 1 -- 172.21.15.99:0/1656090872 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8004a020 con 0x55b057c070b0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8e5f7fe640 1 -- 172.21.15.99:0/1656090872 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8002a570 con 0x55b057c070b0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8e5f7fe640 1 -- 172.21.15.99:0/1656090872 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8001f500 con 0x55b057c070b0 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/1656090872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 msgr2=0x55b057c074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.574+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/1656090872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8f8004cdd0 tx=0x7f8f80029fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/1656090872 shutdown_connections 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/1656090872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c074b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/1656090872 >> 172.21.15.99:0/1656090872 conn(0x55b057c2b040 msgr2=0x55b057c29140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/1656090872 shutdown_connections 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/1656090872 wait complete. 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 Processor -- start 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- start start 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f8ab0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b057c05de0 con 0x55b057c070b0 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f88e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56540/0 (socket says 172.21.15.99:56540) 2024-09-13T23:26:31.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 learned_addr learned my addr 172.21.15.99:0/785464284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.575+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b057c38880 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8f88e01640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8f8004cd30 tx=0x7f8f8004cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8e5dffb640 1 -- 172.21.15.99:0/785464284 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8003a070 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8e5dffb640 1 -- 172.21.15.99:0/785464284 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8001f710 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b057c38b10 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8e5dffb640 1 -- 172.21.15.99:0/785464284 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f8001fa30 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.576+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b057c3b7c0 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8e5dffb640 1 -- 172.21.15.99:0/785464284 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8f8003d070 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8e5dffb640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e50036ce0 0x7f8e500391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8e5dffb640 1 -- 172.21.15.99:0/785464284 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8f80015420 con 0x55b057c070b0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f88600640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e50036ce0 0x7f8e500391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057c43da0 0x55b057c46260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c469b0 con 0x55b057c43da0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057c43da0 0x55b057c46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f88600640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e50036ce0 0x7f8e500391a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f780539f0 tx=0x7f8f78092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.577+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057c43da0 0x55b057c46260 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f70009050 con 0x55b057c43da0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 realm 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c43240 con 0x55b057c43da0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f70009050 con 0x55b057c43da0 2024-09-13T23:26:31.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c47490 con 0x55b057c43da0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f70009050 con 0x55b057c43da0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c47d60 con 0x55b057c43da0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8f70009050 con 0x55b057c43da0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c48610 0x55b057c4aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.578+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4b140 con 0x55b057c48610 2024-09-13T23:26:31.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f88e01640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c48610 0x55b057c4aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f88e01640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c48610 0x55b057c4aa00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f8ab0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f8ab0c800 20 searching for the correct realm 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b057c4d1f0 0x55b057c4f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.579+0000 7f8f88600640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b057c4d1f0 0x55b057c4f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88600640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b057c4d1f0 0x55b057c4f6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88e01640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8f80058040 0x7f8f80040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.580+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8f80058040 0x7f8f80040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8f80058040 0x7f8f80040040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70009050 con 0x7f8f80058040 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70009050 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.581+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.582+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.583+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.584+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.585+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.586+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c4d1f0 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.587+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x7f8f80058040 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c43da0 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4fd80 con 0x55b057c48610 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4bbf0 con 0x55b057c43da0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.588+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4b800 con 0x55b057c43da0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c4c560 con 0x55b057c48610 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 zone default found 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 4 Realm: () 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 zonegroup default 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c506b0 con 0x7f8f80058040 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.589+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52490 con 0x55b057c4d1f0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52920 con 0x55b057c4d1f0 2024-09-13T23:26:31.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 started sync module instance, tier type = 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.590+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c518d0 con 0x55b057c48610 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.591+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.591+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94215875141104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c518d0 con 0x55b057c48610 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.591+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c534d0 con 0x55b057c43da0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.592+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94215875141104] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.592+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.592+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94215875145632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c518d0 con 0x55b057c43da0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.592+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c53f50 con 0x55b057c4d1f0 2024-09-13T23:26:31.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.593+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94215875145632] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.594+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.594+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94215875138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c51840 con 0x55b057c4d1f0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.594+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c54e40 con 0x55b057c48610 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.595+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94215875138592] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.595+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.595+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94215875152272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c54db0 con 0x55b057c48610 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.595+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c55c00 con 0x55b057c43da0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.596+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94215875152272] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.596+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.596+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94215875154480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c55c00 con 0x55b057c43da0 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.596+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c56610 con 0x7f8f80058040 2024-09-13T23:26:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.597+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94215875154480] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.597+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.597+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94215875155536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c56610 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.597+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c57050 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.598+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94215875155536] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.598+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.598+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94215875158368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c56640 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.598+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c579b0 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94215875158368] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94215875163264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c57970 con 0x7f8f80058040 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=0 2024-09-13T23:26:31.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=1 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=2 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=3 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=4 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=5 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.599+0000 7f8f8ab0c800 20 add_watcher() i=6 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.600+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94215875163264] v33'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.600+0000 7f8f8ab0c800 20 add_watcher() i=7 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.600+0000 7f8f8ab0c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.600+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c5add0 con 0x55b057c43da0 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.601+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.601+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94215875161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c582f0 con 0x55b057c43da0 2024-09-13T23:26:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94215875161472] v33'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8e3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 5 note: GC not initialized 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8e3d7e2640 20 reqs_thread_entry: start 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 20 Filter name: none 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8daeffd640 20 reqs_thread_entry: start 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.602+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c8ddf0 con 0x55b057c43da0 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.603+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.603+0000 7f8f8ab0c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:26:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.603+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b057c8f340 con 0x7f8f80058040 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.603+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.604+0000 7f8e3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.604+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94215875161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c5a280 con 0x55b057c43da0 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.605+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94215875161472] v33'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.605+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94215875141104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c56d80 con 0x55b057c48610 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.606+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94215875141104] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.606+0000 7f8f8ab0c800 20 remove_watcher() i=0 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.606+0000 7f8f8ab0c800 2 removed watcher, disabling cache 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.606+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94215875145632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c51dd0 con 0x55b057c43da0 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.607+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94215875145632] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.607+0000 7f8f8ab0c800 20 remove_watcher() i=1 2024-09-13T23:26:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.607+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94215875138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52fa0 con 0x55b057c4d1f0 2024-09-13T23:26:31.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.608+0000 7f8f88600640 1 -- 172.21.15.99:0/785464284 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94215875138592] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f7807a030 con 0x55b057c4d1f0 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.608+0000 7f8f8ab0c800 20 remove_watcher() i=2 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.608+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94215875152272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52fa0 con 0x55b057c48610 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.609+0000 7f8f88e01640 1 -- 172.21.15.99:0/785464284 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94215875152272] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f8003c030 con 0x55b057c48610 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.609+0000 7f8f8ab0c800 20 remove_watcher() i=3 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.609+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94215875154480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c54990 con 0x55b057c43da0 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.611+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94215875154480] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x55b057c43da0 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.611+0000 7f8f8ab0c800 20 remove_watcher() i=4 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.611+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94215875155536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52fa0 con 0x7f8f80058040 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.612+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94215875155536] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.612+0000 7f8f8ab0c800 20 remove_watcher() i=5 2024-09-13T23:26:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.612+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94215875158368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c54990 con 0x7f8f80058040 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.613+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94215875158368] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.613+0000 7f8f8ab0c800 20 remove_watcher() i=6 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.613+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94215875163264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b057c52fa0 con 0x7f8f80058040 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.614+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94215875163264] v33'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8f70029040 con 0x7f8f80058040 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.614+0000 7f8f8ab0c800 20 remove_watcher() i=7 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8f80058040 msgr2=0x7f8f80040040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8f80058040 0x7f8f80040040 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057c43da0 msgr2=0x55b057c46260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057c43da0 0x55b057c46260 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c48610 msgr2=0x55b057c4aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c48610 0x55b057c4aa00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b057c4d1f0 msgr2=0x55b057c4f6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b057c4d1f0 0x55b057c4f6b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e50036ce0 msgr2=0x7f8e500391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e50036ce0 0x7f8e500391a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8f780539f0 tx=0x7f8f78092000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 msgr2=0x55b057c38340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8f8004cd30 tx=0x7f8f8004cd60 comp rx=0 tx=0).stop 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f7ffff640 1 -- 172.21.15.99:0/785464284 reap_dead start 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 shutdown_connections 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/785464284 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c070b0 0x55b057c38340 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 >> 172.21.15.99:0/785464284 conn(0x55b057c2b040 msgr2=0x55b057c29110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 shutdown_connections 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/785464284 wait complete. 2024-09-13T23:26:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 msgr2=0x7f8e60039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 0x7f8e60039000 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55b057c0f200 tx=0x7f8f7808ec10 comp rx=0 tx=0).stop 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 msgr2=0x55b057c223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x55b057c0ecb0 tx=0x7f8f800163e0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 shutdown_connections 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e60036b40 0x7f8e60039000 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/2731265487 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057c21f90 0x55b057c223b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 >> 172.21.15.99:0/2731265487 conn(0x55b057c16f20 msgr2=0x55b057c19aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 shutdown_connections 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.615+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/2731265487 wait complete. 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 msgr2=0x55b057c0e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 0x55b057c0e240 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 msgr2=0x55b057c13040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 0x55b057c13040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 msgr2=0x7f8e70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 0x7f8e70039000 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f70000f60 tx=0x7f8f700012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 msgr2=0x55b057a83de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x55b057bff650 tx=0x7f8f78002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 shutdown_connections 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b057c10c50 0x55b057c13040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b057b0fe20 0x55b057c0e240 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8e70036b40 0x7f8e70039000 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 --2- 172.21.15.99:0/852619464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b057b0f4e0 0x55b057a83de0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 >> 172.21.15.99:0/852619464 conn(0x55b057b0add0 msgr2=0x55b057bf8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 shutdown_connections 2024-09-13T23:26:31.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.616+0000 7f8f8ab0c800 1 -- 172.21.15.99:0/852619464 wait complete. 2024-09-13T23:26:31.632 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T23:26:31.633 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T23:26:31.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:26:31.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T23:26:31.633 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T23:26:31.679 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9d2b3f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560729830d40 0x560729833130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9d2b3f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607296e9b30 con 0x56072979e610 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9d2b3f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5607296cb360 con 0x560729830d40 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9c7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560729830d40 0x560729833130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9ce890640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x56072979e610 0x56072982f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46942/0 (socket says 172.21.15.99:46942) 2024-09-13T23:26:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.679+0000 7fa9ce890640 1 -- 172.21.15.99:0/3700133449 learned_addr learned my addr 172.21.15.99:0/3700133449 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.680+0000 7fa9c7fff640 1 -- 172.21.15.99:0/3700133449 >> v1:172.21.15.43:6789/0 conn(0x56072979e610 legacy=0x56072982f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.680+0000 7fa9c7fff640 1 -- 172.21.15.99:0/3700133449 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607296f1e00 con 0x560729830d40 2024-09-13T23:26:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/3700133449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560729830d40 0x560729833130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800a470 tx=0x7fa9b8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc43ce8f1e63b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9ce08f640 1 -- 172.21.15.99:0/3700133449 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b8053570 con 0x560729830d40 2024-09-13T23:26:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9ce08f640 1 -- 172.21.15.99:0/3700133449 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b8058070 con 0x560729830d40 2024-09-13T23:26:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9ce08f640 1 -- 172.21.15.99:0/3700133449 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9b8053880 con 0x560729830d40 2024-09-13T23:26:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3700133449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560729830d40 msgr2=0x560729833130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3700133449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560729830d40 0x560729833130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa9b800a470 tx=0x7fa9b8045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3700133449 shutdown_connections 2024-09-13T23:26:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3700133449 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560729830d40 0x560729833130 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3700133449 >> 172.21.15.99:0/3700133449 conn(0x560729824db0 msgr2=0x5607298271d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3700133449 shutdown_connections 2024-09-13T23:26:31.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.682+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3700133449 wait complete. 2024-09-13T23:26:31.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9d2b3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9d2b3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560729776360 con 0x56072979e610 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9ce890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9ce890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56550/0 (socket says 172.21.15.99:56550) 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.696+0000 7fa9ce890640 1 -- 172.21.15.99:0/2878081907 learned_addr learned my addr 172.21.15.99:0/2878081907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.697+0000 7fa9ce890640 1 -- 172.21.15.99:0/2878081907 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607296c3bc0 con 0x56072979e610 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.697+0000 7fa9ce890640 1 --2- 172.21.15.99:0/2878081907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0001d80 tx=0x7fa9c0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838d37e7ca6ff1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.697+0000 7fa8bce09640 1 -- 172.21.15.99:0/2878081907 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c0013030 con 0x56072979e610 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.697+0000 7fa8bce09640 1 -- 172.21.15.99:0/2878081907 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c000e470 con 0x56072979e610 2024-09-13T23:26:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.697+0000 7fa8bce09640 1 -- 172.21.15.99:0/2878081907 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c000e810 con 0x56072979e610 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/2878081907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 msgr2=0x56072991bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/2878081907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0001d80 tx=0x7fa9c0001e70 comp rx=0 tx=0).stop 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/2878081907 shutdown_connections 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/2878081907 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x56072991bac0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/2878081907 >> 172.21.15.99:0/2878081907 conn(0x560729824db0 msgr2=0x560729917480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/2878081907 shutdown_connections 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/2878081907 wait complete. 2024-09-13T23:26:31.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9d2b3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560729833910 con 0x56072979e610 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9ce890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9ce890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56562/0 (socket says 172.21.15.99:56562) 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.698+0000 7fa9ce890640 1 -- 172.21.15.99:0/3096100872 learned_addr learned my addr 172.21.15.99:0/3096100872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa9ce890640 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607296d7fe0 con 0x56072979e610 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa9ce890640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0004000 tx=0x7fa9c0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa8bb606640 1 -- 172.21.15.99:0/3096100872 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c0027070 con 0x56072979e610 2024-09-13T23:26:31.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa8bb606640 1 -- 172.21.15.99:0/3096100872 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c0001400 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560729923a10 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa8bb606640 1 -- 172.21.15.99:0/3096100872 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c0019a70 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.699+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729923f30 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa8bb606640 1 -- 172.21.15.99:0/3096100872 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9c002a070 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa8bb606640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 0x7fa8b4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa8bb606640 1 -- 172.21.15.99:0/3096100872 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa9c001f070 con 0x56072979e610 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 0x7fa8b4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 0x56072992a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072992aad0 con 0x560729830d40 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.700+0000 7fa9cf091640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 0x56072992a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 0x7fa8b4039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8057000 tx=0x7fa9b8052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9cf091640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 0x56072992a540 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9cf091640 1 -- 172.21.15.99:0/3096100872 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c800a4a0 con 0x560729830d40 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729927b10 con 0x560729830d40 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9cf091640 1 -- 172.21.15.99:0/3096100872 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9c800a4a0 con 0x560729830d40 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 0x56072992f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072992f8b0 con 0x56072992ce20 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.701+0000 7fa9ce890640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 0x56072992f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9ce890640 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 0x56072992f210 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9ce890640 1 -- 172.21.15.99:0/3096100872 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9c0029030 con 0x56072992ce20 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072992bcc0 con 0x560729830d40 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9cf091640 1 -- 172.21.15.99:0/3096100872 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9c800a4a0 con 0x560729830d40 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072992c1a0 con 0x56072992ce20 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.702+0000 7fa9ce890640 1 -- 172.21.15.99:0/3096100872 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9c0029030 con 0x56072992ce20 2024-09-13T23:26:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9d2b3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9d2b3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5607296c5580 con 0x56072993e270 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56580/0 (socket says 172.21.15.99:56580) 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.703+0000 7fa9cf091640 1 -- 172.21.15.99:0/1817196755 learned_addr learned my addr 172.21.15.99:0/1817196755 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa9cf091640 1 -- 172.21.15.99:0/1817196755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072993ebd0 con 0x56072993e270 2024-09-13T23:26:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa9cf091640 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x560729924580 tx=0x7fa9c80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa8b8e01640 1 -- 172.21.15.99:0/1817196755 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c8013640 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa8b8e01640 1 -- 172.21.15.99:0/1817196755 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c80137e0 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56072993ee60 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa8b8e01640 1 -- 172.21.15.99:0/1817196755 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c8013ae0 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.704+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729941b40 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa8b8e01640 1 -- 172.21.15.99:0/1817196755 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9c8011040 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa8b8e01640 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 0x7fa8a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa8b8e01640 1 -- 172.21.15.99:0/1817196755 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa9c800e040 con 0x56072993e270 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 0x7fa8a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 0x7fa8a8039050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x560729927a30 tx=0x7fa9c002bed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9d2b3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.705+0000 7fa9d2b3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072991c270 con 0x56072994af30 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56590/0 (socket says 172.21.15.99:56590) 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa9cf091640 1 -- 172.21.15.99:0/471295410 learned_addr learned my addr 172.21.15.99:0/471295410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa9cf091640 1 -- 172.21.15.99:0/471295410 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072994b900 con 0x56072994af30 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa9cf091640 1 --2- 172.21.15.99:0/471295410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800afb0 tx=0x7fa9c801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fb6e88123dde62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa8b27fc640 1 -- 172.21.15.99:0/471295410 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c8021570 con 0x56072994af30 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa8b27fc640 1 -- 172.21.15.99:0/471295410 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c801f340 con 0x56072994af30 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.706+0000 7fa8b27fc640 1 -- 172.21.15.99:0/471295410 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c8014cc0 con 0x56072994af30 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/471295410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 msgr2=0x56072994b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/471295410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800afb0 tx=0x7fa9c801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/471295410 shutdown_connections 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/471295410 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x56072994b330 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/471295410 >> 172.21.15.99:0/471295410 conn(0x560729947290 msgr2=0x560729945390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/471295410 shutdown_connections 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/471295410 wait complete. 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 Processor -- start 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- start start 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x560729952360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9d2b3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56072994bf70 con 0x56072994af30 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x560729952360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9cf091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x560729952360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56598/0 (socket says 172.21.15.99:56598) 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 learned_addr learned my addr 172.21.15.99:0/1263704701 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.707+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607299528a0 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa9cf091640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x560729952360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8048010 tx=0x7fa9c804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa8b0ff9640 1 -- 172.21.15.99:0/1263704701 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c8013e60 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa8b0ff9640 1 -- 172.21.15.99:0/1263704701 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c8040360 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560729952b30 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa8b0ff9640 1 -- 172.21.15.99:0/1263704701 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9c804e2b0 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.708+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560729952b30 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa8b0ff9640 1 -- 172.21.15.99:0/1263704701 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa9c804e470 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa8b0ff9640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa898036b90 0x7fa898039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa8b0ff9640 1 -- 172.21.15.99:0/1263704701 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa9c8007050 con 0x56072994af30 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa898036b90 0x7fa898039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072995dbd0 0x560729960090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607299607e0 con 0x56072995dbd0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.709+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072995dbd0 0x560729960090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa898036b90 0x7fa898039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000df90 tx=0x7fa9c0047000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072995dbd0 0x560729960090 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 realm 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729960c10 con 0x56072995dbd0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607299614b0 con 0x56072995dbd0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.710+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729961850 con 0x56072995dbd0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5607299625b0 0x5607299649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729964ee0 con 0x5607299625b0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9cf091640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5607299625b0 0x5607299649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9cf091640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5607299625b0 0x5607299649a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 20 searching for the correct realm 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560729966f60 0x560729969420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.711+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560729966f60 0x560729969420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9ce890640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560729966f60 0x560729969420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9cf091640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa9c8044070 0x7fa9c804b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.712+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa9c8044070 0x7fa9c804b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.713+0000 7fa9c7fff640 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa9c8044070 0x7fa9c804b250 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.713+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.713+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.713+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.713+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.714+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.715+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.716+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.717+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.718+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x560729966f60 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.719+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x7fa9c8044070 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x56072995dbd0 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560729969af0 con 0x5607299625b0 2024-09-13T23:26:31.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.720+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729965960 con 0x56072995dbd0 2024-09-13T23:26:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729965570 con 0x56072995dbd0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607299662d0 con 0x5607299625b0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 zone default found 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 4 Realm: () 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 zonegroup default 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072996a420 con 0x7fa9c8044070 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.721+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072996c200 con 0x560729966f60 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56072996c690 con 0x560729966f60 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 20 started sync module instance, tier type = 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.722+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996b640 con 0x5607299625b0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.723+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.723+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94588762503728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996b2a0 con 0x5607299625b0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.723+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996d5c0 con 0x56072995dbd0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.724+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94588762503728] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.724+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.724+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94588762508016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996d5c0 con 0x56072995dbd0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.724+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996e000 con 0x560729966f60 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.725+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.725+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94588762512080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996e8a0 con 0x560729966f60 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.725+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996f3a0 con 0x5607299625b0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.725+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94588762508016] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.726+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94588762512080] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.726+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.726+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94588762514416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996d110 con 0x5607299625b0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.726+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996fdb0 con 0x56072995dbd0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.727+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94588762514416] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.727+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.728+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94588762517136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996fdb0 con 0x56072995dbd0 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.728+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729970770 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.728+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94588762517136] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.729+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.729+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94588762520288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729970770 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.729+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729971130 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.730+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94588762520288] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.730+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.730+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94588762522784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729971130 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.730+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729971af0 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94588762522784] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94588762525280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729971af0 con 0x7fa9c8044070 2024-09-13T23:26:31.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=0 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=1 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=2 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=3 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=4 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=5 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.731+0000 7fa9d2b3f800 20 add_watcher() i=6 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94588762525280] v33'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9d2b3f800 20 add_watcher() i=7 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9d2b3f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560729974e00 con 0x56072995dbd0 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.732+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94588762527664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729972080 con 0x56072995dbd0 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.733+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94588762527664] v33'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.733+0000 7fa8857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 5 note: GC not initialized 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa7fffff640 20 reqs_thread_entry: start 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 Filter name: none 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa7fdffb640 20 reqs_thread_entry: start 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607299a7d50 con 0x56072995dbd0 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.734+0000 7fa9d2b3f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:26:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.735+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5607299a92a0 con 0x7fa9c8044070 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.735+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.736+0000 7fa8857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.736+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94588762527664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560729973da0 con 0x56072995dbd0 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.737+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94588762527664] v33'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.737+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94588762503728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607299717b0 con 0x5607299625b0 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.738+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94588762503728] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.738+0000 7fa9d2b3f800 20 remove_watcher() i=0 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.738+0000 7fa9d2b3f800 2 removed watcher, disabling cache 2024-09-13T23:26:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.738+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94588762508016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607299717b0 con 0x56072995dbd0 2024-09-13T23:26:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.739+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94588762508016] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.739+0000 7fa9d2b3f800 20 remove_watcher() i=1 2024-09-13T23:26:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.739+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94588762512080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996caf0 con 0x560729966f60 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.740+0000 7fa9ce890640 1 -- 172.21.15.99:0/1263704701 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94588762512080] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c003e070 con 0x560729966f60 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.740+0000 7fa9d2b3f800 20 remove_watcher() i=2 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.740+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94588762514416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607299717b0 con 0x5607299625b0 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.741+0000 7fa9cf091640 1 -- 172.21.15.99:0/1263704701 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94588762514416] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c8055070 con 0x5607299625b0 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.741+0000 7fa9d2b3f800 20 remove_watcher() i=3 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.741+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94588762517136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996caf0 con 0x56072995dbd0 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.742+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94588762517136] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x56072995dbd0 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.742+0000 7fa9d2b3f800 20 remove_watcher() i=4 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.742+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94588762520288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5607299717b0 con 0x7fa9c8044070 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.744+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94588762520288] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.744+0000 7fa9d2b3f800 20 remove_watcher() i=5 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.744+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94588762522784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996caf0 con 0x7fa9c8044070 2024-09-13T23:26:31.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.745+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94588762522784] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.745+0000 7fa9d2b3f800 20 remove_watcher() i=6 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.745+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94588762525280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56072996fae0 con 0x7fa9c8044070 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94588762525280] v33'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9b8051070 con 0x7fa9c8044070 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 20 remove_watcher() i=7 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa9c8044070 msgr2=0x7fa9c804b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa9c8044070 0x7fa9c804b250 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072995dbd0 msgr2=0x560729960090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56072995dbd0 0x560729960090 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5607299625b0 msgr2=0x5607299649a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5607299625b0 0x5607299649a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560729966f60 msgr2=0x560729969420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560729966f60 0x560729969420 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa898036b90 msgr2=0x7fa898039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa898036b90 0x7fa898039050 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000df90 tx=0x7fa9c0047000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 msgr2=0x560729952360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1263704701 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072994af30 0x560729952360 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8048010 tx=0x7fa9c804cd90 comp rx=0 tx=0).stop 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 reap_dead start 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9c7fff640 1 -- 172.21.15.99:0/1263704701 reap_dead start 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 shutdown_connections 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 >> 172.21.15.99:0/1263704701 conn(0x560729947290 msgr2=0x560729945360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 shutdown_connections 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1263704701 wait complete. 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 msgr2=0x7fa8a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 0x7fa8a8039050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x560729927a30 tx=0x7fa9c002bed0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 msgr2=0x56072993e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x560729924580 tx=0x7fa9c80167b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 shutdown_connections 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8a8036b90 0x7fa8a8039050 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/1817196755 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072993e270 0x56072993e690 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 >> 172.21.15.99:0/1817196755 conn(0x560729933200 msgr2=0x560729935d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 shutdown_connections 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.746+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/1817196755 wait complete. 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 msgr2=0x56072992a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 0x56072992a540 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 msgr2=0x56072992f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 0x56072992f210 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 msgr2=0x7fa8b4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 0x7fa8b4039000 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8057000 tx=0x7fa9b8052000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 msgr2=0x5607299234d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0004000 tx=0x7fa9c0000bc0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 shutdown_connections 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56072992ce20 0x56072992f210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560729830d40 0x56072992a540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa8b4036b40 0x7fa8b4039000 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 --2- 172.21.15.99:0/3096100872 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56072979e610 0x5607299234d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 >> 172.21.15.99:0/3096100872 conn(0x560729824db0 msgr2=0x560729915d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 shutdown_connections 2024-09-13T23:26:31.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.747+0000 7fa9d2b3f800 1 -- 172.21.15.99:0/3096100872 wait complete. 2024-09-13T23:26:31.759 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T23:26:31.759 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:26:31.760 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:26:31.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T23:26:31.760 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T23:26:31.806 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.806 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.805+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e7b0c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d62e4a44e0 0x55d62e4a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e7b0c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d62e364b30 con 0x55d62e4a4e20 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e7b0c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d62e346360 con 0x55d62e4a44e0 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e5600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d62e4a44e0 0x55d62e4a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e5600640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d62e4a44e0 0x55d62e4a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56602/0 (socket says 172.21.15.99:56602) 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e5600640 1 -- 172.21.15.99:0/921419020 learned_addr learned my addr 172.21.15.99:0/921419020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e5600640 1 -- 172.21.15.99:0/921419020 >> v1:172.21.15.43:6789/0 conn(0x55d62e4a4e20 legacy=0x55d62e4a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.806+0000 7f54e5600640 1 -- 172.21.15.99:0/921419020 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e36ce00 con 0x55d62e4a44e0 2024-09-13T23:26:31.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.808+0000 7f54e5600640 1 --2- 172.21.15.99:0/921419020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e4a48e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54d800a520 tx=0x7f54d8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7131f23547632052 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.808+0000 7f54e4dff640 1 -- 172.21.15.99:0/921419020 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d8055070 con 0x55d62e4a44e0 2024-09-13T23:26:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.808+0000 7f54e4dff640 1 -- 172.21.15.99:0/921419020 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d80515b0 con 0x55d62e4a44e0 2024-09-13T23:26:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.808+0000 7f54e4dff640 1 -- 172.21.15.99:0/921419020 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d80518d0 con 0x55d62e4a44e0 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 -- 172.21.15.99:0/921419020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 msgr2=0x55d62e4a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/921419020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e4a48e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f54d800a520 tx=0x7f54d8045ba0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 -- 172.21.15.99:0/921419020 shutdown_connections 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/921419020 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e4a48e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 -- 172.21.15.99:0/921419020 >> 172.21.15.99:0/921419020 conn(0x55d62e49fdd0 msgr2=0x55d62e4a21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 -- 172.21.15.99:0/921419020 shutdown_connections 2024-09-13T23:26:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.809+0000 7f54e7b0c800 1 -- 172.21.15.99:0/921419020 wait complete. 2024-09-13T23:26:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.822+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.822+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e7b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e7b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d62e3f1360 con 0x55d62e4a44e0 2024-09-13T23:26:31.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56616/0 (socket says 172.21.15.99:56616) 2024-09-13T23:26:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e5600640 1 -- 172.21.15.99:0/980875895 learned_addr learned my addr 172.21.15.99:0/980875895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e5600640 1 -- 172.21.15.99:0/980875895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e33ebc0 con 0x55d62e4a44e0 2024-09-13T23:26:31.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.823+0000 7f54e5600640 1 --2- 172.21.15.99:0/980875895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f54d8025da0 tx=0x7f54d8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd61e886984dbf99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f53d3606640 1 -- 172.21.15.99:0/980875895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d8051950 con 0x55d62e4a44e0 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f53d3606640 1 -- 172.21.15.99:0/980875895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d8051af0 con 0x55d62e4a44e0 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f53d3606640 1 -- 172.21.15.99:0/980875895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d8051dd0 con 0x55d62e4a44e0 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 -- 172.21.15.99:0/980875895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 msgr2=0x55d62e418da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/980875895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f54d8025da0 tx=0x7f54d8051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 -- 172.21.15.99:0/980875895 shutdown_connections 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/980875895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e418da0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 -- 172.21.15.99:0/980875895 >> 172.21.15.99:0/980875895 conn(0x55d62e49fdd0 msgr2=0x55d62e58f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 -- 172.21.15.99:0/980875895 shutdown_connections 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.824+0000 7f54e7b0c800 1 -- 172.21.15.99:0/980875895 wait complete. 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e7b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e7b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d62e4ab500 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e5600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56622/0 (socket says 172.21.15.99:56622) 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e5600640 1 -- 172.21.15.99:0/731726605 learned_addr learned my addr 172.21.15.99:0/731726605 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e5600640 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e352fe0 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.825+0000 7f54e5600640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54d8067040 tx=0x7f54d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f53d1e03640 1 -- 172.21.15.99:0/731726605 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d8073070 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f53d1e03640 1 -- 172.21.15.99:0/731726605 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d805a450 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d62e59e910 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f53d1e03640 1 -- 172.21.15.99:0/731726605 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54d805a730 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62e59ee90 con 0x55d62e4a44e0 2024-09-13T23:26:31.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.826+0000 7f53d1e03640 1 -- 172.21.15.99:0/731726605 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54d8076070 con 0x55d62e4a44e0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f53d1e03640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 0x7f53cc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f53d1e03640 1 -- 172.21.15.99:0/731726605 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f54d8062070 con 0x55d62e4a44e0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54dffff640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 0x7f53cc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 0x55d62e5a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5a59c0 con 0x55d62e4a4e20 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54e5e01640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 0x55d62e5a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54dffff640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 0x7f53cc039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54d0001e10 tx=0x7f54d0001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54e5e01640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 0x55d62e5a5440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.827+0000 7f54e5e01640 1 -- 172.21.15.99:0/731726605 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e4a4e20 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5a6280 con 0x55d62e4a4e20 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e5e01640 1 -- 172.21.15.99:0/731726605 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e4a4e20 2024-09-13T23:26:31.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 0x55d62e5aa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5aa7b0 con 0x55d62e5a7b90 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e5600640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 0x55d62e5aa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e5600640 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 0x55d62e5aa020 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e5600640 1 -- 172.21.15.99:0/731726605 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54d8075030 con 0x55d62e5a7b90 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.828+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5a6ad0 con 0x55d62e4a4e20 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.829+0000 7f54e5e01640 1 -- 172.21.15.99:0/731726605 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e4a4e20 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.829+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5a6eb0 con 0x55d62e5a7b90 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.829+0000 7f54e5600640 1 -- 172.21.15.99:0/731726605 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54d8075030 con 0x55d62e5a7b90 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.829+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.829+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e7b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e7b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d62e340580 con 0x55d62e5b9130 2024-09-13T23:26:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56626/0 (socket says 172.21.15.99:56626) 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e5e01640 1 -- 172.21.15.99:0/1231903123 learned_addr learned my addr 172.21.15.99:0/1231903123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e5e01640 1 -- 172.21.15.99:0/1231903123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e5b9a90 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e5e01640 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55d62e59f480 tx=0x7f54e00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f53caffd640 1 -- 172.21.15.99:0/1231903123 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e0013640 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f53caffd640 1 -- 172.21.15.99:0/1231903123 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e00137e0 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d62e5b9d20 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.830+0000 7f53caffd640 1 -- 172.21.15.99:0/1231903123 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e0013ae0 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.831+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62e5bca00 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.831+0000 7f53caffd640 1 -- 172.21.15.99:0/1231903123 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54e0011040 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.831+0000 7f53caffd640 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 0x7f53bc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.831+0000 7f53caffd640 1 -- 172.21.15.99:0/1231903123 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f54e000e040 con 0x55d62e5b9130 2024-09-13T23:26:31.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5600640 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 0x7f53bc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5600640 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 0x7f53bc039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55d62e5a2930 tx=0x7f54d80643b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e7b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e7b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d62e599a20 con 0x55d62e5c5df0 2024-09-13T23:26:31.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56630/0 (socket says 172.21.15.99:56630) 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5e01640 1 -- 172.21.15.99:0/1588480972 learned_addr learned my addr 172.21.15.99:0/1588480972 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.832+0000 7f54e5e01640 1 -- 172.21.15.99:0/1588480972 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e5c67c0 con 0x55d62e5c5df0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e5e01640 1 --2- 172.21.15.99:0/1588480972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54e000afb0 tx=0x7f54e001fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf8c3c48219e87c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1588480972 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e0021570 con 0x55d62e5c5df0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1588480972 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e001f340 con 0x55d62e5c5df0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f53c8ff9640 1 -- 172.21.15.99:0/1588480972 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e0014cc0 con 0x55d62e5c5df0 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1588480972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 msgr2=0x55d62e5c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1588480972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54e000afb0 tx=0x7f54e001fcc0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1588480972 shutdown_connections 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1588480972 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5c61f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1588480972 >> 172.21.15.99:0/1588480972 conn(0x55d62e5c2150 msgr2=0x55d62e5c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1588480972 shutdown_connections 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.833+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1588480972 wait complete. 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e7b0c800 1 Processor -- start 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e7b0c800 1 -- start start 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e7b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e7b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d62e5c6e30 con 0x55d62e5c5df0 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e5e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56638/0 (socket says 172.21.15.99:56638) 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 learned_addr learned my addr 172.21.15.99:0/2871359607 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62e5cd860 con 0x55d62e5c5df0 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.834+0000 7f54e5e01640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5cd320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54e004cd60 tx=0x7f54e004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f53baffd640 1 -- 172.21.15.99:0/2871359607 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e0040360 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f53baffd640 1 -- 172.21.15.99:0/2871359607 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e004e2b0 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d62e5cdaf0 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f53baffd640 1 -- 172.21.15.99:0/2871359607 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e004e590 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62e5d07a0 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.835+0000 7f53baffd640 1 -- 172.21.15.99:0/2871359607 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f54e003b020 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f53baffd640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53b0036b40 0x7f53b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f53baffd640 1 -- 172.21.15.99:0/2871359607 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f54e0039020 con 0x55d62e5c5df0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54e5600640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53b0036b40 0x7f53b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e5d8db0 0x55d62e5db270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5db9c0 con 0x55d62e5d8db0 2024-09-13T23:26:31.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54dffff640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e5d8db0 0x55d62e5db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54e5600640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53b0036b40 0x7f53b0039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f54d8064520 tx=0x7f54d808c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.836+0000 7f54dffff640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e5d8db0 0x55d62e5db270 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000bdb0 con 0x55d62e5d8db0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 realm 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5d8200 con 0x55d62e5d8db0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000bdb0 con 0x55d62e5d8db0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5dc4a0 con 0x55d62e5d8db0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d000bdb0 con 0x55d62e5d8db0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5dcd70 con 0x55d62e5d8db0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54d000bdb0 con 0x55d62e5d8db0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5dd620 0x55d62e5dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e0190 con 0x55d62e5dd620 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.837+0000 7f54e5e01640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5dd620 0x55d62e5dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e5e01640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5dd620 0x55d62e5dfa30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e7b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e7b0c800 20 searching for the correct realm 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d62e5e2240 0x55d62e5e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e5600640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d62e5e2240 0x55d62e5e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.838+0000 7f54e5600640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d62e5e2240 0x55d62e5e4700 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54e5e01640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f54e0044070 0x7f54e003b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.839+0000 7f54dffff640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f54e0044070 0x7f54e003b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f54e0044070 0x7f54e003b6a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000bdb0 con 0x7f54e0044070 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d000bdb0 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.840+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.841+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.842+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.843+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.844+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.845+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5e2240 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.846+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x7f54e0044070 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e4dd0 con 0x55d62e5dd620 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e0c40 con 0x55d62e5d8db0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.847+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e0850 con 0x55d62e5d8db0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e15b0 con 0x55d62e5dd620 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 zone default found 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 4 Realm: () 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 zonegroup default 2024-09-13T23:26:31.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e5700 con 0x7f54e0044070 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.848+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e7170 con 0x55d62e5e2240 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e75c0 con 0x55d62e5e2240 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 20 started sync module instance, tier type = 2024-09-13T23:26:31.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.849+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e6570 con 0x55d62e5dd620 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.850+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.850+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94378389301600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e6d80 con 0x55d62e5dd620 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.850+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e84f0 con 0x55d62e5d8db0 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.851+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94378389301600] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.851+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.851+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94378389305888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e84f0 con 0x55d62e5d8db0 2024-09-13T23:26:31.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.851+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e8f80 con 0x55d62e5e2240 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.852+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.852+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94378389310032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e9820 con 0x55d62e5e2240 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.852+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ea320 con 0x55d62e5dd620 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.852+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94378389305888] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.853+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94378389310032] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.854+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.854+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94378389312368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e8040 con 0x55d62e5dd620 2024-09-13T23:26:31.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.854+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eabc0 con 0x55d62e5d8db0 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.855+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94378389312368] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.855+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.855+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94378389315088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eabc0 con 0x55d62e5d8db0 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.855+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eb5d0 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.856+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94378389315088] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.856+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.856+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94378389320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eabc0 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.856+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ebfe0 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.857+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.857+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94378389322544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ec400 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.857+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ecef0 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.857+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94378389320448] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94378389326272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eceb0 con 0x7f54e0044070 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=0 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=1 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=2 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=3 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=4 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=5 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94378389322544] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.858+0000 7f54e7b0c800 20 add_watcher() i=6 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94378389326272] v33'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54e7b0c800 20 add_watcher() i=7 2024-09-13T23:26:31.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54e7b0c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ebf50 con 0x55d62e5d8db0 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.859+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94378389317392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ebf50 con 0x55d62e5d8db0 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.860+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94378389317392] v33'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.860+0000 7f539b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 5 note: GC not initialized 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f539a7e4640 20 reqs_thread_entry: start 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 Filter name: none 2024-09-13T23:26:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f530bfff640 20 reqs_thread_entry: start 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e622dd0 con 0x55d62e5d8db0 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.861+0000 7f54e7b0c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.862+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d62e624320 con 0x7f54e0044070 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.862+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.863+0000 7f539b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.863+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94378389317392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e621880 con 0x55d62e5d8db0 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.864+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94378389317392] v33'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.864+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94378389301600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5ea710 con 0x55d62e5dd620 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.865+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94378389301600] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.865+0000 7f54e7b0c800 20 remove_watcher() i=0 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.865+0000 7f54e7b0c800 2 removed watcher, disabling cache 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.865+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94378389305888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e6960 con 0x55d62e5d8db0 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.866+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94378389305888] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.866+0000 7f54e7b0c800 20 remove_watcher() i=1 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.866+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94378389310032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e6960 con 0x55d62e5e2240 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.867+0000 7f54e5600640 1 -- 172.21.15.99:0/2871359607 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94378389310032] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d80a0070 con 0x55d62e5e2240 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.867+0000 7f54e7b0c800 20 remove_watcher() i=2 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.867+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94378389312368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e7a20 con 0x55d62e5dd620 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.868+0000 7f54e5e01640 1 -- 172.21.15.99:0/2871359607 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94378389312368] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e000a4a0 con 0x55d62e5dd620 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.868+0000 7f54e7b0c800 20 remove_watcher() i=3 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.868+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94378389315088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e7a20 con 0x55d62e5d8db0 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.869+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94378389315088] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x55d62e5d8db0 2024-09-13T23:26:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.869+0000 7f54e7b0c800 20 remove_watcher() i=4 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.869+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94378389320448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5e7a20 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.870+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94378389320448] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.870+0000 7f54e7b0c800 20 remove_watcher() i=5 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.870+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94378389322544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eb300 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.871+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94378389322544] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.871+0000 7f54e7b0c800 20 remove_watcher() i=6 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.871+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94378389326272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d62e5eb300 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94378389326272] v33'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54d002a040 con 0x7f54e0044070 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 20 remove_watcher() i=7 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f54e0044070 msgr2=0x7f54e003b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f54e0044070 0x7f54e003b6a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e5d8db0 msgr2=0x55d62e5db270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e5d8db0 0x55d62e5db270 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5dd620 msgr2=0x55d62e5dfa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5dd620 0x55d62e5dfa30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d62e5e2240 msgr2=0x55d62e5e4700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d62e5e2240 0x55d62e5e4700 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53b0036b40 msgr2=0x7f53b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53b0036b40 0x7f53b0039000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f54d8064520 tx=0x7f54d808c000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 msgr2=0x55d62e5cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/2871359607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5c5df0 0x55d62e5cd320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f54e004cd60 tx=0x7f54e004cd90 comp rx=0 tx=0).stop 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 reap_dead start 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54dffff640 1 -- 172.21.15.99:0/2871359607 reap_dead start 2024-09-13T23:26:31.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 shutdown_connections 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 >> 172.21.15.99:0/2871359607 conn(0x55d62e5c2150 msgr2=0x55d62e5c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 shutdown_connections 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.872+0000 7f54e7b0c800 1 -- 172.21.15.99:0/2871359607 wait complete. 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 msgr2=0x7f53bc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 0x7f53bc039050 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55d62e5a2930 tx=0x7f54d80643b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 msgr2=0x55d62e5b9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x55d62e59f480 tx=0x7f54e00167b0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 shutdown_connections 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53bc036b90 0x7f53bc039050 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/1231903123 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e5b9130 0x55d62e5b9550 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 >> 172.21.15.99:0/1231903123 conn(0x55d62e5ae0c0 msgr2=0x55d62e5b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 shutdown_connections 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/1231903123 wait complete. 2024-09-13T23:26:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 msgr2=0x55d62e5a5440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 0x55d62e5a5440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 msgr2=0x55d62e5aa020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 0x55d62e5aa020 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 msgr2=0x7f53cc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 0x7f53cc039050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f54d0001e10 tx=0x7f54d0001390 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 msgr2=0x55d62e59e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f54d8067040 tx=0x7f54d8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 shutdown_connections 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d62e5a7b90 0x55d62e5aa020 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d62e4a4e20 0x55d62e5a5440 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f53cc036b90 0x7f53cc039050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 --2- 172.21.15.99:0/731726605 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d62e4a44e0 0x55d62e59e3d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 >> 172.21.15.99:0/731726605 conn(0x55d62e49fdd0 msgr2=0x55d62e58da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 shutdown_connections 2024-09-13T23:26:31.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.873+0000 7f54e7b0c800 1 -- 172.21.15.99:0/731726605 wait complete. 2024-09-13T23:26:31.889 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T23:00:00.000000Z","epoch":1726268400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T23:26:31.889 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:26:31.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:26:31.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T23:26:31.889 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T23:26:31.941 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:31.942 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:31.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.941+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.941+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.941+0000 7fab12f1f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a2b255fe30 0x55a2b25ef220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.941+0000 7fab12f1f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2b24abb30 con 0x55a2b25ef760 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.941+0000 7fab12f1f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a2b248d360 con 0x55a2b255fe30 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.942+0000 7fab0eb95640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a2b255fe30 0x55a2b25ef220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.942+0000 7fab0eb95640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a2b255fe30 0x55a2b25ef220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56648/0 (socket says 172.21.15.99:56648) 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.942+0000 7fab0eb95640 1 -- 172.21.15.99:0/235332367 learned_addr learned my addr 172.21.15.99:0/235332367 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.942+0000 7fab0eb95640 1 -- 172.21.15.99:0/235332367 >> v1:172.21.15.43:6789/0 conn(0x55a2b25ef760 legacy=0x55a2b25f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.942+0000 7fab0eb95640 1 -- 172.21.15.99:0/235332367 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b24b3e00 con 0x55a2b255fe30 2024-09-13T23:26:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab0eb95640 1 --2- 172.21.15.99:0/235332367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b25ef220 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a520 tx=0x7fab00045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac51bef5245b4fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab0db93640 1 -- 172.21.15.99:0/235332367 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab00055070 con 0x55a2b255fe30 2024-09-13T23:26:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab0db93640 1 -- 172.21.15.99:0/235332367 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab000515b0 con 0x55a2b255fe30 2024-09-13T23:26:31.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab0db93640 1 -- 172.21.15.99:0/235332367 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab000518d0 con 0x55a2b255fe30 2024-09-13T23:26:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 -- 172.21.15.99:0/235332367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 msgr2=0x55a2b25ef220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 --2- 172.21.15.99:0/235332367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b25ef220 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fab0000a520 tx=0x7fab00045ba0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 -- 172.21.15.99:0/235332367 shutdown_connections 2024-09-13T23:26:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 --2- 172.21.15.99:0/235332367 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b25ef220 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 -- 172.21.15.99:0/235332367 >> 172.21.15.99:0/235332367 conn(0x55a2b25e6e30 msgr2=0x55a2b25e9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 -- 172.21.15.99:0/235332367 shutdown_connections 2024-09-13T23:26:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.944+0000 7fab12f1f800 1 -- 172.21.15.99:0/235332367 wait complete. 2024-09-13T23:26:31.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.958+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab12f1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab12f1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a2b2538370 con 0x55a2b255fe30 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab0eb95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab0eb95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56650/0 (socket says 172.21.15.99:56650) 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab0eb95640 1 -- 172.21.15.99:0/949091199 learned_addr learned my addr 172.21.15.99:0/949091199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab0eb95640 1 -- 172.21.15.99:0/949091199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b2485bc0 con 0x55a2b255fe30 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.959+0000 7fab0eb95640 1 --2- 172.21.15.99:0/949091199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab00025da0 tx=0x7fab00051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488a800f57920257 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fa9fce09640 1 -- 172.21.15.99:0/949091199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab00051950 con 0x55a2b255fe30 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fa9fce09640 1 -- 172.21.15.99:0/949091199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab00051af0 con 0x55a2b255fe30 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fa9fce09640 1 -- 172.21.15.99:0/949091199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab00051dd0 con 0x55a2b255fe30 2024-09-13T23:26:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 -- 172.21.15.99:0/949091199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 msgr2=0x55a2b26db950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 --2- 172.21.15.99:0/949091199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab00025da0 tx=0x7fab00051000 comp rx=0 tx=0).stop 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 -- 172.21.15.99:0/949091199 shutdown_connections 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 --2- 172.21.15.99:0/949091199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26db950 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 -- 172.21.15.99:0/949091199 >> 172.21.15.99:0/949091199 conn(0x55a2b25e6e30 msgr2=0x55a2b26d7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 -- 172.21.15.99:0/949091199 shutdown_connections 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.960+0000 7fab12f1f800 1 -- 172.21.15.99:0/949091199 wait complete. 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab12f1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab12f1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a2b25f3630 con 0x55a2b255fe30 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab0eb95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab0eb95640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56666/0 (socket says 172.21.15.99:56666) 2024-09-13T23:26:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab0eb95640 1 -- 172.21.15.99:0/3557977060 learned_addr learned my addr 172.21.15.99:0/3557977060 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.961+0000 7fab0eb95640 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b2499fe0 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fab0eb95640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab00067040 tx=0x7fab00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fa9fb606640 1 -- 172.21.15.99:0/3557977060 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab00073070 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fa9fb606640 1 -- 172.21.15.99:0/3557977060 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0005a450 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b26e37c0 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fa9fb606640 1 -- 172.21.15.99:0/3557977060 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0005a730 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.962+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b26e3d40 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fa9fb606640 1 -- 172.21.15.99:0/3557977060 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab00076070 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fa9fb606640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 0x7fa9f4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fa9fb606640 1 -- 172.21.15.99:0/3557977060 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fab00062070 con 0x55a2b255fe30 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab0e394640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 0x7fa9f4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 0x55a2b26ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b26ea870 con 0x55a2b25ef760 2024-09-13T23:26:31.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab0f396640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 0x55a2b26ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab0e394640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 0x7fa9f4039050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaf8001e10 tx=0x7faaf8001390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.963+0000 7fab0f396640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 0x55a2b26ea2f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab0f396640 1 -- 172.21.15.99:0/3557977060 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab0800a4a0 con 0x55a2b25ef760 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b26eb130 con 0x55a2b25ef760 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab0f396640 1 -- 172.21.15.99:0/3557977060 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab0800a4a0 con 0x55a2b25ef760 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 0x55a2b26eef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b26ef6a0 con 0x55a2b26eca80 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab0eb95640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 0x55a2b26eef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.964+0000 7fab0eb95640 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 0x55a2b26eef10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab0eb95640 1 -- 172.21.15.99:0/3557977060 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab00075030 con 0x55a2b26eca80 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b26eb980 con 0x55a2b25ef760 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab0f396640 1 -- 172.21.15.99:0/3557977060 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab0800a4a0 con 0x55a2b25ef760 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b26ebd60 con 0x55a2b26eca80 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab0eb95640 1 -- 172.21.15.99:0/3557977060 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab00075030 con 0x55a2b26eca80 2024-09-13T23:26:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.965+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab12f1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab12f1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a2b2487580 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56676/0 (socket says 172.21.15.99:56676) 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab0f396640 1 -- 172.21.15.99:0/3209628671 learned_addr learned my addr 172.21.15.99:0/3209628671 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab0f396640 1 -- 172.21.15.99:0/3209628671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b26fe920 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.966+0000 7fab0f396640 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55a2b26eac50 tx=0x7fab080163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fa9f8e01640 1 -- 172.21.15.99:0/3209628671 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab08013450 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fa9f8e01640 1 -- 172.21.15.99:0/3209628671 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab080135f0 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fa9f8e01640 1 -- 172.21.15.99:0/3209628671 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab080138d0 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b26febb0 con 0x55a2b26fdfc0 2024-09-13T23:26:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b2701890 con 0x55a2b26fdfc0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.967+0000 7fa9f8e01640 1 -- 172.21.15.99:0/3209628671 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab08011040 con 0x55a2b26fdfc0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fa9f8e01640 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 0x7fa9e8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fa9f8e01640 1 -- 172.21.15.99:0/3209628671 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fab0800e040 con 0x55a2b26fdfc0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab0eb95640 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 0x7fa9e8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab0eb95640 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 0x7fa9e8039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a2b26e7900 tx=0x7fab000643b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab12f1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab12f1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a2b26dc040 con 0x55a2b25ec450 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56684/0 (socket says 172.21.15.99:56684) 2024-09-13T23:26:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.968+0000 7fab0f396640 1 -- 172.21.15.99:0/1071372703 learned_addr learned my addr 172.21.15.99:0/1071372703 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab0f396640 1 -- 172.21.15.99:0/1071372703 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b25ece20 con 0x55a2b25ec450 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab0f396640 1 --2- 172.21.15.99:0/1071372703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fab0804cd90 tx=0x7fab0804cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1b6c277e473007 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fa9f27fc640 1 -- 172.21.15.99:0/1071372703 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0804a070 con 0x55a2b25ec450 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fa9f27fc640 1 -- 172.21.15.99:0/1071372703 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0802a570 con 0x55a2b25ec450 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fa9f27fc640 1 -- 172.21.15.99:0/1071372703 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0801f4c0 con 0x55a2b25ec450 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 -- 172.21.15.99:0/1071372703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 msgr2=0x55a2b25ec850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 --2- 172.21.15.99:0/1071372703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fab0804cd90 tx=0x7fab0804cf90 comp rx=0 tx=0).stop 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 -- 172.21.15.99:0/1071372703 shutdown_connections 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 --2- 172.21.15.99:0/1071372703 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b25ec850 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 -- 172.21.15.99:0/1071372703 >> 172.21.15.99:0/1071372703 conn(0x55a2b2707070 msgr2=0x55a2b2705170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 -- 172.21.15.99:0/1071372703 shutdown_connections 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.969+0000 7fab12f1f800 1 -- 172.21.15.99:0/1071372703 wait complete. 2024-09-13T23:26:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab12f1f800 1 Processor -- start 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab12f1f800 1 -- start start 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab12f1f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab12f1f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a2b25eb180 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab0f396640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56686/0 (socket says 172.21.15.99:56686) 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 learned_addr learned my addr 172.21.15.99:0/326506393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b2714870 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.970+0000 7fab0f396640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fab0802ac70 tx=0x7fab0804cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fa9f0ff9640 1 -- 172.21.15.99:0/326506393 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0801f710 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fa9f0ff9640 1 -- 172.21.15.99:0/326506393 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab08039070 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fa9f0ff9640 1 -- 172.21.15.99:0/326506393 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab0801f9e0 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b2714b00 con 0x55a2b25ec450 2024-09-13T23:26:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b27177b0 con 0x55a2b25ec450 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fa9f0ff9640 1 -- 172.21.15.99:0/326506393 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fab08033070 con 0x55a2b25ec450 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.971+0000 7fa9f0ff9640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9d8036b40 0x7fa9d8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fa9f0ff9640 1 -- 172.21.15.99:0/326506393 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fab08015420 con 0x55a2b25ec450 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab0eb95640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9d8036b40 0x7fa9d8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab0eb95640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9d8036b40 0x7fa9d8039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab00064520 tx=0x7fab0008c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b271fde0 0x55a2b27222a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27229f0 con 0x55a2b271fde0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.972+0000 7fab0e394640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b271fde0 0x55a2b27222a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab0e394640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b271fde0 0x55a2b27222a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaf800bdb0 con 0x55a2b271fde0 2024-09-13T23:26:31.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 realm 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b271f230 con 0x55a2b271fde0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaf800bdb0 con 0x55a2b271fde0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27234e0 con 0x55a2b271fde0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaf800bdb0 con 0x55a2b271fde0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.973+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2723db0 con 0x55a2b271fde0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faaf800bdb0 con 0x55a2b271fde0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b27246f0 0x55a2b2726b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27272b0 con 0x55a2b27246f0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab0f396640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b27246f0 0x55a2b2726b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab0f396640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b27246f0 0x55a2b2726b20 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:31.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 20 searching for the correct realm 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a2b2729280 0x55a2b272b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.974+0000 7fab0eb95640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a2b2729280 0x55a2b272b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0eb95640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a2b2729280 0x55a2b272b740 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0f396640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab08059040 0x7fab0804ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.975+0000 7fab0e394640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab08059040 0x7fab0804ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:31.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab08059040 0x7fab0804ea50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf800bdb0 con 0x7fab08059040 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf800bdb0 con 0x55a2b271fde0 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.976+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.977+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.978+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.979+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.980+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.981+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b2729280 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.982+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x7fab08059040 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b271fde0 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272be10 con 0x55a2b27246f0 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:32.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2727ca0 con 0x55a2b271fde0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.983+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2728540 con 0x55a2b271fde0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272c290 con 0x55a2b27246f0 2024-09-13T23:26:32.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 zone default found 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 4 Realm: () 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 zonegroup default 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272cae0 con 0x7fab08059040 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272e4c0 con 0x55a2b2729280 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.984+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272e900 con 0x55a2b2729280 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 20 started sync module instance, tier type = 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.985+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272d950 con 0x55a2b27246f0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.986+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.986+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157266935104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272f210 con 0x55a2b27246f0 2024-09-13T23:26:32.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.986+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272fa60 con 0x55a2b271fde0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.987+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157266935104] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.987+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.987+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157266939232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272f770 con 0x55a2b271fde0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.987+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2730230 con 0x55a2b2729280 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.988+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.988+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157266943232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2730ad0 con 0x55a2b2729280 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.988+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27315b0 con 0x55a2b27246f0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.988+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157266939232] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.989+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157266943232] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.989+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.989+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157266945568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27310c0 con 0x55a2b27246f0 2024-09-13T23:26:32.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.989+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2731ff0 con 0x55a2b271fde0 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.990+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.990+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157266950976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2732410 con 0x55a2b271fde0 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.990+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2732e60 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.990+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157266945568] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.991+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157266950976] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.991+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.991+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157266954576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2731f60 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.991+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2733700 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.992+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157266954576] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.992+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.992+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157266940352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2731f60 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.993+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2733d20 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.993+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.993+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157266958448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2734140 con 0x7fab08059040 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=0 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=1 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=2 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=3 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=4 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=5 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157266940352] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=6 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157266958448] v33'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 20 add_watcher() i=7 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.994+0000 7fab12f1f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.995+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2734140 con 0x55a2b271fde0 2024-09-13T23:26:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.995+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.995+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157266959504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b27340b0 con 0x55a2b271fde0 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157266959504] v33'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fa9c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab12f1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab12f1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab12f1f800 5 note: GC not initialized 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fa93ffff640 20 reqs_thread_entry: start 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab12f1f800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.996+0000 7fab12f1f800 20 Filter name: none 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fa93dffb640 20 reqs_thread_entry: start 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b276a540 con 0x7fab08059040 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768b80 con 0x55a2b271fde0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:26:32.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.997+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2769450 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.998+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v33'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.998+0000 7fab12f1f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.998+0000 7fab12f1f800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.998+0000 7fab12f1f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.998+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94157267177376 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b276dfe0 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== watch-notify(notify (1) cookie 94157266958448 notify 141733920799 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55a2b27697f0 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fa9f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 94157266958448 notifier 4731 bl.length()=556 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fa9f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fa9f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fa9f27fc640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa9d4003ea0 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(65 notify.7 [notify cookie 94157267177376 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== watch-notify(notify_complete (2) cookie 94157267177376 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2b2768d50 con 0x7fab08059040 2024-09-13T23:26:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:31.999+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768f50 con 0x55a2b271fde0 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.000+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.000+0000 7fab12f1f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.000+0000 7fab12f1f800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.000+0000 7fab12f1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.000+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94157267192576 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768f50 con 0x7fab08059040 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== watch-notify(notify (1) cookie 94157266954576 notify 141733920800 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a2b2768d50 con 0x7fab08059040 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fa9f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920800 cookie 94157266954576 notifier 4731 bl.length()=177 2024-09-13T23:26:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fa9f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fa9f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fa9f1ffb640 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa944003400 con 0x7fab08059040 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(68 notify.5 [notify cookie 94157267192576 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.001+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== watch-notify(notify_complete (2) cookie 94157267192576 notify 141733920800 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2b24abb30 con 0x7fab08059040 2024-09-13T23:26:32.017 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T23:26:31.998750Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:26:31.998740Z","tags":[],"group_ids":[]} 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.002+0000 7fa9c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.002+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157266959504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768200 con 0x55a2b271fde0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.003+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94157266959504] v33'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.003+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157266935104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768200 con 0x55a2b27246f0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.004+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94157266935104] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.004+0000 7fab12f1f800 20 remove_watcher() i=0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.004+0000 7fab12f1f800 2 removed watcher, disabling cache 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.004+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157266939232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768200 con 0x55a2b271fde0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.005+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94157266939232] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.005+0000 7fab12f1f800 20 remove_watcher() i=1 2024-09-13T23:26:32.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.005+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157266943232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2768200 con 0x55a2b2729280 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.006+0000 7fab0eb95640 1 -- 172.21.15.99:0/326506393 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94157266943232] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab000a0070 con 0x55a2b2729280 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.006+0000 7fab12f1f800 20 remove_watcher() i=2 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.006+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157266945568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272dd40 con 0x55a2b27246f0 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.007+0000 7fab0f396640 1 -- 172.21.15.99:0/326506393 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94157266945568] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab08027020 con 0x55a2b27246f0 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.007+0000 7fab12f1f800 20 remove_watcher() i=3 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.007+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157266950976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2730620 con 0x55a2b271fde0 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.008+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94157266950976] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x55a2b271fde0 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.008+0000 7fab12f1f800 20 remove_watcher() i=4 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.008+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157266954576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272dd40 con 0x7fab08059040 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.009+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94157266954576] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.009+0000 7fab12f1f800 20 remove_watcher() i=5 2024-09-13T23:26:32.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.009+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157266940352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b2731b40 con 0x7fab08059040 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.010+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94157266940352] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.010+0000 7fab12f1f800 20 remove_watcher() i=6 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.010+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157266958448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a2b272f210 con 0x7fab08059040 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94157266958448] v33'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faaf802a040 con 0x7fab08059040 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 20 remove_watcher() i=7 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab08059040 msgr2=0x7fab0804ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fab08059040 0x7fab0804ea50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b271fde0 msgr2=0x55a2b27222a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b271fde0 0x55a2b27222a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b27246f0 msgr2=0x55a2b2726b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b27246f0 0x55a2b2726b20 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a2b2729280 msgr2=0x55a2b272b740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a2b2729280 0x55a2b272b740 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9d8036b40 msgr2=0x7fa9d8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9d8036b40 0x7fa9d8039000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fab00064520 tx=0x7fab0008c000 comp rx=0 tx=0).stop 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 msgr2=0x55a2b2714330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fab0802ac70 tx=0x7fab0804cd20 comp rx=0 tx=0).stop 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab0e394640 1 -- 172.21.15.99:0/326506393 reap_dead start 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 shutdown_connections 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 --2- 172.21.15.99:0/326506393 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b25ec450 0x55a2b2714330 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 >> 172.21.15.99:0/326506393 conn(0x55a2b2707070 msgr2=0x55a2b2705140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 shutdown_connections 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.011+0000 7fab12f1f800 1 -- 172.21.15.99:0/326506393 wait complete. 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 msgr2=0x7fa9e8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 0x7fa9e8039050 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55a2b26e7900 tx=0x7fab000643b0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 msgr2=0x55a2b26fe3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55a2b26eac50 tx=0x7fab080163e0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 shutdown_connections 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9e8036b90 0x7fa9e8039050 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3209628671 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b26fdfc0 0x55a2b26fe3e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 >> 172.21.15.99:0/3209628671 conn(0x55a2b26f2f50 msgr2=0x55a2b26f5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 shutdown_connections 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3209628671 wait complete. 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 msgr2=0x55a2b26ea2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 0x55a2b26ea2f0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 msgr2=0x55a2b26eef10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 0x55a2b26eef10 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 msgr2=0x7fa9f4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 0x7fa9f4039050 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faaf8001e10 tx=0x7faaf8001390 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 msgr2=0x55a2b26e3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab00067040 tx=0x7fab00002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 shutdown_connections 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a2b26eca80 0x55a2b26eef10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a2b25ef760 0x55a2b26ea2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa9f4036b90 0x7fa9f4039050 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 --2- 172.21.15.99:0/3557977060 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a2b255fe30 0x55a2b26e3280 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 >> 172.21.15.99:0/3557977060 conn(0x55a2b25e6e30 msgr2=0x55a2b26d5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 shutdown_connections 2024-09-13T23:26:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.012+0000 7fab12f1f800 1 -- 172.21.15.99:0/3557977060 wait complete. 2024-09-13T23:26:32.029 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T23:26:31.998750Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:26:31.998740Z', 'tags': [], 'group_ids': []} 2024-09-13T23:26:32.055 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:26:32.059 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:26:32.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:26:32.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T23:26:32.060 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T23:26:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.105+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.105+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.105+0000 7fa6d353e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5621d74cbe10 0x5621d755d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.105+0000 7fa6d353e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5621d7417b30 con 0x5621d755db40 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.105+0000 7fa6d353e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5621d73f9360 con 0x5621d74cbe10 2024-09-13T23:26:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.106+0000 7fa6cf234640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5621d74cbe10 0x5621d755d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.106+0000 7fa6c7fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5621d755db40 0x5621d755ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:46978/0 (socket says 172.21.15.99:46978) 2024-09-13T23:26:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.106+0000 7fa6c7fff640 1 -- 172.21.15.99:0/76457 learned_addr learned my addr 172.21.15.99:0/76457 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.106+0000 7fa6cf234640 1 -- 172.21.15.99:0/76457 >> v1:172.21.15.43:6789/0 conn(0x5621d755db40 legacy=0x5621d755ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.106+0000 7fa6cf234640 1 -- 172.21.15.99:0/76457 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d741fe00 con 0x5621d74cbe10 2024-09-13T23:26:32.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.108+0000 7fa6cf234640 1 --2- 172.21.15.99:0/76457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d755d600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000a470 tx=0x7fa6c0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ce2467c0397e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.108+0000 7fa6cea33640 1 -- 172.21.15.99:0/76457 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c0053570 con 0x5621d74cbe10 2024-09-13T23:26:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.108+0000 7fa6cea33640 1 -- 172.21.15.99:0/76457 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c0058070 con 0x5621d74cbe10 2024-09-13T23:26:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.108+0000 7fa6cea33640 1 -- 172.21.15.99:0/76457 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c0053880 con 0x5621d74cbe10 2024-09-13T23:26:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 -- 172.21.15.99:0/76457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 msgr2=0x5621d755d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 --2- 172.21.15.99:0/76457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d755d600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000a470 tx=0x7fa6c0045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 -- 172.21.15.99:0/76457 shutdown_connections 2024-09-13T23:26:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 --2- 172.21.15.99:0/76457 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d755d600 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 -- 172.21.15.99:0/76457 >> 172.21.15.99:0/76457 conn(0x5621d7552dd0 msgr2=0x5621d75551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 -- 172.21.15.99:0/76457 shutdown_connections 2024-09-13T23:26:32.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.109+0000 7fa6d353e800 1 -- 172.21.15.99:0/76457 wait complete. 2024-09-13T23:26:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6d353e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6d353e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d74a4360 con 0x5621d74cbe10 2024-09-13T23:26:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6cf234640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6cf234640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56708/0 (socket says 172.21.15.99:56708) 2024-09-13T23:26:32.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6cf234640 1 -- 172.21.15.99:0/540958844 learned_addr learned my addr 172.21.15.99:0/540958844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.123+0000 7fa6cf234640 1 -- 172.21.15.99:0/540958844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d73f1bc0 con 0x5621d74cbe10 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.124+0000 7fa6cf234640 1 --2- 172.21.15.99:0/540958844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0025c20 tx=0x7fa6c0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6217d73a8e41c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.124+0000 7fa5bd60a640 1 -- 172.21.15.99:0/540958844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c005c580 con 0x5621d74cbe10 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.124+0000 7fa5bd60a640 1 -- 172.21.15.99:0/540958844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c0063030 con 0x5621d74cbe10 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.124+0000 7fa5bd60a640 1 -- 172.21.15.99:0/540958844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c005c850 con 0x5621d74cbe10 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- 172.21.15.99:0/540958844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 msgr2=0x5621d7649a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 --2- 172.21.15.99:0/540958844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0025c20 tx=0x7fa6c0051000 comp rx=0 tx=0).stop 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- 172.21.15.99:0/540958844 shutdown_connections 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 --2- 172.21.15.99:0/540958844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d7649a80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- 172.21.15.99:0/540958844 >> 172.21.15.99:0/540958844 conn(0x5621d7552dd0 msgr2=0x5621d7645440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- 172.21.15.99:0/540958844 shutdown_connections 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- 172.21.15.99:0/540958844 wait complete. 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6d353e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d7561920 con 0x5621d74cbe10 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6cf234640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6cf234640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56718/0 (socket says 172.21.15.99:56718) 2024-09-13T23:26:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.125+0000 7fa6cf234640 1 -- 172.21.15.99:0/4037381048 learned_addr learned my addr 172.21.15.99:0/4037381048 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa6cf234640 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d7405fe0 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa6cf234640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000a330 tx=0x7fa6c0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa5bbe07640 1 -- 172.21.15.99:0/4037381048 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c006c030 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa5bbe07640 1 -- 172.21.15.99:0/4037381048 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c005c580 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa5bbe07640 1 -- 172.21.15.99:0/4037381048 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c005c860 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621d7651900 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.126+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d7651e80 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa5bbe07640 1 -- 172.21.15.99:0/4037381048 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa6c0053440 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa5bbe07640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 0x7fa5b4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa5bbe07640 1 -- 172.21.15.99:0/4037381048 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa6c0070020 con 0x5621d74cbe10 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 0x7fa5b4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 0x5621d7658430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7658970 con 0x5621d755db40 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 0x5621d7658430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.127+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 0x7fa5b4039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f60 tx=0x7fa6b80012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 0x5621d7658430 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6cfa35640 1 -- 172.21.15.99:0/4037381048 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6c800a4a0 con 0x5621d755db40 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7655a00 con 0x5621d755db40 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6cfa35640 1 -- 172.21.15.99:0/4037381048 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6c800a4a0 con 0x5621d755db40 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 0x5621d765d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d765d750 con 0x5621d765acc0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6cf234640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 0x5621d765d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.128+0000 7fa6cf234640 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 0x5621d765d0b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.129+0000 7fa6cf234640 1 -- 172.21.15.99:0/4037381048 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d765acc0 2024-09-13T23:26:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.129+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7659b60 con 0x5621d755db40 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.129+0000 7fa6cfa35640 1 -- 172.21.15.99:0/4037381048 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6c800a4a0 con 0x5621d755db40 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.129+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d765a040 con 0x5621d765acc0 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.129+0000 7fa6cf234640 1 -- 172.21.15.99:0/4037381048 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d765acc0 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6d353e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6d353e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d73f3580 con 0x5621d766c070 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56732/0 (socket says 172.21.15.99:56732) 2024-09-13T23:26:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6cfa35640 1 -- 172.21.15.99:0/615259163 learned_addr learned my addr 172.21.15.99:0/615259163 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:32.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6cfa35640 1 -- 172.21.15.99:0/615259163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d766c9d0 con 0x5621d766c070 2024-09-13T23:26:32.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.130+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x5621d76525e0 tx=0x7fa6c80167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa5b9602640 1 -- 172.21.15.99:0/615259163 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c8013640 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa5b9602640 1 -- 172.21.15.99:0/615259163 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c80137e0 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621d766cc60 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa5b9602640 1 -- 172.21.15.99:0/615259163 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c8013ae0 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d766f940 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa5b9602640 1 -- 172.21.15.99:0/615259163 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa6c8011040 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.131+0000 7fa5b9602640 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 0x7fa5a8039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa5b9602640 1 -- 172.21.15.99:0/615259163 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa6c800e040 con 0x5621d766c070 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6cf234640 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 0x7fa5a8039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6cf234640 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 0x7fa5a8039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5621d7655920 tx=0x7fa6c0000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6d353e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6d353e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d764a1d0 con 0x5621d7678d30 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56740/0 (socket says 172.21.15.99:56740) 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.132+0000 7fa6cfa35640 1 -- 172.21.15.99:0/3775236825 learned_addr learned my addr 172.21.15.99:0/3775236825 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6cfa35640 1 -- 172.21.15.99:0/3775236825 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d7679700 con 0x5621d7678d30 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/3775236825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800afb0 tx=0x7fa6c801fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d017f9ebebd56829 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/3775236825 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c8021570 con 0x5621d7678d30 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/3775236825 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c801f340 con 0x5621d7678d30 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/3775236825 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c8014cc0 con 0x5621d7678d30 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 -- 172.21.15.99:0/3775236825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 msgr2=0x5621d7679130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 --2- 172.21.15.99:0/3775236825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800afb0 tx=0x7fa6c801fcc0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 -- 172.21.15.99:0/3775236825 shutdown_connections 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 --2- 172.21.15.99:0/3775236825 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d7679130 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 -- 172.21.15.99:0/3775236825 >> 172.21.15.99:0/3775236825 conn(0x5621d7675090 msgr2=0x5621d7673190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 -- 172.21.15.99:0/3775236825 shutdown_connections 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.133+0000 7fa6d353e800 1 -- 172.21.15.99:0/3775236825 wait complete. 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6d353e800 1 Processor -- start 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6d353e800 1 -- start start 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6d353e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6d353e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5621d7679d70 con 0x5621d7678d30 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6cfa35640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56752/0 (socket says 172.21.15.99:56752) 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 learned_addr learned my addr 172.21.15.99:0/916962887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:32.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621d76806e0 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.134+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8048010 tx=0x7fa6c804cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa5b17fa640 1 -- 172.21.15.99:0/916962887 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c8013e60 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa5b17fa640 1 -- 172.21.15.99:0/916962887 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c8040360 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621d7680970 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa5b17fa640 1 -- 172.21.15.99:0/916962887 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6c804e2b0 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621d7680970 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.135+0000 7fa5b17fa640 1 -- 172.21.15.99:0/916962887 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa6c804e470 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa5b17fa640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa598036b90 0x7fa598039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa5b17fa640 1 -- 172.21.15.99:0/916962887 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa6c8007050 con 0x5621d7678d30 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6cf234640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa598036b90 0x7fa598039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6cf234640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa598036b90 0x7fa598039050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0067b80 tx=0x7fa6c0087000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d768ba70 0x5621d768df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d768e680 con 0x5621d768ba70 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.136+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d768ba70 0x5621d768df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d768ba70 0x5621d768df30 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b8009050 con 0x5621d768ba70 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 realm 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d768aec0 con 0x5621d768ba70 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b8009050 con 0x5621d768ba70 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:32.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d768f170 con 0x5621d768ba70 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b8009050 con 0x5621d768ba70 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.137+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d768fa40 con 0x5621d768ba70 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6b8009050 con 0x5621d768ba70 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d7690380 0x5621d7692770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7692f00 con 0x5621d7690380 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d7690380 0x5621d7692770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d7690380 0x5621d7692770 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 20 searching for the correct realm 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5621d7694ed0 0x5621d7697390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.138+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cf234640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5621d7694ed0 0x5621d7697390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cf234640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5621d7694ed0 0x5621d7697390 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cfa35640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa6c8044070 0x7fa6c804b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.139+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa6c8044070 0x7fa6c804b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa6c8044070 0x7fa6c804b250 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8009050 con 0x7fa6c8044070 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8009050 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.140+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.141+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.142+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.143+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.144+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.145+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7694ed0 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.146+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x7fa6c8044070 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d768ba70 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697a60 con 0x5621d7690380 2024-09-13T23:26:32.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.147+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76938f0 con 0x5621d768ba70 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7694190 con 0x5621d768ba70 2024-09-13T23:26:32.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7697ee0 con 0x5621d7690380 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 zone default found 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 4 Realm: () 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 zonegroup default 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d7698730 con 0x7fa6c8044070 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.148+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d769a4b0 con 0x5621d7694ed0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d769a8c0 con 0x5621d7694ed0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 20 started sync module instance, tier type = 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:32.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.149+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d7699950 con 0x5621d7690380 2024-09-13T23:26:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.150+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.150+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94703347932528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769b1d0 con 0x5621d7690380 2024-09-13T23:26:32.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.150+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769ba20 con 0x5621d768ba70 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.151+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94703347932528] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.151+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.151+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94703347936544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769b750 con 0x5621d768ba70 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.151+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769c270 con 0x5621d7694ed0 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.153+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94703347936544] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.153+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.153+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94703347940672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769c660 con 0x5621d7694ed0 2024-09-13T23:26:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.153+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769d080 con 0x5621d7690380 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.154+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94703347940672] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.154+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.154+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94703347944304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769d040 con 0x5621d7690380 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.154+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769db10 con 0x5621d768ba70 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.155+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94703347944304] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.155+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.155+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94703347947008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769dad0 con 0x5621d768ba70 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.155+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769e540 con 0x7fa6c8044070 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.156+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94703347947008] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.156+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.156+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94703347949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769e540 con 0x7fa6c8044070 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.156+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769ef80 con 0x7fa6c8044070 2024-09-13T23:26:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.157+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94703347949680] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.157+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.157+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94703347937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769ef80 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.157+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769f980 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.158+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94703347937696] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.158+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94703347954832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d769fb60 con 0x7fa6c8044070 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=0 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=1 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=2 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=3 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=4 2024-09-13T23:26:32.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=5 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=6 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94703347954832] v33'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 20 add_watcher() i=7 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.159+0000 7fa6d353e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.160+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76a2f30 con 0x5621d768ba70 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.160+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.160+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94703347956304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76a0320 con 0x5621d768ba70 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94703347956304] v33'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa6d353e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa6d353e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa6d353e800 5 note: GC not initialized 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.161+0000 7fa584fe1640 20 reqs_thread_entry: start 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 20 Filter name: none 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa4fe7fc640 20 reqs_thread_entry: start 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d61d0 con 0x7fa6c8044070 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.162+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76da570 con 0x5621d7690380 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v33'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6d353e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94703348195392 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76db240 con 0x7fa6c8044070 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== watch-notify(notify (1) cookie 94703347949680 notify 141733920801 ret 0) ==== 424+0+0 (crc 0 0 0) 0x5621d7417b30 con 0x7fa6c8044070 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa5b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94703347949680 notifier 4738 bl.length()=382 2024-09-13T23:26:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa5b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa5b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(64 notify.5 [notify cookie 94703348195392 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa594003ea0 con 0x7fa6c8044070 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.164+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== watch-notify(notify_complete (2) cookie 94703348195392 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa6b803e660 con 0x7fa6c8044070 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76da040 con 0x5621d768ba70 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 : miss 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 8.14 8:2b0134f5:root::.bucket.meta.myfoo6%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d8370 con 0x5621d7694ed0 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.165+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 8.14 8:2b0134f5:root::.bucket.meta.myfoo6%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76e2220 con 0x5621d7694ed0 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.166+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9, ofs0, ns] 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 94703348182704 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76dc680 con 0x5621d768ba70 2024-09-13T23:26:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 94703347936544 notify 141733920793 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fa6b803e660 con 0x5621d768ba70 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa5b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920793 cookie 94703347936544 notifier 4738 bl.length()=748 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa5b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa5b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa5b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa594003ea0 con 0x5621d768ba70 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(69 notify.1 [notify cookie 94703348182704 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94703348182704 notify 141733920793 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa6b803eaf0 con 0x5621d768ba70 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): orig_sources= new_sources= 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): potential sources added=[] removed=[] 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): orig_dests= new_dests= 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): potential dests added=[] removed=[] 2024-09-13T23:26:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.167+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d6eb0 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.168+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(71 bud.buckets [call] v33'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.168+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d6eb0 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.169+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(72 bud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.169+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d6eb0 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.170+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v33'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.170+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.170+0000 7fa6d353e800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.170+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.170+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94703348182704 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76dc900 con 0x5621d7690380 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== watch-notify(notify (1) cookie 94703347944304 notify 141733920783 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fa6c8030070 con 0x5621d7690380 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920783 cookie 94703347944304 notifier 4738 bl.length()=316 2024-09-13T23:26:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa5b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(74 notify.3 [notify cookie 94703348182704 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa5b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa5b27fc640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa504003400 con 0x5621d7690380 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== watch-notify(notify_complete (2) cookie 94703348182704 notify 141733920783 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621d7679700 con 0x5621d7690380 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6d353e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 : hit (requested=0x17, cached=0x17) 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6d353e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.171+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:76 8.14 8:2b0134f5:root::.bucket.meta.myfoo6%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d7d10 con 0x5621d7694ed0 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(76 .bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v33'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6d353e800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6d353e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9, ofs0, ns] 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94703348183856 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d7c00 con 0x5621d768ba70 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== watch-notify(notify (1) cookie 94703347936544 notify 141733920794 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5621d76dc680 con 0x5621d768ba70 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920794 cookie 94703347936544 notifier 4738 bl.length()=748 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa5b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(77 notify.1 [notify cookie 94703348183856 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa5b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa5b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.172+0000 7fa5b27fc640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa5040037c0 con 0x5621d768ba70 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== watch-notify(notify_complete (2) cookie 94703348183856 notify 141733920794 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5621d76d9c10 con 0x5621d768ba70 2024-09-13T23:26:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): orig_sources= new_sources= 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): potential sources added=[] removed=[] 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): orig_dests= new_dests= 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 20 handle_bi_update(): bucket=:myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]): potential dests added=[] removed=[] 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 4.1f 4:f945b4ed:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(79 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:80 4.15 4:aaa0fa2e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(80 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.173+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:81 4.6 4:61d9c90b:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(81 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 4.39 4:9db64c29:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(82 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:83 4.3a 4:5c250fbd:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(83 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.174+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:84 4.b 4:d1020db2:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7690380 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(84 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 4.1d 4:b91f06a9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(85 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c007b070 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 4.30 4:0fc2228d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(86 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 4.29 4:94808ab6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(87 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.175+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:88 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(88 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [call out=374b] v0'0 uv4 ondisk = 0) ==== 194+0+374 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 4.3b 4:de60afd0:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d77e0 con 0x5621d7694ed0 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(89 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 get_obj_state: octx=0x7fa6c804bb00 obj=myfoo6:thirteen state=0x5621d76db808 s->prefetch_data=0 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 3.29 3:94bd5d51:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d7be0 con 0x7fa6c8044070 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen [getxattrs out=848b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+864 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 10 manifest: total_size = 8 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.3524746181238703 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T23:26:32.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 20 get_obj_state: octx=0x7fa6c804bb00 obj=myfoo6:thirteen state=0x5621d76db808 s->prefetch_data=0 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.176+0000 7fa6d353e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 : hit (requested=0x17, cached=0x17) 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.177+0000 7fa6d353e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.177+0000 7fa6d353e800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.177+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76e02e0 con 0x5621d7694ed0 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.177+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(91 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [stat,call,call] v33'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.178+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 3.29 3:94bd5d51:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen:head [cmpxattr user.rgw.idtag (59) op 1 mode 1 in=73b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76e38d0 con 0x7fa6c8044070 2024-09-13T23:26:32.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.179+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen [cmpxattr (59) op 1 mode 1,setxattr (117),setxattr (33)] v33'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.179+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:93 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76e5350 con 0x5621d7694ed0 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:1 objects processed in :myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9]). Next marker thirteen 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.179+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76e5350 con 0x5621d7690380 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(93 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa5b2ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v33'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6d353e800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94703348183856 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76db620 con 0x7fa6c8044070 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify (1) cookie 94703347949680 notify 141733920802 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5621d76d9c10 con 0x7fa6c8044070 2024-09-13T23:26:32.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 94703347949680 notifier 4738 bl.length()=556 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa5b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa5b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(95 notify.5 [notify cookie 94703348183856 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.180+0000 7fa5b27fc640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa504003560 con 0x7fa6c8044070 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.181+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.181+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== watch-notify(notify_complete (2) cookie 94703348183856 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa6b803eaf0 con 0x7fa6c8044070 2024-09-13T23:26:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.181+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d7330 con 0x5621d768ba70 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v33'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94703348183856 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76db620 con 0x7fa6c8044070 2024-09-13T23:26:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== watch-notify(notify (1) cookie 94703347949680 notify 141733920803 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fa6b803eaf0 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa5b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94703347949680 notifier 4738 bl.length()=177 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa5b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa5b27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(98 notify.5 [notify cookie 94703348183856 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa5b27fc640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa504003560 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== watch-notify(notify_complete (2) cookie 94703348183856 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa6b802fa90 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 10 removing user index: bar 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.182+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d7330 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(100 bar [delete] v33'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6d353e800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T23:26:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6d353e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94703348198288 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5621d76db620 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== watch-notify(notify (1) cookie 94703347954832 notify 141733920804 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fa6b802fa90 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa5b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94703347954832 notifier 4738 bl.length()=152 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(101 notify.7 [notify cookie 94703348198288 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.183+0000 7fa5b2ffd640 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fa594003ea0 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.184+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.184+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== watch-notify(notify_complete (2) cookie 94703348198288 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa6b802fcc0 con 0x7fa6c8044070 2024-09-13T23:26:32.203 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T23:26:31.998750Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:26:31.998740Z","tags":[],"group_ids":[]} 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.185+0000 7fa585fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.185+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94703347956304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d768ba70 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.186+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94703347956304] v33'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.186+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94703347932528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d7690380 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.187+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94703347932528] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.187+0000 7fa6d353e800 20 remove_watcher() i=0 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.187+0000 7fa6d353e800 2 removed watcher, disabling cache 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.187+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94703347936544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d768ba70 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.188+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94703347936544] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.188+0000 7fa6d353e800 20 remove_watcher() i=1 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.188+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94703347940672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d7694ed0 2024-09-13T23:26:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.189+0000 7fa6cf234640 1 -- 172.21.15.99:0/916962887 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94703347940672] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c00b2040 con 0x5621d7694ed0 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.189+0000 7fa6d353e800 20 remove_watcher() i=2 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.189+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94703347944304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d7690380 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.190+0000 7fa6cfa35640 1 -- 172.21.15.99:0/916962887 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94703347944304] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6c8055070 con 0x5621d7690380 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.190+0000 7fa6d353e800 20 remove_watcher() i=3 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.190+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94703347947008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x5621d768ba70 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.191+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94703347947008] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x5621d768ba70 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.191+0000 7fa6d353e800 20 remove_watcher() i=4 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.191+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94703347949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x7fa6c8044070 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.192+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94703347949680] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.192+0000 7fa6d353e800 20 remove_watcher() i=5 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.192+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94703347937696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x7fa6c8044070 2024-09-13T23:26:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.193+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94703347937696] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.193+0000 7fa6d353e800 20 remove_watcher() i=6 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.193+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94703347954832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5621d76d3f40 con 0x7fa6c8044070 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94703347954832] v33'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b8029040 con 0x7fa6c8044070 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 20 remove_watcher() i=7 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa6c8044070 msgr2=0x7fa6c804b250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fa6c8044070 0x7fa6c804b250 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d768ba70 msgr2=0x5621d768df30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d768ba70 0x5621d768df30 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d7690380 msgr2=0x5621d7692770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d7690380 0x5621d7692770 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5621d7694ed0 msgr2=0x5621d7697390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5621d7694ed0 0x5621d7697390 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa598036b90 msgr2=0x7fa598039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.194+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa598036b90 0x7fa598039050 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0067b80 tx=0x7fa6c0087000 comp rx=0 tx=0).stop 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 msgr2=0x5621d76801a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8048010 tx=0x7fa6c804cd90 comp rx=0 tx=0).stop 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6c7fff640 1 -- 172.21.15.99:0/916962887 reap_dead start 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 shutdown_connections 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/916962887 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d7678d30 0x5621d76801a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 >> 172.21.15.99:0/916962887 conn(0x5621d7675090 msgr2=0x5621d7673160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 shutdown_connections 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/916962887 wait complete. 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 msgr2=0x7fa5a8039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 0x7fa5a8039050 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5621d7655920 tx=0x7fa6c0000bc0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 msgr2=0x5621d766c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x5621d76525e0 tx=0x7fa6c80167b0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 shutdown_connections 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5a8036b90 0x7fa5a8039050 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/615259163 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d766c070 0x5621d766c490 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 >> 172.21.15.99:0/615259163 conn(0x5621d7661000 msgr2=0x5621d7663b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 shutdown_connections 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/615259163 wait complete. 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 msgr2=0x5621d7658430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 0x5621d7658430 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 msgr2=0x5621d765d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 0x5621d765d0b0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 msgr2=0x7fa5b4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 0x7fa5b4039050 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8000f60 tx=0x7fa6b80012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 msgr2=0x5621d76513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.195+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000a330 tx=0x7fa6c0002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 shutdown_connections 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5621d765acc0 0x5621d765d0b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5621d755db40 0x5621d7658430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa5b4036b90 0x7fa5b4039050 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 --2- 172.21.15.99:0/4037381048 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5621d74cbe10 0x5621d76513c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 >> 172.21.15.99:0/4037381048 conn(0x5621d7552dd0 msgr2=0x5621d7643cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 shutdown_connections 2024-09-13T23:26:32.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:32.196+0000 7fa6d353e800 1 -- 172.21.15.99:0/4037381048 wait complete. 2024-09-13T23:26:32.214 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T23:26:31.998750Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:26:31.998740Z', 'tags': [], 'group_ids': []} 2024-09-13T23:26:37.222 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:26:37.222 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:26:37.222 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:26:37.222 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T23:26:37.223 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T23:26:37.282 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:37.282 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:37.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.281+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.281+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.281+0000 7f5ff9e13800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560c9cd51dd0 0x560c9cd541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.281+0000 7f5ff9e13800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c9cc0ab30 con 0x560c9ccbf650 2024-09-13T23:26:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.281+0000 7f5ff9e13800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x560c9cbec360 con 0x560c9cd51dd0 2024-09-13T23:26:37.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff4d2b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560c9cd51dd0 0x560c9cd541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff552c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x560c9ccbf650 0x560c9cd506b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:40212/0 (socket says 172.21.15.99:40212) 2024-09-13T23:26:37.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff4d2b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x560c9cd51dd0 0x560c9cd541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34742/0 (socket says 172.21.15.99:34742) 2024-09-13T23:26:37.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff552c640 1 -- 172.21.15.99:0/2412112875 learned_addr learned my addr 172.21.15.99:0/2412112875 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:37.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/2412112875 >> v1:172.21.15.43:6789/0 conn(0x560c9ccbf650 legacy=0x560c9cd506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.282+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/2412112875 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9cc12e00 con 0x560c9cd51dd0 2024-09-13T23:26:37.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.284+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/2412112875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9cd51dd0 0x560c9cd541c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2ca164478032c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.284+0000 7f5feffff640 1 -- 172.21.15.99:0/2412112875 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053570 con 0x560c9cd51dd0 2024-09-13T23:26:37.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.284+0000 7f5feffff640 1 -- 172.21.15.99:0/2412112875 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0058070 con 0x560c9cd51dd0 2024-09-13T23:26:37.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.284+0000 7f5feffff640 1 -- 172.21.15.99:0/2412112875 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe0053880 con 0x560c9cd51dd0 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 -- 172.21.15.99:0/2412112875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9cd51dd0 msgr2=0x560c9cd541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/2412112875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9cd51dd0 0x560c9cd541c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000a470 tx=0x7f5fe0045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 -- 172.21.15.99:0/2412112875 shutdown_connections 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/2412112875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9cd51dd0 0x560c9cd541c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 -- 172.21.15.99:0/2412112875 >> 172.21.15.99:0/2412112875 conn(0x560c9cd45e20 msgr2=0x560c9cd48240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 -- 172.21.15.99:0/2412112875 shutdown_connections 2024-09-13T23:26:37.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.285+0000 7f5ff9e13800 1 -- 172.21.15.99:0/2412112875 wait complete. 2024-09-13T23:26:37.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.301+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.301+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.301+0000 7f5ff9e13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff9e13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560c9cc97370 con 0x560c9ccbf650 2024-09-13T23:26:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff552c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff552c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34748/0 (socket says 172.21.15.99:34748) 2024-09-13T23:26:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff552c640 1 -- 172.21.15.99:0/3760422280 learned_addr learned my addr 172.21.15.99:0/3760422280 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff552c640 1 -- 172.21.15.99:0/3760422280 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9cbe4bc0 con 0x560c9ccbf650 2024-09-13T23:26:37.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.302+0000 7f5ff552c640 1 --2- 172.21.15.99:0/3760422280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001610 tx=0x7f5fe8001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbe1875df79e175 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ee3606640 1 -- 172.21.15.99:0/3760422280 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8004520 con 0x560c9ccbf650 2024-09-13T23:26:37.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ee3606640 1 -- 172.21.15.99:0/3760422280 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe80046c0 con 0x560c9ccbf650 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ee3606640 1 -- 172.21.15.99:0/3760422280 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8004a20 con 0x560c9ccbf650 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3760422280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 msgr2=0x560c9ce3cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3760422280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8001610 tx=0x7f5fe8001ad0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3760422280 shutdown_connections 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3760422280 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce3cb90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3760422280 >> 172.21.15.99:0/3760422280 conn(0x560c9cd45e20 msgr2=0x560c9ce38550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.303+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3760422280 shutdown_connections 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3760422280 wait complete. 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff9e13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff9e13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560c9cd549d0 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff552c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff552c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34758/0 (socket says 172.21.15.99:34758) 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.304+0000 7f5ff552c640 1 -- 172.21.15.99:0/1628503571 learned_addr learned my addr 172.21.15.99:0/1628503571 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ff552c640 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9cbf8fe0 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ff552c640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8007fd0 tx=0x7f5fe8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ee1e03640 1 -- 172.21.15.99:0/1628503571 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8014500 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ee1e03640 1 -- 172.21.15.99:0/1628503571 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8023070 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ee1e03640 1 -- 172.21.15.99:0/1628503571 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fe8014810 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9ce44b00 con 0x560c9ccbf650 2024-09-13T23:26:37.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.305+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ce44f60 con 0x560c9ccbf650 2024-09-13T23:26:37.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ee1e03640 1 -- 172.21.15.99:0/1628503571 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5fe8010070 con 0x560c9ccbf650 2024-09-13T23:26:37.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ee1e03640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 0x7f5edc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ee1e03640 1 -- 172.21.15.99:0/1628503571 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5fe804c910 con 0x560c9ccbf650 2024-09-13T23:26:37.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 0x7f5edc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 0x560c9ce4b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce4bba0 con 0x560c9cd51dd0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.306+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 0x560c9ce4b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 0x7f5edc039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0057000 tx=0x7f5fe0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 0x560c9ce4b560 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/1628503571 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5ff00083e0 con 0x560c9cd51dd0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce48a50 con 0x560c9cd51dd0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/1628503571 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5ff00083e0 con 0x560c9cd51dd0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.307+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 0x560c9ce50290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce50960 con 0x560c9ce4dea0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff552c640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 0x560c9ce50290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff552c640 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 0x560c9ce50290 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff552c640 1 -- 172.21.15.99:0/1628503571 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce4dea0 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce4cd40 con 0x560c9cd51dd0 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/1628503571 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5ff00083e0 con 0x560c9cd51dd0 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.308+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce4d200 con 0x560c9ce4dea0 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.309+0000 7f5ff552c640 1 -- 172.21.15.99:0/1628503571 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce4dea0 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.309+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.309+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.309+0000 7f5ff9e13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.309+0000 7f5ff9e13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560c9cbe6580 con 0x560c9ce5f310 2024-09-13T23:26:37.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34760/0 (socket says 172.21.15.99:34760) 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/4187607130 learned_addr learned my addr 172.21.15.99:0/4187607130 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/4187607130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9ce5fc70 con 0x560c9ce5f310 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x560c9ce45350 tx=0x7f5ff000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5edaffd640 1 -- 172.21.15.99:0/4187607130 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff001c020 con 0x560c9ce5f310 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5edaffd640 1 -- 172.21.15.99:0/4187607130 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0007c30 con 0x560c9ce5f310 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9ce5ff00 con 0x560c9ce5f310 2024-09-13T23:26:37.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5edaffd640 1 -- 172.21.15.99:0/4187607130 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff0018440 con 0x560c9ce5f310 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.310+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ce62be0 con 0x560c9ce5f310 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.311+0000 7f5edaffd640 1 -- 172.21.15.99:0/4187607130 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ff001f020 con 0x560c9ce5f310 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.311+0000 7f5edaffd640 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 0x7f5ed0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.311+0000 7f5edaffd640 1 -- 172.21.15.99:0/4187607130 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5ff004e230 con 0x560c9ce5f310 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.311+0000 7f5ff552c640 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 0x7f5ed0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff552c640 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 0x7f5ed0039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x560c9ce4c000 tx=0x7f5fe804ac80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff9e13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff9e13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560c9ce3d340 con 0x560c9ce6bf10 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34774/0 (socket says 172.21.15.99:34774) 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3007832469 learned_addr learned my addr 172.21.15.99:0/3007832469 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.312+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3007832469 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9ce6c8e0 con 0x560c9ce6bf10 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/3007832469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5ff004c610 tx=0x7f5ff004c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3f93abe8f5251a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ed8ff9640 1 -- 172.21.15.99:0/3007832469 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff0018b90 con 0x560c9ce6bf10 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ed8ff9640 1 -- 172.21.15.99:0/3007832469 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0029350 con 0x560c9ce6bf10 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ed8ff9640 1 -- 172.21.15.99:0/3007832469 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff0018d30 con 0x560c9ce6bf10 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3007832469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 msgr2=0x560c9ce6c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3007832469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5ff004c610 tx=0x7f5ff004c8e0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3007832469 shutdown_connections 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3007832469 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce6c310 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3007832469 >> 172.21.15.99:0/3007832469 conn(0x560c9ce68300 msgr2=0x560c9ce66400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3007832469 shutdown_connections 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.313+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3007832469 wait complete. 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff9e13800 1 Processor -- start 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff9e13800 1 -- start start 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff9e13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff9e13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x560c9ce6cef0 con 0x560c9ce6bf10 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff5d2d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34778/0 (socket says 172.21.15.99:34778) 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 learned_addr learned my addr 172.21.15.99:0/3992832541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9ce738e0 con 0x560c9ce6bf10 2024-09-13T23:26:37.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.314+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x560c9ce67380 tx=0x7f5ff004c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ec6ffd640 1 -- 172.21.15.99:0/3992832541 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff0029500 con 0x560c9ce6bf10 2024-09-13T23:26:37.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ec6ffd640 1 -- 172.21.15.99:0/3992832541 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff004ca20 con 0x560c9ce6bf10 2024-09-13T23:26:37.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c9ce73b70 con 0x560c9ce6bf10 2024-09-13T23:26:37.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ec6ffd640 1 -- 172.21.15.99:0/3992832541 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ff004cd00 con 0x560c9ce6bf10 2024-09-13T23:26:37.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9ce76820 con 0x560c9ce6bf10 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.315+0000 7f5ec6ffd640 1 -- 172.21.15.99:0/3992832541 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f5ff0016040 con 0x560c9ce6bf10 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ec6ffd640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ec0036b90 0x7f5ec0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ec6ffd640 1 -- 172.21.15.99:0/3992832541 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f5ff0033070 con 0x560c9ce6bf10 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ff552c640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ec0036b90 0x7f5ec0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ff552c640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ec0036b90 0x7f5ec0039050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8044fd0 tx=0x7f5fe8039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9ce7ef40 0x560c9ce81400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.316+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce81b50 con 0x560c9ce7ef40 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9ce7ef40 0x560c9ce81400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9ce7ef40 0x560c9ce81400 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff9e13800 20 realm 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce81f80 con 0x560c9ce7ef40 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.317+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce82850 con 0x560c9ce7ef40 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce82bf0 con 0x560c9ce7ef40 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce83950 0x560c9ce85d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce86350 con 0x560c9ce83950 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.318+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce83950 0x560c9ce85d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce83950 0x560c9ce85d40 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ff0057040 con 0x560c9ce83950 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff9e13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff9e13800 20 searching for the correct realm 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560c9ce882c0 0x560c9ce8a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff552c640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560c9ce882c0 0x560c9ce8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.319+0000 7f5ff552c640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560c9ce882c0 0x560c9ce8a780 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ff0057040 con 0x560c9ce83950 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff5d2d640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ff00203b0 0x7f5ff00263c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.320+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ff00203b0 0x7f5ff00263c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ff00203b0 0x7f5ff00263c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.321+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ff0057040 con 0x560c9ce83950 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.322+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.323+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5ff0057040 con 0x560c9ce83950 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.324+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.325+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.326+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ff0057040 con 0x560c9ce83950 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.327+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce882c0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.328+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x7f5ff00203b0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce7ef40 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8ae50 con 0x560c9ce83950 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.329+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce87830 con 0x560c9ce7ef40 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce870a0 con 0x560c9ce7ef40 2024-09-13T23:26:37.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8b2d0 con 0x560c9ce83950 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 zone default found 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 4 Realm: () 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 zonegroup default 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.330+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8b780 con 0x7f5ff00203b0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8d500 con 0x560c9ce882c0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8d950 con 0x560c9ce882c0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 started sync module instance, tier type = 2024-09-13T23:26:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.331+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8c9a0 con 0x560c9ce83950 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.332+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.332+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94612172099232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8c9a0 con 0x560c9ce83950 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.332+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8e440 con 0x560c9ce7ef40 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.333+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94612172099232] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.334+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.334+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94612172103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8e7e0 con 0x560c9ce7ef40 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.334+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8f280 con 0x560c9ce882c0 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.335+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94612172103472] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.335+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.335+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94612172107120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce8f620 con 0x560c9ce882c0 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.335+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce900c0 con 0x560c9ce83950 2024-09-13T23:26:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.336+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94612172107120] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.336+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.336+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94612172110736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce90080 con 0x560c9ce83950 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.336+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce90b40 con 0x560c9ce7ef40 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.338+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94612172110736] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.338+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.338+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94612172113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce90b40 con 0x560c9ce7ef40 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.338+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce91550 con 0x7f5ff00203b0 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.339+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94612172113488] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.339+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.339+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94612172096752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce91550 con 0x7f5ff00203b0 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.339+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce91f90 con 0x7f5ff00203b0 2024-09-13T23:26:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.340+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.340+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94612172118752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce923b0 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.340+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce92e50 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.340+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94612172096752] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94612172118752] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94612172116128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce923b0 con 0x7f5ff00203b0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=0 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=1 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=2 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=3 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=4 2024-09-13T23:26:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=5 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.341+0000 7f5ff9e13800 20 add_watcher() i=6 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.342+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94612172116128] v33'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.342+0000 7f5ff9e13800 20 add_watcher() i=7 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.342+0000 7f5ff9e13800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.342+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce95e40 con 0x560c9ce7ef40 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.343+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.343+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94612172120272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ce932c0 con 0x560c9ce7ef40 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94612172120272] v33'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5eab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5ff9e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5ff9e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5ff9e13800 5 note: GC not initialized 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5eaa7e4640 20 reqs_thread_entry: start 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.344+0000 7f5ff9e13800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 20 Filter name: none 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5e1bfff640 20 reqs_thread_entry: start 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec9160 con 0x7f5ff00203b0 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T23:26:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec77a0 con 0x7f5ff00203b0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.345+0000 7f5ff9e13800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.346+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec8040 con 0x7f5ff00203b0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff9e13800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff9e13800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:26:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff9e13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94612172340112 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ceccc00 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== watch-notify(notify (1) cookie 94612172096752 notify 141733920805 ret 0) ==== 598+0+0 (crc 0 0 0) 0x560c9cec83e0 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ed8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 94612172096752 notifier 4745 bl.length()=556 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ed8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ed8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ed8ff9640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5eb8003ea0 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.347+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(65 notify.5 [notify cookie 94612172340112 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.348+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== watch-notify(notify_complete (2) cookie 94612172340112 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c9cec8bb0 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.348+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.348+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9ceca730 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v33'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff9e13800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:26:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff9e13800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff9e13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94612172340032 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x560c9ceccc00 con 0x560c9ce882c0 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 94612172107120 notify 141733920774 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f5fe805f040 con 0x560c9ce882c0 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ec7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920774 cookie 94612172107120 notifier 4745 bl.length()=177 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ec7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ec7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ec7fff640 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5e28003400 con 0x560c9ce882c0 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.349+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [notify cookie 94612172340032 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.350+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== watch-notify(notify_complete (2) cookie 94612172340032 notify 141733920774 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560c9ce44f60 con 0x560c9ce882c0 2024-09-13T23:26:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.350+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.381 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T23:26:37.347017Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:26:37.347005Z","tags":[],"group_ids":[]} 2024-09-13T23:26:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.351+0000 7f5eab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.351+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94612172120272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce7ef40 2024-09-13T23:26:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.352+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94612172120272] v33'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.352+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94612172099232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce83950 2024-09-13T23:26:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.353+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94612172099232] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.353+0000 7f5ff9e13800 20 remove_watcher() i=0 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.353+0000 7f5ff9e13800 2 removed watcher, disabling cache 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.353+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94612172103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce7ef40 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.354+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94612172103472] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.354+0000 7f5ff9e13800 20 remove_watcher() i=1 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.354+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94612172107120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce882c0 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.355+0000 7f5ff552c640 1 -- 172.21.15.99:0/3992832541 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94612172107120] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe800f030 con 0x560c9ce882c0 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.355+0000 7f5ff9e13800 20 remove_watcher() i=2 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.355+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94612172110736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce83950 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.356+0000 7f5ff5d2d640 1 -- 172.21.15.99:0/3992832541 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94612172110736] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ff0062040 con 0x560c9ce83950 2024-09-13T23:26:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.356+0000 7f5ff9e13800 20 remove_watcher() i=3 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.356+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94612172113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x560c9ce7ef40 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.357+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94612172113488] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x560c9ce7ef40 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.357+0000 7f5ff9e13800 20 remove_watcher() i=4 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.357+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94612172096752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.358+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94612172096752] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.358+0000 7f5ff9e13800 20 remove_watcher() i=5 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.358+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94612172118752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.360+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94612172118752] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.360+0000 7f5ff9e13800 20 remove_watcher() i=6 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.360+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94612172116128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x560c9cec6e20 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94612172116128] v33'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5fe0051070 con 0x7f5ff00203b0 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 20 remove_watcher() i=7 2024-09-13T23:26:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ff00203b0 msgr2=0x7f5ff00263c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f5ff00203b0 0x7f5ff00263c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9ce7ef40 msgr2=0x560c9ce81400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9ce7ef40 0x560c9ce81400 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce83950 msgr2=0x560c9ce85d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce83950 0x560c9ce85d40 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560c9ce882c0 msgr2=0x560c9ce8a780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x560c9ce882c0 0x560c9ce8a780 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ec0036b90 msgr2=0x7f5ec0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ec0036b90 0x7f5ec0039050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8044fd0 tx=0x7f5fe8039000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 msgr2=0x560c9ce733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff4d2b640 1 -- 172.21.15.99:0/3992832541 reap_dead start 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x560c9ce67380 tx=0x7f5ff004c5a0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 shutdown_connections 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/3992832541 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce6bf10 0x560c9ce733a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 >> 172.21.15.99:0/3992832541 conn(0x560c9ce68300 msgr2=0x560c9ce6d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 shutdown_connections 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.361+0000 7f5ff9e13800 1 -- 172.21.15.99:0/3992832541 wait complete. 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 msgr2=0x7f5ed0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 0x7f5ed0039000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x560c9ce4c000 tx=0x7f5fe804ac80 comp rx=0 tx=0).stop 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 msgr2=0x560c9ce5f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x560c9ce45350 tx=0x7f5ff000beb0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 shutdown_connections 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5ed0036b40 0x7f5ed0039000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/4187607130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ce5f310 0x560c9ce5f730 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 >> 172.21.15.99:0/4187607130 conn(0x560c9ce542a0 msgr2=0x560c9ce56e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 shutdown_connections 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/4187607130 wait complete. 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 msgr2=0x560c9ce4b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 0x560c9ce4b560 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 msgr2=0x560c9ce50290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 0x560c9ce50290 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 msgr2=0x7f5edc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 0x7f5edc039000 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0057000 tx=0x7f5fe0052000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 msgr2=0x560c9ce445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8007fd0 tx=0x7f5fe8000f40 comp rx=0 tx=0).stop 2024-09-13T23:26:37.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 shutdown_connections 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x560c9ce4dea0 0x560c9ce50290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x560c9cd51dd0 0x560c9ce4b560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f5edc036b40 0x7f5edc039000 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 --2- 172.21.15.99:0/1628503571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x560c9ccbf650 0x560c9ce445c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 >> 172.21.15.99:0/1628503571 conn(0x560c9cd45e20 msgr2=0x560c9ce36dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 shutdown_connections 2024-09-13T23:26:37.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.362+0000 7f5ff9e13800 1 -- 172.21.15.99:0/1628503571 wait complete. 2024-09-13T23:26:37.392 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T23:26:37.347017Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:26:37.347005Z', 'tags': [], 'group_ids': []} 2024-09-13T23:26:37.413 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:26:37.418 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T23:26:37.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:26:37.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T23:26:37.419 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T23:26:37.465 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:37.465 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.464+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.464+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.464+0000 7effbaf2e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5616b931b710 0x5616b931bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.464+0000 7effbaf2e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616b91dab30 con 0x5616b931c050 2024-09-13T23:26:37.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.464+0000 7effbaf2e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5616b91bc360 con 0x5616b931b710 2024-09-13T23:26:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.465+0000 7effb6b6e640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5616b931b710 0x5616b931bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.465+0000 7effaffff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5616b931c050 0x5616b9320a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:40214/0 (socket says 172.21.15.99:40214) 2024-09-13T23:26:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.465+0000 7effaffff640 1 -- 172.21.15.99:0/902162875 learned_addr learned my addr 172.21.15.99:0/902162875 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.465+0000 7effb6b6e640 1 -- 172.21.15.99:0/902162875 >> v1:172.21.15.43:6789/0 conn(0x5616b931c050 legacy=0x5616b9320a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.465+0000 7effb6b6e640 1 -- 172.21.15.99:0/902162875 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b91e2e00 con 0x5616b931b710 2024-09-13T23:26:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effb6b6e640 1 --2- 172.21.15.99:0/902162875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b931bb10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7effa800a470 tx=0x7effa8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1167e40931e3292 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effb636d640 1 -- 172.21.15.99:0/902162875 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8053570 con 0x5616b931b710 2024-09-13T23:26:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effb636d640 1 -- 172.21.15.99:0/902162875 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8058070 con 0x5616b931b710 2024-09-13T23:26:37.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effb636d640 1 -- 172.21.15.99:0/902162875 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8053880 con 0x5616b931b710 2024-09-13T23:26:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 -- 172.21.15.99:0/902162875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 msgr2=0x5616b931bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 --2- 172.21.15.99:0/902162875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b931bb10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7effa800a470 tx=0x7effa8045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 -- 172.21.15.99:0/902162875 shutdown_connections 2024-09-13T23:26:37.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 --2- 172.21.15.99:0/902162875 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b931bb10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 -- 172.21.15.99:0/902162875 >> 172.21.15.99:0/902162875 conn(0x5616b9316fe0 msgr2=0x5616b9319400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 -- 172.21.15.99:0/902162875 shutdown_connections 2024-09-13T23:26:37.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.467+0000 7effbaf2e800 1 -- 172.21.15.99:0/902162875 wait complete. 2024-09-13T23:26:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.481+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.481+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effbaf2e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effbaf2e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5616b9267360 con 0x5616b931b710 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effb6b6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effb6b6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34790/0 (socket says 172.21.15.99:34790) 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effb6b6e640 1 -- 172.21.15.99:0/2798473045 learned_addr learned my addr 172.21.15.99:0/2798473045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effb6b6e640 1 -- 172.21.15.99:0/2798473045 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b91b4bc0 con 0x5616b931b710 2024-09-13T23:26:37.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.482+0000 7effb6b6e640 1 --2- 172.21.15.99:0/2798473045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7effa8025c20 tx=0x7effa8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f986849df810a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7efea4e09640 1 -- 172.21.15.99:0/2798473045 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8053ba0 con 0x5616b931b710 2024-09-13T23:26:37.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7efea4e09640 1 -- 172.21.15.99:0/2798473045 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8063030 con 0x5616b931b710 2024-09-13T23:26:37.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7efea4e09640 1 -- 172.21.15.99:0/2798473045 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8053440 con 0x5616b931b710 2024-09-13T23:26:37.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 -- 172.21.15.99:0/2798473045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 msgr2=0x5616b940a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2798473045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7effa8025c20 tx=0x7effa8051000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 -- 172.21.15.99:0/2798473045 shutdown_connections 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2798473045 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b940a8a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 -- 172.21.15.99:0/2798473045 >> 172.21.15.99:0/2798473045 conn(0x5616b9316fe0 msgr2=0x5616b9406260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 -- 172.21.15.99:0/2798473045 shutdown_connections 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.483+0000 7effbaf2e800 1 -- 172.21.15.99:0/2798473045 wait complete. 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effbaf2e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effbaf2e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5616b93225f0 con 0x5616b931b710 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effb6b6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effb6b6e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34794/0 (socket says 172.21.15.99:34794) 2024-09-13T23:26:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effb6b6e640 1 -- 172.21.15.99:0/1571218362 learned_addr learned my addr 172.21.15.99:0/1571218362 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effb6b6e640 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b91c8fe0 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.484+0000 7effb6b6e640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x5616b940b700 tx=0x7effa8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7efea3606640 1 -- 172.21.15.99:0/1571218362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8078070 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7efea3606640 1 -- 172.21.15.99:0/1571218362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa8053570 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b9412740 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7efea3606640 1 -- 172.21.15.99:0/1571218362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8053850 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b9412cc0 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.485+0000 7efea3606640 1 -- 172.21.15.99:0/1571218362 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effa807b070 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7efea3606640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 0x7efe9c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7efea3606640 1 -- 172.21.15.99:0/1571218362 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7effa8070070 con 0x5616b931b710 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effaffff640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 0x7efe9c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 0x5616b9419270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9419890 con 0x5616b931c050 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effb736f640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 0x5616b9419270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effaffff640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 0x7efe9c039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7effa0000f60 tx=0x7effa00012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effb736f640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 0x5616b9419270 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.486+0000 7effb736f640 1 -- 172.21.15.99:0/1571218362 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effb000a4a0 con 0x5616b931c050 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9416840 con 0x5616b931c050 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effb736f640 1 -- 172.21.15.99:0/1571218362 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effb000a4a0 con 0x5616b931c050 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 0x5616b941e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b941e710 con 0x5616b941bc30 2024-09-13T23:26:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effb6b6e640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 0x5616b941e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.487+0000 7effb6b6e640 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 0x5616b941e020 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.488+0000 7effb6b6e640 1 -- 172.21.15.99:0/1571218362 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7effa807a030 con 0x5616b941bc30 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.488+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b941aa10 con 0x5616b931c050 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.488+0000 7effb736f640 1 -- 172.21.15.99:0/1571218362 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effb000a4a0 con 0x5616b931c050 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.488+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b941aef0 con 0x5616b941bc30 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.488+0000 7effb6b6e640 1 -- 172.21.15.99:0/1571218362 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7effa807a030 con 0x5616b941bc30 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effbaf2e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effbaf2e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5616b91b6580 con 0x5616b942cf70 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34810/0 (socket says 172.21.15.99:34810) 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effb736f640 1 -- 172.21.15.99:0/839550971 learned_addr learned my addr 172.21.15.99:0/839550971 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.489+0000 7effb736f640 1 -- 172.21.15.99:0/839550971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b942d8d0 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7effb736f640 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x5616b9419c90 tx=0x7effb00163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7efea0e01640 1 -- 172.21.15.99:0/839550971 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0013450 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7efea0e01640 1 -- 172.21.15.99:0/839550971 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb00135f0 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7efea0e01640 1 -- 172.21.15.99:0/839550971 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb00138d0 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b942db60 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.490+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b9430840 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7efea0e01640 1 -- 172.21.15.99:0/839550971 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effb0011040 con 0x5616b942cf70 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7efea0e01640 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 0x7efe90039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7efea0e01640 1 -- 172.21.15.99:0/839550971 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7effb000e040 con 0x5616b942cf70 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effb6b6e640 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 0x7efe90039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effb6b6e640 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 0x7efe90039050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5616b941a1e0 tx=0x7effa808ec10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effbaf2e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.491+0000 7effbaf2e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5616b940aff0 con 0x5616b9439cc0 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34818/0 (socket says 172.21.15.99:34818) 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7effb736f640 1 -- 172.21.15.99:0/3071754935 learned_addr learned my addr 172.21.15.99:0/3071754935 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7effb736f640 1 -- 172.21.15.99:0/3071754935 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b943a690 con 0x5616b9439cc0 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7effb736f640 1 --2- 172.21.15.99:0/3071754935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7effb004cd90 tx=0x7effb0014aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c288d4184018eef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7efe9a7fc640 1 -- 172.21.15.99:0/3071754935 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb001f390 con 0x5616b9439cc0 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7efe9a7fc640 1 -- 172.21.15.99:0/3071754935 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb0012cb0 con 0x5616b9439cc0 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.492+0000 7efe9a7fc640 1 -- 172.21.15.99:0/3071754935 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb001f530 con 0x5616b9439cc0 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- 172.21.15.99:0/3071754935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 msgr2=0x5616b943a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 --2- 172.21.15.99:0/3071754935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7effb004cd90 tx=0x7effb0014aa0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- 172.21.15.99:0/3071754935 shutdown_connections 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 --2- 172.21.15.99:0/3071754935 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b943a0c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- 172.21.15.99:0/3071754935 >> 172.21.15.99:0/3071754935 conn(0x5616b9436020 msgr2=0x5616b9434120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- 172.21.15.99:0/3071754935 shutdown_connections 2024-09-13T23:26:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- 172.21.15.99:0/3071754935 wait complete. 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 Processor -- start 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- start start 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b9441130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effbaf2e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5616b943ad00 con 0x5616b9439cc0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b9441130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effb736f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b9441130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34834/0 (socket says 172.21.15.99:34834) 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.493+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 learned_addr learned my addr 172.21.15.99:0/2261729371 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b9441670 con 0x5616b9439cc0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7effb736f640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b9441130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7effb002a040 tx=0x7effb004cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7efe98ff9640 1 -- 172.21.15.99:0/2261729371 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0038070 con 0x5616b9439cc0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7efe98ff9640 1 -- 172.21.15.99:0/2261729371 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb001f920 con 0x5616b9439cc0 2024-09-13T23:26:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b9441900 con 0x5616b9439cc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7efe98ff9640 1 -- 172.21.15.99:0/2261729371 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0013bc0 con 0x5616b9439cc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.494+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b94445b0 con 0x5616b9439cc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.495+0000 7efe98ff9640 1 -- 172.21.15.99:0/2261729371 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7effb003b070 con 0x5616b9439cc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.495+0000 7efe98ff9640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe80036b40 0x7efe80039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.495+0000 7efe98ff9640 1 -- 172.21.15.99:0/2261729371 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7effb0034c10 con 0x5616b9439cc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.495+0000 7effb6b6e640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe80036b40 0x7efe80039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.495+0000 7effb6b6e640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe80036b40 0x7efe80039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effa800a470 tx=0x7effa8092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b944cdc0 0x5616b944f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b944f9d0 con 0x5616b944cdc0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effaffff640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b944cdc0 0x5616b944f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effaffff640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b944cdc0 0x5616b944f280 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effa0009050 con 0x5616b944cdc0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 20 realm 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b944c210 con 0x5616b944cdc0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.496+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effa0009050 con 0x5616b944cdc0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b94504c0 con 0x5616b944cdc0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effa0009050 con 0x5616b944cdc0 2024-09-13T23:26:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9450d90 con 0x5616b944cdc0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7effa0009050 con 0x5616b944cdc0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b94516d0 0x5616b9453ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9454250 con 0x5616b94516d0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effb736f640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b94516d0 0x5616b9453ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.497+0000 7effb736f640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b94516d0 0x5616b9453ac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effbaf2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:37.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effbaf2e800 20 searching for the correct realm 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5616b9456220 0x5616b94586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effb6b6e640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5616b9456220 0x5616b94586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effb6b6e640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5616b9456220 0x5616b94586e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.498+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.499+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.499+0000 7effb736f640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7effb0045050 0x7effb00343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.499+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.499+0000 7effaffff640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7effb0045050 0x7effb00343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.499+0000 7effaffff640 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7effb0045050 0x7effb00343f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0009050 con 0x7effb0045050 2024-09-13T23:26:37.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0009050 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.500+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.501+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.502+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.503+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.504+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.505+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b9456220 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x7effb0045050 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b944cdc0 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.506+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5616b9458db0 con 0x5616b94516d0 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:37.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9454c10 con 0x5616b944cdc0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b94554b0 con 0x5616b944cdc0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.507+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b9459230 con 0x5616b94516d0 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 zone default found 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 4 Realm: () 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 zonegroup default 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b94550c0 con 0x7effb0045050 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b945b960 con 0x5616b9456220 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.508+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b945bd00 con 0x5616b9456220 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.509+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.509+0000 7effbaf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.509+0000 7effbaf2e800 20 started sync module instance, tier type = 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.509+0000 7effbaf2e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.509+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945adf0 con 0x5616b94516d0 2024-09-13T23:26:37.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.510+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.510+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655597621728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945aa50 con 0x5616b94516d0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.510+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945ca40 con 0x5616b944cdc0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.511+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655597621728] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.511+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.511+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655597625504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945c970 con 0x5616b944cdc0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.511+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945d4c0 con 0x5616b9456220 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.512+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.512+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655597629392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945dd60 con 0x5616b9456220 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.512+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655597625504] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.512+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945c500 con 0x5616b94516d0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.513+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655597629392] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.513+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.514+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655597631664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945e7f0 con 0x5616b94516d0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.514+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945f1b0 con 0x5616b944cdc0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.515+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.515+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655597636864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b945f5d0 con 0x5616b944cdc0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.515+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b94600b0 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.515+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655597631664] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.516+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.516+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655597640640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b94600b0 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.516+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9460ac0 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.516+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655597636864] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.517+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655597640640] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.517+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.517+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655597637920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9460610 con 0x7effb0045050 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.517+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9460fd0 con 0x7effb0045050 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655597637920] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655597634288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9460fd0 con 0x7effb0045050 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=0 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=1 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=2 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=3 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=4 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=5 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.518+0000 7effbaf2e800 20 add_watcher() i=6 2024-09-13T23:26:37.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655597634288] v33'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effbaf2e800 20 add_watcher() i=7 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effbaf2e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b94642f0 con 0x5616b944cdc0 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.519+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655597644944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9461560 con 0x5616b944cdc0 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.520+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655597644944] v33'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.520+0000 7efe6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 5 note: GC not initialized 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7efde7fff640 20 reqs_thread_entry: start 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:37.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 20 Filter name: none 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7efde5ffb640 20 reqs_thread_entry: start 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.521+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5616b94978b0 con 0x5616b94516d0 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effbaf2e800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effbaf2e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effbaf2e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effbaf2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.522+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b949bc00 con 0x7effb0045050 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.523+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v33'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.537 INFO:teuthology.orchestra.run.smithi099.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T23:26:37.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.523+0000 7efe6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.523+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655597644944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b944cdc0 2024-09-13T23:26:37.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.524+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94655597644944] v33'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.524+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655597621728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b94516d0 2024-09-13T23:26:37.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.525+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94655597621728] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.526+0000 7effbaf2e800 20 remove_watcher() i=0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.526+0000 7effbaf2e800 2 removed watcher, disabling cache 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.526+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655597625504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b944cdc0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.527+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94655597625504] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.527+0000 7effbaf2e800 20 remove_watcher() i=1 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.527+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655597629392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b9456220 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.528+0000 7effb6b6e640 1 -- 172.21.15.99:0/2261729371 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94655597629392] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa807a030 con 0x5616b9456220 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.528+0000 7effbaf2e800 20 remove_watcher() i=2 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.528+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655597631664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b94516d0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.529+0000 7effb736f640 1 -- 172.21.15.99:0/2261729371 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94655597631664] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effb003a030 con 0x5616b94516d0 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.529+0000 7effbaf2e800 20 remove_watcher() i=3 2024-09-13T23:26:37.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.529+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655597636864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x5616b944cdc0 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.530+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94655597636864] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x5616b944cdc0 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.530+0000 7effbaf2e800 20 remove_watcher() i=4 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.530+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655597640640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.531+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94655597640640] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.531+0000 7effbaf2e800 20 remove_watcher() i=5 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.531+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655597637920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.533+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94655597637920] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.533+0000 7effbaf2e800 20 remove_watcher() i=6 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.533+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655597634288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5616b9495600 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94655597634288] v33'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7effa0029040 con 0x7effb0045050 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 20 remove_watcher() i=7 2024-09-13T23:26:37.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7effb0045050 msgr2=0x7effb00343f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7effb0045050 0x7effb00343f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b944cdc0 msgr2=0x5616b944f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b944cdc0 0x5616b944f280 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b94516d0 msgr2=0x5616b9453ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b94516d0 0x5616b9453ac0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5616b9456220 msgr2=0x5616b94586e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5616b9456220 0x5616b94586e0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe80036b40 msgr2=0x7efe80039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe80036b40 0x7efe80039000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effa800a470 tx=0x7effa8092000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 msgr2=0x5616b9441130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/2261729371 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b9439cc0 0x5616b9441130 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7effb002a040 tx=0x7effb004cd20 comp rx=0 tx=0).stop 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 reap_dead start 2024-09-13T23:26:37.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effaffff640 1 -- 172.21.15.99:0/2261729371 reap_dead start 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 shutdown_connections 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 >> 172.21.15.99:0/2261729371 conn(0x5616b9436020 msgr2=0x5616b94340f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 shutdown_connections 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/2261729371 wait complete. 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 msgr2=0x7efe90039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 0x7efe90039050 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x5616b941a1e0 tx=0x7effa808ec10 comp rx=0 tx=0).stop 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 msgr2=0x5616b942d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x5616b9419c90 tx=0x7effb00163e0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 shutdown_connections 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe90036b90 0x7efe90039050 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 --2- 172.21.15.99:0/839550971 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b942cf70 0x5616b942d390 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 >> 172.21.15.99:0/839550971 conn(0x5616b9421f00 msgr2=0x5616b9424a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 shutdown_connections 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.534+0000 7effbaf2e800 1 -- 172.21.15.99:0/839550971 wait complete. 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 msgr2=0x5616b9419270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 0x5616b9419270 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 msgr2=0x5616b941e020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 0x5616b941e020 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 msgr2=0x7efe9c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 0x7efe9c039000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7effa0000f60 tx=0x7effa00012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 msgr2=0x5616b9412200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x5616b940b700 tx=0x7effa8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 shutdown_connections 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5616b941bc30 0x5616b941e020 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5616b931c050 0x5616b9419270 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe9c036b40 0x7efe9c039000 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 --2- 172.21.15.99:0/1571218362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5616b931b710 0x5616b9412200 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 >> 172.21.15.99:0/1571218362 conn(0x5616b9316fe0 msgr2=0x5616b9404ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 shutdown_connections 2024-09-13T23:26:37.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.535+0000 7effbaf2e800 1 -- 172.21.15.99:0/1571218362 wait complete. 2024-09-13T23:26:37.548 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T23:26:37.553 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:26:37.553 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:26:37.560 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T23:26:37.560 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T23:26:37.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:26:37.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T23:26:37.561 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T23:26:37.606 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:37.606 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.605+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.605+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.605+0000 7f808e326800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5556a7181650 0x5556a72101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.605+0000 7f808e326800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5556a70ccb30 con 0x5556a7210720 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.605+0000 7f808e326800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5556a70ae360 con 0x5556a7181650 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f8089fe3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5556a7181650 0x5556a72101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f80897e2640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5556a7210720 0x5556a7212b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:40220/0 (socket says 172.21.15.99:40220) 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f8089fe3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5556a7181650 0x5556a72101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34846/0 (socket says 172.21.15.99:34846) 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f80897e2640 1 -- 172.21.15.99:0/2408707256 learned_addr learned my addr 172.21.15.99:0/2408707256 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:37.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f8089fe3640 1 -- 172.21.15.99:0/2408707256 >> v1:172.21.15.43:6789/0 conn(0x5556a7210720 legacy=0x5556a7212b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.606+0000 7f8089fe3640 1 -- 172.21.15.99:0/2408707256 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a70d4e00 con 0x5556a7181650 2024-09-13T23:26:37.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f8089fe3640 1 --2- 172.21.15.99:0/2408707256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72101e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a470 tx=0x7f807c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b7de6de825f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f8088fe1640 1 -- 172.21.15.99:0/2408707256 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c053570 con 0x5556a7181650 2024-09-13T23:26:37.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f8088fe1640 1 -- 172.21.15.99:0/2408707256 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c058070 con 0x5556a7181650 2024-09-13T23:26:37.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f8088fe1640 1 -- 172.21.15.99:0/2408707256 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c053880 con 0x5556a7181650 2024-09-13T23:26:37.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f808e326800 1 -- 172.21.15.99:0/2408707256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 msgr2=0x5556a72101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.608+0000 7f808e326800 1 --2- 172.21.15.99:0/2408707256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72101e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a470 tx=0x7f807c045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.609+0000 7f808e326800 1 -- 172.21.15.99:0/2408707256 shutdown_connections 2024-09-13T23:26:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.609+0000 7f808e326800 1 --2- 172.21.15.99:0/2408707256 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72101e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.609+0000 7f808e326800 1 -- 172.21.15.99:0/2408707256 >> 172.21.15.99:0/2408707256 conn(0x5556a7207db0 msgr2=0x5556a720a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.609+0000 7f808e326800 1 -- 172.21.15.99:0/2408707256 shutdown_connections 2024-09-13T23:26:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.609+0000 7f808e326800 1 -- 172.21.15.99:0/2408707256 wait complete. 2024-09-13T23:26:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.622+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f808e326800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f808e326800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556a7159360 con 0x5556a7181650 2024-09-13T23:26:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f8089fe3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f8089fe3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34862/0 (socket says 172.21.15.99:34862) 2024-09-13T23:26:37.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f8089fe3640 1 -- 172.21.15.99:0/1952738125 learned_addr learned my addr 172.21.15.99:0/1952738125 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.623+0000 7f8089fe3640 1 -- 172.21.15.99:0/1952738125 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a70a6bc0 con 0x5556a7181650 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.624+0000 7f8089fe3640 1 --2- 172.21.15.99:0/1952738125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f807c025c20 tx=0x7f807c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ff9cd6752665da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.624+0000 7f7f77e07640 1 -- 172.21.15.99:0/1952738125 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c05c580 con 0x5556a7181650 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.624+0000 7f7f77e07640 1 -- 172.21.15.99:0/1952738125 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c063030 con 0x5556a7181650 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.624+0000 7f7f77e07640 1 -- 172.21.15.99:0/1952738125 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c05c850 con 0x5556a7181650 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- 172.21.15.99:0/1952738125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 msgr2=0x5556a72fc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 --2- 172.21.15.99:0/1952738125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f807c025c20 tx=0x7f807c051000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- 172.21.15.99:0/1952738125 shutdown_connections 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 --2- 172.21.15.99:0/1952738125 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a72fc880 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- 172.21.15.99:0/1952738125 >> 172.21.15.99:0/1952738125 conn(0x5556a7207db0 msgr2=0x5556a72f8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- 172.21.15.99:0/1952738125 shutdown_connections 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- 172.21.15.99:0/1952738125 wait complete. 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f808e326800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556a7214620 con 0x5556a7181650 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.625+0000 7f8089fe3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f8089fe3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34872/0 (socket says 172.21.15.99:34872) 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f8089fe3640 1 -- 172.21.15.99:0/3418663884 learned_addr learned my addr 172.21.15.99:0/3418663884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f8089fe3640 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a70bafe0 con 0x5556a7181650 2024-09-13T23:26:37.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a330 tx=0x7f807c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f7f76604640 1 -- 172.21.15.99:0/3418663884 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c06c030 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f7f76604640 1 -- 172.21.15.99:0/3418663884 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807c05c580 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556a720c200 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f7f76604640 1 -- 172.21.15.99:0/3418663884 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f807c05c860 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.626+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a720c780 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f7f76604640 1 -- 172.21.15.99:0/3418663884 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f807c053440 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f7f76604640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 0x7f7f70039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f7f76604640 1 -- 172.21.15.99:0/3418663884 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f807c070020 con 0x5556a7181650 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f80897e2640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 0x7f7f70039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 0x5556a730d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.627+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a730da90 con 0x5556a7210720 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 0x5556a730d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f80897e2640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 0x7f7f70039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8080000f60 tx=0x7f80800012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 0x5556a730d550 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f808a7e4640 1 -- 172.21.15.99:0/3418663884 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f808400a4a0 con 0x5556a7210720 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a730e2e0 con 0x5556a7210720 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.628+0000 7f808a7e4640 1 -- 172.21.15.99:0/3418663884 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f808400a4a0 con 0x5556a7210720 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 0x5556a7312180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7312910 con 0x5556a730fd10 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 0x5556a7312180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 0x5556a7312180 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f8089fe3640 1 -- 172.21.15.99:0/3418663884 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f807c07b070 con 0x5556a730fd10 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a730eb30 con 0x5556a7210720 2024-09-13T23:26:37.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.629+0000 7f808a7e4640 1 -- 172.21.15.99:0/3418663884 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f808400a4a0 con 0x5556a7210720 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a730ef10 con 0x5556a730fd10 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f8089fe3640 1 -- 172.21.15.99:0/3418663884 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f807c07b070 con 0x5556a730fd10 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f808e326800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.630+0000 7f808e326800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556a720e050 con 0x5556a73212d0 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34884/0 (socket says 172.21.15.99:34884) 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808a7e4640 1 -- 172.21.15.99:0/1125114820 learned_addr learned my addr 172.21.15.99:0/1125114820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808a7e4640 1 -- 172.21.15.99:0/1125114820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a7321c30 con 0x5556a73212d0 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808a7e4640 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x5556a720d670 tx=0x7f80840163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f7f6f7fe640 1 -- 172.21.15.99:0/1125114820 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084013450 con 0x5556a73212d0 2024-09-13T23:26:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f7f6f7fe640 1 -- 172.21.15.99:0/1125114820 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80840135f0 con 0x5556a73212d0 2024-09-13T23:26:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556a7321ec0 con 0x5556a73212d0 2024-09-13T23:26:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f7f6f7fe640 1 -- 172.21.15.99:0/1125114820 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084013910 con 0x5556a73212d0 2024-09-13T23:26:37.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.631+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a7324ba0 con 0x5556a73212d0 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.632+0000 7f7f6f7fe640 1 -- 172.21.15.99:0/1125114820 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8084011040 con 0x5556a73212d0 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.632+0000 7f7f6f7fe640 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 0x7f7f640390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.632+0000 7f7f6f7fe640 1 -- 172.21.15.99:0/1125114820 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f808400e040 con 0x5556a73212d0 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.632+0000 7f8089fe3640 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 0x7f7f640390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f8089fe3640 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 0x7f7f640390a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5556a720cd20 tx=0x7f807c08ee50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808e326800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808e326800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556a70a8580 con 0x5556a732e020 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34894/0 (socket says 172.21.15.99:34894) 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808a7e4640 1 -- 172.21.15.99:0/1060926300 learned_addr learned my addr 172.21.15.99:0/1060926300 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.633+0000 7f808a7e4640 1 -- 172.21.15.99:0/1060926300 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a732e9f0 con 0x5556a732e020 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808a7e4640 1 --2- 172.21.15.99:0/1060926300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f808404ce00 tx=0x7f8084029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d722c35dfa090056 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/1060926300 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084046120 con 0x5556a732e020 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/1060926300 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808401f390 con 0x5556a732e020 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/1060926300 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084012cb0 con 0x5556a732e020 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- 172.21.15.99:0/1060926300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 msgr2=0x5556a732e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 --2- 172.21.15.99:0/1060926300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f808404ce00 tx=0x7f8084029fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- 172.21.15.99:0/1060926300 shutdown_connections 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 --2- 172.21.15.99:0/1060926300 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a732e420 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- 172.21.15.99:0/1060926300 >> 172.21.15.99:0/1060926300 conn(0x5556a732a380 msgr2=0x5556a7328480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- 172.21.15.99:0/1060926300 shutdown_connections 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- 172.21.15.99:0/1060926300 wait complete. 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 Processor -- start 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.634+0000 7f808e326800 1 -- start start 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808e326800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808e326800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5556a732eee0 con 0x5556a732e020 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808a7e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34902/0 (socket says 172.21.15.99:34902) 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 learned_addr learned my addr 172.21.15.99:0/3108369252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a7335870 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8084046040 tx=0x7f808404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f7f5b7fe640 1 -- 172.21.15.99:0/3108369252 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084029770 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f7f5b7fe640 1 -- 172.21.15.99:0/3108369252 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808403a070 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556a7335b00 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f7f5b7fe640 1 -- 172.21.15.99:0/3108369252 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8084029910 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.635+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a73387b0 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.636+0000 7f7f5b7fe640 1 -- 172.21.15.99:0/3108369252 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f808404eaf0 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.636+0000 7f7f5b7fe640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f54036b90 0x7f7f54039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.636+0000 7f7f5b7fe640 1 -- 172.21.15.99:0/3108369252 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8084049030 con 0x5556a732e020 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.636+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f54036b90 0x7f7f54039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f54036b90 0x7f7f54039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f807c090010 tx=0x7f807c091000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7340ff0 0x5556a73434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7343c00 con 0x5556a7340ff0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f80897e2640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7340ff0 0x5556a73434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.637+0000 7f80897e2640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7340ff0 0x5556a73434b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8080009050 con 0x5556a7340ff0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 realm 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7340440 con 0x5556a7340ff0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8080009050 con 0x5556a7340ff0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73446f0 con 0x5556a7340ff0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8080009050 con 0x5556a7340ff0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7344fc0 con 0x5556a7340ff0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8080009050 con 0x5556a7340ff0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a7345900 0x5556a7347cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.638+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7348480 con 0x5556a7345900 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a7345900 0x5556a7347cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a7345900 0x5556a7347cf0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808e326800 20 searching for the correct realm 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556a734a450 0x5556a734c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556a734a450 0x5556a734c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.639+0000 7f8089fe3640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556a734a450 0x5556a734c910 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f808a7e4640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8084035070 0x7f80840464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.640+0000 7f80897e2640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8084035070 0x7f80840464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.641+0000 7f80897e2640 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8084035070 0x7f80840464b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.641+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080009050 con 0x7f8084035070 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.641+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.641+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080009050 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.641+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.642+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.643+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.644+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.645+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.646+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.647+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a734a450 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x7f8084035070 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7340ff0 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5556a734cfe0 con 0x5556a7345900 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.648+0000 7f808e326800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:37.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7348e70 con 0x5556a7340ff0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7349710 con 0x5556a7340ff0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a734d460 con 0x5556a7345900 2024-09-13T23:26:37.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 zone default found 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 4 Realm: () 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 zonegroup default 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.649+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a734dcb0 con 0x7f8084035070 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a734fa30 con 0x5556a734a450 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a734fe50 con 0x5556a734a450 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 started sync module instance, tier type = 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.650+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a734eed0 con 0x5556a7345900 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.651+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.651+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93830660813776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a734eed0 con 0x5556a7345900 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.651+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73509d0 con 0x5556a7340ff0 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.652+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93830660813776] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.653+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.653+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93830660818080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a734eed0 con 0x5556a7340ff0 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.653+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7351450 con 0x5556a734a450 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.654+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.654+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93830660820832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7351d20 con 0x5556a734a450 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.654+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7352820 con 0x5556a7345900 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.654+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93830660818080] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.655+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93830660820832] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.655+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.655+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93830660823152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a734ea20 con 0x5556a7345900 2024-09-13T23:26:37.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.655+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7353100 con 0x5556a7340ff0 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.656+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93830660823152] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.657+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.657+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93830660825872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73530c0 con 0x5556a7340ff0 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.657+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7353b50 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.658+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.658+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93830660830816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7353b50 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.658+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93830660825872] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.658+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73548a0 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.659+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93830660830816] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.659+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.659+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93830660833088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7353b50 con 0x7f8084035070 2024-09-13T23:26:37.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.659+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7354f20 con 0x7f8084035070 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93830660833088] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93830660834144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7354f20 con 0x7f8084035070 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=0 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=1 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=2 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=3 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=4 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=5 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.660+0000 7f808e326800 20 add_watcher() i=6 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93830660834144] v33'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f808e326800 20 add_watcher() i=7 2024-09-13T23:26:37.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f808e326800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7358350 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.661+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93830660835840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7355870 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.662+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93830660835840] v33'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.663+0000 7f7f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.663+0000 7f808e326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.663+0000 7f808e326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.663+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7358180 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.664+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.664+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73614e0 con 0x7f8084035070 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.665+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.665+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73618e0 con 0x5556a734a450 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.666+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.666+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7361d20 con 0x5556a7340ff0 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.667+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.667+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362290 con 0x5556a7345900 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.668+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.668+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362290 con 0x5556a734a450 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.669+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.669+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362290 con 0x5556a7340ff0 2024-09-13T23:26:37.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.670+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.670+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362300 con 0x7f8084035070 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.671+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.671+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362300 con 0x5556a7345900 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.672+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.672+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73622a0 con 0x5556a734a450 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.673+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.673+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a7345900 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.674+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.674+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x7f8084035070 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.675+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.675+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a7345900 2024-09-13T23:26:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.676+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.676+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x7f8084035070 2024-09-13T23:26:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.677+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'53 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.677+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a7340ff0 2024-09-13T23:26:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.678+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.678+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a734a450 2024-09-13T23:26:37.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.679+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'64 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.679+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362c60 con 0x5556a7345900 2024-09-13T23:26:37.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.680+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.680+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.681+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.681+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a7340ff0 2024-09-13T23:26:37.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.683+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'35 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.683+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a7340ff0 2024-09-13T23:26:37.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.683+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.683+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.684+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'65 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.685+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a7345900 2024-09-13T23:26:37.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.685+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.686+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a734a450 2024-09-13T23:26:37.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.686+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.686+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362840 con 0x5556a734a450 2024-09-13T23:26:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.687+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.687+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.688+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.688+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.689+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.689+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x7f8084035070 2024-09-13T23:26:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.690+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.690+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.691+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.691+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x7f8084035070 2024-09-13T23:26:37.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.692+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.692+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a734a450 2024-09-13T23:26:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.693+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.693+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x7f8084035070 2024-09-13T23:26:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.695+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.695+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a7362a10 con 0x5556a7345900 2024-09-13T23:26:37.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'33 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f7f3a7fc640 20 reqs_thread_entry: start 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808e326800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808e326800 20 Filter name: none 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f7eabfff640 20 reqs_thread_entry: start 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808e326800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.696+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a738d7e0 con 0x5556a7345900 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73900a0 con 0x5556a7340ff0 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 : miss 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.697+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 8.14 8:2b0134f5:root::.bucket.meta.myfoo6%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a738ff10 con 0x5556a734a450 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(96 .bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x17 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:97 4.1f 4:f945b4ed:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d400 con 0x5556a734a450 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(97 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:98 4.15 4:aaa0fa2e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d480 con 0x5556a734a450 2024-09-13T23:26:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(98 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.698+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 4.6 4:61d9c90b:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d480 con 0x5556a734a450 2024-09-13T23:26:37.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(99 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 4.39 4:9db64c29:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d480 con 0x5556a734a450 2024-09-13T23:26:37.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(100 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:101 4.3a 4:5c250fbd:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d480 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(101 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.699+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:102 4.b 4:d1020db2:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a7345900 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(102 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 4.1d 4:b91f06a9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(103 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:104 4.30 4:0fc2228d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(104 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c07b070 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:105 4.29 4:94808ab6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(105 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.700+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(106 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [call out=345b] v0'0 uv6 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f808e326800 10 cls_bucket_list_unordered: got thirteen 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:107 4.3b 4:de60afd0:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740d3e0 con 0x5556a734a450 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(107 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f808e326800 20 get_obj_state: octx=0x7f8084040ed0 obj=myfoo6:thirteen state=0x5556a740b488 s->prefetch_data=0 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.701+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:108 3.29 3:94bd5d51:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740c2b0 con 0x7f8084035070 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(108 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen [getxattrs out=816b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+832 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 10 manifest: total_size = 8 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 20 get_obj_state: setting s->obj_tag to _Ci5L2UCVDPxDLJggNP2iNQLVaQz2uTb 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 20 get_obj_state: octx=0x7f8084040ed0 obj=myfoo6:thirteen state=0x5556a740b488 s->prefetch_data=0 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 20 prepare_atomic_modification: state is not atomic. state=0x5556a740b488 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.702+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:109 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740cb40 con 0x5556a734a450 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.703+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(109 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.703+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:110 3.29 3:94bd5d51:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740cb40 con 0x7f8084035070 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(110 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9_thirteen [call] v33'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:111 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740ca80 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:112 4.1f 4:f945b4ed:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740ca80 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:113 4.15 4:aaa0fa2e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a7398a10 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:114 4.6 4:61d9c90b:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a739b350 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:115 4.39 4:9db64c29:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a739ddf0 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:116 4.3a 4:5c250fbd:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a739b350 con 0x5556a734a450 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:117 4.b 4:d1020db2:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73a2b30 con 0x5556a7345900 2024-09-13T23:26:37.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:118 4.1d 4:b91f06a9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73a5470 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:119 4.30 4:0fc2228d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73a7e00 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.704+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:120 4.29 4:94808ab6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73aa770 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(117 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:121 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73aa770 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(112 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 4.3b 4:de60afd0:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740ad90 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(115 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(114 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(116 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(119 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(120 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(113 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0b4060 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(118 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.705+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(122 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(111 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f7f6d7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(121 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9])"; uploads.size()=0; is_truncated=0 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:123 4.1f 4:f945b4ed:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b250 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:124 4.15 4:aaa0fa2e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b5f0 con 0x5556a734a450 2024-09-13T23:26:37.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:125 4.6 4:61d9c90b:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b990 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:126 4.39 4:9db64c29:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b250 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:127 4.3a 4:5c250fbd:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73aa6f0 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:128 4.b 4:d1020db2:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b250 con 0x5556a7345900 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:129 4.1d 4:b91f06a9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73aa6f0 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:130 4.30 4:0fc2228d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b250 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:131 4.29 4:94808ab6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73aa6f0 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:132 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73a14c0 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.706+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:133 4.3b 4:de60afd0:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73ac120 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(128 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8084027020 con 0x5556a7345900 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(123 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(124 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(125 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(126 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(127 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(129 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(130 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(131 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(132 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(133 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.707+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73abc70 con 0x5556a7340ff0 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(134 bud.buckets [call] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6c0 con 0x5556a7340ff0 2024-09-13T23:26:37.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.708+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73abc70 con 0x5556a7340ff0 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(136 myfoo6 [call,call,delete] v33'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f808e326800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f808e326800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93830661193792 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a73abc70 con 0x5556a7345900 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== watch-notify(notify (1) cookie 93830660823152 notify 141733920785 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5556a73622a0 con 0x5556a7345900 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.709+0000 7f7f6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920785 cookie 93830660823152 notifier 4759 bl.length()=150 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.710+0000 7f7f6cff9640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7eb40032c0 con 0x5556a7345900 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.710+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(137 notify.3 [notify cookie 93830661193792 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.710+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== watch-notify(notify_complete (2) cookie 93830661193792 notify 141733920785 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5556a7335b00 con 0x5556a7345900 2024-09-13T23:26:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.710+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.710+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:139 8.14 8:2b0134f5:root::.bucket.meta.myfoo6%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740bb50 con 0x5556a734a450 2024-09-13T23:26:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(139 .bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [call,call,delete] v33'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f808e326800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 from cache 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f808e326800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9, ofs0, ns] 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 93830661193792 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== watch-notify(notify (1) cookie 93830660818080 notify 141733920796 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5556a73616b0 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f7f6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920796 cookie 93830660818080 notifier 4759 bl.length()=207 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7f4c003d60 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(140 notify.1 [notify cookie 93830661193792 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.711+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== watch-notify(notify_complete (2) cookie 93830661193792 notify 141733920796 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5556a7361930 con 0x5556a7340ff0 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:142 4.1f 4:f945b4ed:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a734a450 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:143 4.15 4:aaa0fa2e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738e230 con 0x5556a734a450 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:144 4.6 4:61d9c90b:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738ea80 con 0x5556a734a450 2024-09-13T23:26:37.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:145 4.39 4:9db64c29:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738eea0 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:146 4.3a 4:5c250fbd:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:147 4.b 4:d1020db2:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738e230 con 0x5556a7345900 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:148 4.1d 4:b91f06a9:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738eea0 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:149 4.30 4:0fc2228d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738ea80 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:150 4.29 4:94808ab6:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:151 4.15 4:abdba673:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a73abf20 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.712+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:152 4.3b 4:de60afd0:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738eea0 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.713+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(142 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.0 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.713+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(147 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.5 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.713+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 61 ==== osd_op_reply(144 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.2 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.713+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 62 ==== osd_op_reply(143 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.1 [delete] v33'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.714+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 63 ==== osd_op_reply(145 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.3 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 64 ==== osd_op_reply(146 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.4 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 65 ==== osd_op_reply(148 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.6 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 66 ==== osd_op_reply(150 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.8 [delete] v33'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 67 ==== osd_op_reply(152 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.10 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 68 ==== osd_op_reply(149 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.7 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 69 ==== osd_op_reply(151 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9.9 [delete] v33'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 : miss 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:153 6.8 6:14d16c97:::pubsub..bucket.myfoo6%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a738ea80 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 70 ==== osd_op_reply(153 pubsub..bucket.myfoo6/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 info.flags=0x0 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 10 adding default.rgw.log++pubsub..bucket.myfoo6/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 to cache LRU end 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.716+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:154 6.8 6:14d16c97:::pubsub..bucket.myfoo6%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a734a450 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.718+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 71 ==== osd_op_reply(154 pubsub..bucket.myfoo6/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.9 [delete] v33'33 uv27 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.718+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a7340ff0 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.719+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(155 bud.buckets [call] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.719+0000 7f808e326800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.719+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a7340ff0 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v33'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f808e326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93830661078656 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x7f8084035070 2024-09-13T23:26:37.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== watch-notify(notify (1) cookie 93830660830816 notify 141733920806 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5556a7361930 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f7f6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 93830660830816 notifier 4759 bl.length()=170 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7f4c003d60 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.720+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(157 notify.5 [notify cookie 93830661078656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.721+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.721+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== watch-notify(notify_complete (2) cookie 93830661078656 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5556a7358310 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.721+0000 7f808e326800 10 removing email index: 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.721+0000 7f808e326800 10 removing user buckets index 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.721+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x5556a7340ff0 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(159 bud.buckets [delete] v33'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f808e326800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93830661078656 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740b6a0 con 0x7f8084035070 2024-09-13T23:26:37.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== watch-notify(notify (1) cookie 93830660833088 notify 141733920807 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5556a7358310 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f7f6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 93830660833088 notifier 4759 bl.length()=160 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f7f6cff9640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7eb40032c0 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(160 notify.6 [notify cookie 93830661078656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.722+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.723+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== watch-notify(notify_complete (2) cookie 93830661078656 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8080048040 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.723+0000 7f808e326800 10 removing user index: bud 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.723+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a738ebe0 con 0x5556a7345900 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(162 bud [call,call,delete] v33'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f808e326800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f808e326800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93830661078656 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5556a740bb50 con 0x7f8084035070 2024-09-13T23:26:37.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== watch-notify(notify (1) cookie 93830660830816 notify 141733920808 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f8080048040 con 0x7f8084035070 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f7f6d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 93830660830816 notifier 4759 bl.length()=152 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f7f6d7fa640 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7f4c003d60 con 0x7f8084035070 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(163 notify.5 [notify cookie 93830661078656 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.724+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== watch-notify(notify_complete (2) cookie 93830661078656 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5556a7358140 con 0x7f8084035070 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.725+0000 7f7f3b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.725+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93830660835840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a7340ff0 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.726+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93830660835840] v33'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.726+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93830660813776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a7345900 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.727+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93830660813776] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.727+0000 7f808e326800 20 remove_watcher() i=0 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.727+0000 7f808e326800 2 removed watcher, disabling cache 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.727+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93830660818080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a7340ff0 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.728+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93830660818080] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.729+0000 7f808e326800 20 remove_watcher() i=1 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.729+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93830660820832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a734a450 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.730+0000 7f8089fe3640 1 -- 172.21.15.99:0/3108369252 <== osd.3 v2:172.21.15.99:6816/1212313328 72 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93830660820832] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f807c0bc060 con 0x5556a734a450 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.730+0000 7f808e326800 20 remove_watcher() i=2 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.730+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93830660823152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a7345900 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.731+0000 7f808a7e4640 1 -- 172.21.15.99:0/3108369252 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93830660823152] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8084072020 con 0x5556a7345900 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.731+0000 7f808e326800 20 remove_watcher() i=3 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.731+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93830660825872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x5556a7340ff0 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.732+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93830660825872] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x5556a7340ff0 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.732+0000 7f808e326800 20 remove_watcher() i=4 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.732+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93830660830816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x7f8084035070 2024-09-13T23:26:37.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.733+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93830660830816] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.733+0000 7f808e326800 20 remove_watcher() i=5 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.733+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93830660833088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x7f8084035070 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.734+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93830660833088] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.734+0000 7f808e326800 20 remove_watcher() i=6 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.734+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93830660834144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5556a735d6d0 con 0x7f8084035070 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93830660834144] v33'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8080029040 con 0x7f8084035070 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 20 remove_watcher() i=7 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8084035070 msgr2=0x7f80840464b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8084035070 0x7f80840464b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7340ff0 msgr2=0x5556a73434b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7340ff0 0x5556a73434b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a7345900 msgr2=0x5556a7347cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a7345900 0x5556a7347cf0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556a734a450 msgr2=0x5556a734c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5556a734a450 0x5556a734c910 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f54036b90 msgr2=0x7f7f54039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f54036b90 0x7f7f54039050 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f807c090010 tx=0x7f807c091000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f80897e2640 1 -- 172.21.15.99:0/3108369252 reap_dead start 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 msgr2=0x5556a7335330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8084046040 tx=0x7f808404cd90 comp rx=0 tx=0).stop 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 shutdown_connections 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 --2- 172.21.15.99:0/3108369252 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a732e020 0x5556a7335330 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 >> 172.21.15.99:0/3108369252 conn(0x5556a732a380 msgr2=0x5556a7328450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 shutdown_connections 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.735+0000 7f808e326800 1 -- 172.21.15.99:0/3108369252 wait complete. 2024-09-13T23:26:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 msgr2=0x7f7f640390a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 0x7f7f640390a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5556a720cd20 tx=0x7f807c08ee50 comp rx=0 tx=0).stop 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 msgr2=0x5556a73216f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x5556a720d670 tx=0x7f80840163e0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 shutdown_connections 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f64036be0 0x7f7f640390a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/1125114820 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a73212d0 0x5556a73216f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 >> 172.21.15.99:0/1125114820 conn(0x5556a7316260 msgr2=0x5556a7318de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 shutdown_connections 2024-09-13T23:26:37.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/1125114820 wait complete. 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 msgr2=0x5556a730d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 0x5556a730d550 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 msgr2=0x5556a7312180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 0x5556a7312180 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 msgr2=0x7f7f70039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 0x7f7f70039000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8080000f60 tx=0x7f80800012b0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 msgr2=0x5556a720db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f807c00a330 tx=0x7f807c002fb0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 shutdown_connections 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5556a730fd10 0x5556a7312180 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5556a7210720 0x5556a730d550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7f70036b40 0x7f7f70039000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 --2- 172.21.15.99:0/3418663884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5556a7181650 0x5556a720db10 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 >> 172.21.15.99:0/3418663884 conn(0x5556a7207db0 msgr2=0x5556a72f6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 shutdown_connections 2024-09-13T23:26:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.736+0000 7f808e326800 1 -- 172.21.15.99:0/3418663884 wait complete. 2024-09-13T23:26:37.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:26:37.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T23:26:37.746 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T23:26:37.791 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:26:37.792 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:26:37.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.791+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.791+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.791+0000 7f38aa330800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b871a44d20 0x55b871a47110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.791+0000 7f38aa330800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b8718fdb30 con 0x55b8719b2630 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.791+0000 7f38aa330800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b8718df360 con 0x55b871a44d20 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.792+0000 7f389ffff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b871a44d20 0x55b871a47110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.792+0000 7f38a6080640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b8719b2630 0x55b871a43600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:40230/0 (socket says 172.21.15.99:40230) 2024-09-13T23:26:37.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.792+0000 7f38a6080640 1 -- 172.21.15.99:0/1017992596 learned_addr learned my addr 172.21.15.99:0/1017992596 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:26:37.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.792+0000 7f389ffff640 1 -- 172.21.15.99:0/1017992596 >> v1:172.21.15.43:6789/0 conn(0x55b8719b2630 legacy=0x55b871a43600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.792+0000 7f389ffff640 1 -- 172.21.15.99:0/1017992596 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b871905e00 con 0x55b871a44d20 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f389ffff640 1 --2- 172.21.15.99:0/1017992596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871a47110 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f389000a470 tx=0x7f3890045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893e0c866c5acab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38a587f640 1 -- 172.21.15.99:0/1017992596 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890053570 con 0x55b871a44d20 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38a587f640 1 -- 172.21.15.99:0/1017992596 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3890058070 con 0x55b871a44d20 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38a587f640 1 -- 172.21.15.99:0/1017992596 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3890053880 con 0x55b871a44d20 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 -- 172.21.15.99:0/1017992596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 msgr2=0x55b871a47110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 --2- 172.21.15.99:0/1017992596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871a47110 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f389000a470 tx=0x7f3890045a20 comp rx=0 tx=0).stop 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 -- 172.21.15.99:0/1017992596 shutdown_connections 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 --2- 172.21.15.99:0/1017992596 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871a47110 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 -- 172.21.15.99:0/1017992596 >> 172.21.15.99:0/1017992596 conn(0x55b871a38db0 msgr2=0x55b871a3b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 -- 172.21.15.99:0/1017992596 shutdown_connections 2024-09-13T23:26:37.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.794+0000 7f38aa330800 1 -- 172.21.15.99:0/1017992596 wait complete. 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.808+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.808+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.808+0000 7f38aa330800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.808+0000 7f38aa330800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b87198a360 con 0x55b8719b2630 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f38a6080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f38a6080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34918/0 (socket says 172.21.15.99:34918) 2024-09-13T23:26:37.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f38a6080640 1 -- 172.21.15.99:0/4255298230 learned_addr learned my addr 172.21.15.99:0/4255298230 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f38a6080640 1 -- 172.21.15.99:0/4255298230 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8718d7bc0 con 0x55b8719b2630 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f38a6080640 1 --2- 172.21.15.99:0/4255298230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3898001e10 tx=0x7f389800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea23165da2cee57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f3794608640 1 -- 172.21.15.99:0/4255298230 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3898012020 con 0x55b8719b2630 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f3794608640 1 -- 172.21.15.99:0/4255298230 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389800e5a0 con 0x55b8719b2630 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.809+0000 7f3794608640 1 -- 172.21.15.99:0/4255298230 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389800e8e0 con 0x55b8719b2630 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- 172.21.15.99:0/4255298230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 msgr2=0x55b871b2fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 --2- 172.21.15.99:0/4255298230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3898001e10 tx=0x7f389800b780 comp rx=0 tx=0).stop 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- 172.21.15.99:0/4255298230 shutdown_connections 2024-09-13T23:26:37.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 --2- 172.21.15.99:0/4255298230 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b8719b2630 0x55b871b2fa90 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3898001e10 tx=0x7f389800b780 comp rx=0 tx=0).stop 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- 172.21.15.99:0/4255298230 >> 172.21.15.99:0/4255298230 conn(0x55b871a38db0 msgr2=0x55b871b2b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- 172.21.15.99:0/4255298230 shutdown_connections 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- 172.21.15.99:0/4255298230 wait complete. 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.810+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38aa330800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38aa330800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b871a47920 con 0x55b871a44d20 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38a6080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38a6080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34920/0 (socket says 172.21.15.99:34920) 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38a6080640 1 -- 172.21.15.99:0/150886568 learned_addr learned my addr 172.21.15.99:0/150886568 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38a6080640 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8718ebfe0 con 0x55b871a44d20 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f38a6080640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3898001e10 tx=0x7f3898000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f3792e05640 1 -- 172.21.15.99:0/150886568 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3898012030 con 0x55b871a44d20 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f3792e05640 1 -- 172.21.15.99:0/150886568 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389801a700 con 0x55b871a44d20 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.811+0000 7f3792e05640 1 -- 172.21.15.99:0/150886568 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389801aa20 con 0x55b871a44d20 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.812+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b871b37be0 con 0x55b871a44d20 2024-09-13T23:26:37.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.812+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b871b38100 con 0x55b871a44d20 2024-09-13T23:26:37.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.812+0000 7f3792e05640 1 -- 172.21.15.99:0/150886568 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f3898015020 con 0x55b871a44d20 2024-09-13T23:26:37.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.812+0000 7f3792e05640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 0x7f378c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f3792e05640 1 -- 172.21.15.99:0/150886568 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f3898020030 con 0x55b871a44d20 2024-09-13T23:26:37.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f389ffff640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 0x7f378c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 0x55b871b3eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b3f030 con 0x55b871b3c700 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38a6881640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 0x55b871b3eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38a6881640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 0x55b871b3eaf0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f389ffff640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 0x7f378c039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3890057000 tx=0x7f3890052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38a6881640 1 -- 172.21.15.99:0/150886568 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f38a000a4a0 con 0x55b871b3c700 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.813+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b3bcc0 con 0x55b871b3c700 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38a6881640 1 -- 172.21.15.99:0/150886568 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f38a000a4a0 con 0x55b871b3c700 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 0x55b871b43750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b43df0 con 0x55b871b41360 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38a6080640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 0x55b871b43750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38a6080640 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 0x55b871b43750 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38a6080640 1 -- 172.21.15.99:0/150886568 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f389800dcd0 con 0x55b871b41360 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.814+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b40200 con 0x55b871b3c700 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38a6881640 1 -- 172.21.15.99:0/150886568 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f38a000a4a0 con 0x55b871b3c700 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b406e0 con 0x55b871b41360 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38a6080640 1 -- 172.21.15.99:0/150886568 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f389800dcd0 con 0x55b871b41360 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38aa330800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.815+0000 7f38aa330800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b8718d9580 con 0x55b871b52750 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34930/0 (socket says 172.21.15.99:34930) 2024-09-13T23:26:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38a6881640 1 -- 172.21.15.99:0/1435144095 learned_addr learned my addr 172.21.15.99:0/1435144095 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38a6881640 1 -- 172.21.15.99:0/1435144095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b871b530b0 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38a6881640 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55b871b38750 tx=0x7f38a00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f378bfff640 1 -- 172.21.15.99:0/1435144095 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a0021440 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f378bfff640 1 -- 172.21.15.99:0/1435144095 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a00215e0 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b871b53340 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f378bfff640 1 -- 172.21.15.99:0/1435144095 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a00218c0 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.816+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b871b56020 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.817+0000 7f378bfff640 1 -- 172.21.15.99:0/1435144095 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f38a0011040 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.817+0000 7f378bfff640 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 0x7f3780039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.817+0000 7f378bfff640 1 -- 172.21.15.99:0/1435144095 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f38a000e040 con 0x55b871b52750 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.817+0000 7f38a6080640 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 0x7f3780039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38a6080640 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 0x7f3780039050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f389804aeb0 tx=0x7f389802c500 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38aa330800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38aa330800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b871b30240 con 0x55b871b5f390 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34942/0 (socket says 172.21.15.99:34942) 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38a6881640 1 -- 172.21.15.99:0/3169482266 learned_addr learned my addr 172.21.15.99:0/3169482266 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.818+0000 7f38a6881640 1 -- 172.21.15.99:0/3169482266 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b871b5fd60 con 0x55b871b5f390 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38a6881640 1 --2- 172.21.15.99:0/3169482266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f38a002afd0 tx=0x7f38a001f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c016c47f2f98f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f3789ffb640 1 -- 172.21.15.99:0/3169482266 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a00143c0 con 0x55b871b5f390 2024-09-13T23:26:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f3789ffb640 1 -- 172.21.15.99:0/3169482266 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0014560 con 0x55b871b5f390 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f3789ffb640 1 -- 172.21.15.99:0/3169482266 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a0029c20 con 0x55b871b5f390 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 -- 172.21.15.99:0/3169482266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 msgr2=0x55b871b5f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 --2- 172.21.15.99:0/3169482266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f38a002afd0 tx=0x7f38a001f400 comp rx=0 tx=0).stop 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 -- 172.21.15.99:0/3169482266 shutdown_connections 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 --2- 172.21.15.99:0/3169482266 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b5f790 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 -- 172.21.15.99:0/3169482266 >> 172.21.15.99:0/3169482266 conn(0x55b871b5b780 msgr2=0x55b871b59880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 -- 172.21.15.99:0/3169482266 shutdown_connections 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.819+0000 7f38aa330800 1 -- 172.21.15.99:0/3169482266 wait complete. 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38aa330800 1 Processor -- start 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38aa330800 1 -- start start 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38aa330800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b66880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38aa330800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b871b603a0 con 0x55b871b5f390 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38a6881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b66880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:34952/0 (socket says 172.21.15.99:34952) 2024-09-13T23:26:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 learned_addr learned my addr 172.21.15.99:0/3131662897 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:26:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b871b66dc0 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f38a6881640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b66880 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f38a001f6e0 tx=0x7f38a004cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.820+0000 7f3777fff640 1 -- 172.21.15.99:0/3131662897 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a0044030 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f3777fff640 1 -- 172.21.15.99:0/3131662897 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a004cd80 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b871b67050 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f3777fff640 1 -- 172.21.15.99:0/3131662897 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38a0021da0 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b871b69d00 con 0x55b871b5f390 2024-09-13T23:26:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f3777fff640 1 -- 172.21.15.99:0/3131662897 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f38a0013610 con 0x55b871b5f390 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f3777fff640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3770036b90 0x7f3770039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.821+0000 7f3777fff640 1 -- 172.21.15.99:0/3131662897 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f38a0045070 con 0x55b871b5f390 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f38a6080640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3770036b90 0x7f3770039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f38a6080640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3770036b90 0x7f3770039050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3898001750 tx=0x7f389802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b725c0 0x55b871b74a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b751d0 con 0x55b871b725c0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.822+0000 7f389ffff640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b725c0 0x55b871b74a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f389ffff640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b725c0 0x55b871b74a80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 realm 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b75600 con 0x55b871b725c0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b75ed0 con 0x55b871b725c0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b76270 con 0x55b871b725c0 2024-09-13T23:26:37.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b76fd0 0x55b871b793c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.823+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b799d0 con 0x55b871b76fd0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38a6881640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b76fd0 0x55b871b793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38a6881640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b76fd0 0x55b871b793c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38aa330800 20 searching for the correct realm 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b871b7b960 0x55b871b7de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.824+0000 7f38a6080640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b871b7b960 0x55b871b7de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6080640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b871b7b960 0x55b871b7de20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6881640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f38a002c100 0x7f38a0020820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.825+0000 7f389ffff640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f38a002c100 0x7f38a0020820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.826+0000 7f389ffff640 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f38a002c100 0x7f38a0020820 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.826+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.826+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.826+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.826+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.827+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.828+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.829+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.830+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.831+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b7b960 2024-09-13T23:26:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.832+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x7f38a002c100 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b725c0 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7e4f0 con 0x55b871b76fd0 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7aeb0 con 0x55b871b725c0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.833+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7a720 con 0x55b871b725c0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b79e60 con 0x55b871b76fd0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 zone default found 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 4 Realm: () 2024-09-13T23:26:37.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 zonegroup default 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b7ee20 con 0x7f38a002c100 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.834+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b810a0 con 0x55b871b7b960 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b81440 con 0x55b871b7b960 2024-09-13T23:26:37.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 20 started sync module instance, tier type = 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.835+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b804e0 con 0x55b871b76fd0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.836+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.836+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94250670229712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b80cf0 con 0x55b871b76fd0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.836+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b822b0 con 0x55b871b725c0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.837+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94250670229712] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.837+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.837+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94250670233568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b82b00 con 0x55b871b725c0 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.837+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b833b0 con 0x55b871b7b960 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.838+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.838+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94250670238976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b83c50 con 0x55b871b7b960 2024-09-13T23:26:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.838+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b84720 con 0x55b871b76fd0 2024-09-13T23:26:37.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.838+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94250670233568] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.839+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94250670238976] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.839+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.839+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94250670241696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b82650 con 0x55b871b76fd0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.839+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b85130 con 0x55b871b725c0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.840+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.840+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94250670247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b85550 con 0x55b871b725c0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.840+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94250670241696] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.840+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b85f50 con 0x7f38a002c100 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.841+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.842+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94250670244368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b85f10 con 0x7f38a002c100 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.842+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b86960 con 0x7f38a002c100 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.842+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94250670247040] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.842+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94250670244368] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.843+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.843+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94250670250592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b85e80 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.843+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b86e10 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94250670250592] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94250670253232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b86d80 con 0x7f38a002c100 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=0 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=1 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=2 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=3 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=4 2024-09-13T23:26:37.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=5 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.844+0000 7f38aa330800 20 add_watcher() i=6 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94250670253232] v33'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f38aa330800 20 add_watcher() i=7 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f38aa330800 2 all 8 watchers are set, enabling cache 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871b8a240 con 0x55b871b725c0 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.845+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94250670254752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b87700 con 0x55b871b725c0 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.846+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94250670254752] v33'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.846+0000 7f375cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.846+0000 7f38aa330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.846+0000 7f38aa330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:26:37.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.846+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b8a040 con 0x55b871b725c0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.847+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.847+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b933b0 con 0x7f38a002c100 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.848+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.848+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b937d0 con 0x55b871b7b960 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.849+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.849+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b93c30 con 0x55b871b725c0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.850+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.850+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94240 con 0x55b871b76fd0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.851+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.851+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94240 con 0x55b871b7b960 2024-09-13T23:26:37.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.852+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.852+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94240 con 0x55b871b725c0 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.853+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.854+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b942d0 con 0x7f38a002c100 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.854+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.855+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b943e0 con 0x55b871b76fd0 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.855+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.855+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94490 con 0x55b871b7b960 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.857+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.857+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94490 con 0x55b871b76fd0 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.858+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.858+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x7f38a002c100 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.859+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.859+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b76fd0 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.860+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.860+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x7f38a002c100 2024-09-13T23:26:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.861+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'55 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.861+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b725c0 2024-09-13T23:26:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.862+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.862+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b7b960 2024-09-13T23:26:37.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.863+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.863+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94990 con 0x55b871b76fd0 2024-09-13T23:26:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.864+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.864+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94990 con 0x55b871b7b960 2024-09-13T23:26:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.865+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.865+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94960 con 0x55b871b725c0 2024-09-13T23:26:37.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.866+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'36 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.866+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94960 con 0x55b871b725c0 2024-09-13T23:26:37.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.867+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.867+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94960 con 0x55b871b7b960 2024-09-13T23:26:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.868+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'68 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.868+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94990 con 0x55b871b76fd0 2024-09-13T23:26:37.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.869+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.869+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94990 con 0x55b871b7b960 2024-09-13T23:26:37.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.870+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.870+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b94960 con 0x55b871b7b960 2024-09-13T23:26:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.871+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.871+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b7b960 2024-09-13T23:26:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.872+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.872+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b7b960 2024-09-13T23:26:37.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.872+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.873+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x7f38a002c100 2024-09-13T23:26:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.873+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.874+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b7b960 2024-09-13T23:26:37.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.874+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.874+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x7f38a002c100 2024-09-13T23:26:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.876+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.876+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b7b960 2024-09-13T23:26:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.877+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'69 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.877+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x7f38a002c100 2024-09-13T23:26:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.878+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.878+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871b948d0 con 0x55b871b76fd0 2024-09-13T23:26:37.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.879+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'34 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.879+0000 7f36d77fe640 20 reqs_thread_entry: start 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.879+0000 7f38aa330800 20 init_complete bucket index max shards: 11 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.879+0000 7f38aa330800 20 Filter name: none 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f36d57fa640 20 reqs_thread_entry: start 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bbf9b0 con 0x7f38a002c100 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T23:26:37.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc2380 con 0x7f38a002c100 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 : miss 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.880+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 8.16 8:6a391a1c:root::.bucket.meta.myfoo7%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc21d0 con 0x55b871b7b960 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 info.flags=0x17 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 to cache LRU end 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 2024-09-13T23:26:37.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 4.5 4:a1dcfa1f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b76fd0 2024-09-13T23:26:37.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(97 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.881+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 4.28 4:14bc15de:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(98 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:99 4.3 4:c0e4c313:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(99 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:100 4.32 4:4ea422e5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(100 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.882+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:101 4.1 4:82f09f7d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b76fd0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(101 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:102 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b725c0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(102 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [call out=378b] v0'0 uv6 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38aa330800 10 cls_bucket_list_unordered: got fourteen 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 4.14 4:2a93dec5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b7b960 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(103 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.883+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:104 4.14 4:2a464a22:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f6d0 con 0x55b871b7b960 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.884+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(104 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.884+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:105 4.18 4:19e523ea:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f690 con 0x55b871b76fd0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.884+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(105 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a003a020 con 0x55b871b76fd0 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.884+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:106 4.1c 4:39f140a8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3f690 con 0x7f38a002c100 2024-09-13T23:26:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.885+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(106 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.885+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:107 4.f 4:f0b2041e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3fd20 con 0x55b871b725c0 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.885+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(107 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.885+0000 7f38aa330800 20 get_obj_state: octx=0x7f38a0021f40 obj=myfoo7:fourteen state=0x55b871c3d738 s->prefetch_data=0 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.885+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:108 3.0 3:030ca494:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3e560 con 0x7f38a002c100 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(108 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 10 manifest: total_size = 8 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.13739578744163332932 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 20 get_obj_state: octx=0x7f38a0021f40 obj=myfoo7:fourteen state=0x55b871c3d738 s->prefetch_data=0 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 20 prepare_atomic_modification: state is not atomic. state=0x55b871c3d738 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.886+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:109 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3efd0 con 0x55b871b725c0 2024-09-13T23:26:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.887+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(109 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.887+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:110 3.0 3:030ca494:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871c3efd0 con 0x7f38a002c100 2024-09-13T23:26:37.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(110 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10_fourteen [call] v33'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:111 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6e20 con 0x55b871b725c0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:112 4.5 4:a1dcfa1f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6e20 con 0x55b871b76fd0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:113 4.28 4:14bc15de:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc090 con 0x55b871b725c0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:114 4.3 4:c0e4c313:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bce9f0 con 0x55b871b725c0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:115 4.32 4:4ea422e5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd1330 con 0x55b871b725c0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:116 4.1 4:82f09f7d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd3c70 con 0x55b871b76fd0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:117 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd6140 con 0x55b871b725c0 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.888+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:118 4.14 4:2a93dec5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd8f00 con 0x55b871b7b960 2024-09-13T23:26:37.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(113 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(112 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(114 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(116 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(118 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:119 4.14 4:2a464a22:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd8f00 con 0x55b871b7b960 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:120 4.18 4:19e523ea:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc520 con 0x55b871b76fd0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:121 4.1c 4:39f140a8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc520 con 0x7f38a002c100 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:122 4.f 4:f0b2041e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bca070 con 0x55b871b725c0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(115 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(119 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(120 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(122 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(111 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [stat,call,call] v33'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f3890051070 con 0x55b871b725c0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.889+0000 7f37897fa640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(121 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3890051070 con 0x7f38a002c100 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(117 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [call out=124b] v0'0 uv8 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10])"; uploads.size()=0; is_truncated=0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:123 4.5 4:a1dcfa1f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc520 con 0x55b871b76fd0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:124 4.28 4:14bc15de:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd8f00 con 0x55b871b725c0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:125 4.3 4:c0e4c313:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcba20 con 0x55b871b725c0 2024-09-13T23:26:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:126 4.32 4:4ea422e5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc520 con 0x55b871b725c0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:127 4.1 4:82f09f7d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcba20 con 0x55b871b76fd0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:128 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcc520 con 0x55b871b725c0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:129 4.14 4:2a93dec5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcba20 con 0x55b871b7b960 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:130 4.14 4:2a464a22:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd8f00 con 0x55b871b7b960 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:131 4.18 4:19e523ea:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd6140 con 0x55b871b76fd0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:132 4.1c 4:39f140a8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bd6140 con 0x7f38a002c100 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:133 4.f 4:f0b2041e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcba20 con 0x55b871b725c0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(124 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1 [call out=85b] v0'0 uv11 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(129 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(125 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(123 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(126 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(127 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.890+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(133 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.891+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(130 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.891+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(131 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.891+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(128 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [call out=124b] v0'0 uv8 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.891+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(132 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.891+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(134 fud.buckets [call] v33'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.892+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.893+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(136 myfoo7 [call,call,delete] v33'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.893+0000 7f38aa330800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.893+0000 7f38aa330800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.893+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94250670589840 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== watch-notify(notify (1) cookie 94250670241696 notify 141733920786 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55b871b94ef0 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f3789ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920786 cookie 94250670241696 notifier 4766 bl.length()=150 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f3789ffb640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f376c003d60 con 0x55b871b76fd0 2024-09-13T23:26:37.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(137 notify.3 [notify cookie 94250670589840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== watch-notify(notify_complete (2) cookie 94250670589840 notify 141733920786 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b871b67050 con 0x55b871b76fd0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.894+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:139 8.16 8:6a391a1c:root::.bucket.meta.myfoo7%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b7b960 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 [call,call,delete] v33'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f38aa330800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 from cache 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f38aa330800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10, ofs0, ns] 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94250670589840 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b725c0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 45 ==== watch-notify(notify (1) cookie 94250670247040 notify 141733920797 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55b871b89990 con 0x55b871b725c0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f37897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920797 cookie 94250670247040 notifier 4766 bl.length()=208 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f37897fa640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f36dc0032c0 con 0x55b871b725c0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.895+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 46 ==== osd_op_reply(140 notify.4 [notify cookie 94250670589840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 47 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 48 ==== watch-notify(notify_complete (2) cookie 94250670589840 notify 141733920797 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b871b8a1d0 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:142 4.5 4:a1dcfa1f:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:143 4.28 4:14bc15de:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc0510 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:144 4.3 4:c0e4c313:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc0e20 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:145 4.32 4:4ea422e5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcaa10 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:146 4.1 4:82f09f7d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:147 4.32 4:4ff168fe:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcb710 con 0x55b871b725c0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:148 4.14 4:2a93dec5:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bccc50 con 0x55b871b7b960 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:149 4.14 4:2a464a22:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc0510 con 0x55b871b7b960 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:150 4.18 4:19e523ea:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:151 4.1c 4:39f140a8:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc0e20 con 0x7f38a002c100 2024-09-13T23:26:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.896+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:152 4.f 4:f0b2041e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b725c0 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.897+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== osd_op_reply(150 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.8 [delete] v33'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.897+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 49 ==== osd_op_reply(143 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.1 [delete] v33'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.897+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(148 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.6 [delete] v33'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.897+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(151 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.9 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.898+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(146 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.4 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.898+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(149 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.7 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.898+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 50 ==== osd_op_reply(145 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.3 [delete] v33'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.898+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 51 ==== osd_op_reply(144 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.2 [delete] v33'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== osd_op_reply(142 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.0 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 52 ==== osd_op_reply(152 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.10 [delete] v33'4 uv4 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 53 ==== osd_op_reply(147 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10.5 [delete] v33'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f38aa330800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 : miss 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f38aa330800 20 rados->read ofs=0 len=0 2024-09-13T23:26:37.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.900+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:153 6.13 6:cfb8b212:::pubsub..bucket.myfoo7%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcb710 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.901+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(153 pubsub..bucket.myfoo7/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.901+0000 7f38aa330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.901+0000 7f38aa330800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 info.flags=0x0 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.901+0000 7f38aa330800 10 adding default.rgw.log++pubsub..bucket.myfoo7/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 to cache LRU end 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.901+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:154 6.13 6:cfb8b212:::pubsub..bucket.myfoo7%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bcaa10 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.902+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(154 pubsub..bucket.myfoo7/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.10 [delete] v33'32 uv29 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.902+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.903+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(155 fud.buckets [call] v33'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.903+0000 7f38aa330800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.903+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v33'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f38aa330800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94250670538320 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== watch-notify(notify (1) cookie 94250670238976 notify 141733920775 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b871bc1720 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f3789ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920775 cookie 94250670238976 notifier 4766 bl.length()=170 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(157 notify.2 [notify cookie 94250670538320 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f3789ffb640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f376c003d60 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.904+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.905+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== watch-notify(notify_complete (2) cookie 94250670538320 notify 141733920775 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f389805d040 con 0x55b871b7b960 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.905+0000 7f38aa330800 10 removing email index: 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.905+0000 7f38aa330800 10 removing user buckets index 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.905+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(159 fud.buckets [delete] v33'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f38aa330800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94250670589840 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== watch-notify(notify (1) cookie 94250670250592 notify 141733920809 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55b871b8a1d0 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f37897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94250670250592 notifier 4766 bl.length()=160 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f37897fa640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f36dc0032c0 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(160 notify.6 [notify cookie 94250670589840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== watch-notify(notify_complete (2) cookie 94250670589840 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b871b8a000 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f38aa330800 10 removing user index: fud 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.906+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.907+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(162 fud [call,call,delete] v33'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.907+0000 7f38aa330800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T23:26:37.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.907+0000 7f38aa330800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.907+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94250670589840 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== watch-notify(notify (1) cookie 94250670244368 notify 141733920810 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b871b8a000 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f3789ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94250670244368 notifier 4766 bl.length()=152 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(163 notify.5 [notify cookie 94250670589840 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f3789ffb640 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f376c003d60 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.908+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== watch-notify(notify_complete (2) cookie 94250670589840 notify 141733920810 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b871b8a3e0 con 0x7f38a002c100 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.909+0000 7f375cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.909+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94250670254752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b725c0 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.910+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 54 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94250670254752] v33'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.910+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94250670229712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.911+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94250670229712] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.911+0000 7f38aa330800 20 remove_watcher() i=0 2024-09-13T23:26:37.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.911+0000 7f38aa330800 2 removed watcher, disabling cache 2024-09-13T23:26:37.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.911+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94250670233568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b725c0 2024-09-13T23:26:37.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.912+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 55 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94250670233568] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.912+0000 7f38aa330800 20 remove_watcher() i=1 2024-09-13T23:26:37.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.912+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94250670238976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b7b960 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.913+0000 7f38a6080640 1 -- 172.21.15.99:0/3131662897 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94250670238976] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898037070 con 0x55b871b7b960 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.913+0000 7f38aa330800 20 remove_watcher() i=2 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.913+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94250670241696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b76fd0 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.914+0000 7f38a6881640 1 -- 172.21.15.99:0/3131662897 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94250670241696] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38a0070040 con 0x55b871b76fd0 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.914+0000 7f38aa330800 20 remove_watcher() i=3 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.914+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94250670247040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x55b871b725c0 2024-09-13T23:26:37.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.915+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.1 v2:172.21.15.99:6801/642925376 56 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94250670247040] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x55b871b725c0 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.915+0000 7f38aa330800 20 remove_watcher() i=4 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.915+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94250670244368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.916+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94250670244368] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.916+0000 7f38aa330800 20 remove_watcher() i=5 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.916+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94250670250592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.917+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94250670250592] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.917+0000 7f38aa330800 20 remove_watcher() i=6 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.917+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94250670253232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b871bc6910 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 <== osd.0 v2:172.21.15.43:6800/3849931173 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94250670253232] v33'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389009f090 con 0x7f38a002c100 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 20 remove_watcher() i=7 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f38a002c100 msgr2=0x7f38a0020820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f38a002c100 0x7f38a0020820 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b725c0 msgr2=0x55b871b74a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b725c0 0x55b871b74a80 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b76fd0 msgr2=0x55b871b793c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b76fd0 0x55b871b793c0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b871b7b960 msgr2=0x55b871b7de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.918+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b871b7b960 0x55b871b7de20 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3770036b90 msgr2=0x7f3770039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3770036b90 0x7f3770039050 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3898001750 tx=0x7f389802f000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 msgr2=0x55b871b66880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/3131662897 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b5f390 0x55b871b66880 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f38a001f6e0 tx=0x7f38a004cb10 comp rx=0 tx=0).stop 2024-09-13T23:26:37.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 reap_dead start 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f389ffff640 1 -- 172.21.15.99:0/3131662897 reap_dead start 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 shutdown_connections 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 >> 172.21.15.99:0/3131662897 conn(0x55b871b5b780 msgr2=0x55b871b59850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 shutdown_connections 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/3131662897 wait complete. 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 msgr2=0x7f3780039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 0x7f3780039050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f389804aeb0 tx=0x7f389802c500 comp rx=0 tx=0).stop 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 msgr2=0x55b871b52b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55b871b38750 tx=0x7f38a00167b0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 shutdown_connections 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f3780036b90 0x7f3780039050 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/1435144095 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871b52750 0x55b871b52b70 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 >> 172.21.15.99:0/1435144095 conn(0x55b871b476e0 msgr2=0x55b871b4a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 shutdown_connections 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/1435144095 wait complete. 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 msgr2=0x55b871b3eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 0x55b871b3eaf0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 msgr2=0x55b871b43750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.919+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 0x55b871b43750 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 msgr2=0x7f378c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 0x7f378c039000 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3890057000 tx=0x7f3890052000 comp rx=0 tx=0).stop 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 msgr2=0x55b871b376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3898001e10 tx=0x7f3898000ed0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 shutdown_connections 2024-09-13T23:26:37.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b871b41360 0x55b871b43750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b871b3c700 0x55b871b3eaf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f378c036b40 0x7f378c039000 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 --2- 172.21.15.99:0/150886568 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b871a44d20 0x55b871b376a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 >> 172.21.15.99:0/150886568 conn(0x55b871a38db0 msgr2=0x55b871b29d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 shutdown_connections 2024-09-13T23:26:37.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:26:37.920+0000 7f38aa330800 1 -- 172.21.15.99:0/150886568 wait complete. 2024-09-13T23:27:17.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T23:27:17.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T23:27:17.933 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T23:27:17.985 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:17.985 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:17.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:17.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:17.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6336f3e800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e3c070d900 0x55e3c070fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:17.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6336f3e800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e3c05c9b30 con 0x55e3c07094c0 2024-09-13T23:27:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6336f3e800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55e3c05ab360 con 0x55e3c070d900 2024-09-13T23:27:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6332433640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55e3c070d900 0x55e3c070fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6332c34640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55e3c07094c0 0x55e3c07098c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55142/0 (socket says 172.21.15.99:55142) 2024-09-13T23:27:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.985+0000 7f6332c34640 1 -- 172.21.15.99:0/456161202 learned_addr learned my addr 172.21.15.99:0/456161202 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:17.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.986+0000 7f6332433640 1 -- 172.21.15.99:0/456161202 >> v1:172.21.15.43:6789/0 conn(0x55e3c07094c0 legacy=0x55e3c07098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:17.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.986+0000 7f6332433640 1 -- 172.21.15.99:0/456161202 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c05d1e00 con 0x55e3c070d900 2024-09-13T23:27:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6332433640 1 --2- 172.21.15.99:0/456161202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c070d900 0x55e3c070fcf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f632800a470 tx=0x7f6328045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a7404eae447ede server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6331c32640 1 -- 172.21.15.99:0/456161202 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053570 con 0x55e3c070d900 2024-09-13T23:27:17.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6331c32640 1 -- 172.21.15.99:0/456161202 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6328058070 con 0x55e3c070d900 2024-09-13T23:27:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6331c32640 1 -- 172.21.15.99:0/456161202 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6328053880 con 0x55e3c070d900 2024-09-13T23:27:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 -- 172.21.15.99:0/456161202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c070d900 msgr2=0x55e3c070fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 --2- 172.21.15.99:0/456161202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c070d900 0x55e3c070fcf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f632800a470 tx=0x7f6328045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:17.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 -- 172.21.15.99:0/456161202 shutdown_connections 2024-09-13T23:27:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 --2- 172.21.15.99:0/456161202 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c070d900 0x55e3c070fcf0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 -- 172.21.15.99:0/456161202 >> 172.21.15.99:0/456161202 conn(0x55e3c0704df0 msgr2=0x55e3c0707210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.988+0000 7f6336f3e800 1 -- 172.21.15.99:0/456161202 shutdown_connections 2024-09-13T23:27:17.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:17.989+0000 7f6336f3e800 1 -- 172.21.15.99:0/456161202 wait complete. 2024-09-13T23:27:18.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:18.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6336f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6336f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0656330 con 0x55e3c07094c0 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6332c34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6332c34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56668/0 (socket says 172.21.15.99:56668) 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6332c34640 1 -- 172.21.15.99:0/2593196161 learned_addr learned my addr 172.21.15.99:0/2593196161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.005+0000 7f6332c34640 1 -- 172.21.15.99:0/2593196161 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c05a3bc0 con 0x55e3c07094c0 2024-09-13T23:27:18.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.006+0000 7f6332c34640 1 --2- 172.21.15.99:0/2593196161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6324001610 tx=0x7f6324001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4691b25ef49113b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.006+0000 7f6220e09640 1 -- 172.21.15.99:0/2593196161 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324004520 con 0x55e3c07094c0 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.006+0000 7f6220e09640 1 -- 172.21.15.99:0/2593196161 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63240046c0 con 0x55e3c07094c0 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.006+0000 7f6220e09640 1 -- 172.21.15.99:0/2593196161 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324004a20 con 0x55e3c07094c0 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- 172.21.15.99:0/2593196161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 msgr2=0x55e3c07f8750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2593196161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6324001610 tx=0x7f6324001ad0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- 172.21.15.99:0/2593196161 shutdown_connections 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2593196161 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c07f8750 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- 172.21.15.99:0/2593196161 >> 172.21.15.99:0/2593196161 conn(0x55e3c0704df0 msgr2=0x55e3c07f4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- 172.21.15.99:0/2593196161 shutdown_connections 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- 172.21.15.99:0/2593196161 wait complete. 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.007+0000 7f6336f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3c0710530 con 0x55e3c07094c0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6332c34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6332c34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56670/0 (socket says 172.21.15.99:56670) 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6332c34640 1 -- 172.21.15.99:0/2510094310 learned_addr learned my addr 172.21.15.99:0/2510094310 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6332c34640 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c05b7fe0 con 0x55e3c07094c0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6332c34640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f621f606640 1 -- 172.21.15.99:0/2510094310 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324014500 con 0x55e3c07094c0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f621f606640 1 -- 172.21.15.99:0/2510094310 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6324023070 con 0x55e3c07094c0 2024-09-13T23:27:18.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3c0803ea0 con 0x55e3c07094c0 2024-09-13T23:27:18.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f621f606640 1 -- 172.21.15.99:0/2510094310 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6324014810 con 0x55e3c07094c0 2024-09-13T23:27:18.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.008+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c0804360 con 0x55e3c07094c0 2024-09-13T23:27:18.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.009+0000 7f621f606640 1 -- 172.21.15.99:0/2510094310 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6324010070 con 0x55e3c07094c0 2024-09-13T23:27:18.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.009+0000 7f621f606640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 0x7f6218039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.009+0000 7f621f606640 1 -- 172.21.15.99:0/2510094310 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f632404c800 con 0x55e3c07094c0 2024-09-13T23:27:18.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6332433640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 0x7f6218039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 0x55e3c0808200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0808820 con 0x55e3c070d900 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6333435640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 0x55e3c0808200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6332433640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 0x7f6218039050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6328057000 tx=0x7f6328052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6333435640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 0x55e3c0808200 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6333435640 1 -- 172.21.15.99:0/2510094310 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f632c0083e0 con 0x55e3c070d900 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.010+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0805710 con 0x55e3c070d900 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6333435640 1 -- 172.21.15.99:0/2510094310 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f632c0083e0 con 0x55e3c070d900 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 0x55e3c080cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c080d610 con 0x55e3c080ab50 2024-09-13T23:27:18.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6332c34640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 0x55e3c080cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6332c34640 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 0x55e3c080cf40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6332c34640 1 -- 172.21.15.99:0/2510094310 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f632400f030 con 0x55e3c080ab50 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.011+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08099c0 con 0x55e3c070d900 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.012+0000 7f6333435640 1 -- 172.21.15.99:0/2510094310 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f632c0083e0 con 0x55e3c070d900 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.012+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0809e60 con 0x55e3c080ab50 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.012+0000 7f6332c34640 1 -- 172.21.15.99:0/2510094310 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f632400f030 con 0x55e3c080ab50 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.012+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.012+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6336f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6336f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3c05a5580 con 0x55e3c0801850 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56678/0 (socket says 172.21.15.99:56678) 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6333435640 1 -- 172.21.15.99:0/251621980 learned_addr learned my addr 172.21.15.99:0/251621980 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6333435640 1 -- 172.21.15.99:0/251621980 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c0801c70 con 0x55e3c0801850 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.013+0000 7f6333435640 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55e3c067d7b0 tx=0x7f632c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.014+0000 7f621ce01640 1 -- 172.21.15.99:0/251621980 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c01c020 con 0x55e3c0801850 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.014+0000 7f621ce01640 1 -- 172.21.15.99:0/251621980 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c007cf0 con 0x55e3c0801850 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.014+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3c08004a0 con 0x55e3c0801850 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.014+0000 7f621ce01640 1 -- 172.21.15.99:0/251621980 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c018440 con 0x55e3c0801850 2024-09-13T23:27:18.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.014+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c08009a0 con 0x55e3c0801850 2024-09-13T23:27:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f621ce01640 1 -- 172.21.15.99:0/251621980 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f632c01f020 con 0x55e3c0801850 2024-09-13T23:27:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f621ce01640 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 0x7f620c0390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f621ce01640 1 -- 172.21.15.99:0/251621980 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f632c04e140 con 0x55e3c0801850 2024-09-13T23:27:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6332c34640 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 0x7f620c0390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6332c34640 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 0x7f620c0390c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55e3c0809100 tx=0x7f6324011eb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6336f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.015+0000 7f6336f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3c07f8f00 con 0x55e3c082ae10 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56680/0 (socket says 172.21.15.99:56680) 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f6333435640 1 -- 172.21.15.99:0/1531583167 learned_addr learned my addr 172.21.15.99:0/1531583167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f6333435640 1 -- 172.21.15.99:0/1531583167 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c082b7e0 con 0x55e3c082ae10 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f6333435640 1 --2- 172.21.15.99:0/1531583167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f632c04c5e0 tx=0x7f632c0206e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42f414f0417b7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f62167fc640 1 -- 172.21.15.99:0/1531583167 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c045070 con 0x55e3c082ae10 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f62167fc640 1 -- 172.21.15.99:0/1531583167 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c04b210 con 0x55e3c082ae10 2024-09-13T23:27:18.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.016+0000 7f62167fc640 1 -- 172.21.15.99:0/1531583167 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c018c70 con 0x55e3c082ae10 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- 172.21.15.99:0/1531583167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 msgr2=0x55e3c082b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1531583167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f632c04c5e0 tx=0x7f632c0206e0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- 172.21.15.99:0/1531583167 shutdown_connections 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1531583167 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c082b210 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- 172.21.15.99:0/1531583167 >> 172.21.15.99:0/1531583167 conn(0x55e3c0827170 msgr2=0x55e3c0825270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- 172.21.15.99:0/1531583167 shutdown_connections 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- 172.21.15.99:0/1531583167 wait complete. 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 Processor -- start 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- start start 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.017+0000 7f6336f3e800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55e3c082be50 con 0x55e3c082ae10 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6333435640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56692/0 (socket says 172.21.15.99:56692) 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 learned_addr learned my addr 172.21.15.99:0/1746916019 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c0832820 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6333435640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f632c0164a0 tx=0x7f632c04c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6214ff9640 1 -- 172.21.15.99:0/1746916019 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c045030 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6214ff9640 1 -- 172.21.15.99:0/1746916019 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c0185e0 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6214ff9640 1 -- 172.21.15.99:0/1746916019 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f632c03f040 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3c0832ab0 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.018+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c0835760 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.019+0000 7f6214ff9640 1 -- 172.21.15.99:0/1746916019 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f632c016040 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.019+0000 7f6214ff9640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f61fc036b40 0x7f61fc039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6214ff9640 1 -- 172.21.15.99:0/1746916019 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f632c046070 con 0x55e3c082ae10 2024-09-13T23:27:18.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6332c34640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f61fc036b40 0x7f61fc039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6332c34640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f61fc036b40 0x7f61fc039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6324002020 tx=0x7f6324048000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c083ddc0 0x55e3c0840280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08409d0 con 0x55e3c083ddc0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.020+0000 7f6332433640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c083ddc0 0x55e3c0840280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6332433640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c083ddc0 0x55e3c0840280 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 realm 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0840e00 con 0x55e3c083ddc0 2024-09-13T23:27:18.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08416d0 con 0x55e3c083ddc0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.021+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0841a70 con 0x55e3c083ddc0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c08427d0 0x55e3c0844bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08451d0 con 0x55e3c08427d0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6333435640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c08427d0 0x55e3c0844bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6333435640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c08427d0 0x55e3c0844bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f632c028070 con 0x55e3c08427d0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 20 searching for the correct realm 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e3c0847160 0x55e3c0849620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.022+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6332c34640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e3c0847160 0x55e3c0849620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6332c34640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e3c0847160 0x55e3c0849620 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c028070 con 0x55e3c08427d0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6333435640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f632c021020 0x7f632c047440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.023+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.024+0000 7f6332433640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f632c021020 0x7f632c047440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.024+0000 7f6332433640 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f632c021020 0x7f632c047440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.024+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.024+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.025+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f632c05d040 con 0x55e3c08427d0 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.026+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f632c05d040 con 0x55e3c08427d0 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.027+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.028+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.029+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c05d040 con 0x55e3c08427d0 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.030+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c05d040 con 0x55e3c08427d0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.031+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c0847160 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.032+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.032+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x7f632c021020 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.032+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.032+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c083ddc0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0849cf0 con 0x55e3c08427d0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:18.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0845a20 con 0x55e3c083ddc0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0845e10 con 0x55e3c083ddc0 2024-09-13T23:27:18.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.033+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084a170 con 0x55e3c08427d0 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 zone default found 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 4 Realm: () 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 zonegroup default 2024-09-13T23:27:18.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084a9c0 con 0x7f632c021020 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.034+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084c740 con 0x55e3c0847160 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084cbc0 con 0x55e3c0847160 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 20 started sync module instance, tier type = 2024-09-13T23:27:18.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.035+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084bbe0 con 0x55e3c08427d0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.036+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.036+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94436675862752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084bbe0 con 0x55e3c08427d0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.036+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084d6c0 con 0x55e3c083ddc0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.037+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94436675862752] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.038+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.038+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94436675867024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084bbe0 con 0x55e3c083ddc0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.038+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084e140 con 0x55e3c0847160 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.039+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94436675867024] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.039+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.039+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94436675869776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084e4e0 con 0x55e3c0847160 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.039+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084ef80 con 0x55e3c08427d0 2024-09-13T23:27:18.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.040+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.040+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94436675873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084f850 con 0x55e3c08427d0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.040+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94436675869776] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.040+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084b770 con 0x55e3c083ddc0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.042+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94436675873392] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.042+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.042+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94436675875744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c084f7c0 con 0x55e3c083ddc0 2024-09-13T23:27:18.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.042+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08508b0 con 0x7f632c021020 2024-09-13T23:27:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.043+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.043+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94436675879936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0850cd0 con 0x7f632c021020 2024-09-13T23:27:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.043+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0851720 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.043+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94436675875744] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.044+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94436675879936] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.044+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.044+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94436675883536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0850820 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.044+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0851d00 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.045+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94436675883536] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94436675878368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0851d00 con 0x7f632c021020 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=0 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=1 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=2 2024-09-13T23:27:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=3 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=4 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=5 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.046+0000 7f6336f3e800 20 add_watcher() i=6 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94436675878368] v33'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6336f3e800 20 add_watcher() i=7 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6336f3e800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0854fe0 con 0x55e3c083ddc0 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.047+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94436675885504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0852290 con 0x55e3c083ddc0 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.048+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94436675885504] v33'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.048+0000 7f61e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.048+0000 7f6336f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.048+0000 7f6336f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.048+0000 7f6336f3e800 5 note: GC not initialized 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6163fff640 20 reqs_thread_entry: start 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 20 Filter name: none 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6161ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55e3c08883e0 con 0x55e3c083ddc0 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:27:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.049+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x7f632c021020 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.051+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call] v33'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.051+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x7f632c021020 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.052+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 usage.10 [call] v33'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.053+0000 7f61e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.053+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94436675885504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c083ddc0 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.054+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94436675885504] v33'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.054+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94436675862752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c08427d0 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.055+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94436675862752] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.055+0000 7f6336f3e800 20 remove_watcher() i=0 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.055+0000 7f6336f3e800 2 removed watcher, disabling cache 2024-09-13T23:27:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.055+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94436675867024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c083ddc0 2024-09-13T23:27:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.056+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94436675867024] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.056+0000 7f6336f3e800 20 remove_watcher() i=1 2024-09-13T23:27:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.056+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94436675869776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c0847160 2024-09-13T23:27:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.057+0000 7f6332c34640 1 -- 172.21.15.99:0/1746916019 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94436675869776] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632400f030 con 0x55e3c0847160 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.057+0000 7f6336f3e800 20 remove_watcher() i=2 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.057+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94436675873392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c08427d0 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.058+0000 7f6333435640 1 -- 172.21.15.99:0/1746916019 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94436675873392] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f632c065040 con 0x55e3c08427d0 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.058+0000 7f6336f3e800 20 remove_watcher() i=3 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.058+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94436675875744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x55e3c083ddc0 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.059+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94436675875744] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x55e3c083ddc0 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.060+0000 7f6336f3e800 20 remove_watcher() i=4 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.060+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94436675879936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x7f632c021020 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.061+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94436675879936] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.061+0000 7f6336f3e800 20 remove_watcher() i=5 2024-09-13T23:27:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.061+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94436675883536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x7f632c021020 2024-09-13T23:27:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.062+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94436675883536] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.062+0000 7f6336f3e800 20 remove_watcher() i=6 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.062+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94436675878368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55e3c0887ec0 con 0x7f632c021020 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94436675878368] v33'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6328051070 con 0x7f632c021020 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 20 remove_watcher() i=7 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f632c021020 msgr2=0x7f632c047440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f632c021020 0x7f632c047440 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c083ddc0 msgr2=0x55e3c0840280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c083ddc0 0x55e3c0840280 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c08427d0 msgr2=0x55e3c0844bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c08427d0 0x55e3c0844bc0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e3c0847160 msgr2=0x55e3c0849620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55e3c0847160 0x55e3c0849620 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f61fc036b40 msgr2=0x7f61fc039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f61fc036b40 0x7f61fc039000 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6324002020 tx=0x7f6324048000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 msgr2=0x55e3c08322e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6332433640 1 -- 172.21.15.99:0/1746916019 reap_dead start 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f632c0164a0 tx=0x7f632c04c570 comp rx=0 tx=0).stop 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 shutdown_connections 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 --2- 172.21.15.99:0/1746916019 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c082ae10 0x55e3c08322e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 >> 172.21.15.99:0/1746916019 conn(0x55e3c0827170 msgr2=0x55e3c0825240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 shutdown_connections 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.063+0000 7f6336f3e800 1 -- 172.21.15.99:0/1746916019 wait complete. 2024-09-13T23:27:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 msgr2=0x7f620c0390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 0x7f620c0390c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55e3c0809100 tx=0x7f6324011eb0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 msgr2=0x55e3c07ffea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x55e3c067d7b0 tx=0x7f632c00beb0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 shutdown_connections 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f620c036c00 0x7f620c0390c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/251621980 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c0801850 0x55e3c07ffea0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 >> 172.21.15.99:0/251621980 conn(0x55e3c0810ee0 msgr2=0x55e3c0813a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 shutdown_connections 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/251621980 wait complete. 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 msgr2=0x55e3c0808200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 0x55e3c0808200 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 msgr2=0x55e3c080cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 0x55e3c080cf40 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 msgr2=0x7f6218039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 0x7f6218039050 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6328057000 tx=0x7f6328052000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 msgr2=0x55e3c067ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6324007fd0 tx=0x7f6324000f40 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 shutdown_connections 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55e3c080ab50 0x55e3c080cf40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55e3c070d900 0x55e3c0808200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6218036b90 0x7f6218039050 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 --2- 172.21.15.99:0/2510094310 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55e3c07094c0 0x55e3c067ddc0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 >> 172.21.15.99:0/2510094310 conn(0x55e3c0704df0 msgr2=0x55e3c07f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 shutdown_connections 2024-09-13T23:27:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.064+0000 7f6336f3e800 1 -- 172.21.15.99:0/2510094310 wait complete. 2024-09-13T23:27:18.074 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T23:27:18.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T23:27:18.075 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T23:27:18.118 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.118 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7883529800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x564678630900 0x564678632cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7883529800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646784ebb30 con 0x56467859fdf0 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7883529800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5646784cd360 con 0x564678630900 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f7877fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x564678630900 0x564678632cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f787f279640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x56467859fdf0 0x56467862f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55148/0 (socket says 172.21.15.99:55148) 2024-09-13T23:27:18.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.118+0000 7f787f279640 1 -- 172.21.15.99:0/3157507315 learned_addr learned my addr 172.21.15.99:0/3157507315 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.119+0000 7f7877fff640 1 -- 172.21.15.99:0/3157507315 >> v1:172.21.15.43:6789/0 conn(0x56467859fdf0 legacy=0x56467862f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.119+0000 7f7877fff640 1 -- 172.21.15.99:0/3157507315 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646784f3e00 con 0x564678630900 2024-09-13T23:27:18.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.121+0000 7f7877fff640 1 --2- 172.21.15.99:0/3157507315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564678630900 0x564678632cf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f786800a470 tx=0x7f7868045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603c199a927b211e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.121+0000 7f787ea78640 1 -- 172.21.15.99:0/3157507315 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868053570 con 0x564678630900 2024-09-13T23:27:18.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.121+0000 7f787ea78640 1 -- 172.21.15.99:0/3157507315 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7868058070 con 0x564678630900 2024-09-13T23:27:18.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.121+0000 7f787ea78640 1 -- 172.21.15.99:0/3157507315 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7868053880 con 0x564678630900 2024-09-13T23:27:18.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 -- 172.21.15.99:0/3157507315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564678630900 msgr2=0x564678632cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 --2- 172.21.15.99:0/3157507315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564678630900 0x564678632cf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f786800a470 tx=0x7f7868045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:18.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 -- 172.21.15.99:0/3157507315 shutdown_connections 2024-09-13T23:27:18.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 --2- 172.21.15.99:0/3157507315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x564678630900 0x564678632cf0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 -- 172.21.15.99:0/3157507315 >> 172.21.15.99:0/3157507315 conn(0x564678626df0 msgr2=0x564678629210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 -- 172.21.15.99:0/3157507315 shutdown_connections 2024-09-13T23:27:18.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.122+0000 7f7883529800 1 -- 172.21.15.99:0/3157507315 wait complete. 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.135+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.135+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f7883529800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f7883529800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x564678578330 con 0x56467859fdf0 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f787f279640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f787f279640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56710/0 (socket says 172.21.15.99:56710) 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f787f279640 1 -- 172.21.15.99:0/3280702286 learned_addr learned my addr 172.21.15.99:0/3280702286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f787f279640 1 -- 172.21.15.99:0/3280702286 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646784c5bc0 con 0x56467859fdf0 2024-09-13T23:27:18.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.136+0000 7f787f279640 1 --2- 172.21.15.99:0/3280702286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7870001e10 tx=0x7f787000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861a338e2bfa3ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f776d60a640 1 -- 172.21.15.99:0/3280702286 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7870012020 con 0x56467859fdf0 2024-09-13T23:27:18.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f776d60a640 1 -- 172.21.15.99:0/3280702286 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f787000e5a0 con 0x56467859fdf0 2024-09-13T23:27:18.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f776d60a640 1 -- 172.21.15.99:0/3280702286 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787000e8e0 con 0x56467859fdf0 2024-09-13T23:27:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 -- 172.21.15.99:0/3280702286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 msgr2=0x56467871b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 --2- 172.21.15.99:0/3280702286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7870001e10 tx=0x7f787000b780 comp rx=0 tx=0).stop 2024-09-13T23:27:18.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 -- 172.21.15.99:0/3280702286 shutdown_connections 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 --2- 172.21.15.99:0/3280702286 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x56467871b850 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 -- 172.21.15.99:0/3280702286 >> 172.21.15.99:0/3280702286 conn(0x564678626df0 msgr2=0x564678717210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 -- 172.21.15.99:0/3280702286 shutdown_connections 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.137+0000 7f7883529800 1 -- 172.21.15.99:0/3280702286 wait complete. 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f7883529800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f7883529800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646786335f0 con 0x56467859fdf0 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f787f279640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f787f279640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56714/0 (socket says 172.21.15.99:56714) 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f787f279640 1 -- 172.21.15.99:0/703948159 learned_addr learned my addr 172.21.15.99:0/703948159 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.138+0000 7f787f279640 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646784d9fe0 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f787f279640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f787000b7c0 tx=0x7f7870000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f776be07640 1 -- 172.21.15.99:0/703948159 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7870012030 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f776be07640 1 -- 172.21.15.99:0/703948159 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7870001470 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564678723770 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f776be07640 1 -- 172.21.15.99:0/703948159 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787001a8d0 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.139+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564678723c90 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f776be07640 1 -- 172.21.15.99:0/703948159 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7870015020 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f776be07640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 0x7f7764039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f776be07640 1 -- 172.21.15.99:0/703948159 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7870020030 con 0x56467859fdf0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f7877fff640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 0x7f7764039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 0x56467872a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467872a820 con 0x564678630900 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f787fa7a640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 0x56467872a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f7877fff640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 0x7f7764039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7868057000 tx=0x7f7868052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.140+0000 7f787fa7a640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 0x56467872a2a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f787fa7a640 1 -- 172.21.15.99:0/703948159 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f787800a4a0 con 0x564678630900 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678727870 con 0x564678630900 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f787fa7a640 1 -- 172.21.15.99:0/703948159 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f787800a4a0 con 0x564678630900 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 0x56467872ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467872f5c0 con 0x56467872cb30 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f787f279640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 0x56467872ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.141+0000 7f787f279640 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 0x56467872ef20 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f787f279640 1 -- 172.21.15.99:0/703948159 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7870018950 con 0x56467872cb30 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467872b9d0 con 0x564678630900 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f787fa7a640 1 -- 172.21.15.99:0/703948159 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f787800a4a0 con 0x564678630900 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467872beb0 con 0x56467872cb30 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f787f279640 1 -- 172.21.15.99:0/703948159 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7870018950 con 0x56467872cb30 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.142+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f7883529800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f7883529800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5646784c7580 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56726/0 (socket says 172.21.15.99:56726) 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f787fa7a640 1 -- 172.21.15.99:0/3627846315 learned_addr learned my addr 172.21.15.99:0/3627846315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f787fa7a640 1 -- 172.21.15.99:0/3627846315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467873e8d0 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.143+0000 7f787fa7a640 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x5646787242e0 tx=0x7f78780167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7769602640 1 -- 172.21.15.99:0/3627846315 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878013640 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7769602640 1 -- 172.21.15.99:0/3627846315 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78780137e0 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56467873eb60 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7769602640 1 -- 172.21.15.99:0/3627846315 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878013ae0 con 0x56467873df70 2024-09-13T23:27:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564678741840 con 0x56467873df70 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.144+0000 7f7769602640 1 -- 172.21.15.99:0/3627846315 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7878011040 con 0x56467873df70 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7769602640 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 0x7f7758039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7769602640 1 -- 172.21.15.99:0/3627846315 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f787800e040 con 0x56467873df70 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f787f279640 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 0x7f7758039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f787f279640 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 0x7f7758039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564678727790 tx=0x7f7870024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7883529800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.145+0000 7f7883529800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56467871c000 con 0x56467862c460 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56734/0 (socket says 172.21.15.99:56734) 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f787fa7a640 1 -- 172.21.15.99:0/2450632099 learned_addr learned my addr 172.21.15.99:0/2450632099 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f787fa7a640 1 -- 172.21.15.99:0/2450632099 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56467862ce30 con 0x56467862c460 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f787fa7a640 1 --2- 172.21.15.99:0/2450632099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f787800a120 tx=0x7f787801fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e49e5efd232a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f7762ffd640 1 -- 172.21.15.99:0/2450632099 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f787804a070 con 0x56467862c460 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f7762ffd640 1 -- 172.21.15.99:0/2450632099 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878012cc0 con 0x56467862c460 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.146+0000 7f7762ffd640 1 -- 172.21.15.99:0/2450632099 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78780215b0 con 0x56467862c460 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- 172.21.15.99:0/2450632099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 msgr2=0x56467862c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 --2- 172.21.15.99:0/2450632099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f787800a120 tx=0x7f787801fee0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- 172.21.15.99:0/2450632099 shutdown_connections 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 --2- 172.21.15.99:0/2450632099 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x56467862c860 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- 172.21.15.99:0/2450632099 >> 172.21.15.99:0/2450632099 conn(0x564678747060 msgr2=0x564678745160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- 172.21.15.99:0/2450632099 shutdown_connections 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- 172.21.15.99:0/2450632099 wait complete. 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 Processor -- start 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- start start 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f7883529800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56467862b140 con 0x56467862c460 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f787fa7a640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56748/0 (socket says 172.21.15.99:56748) 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.147+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 learned_addr learned my addr 172.21.15.99:0/2083366695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646787547e0 con 0x56467862c460 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f787fa7a640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7878021040 tx=0x7f787804cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f77617fa640 1 -- 172.21.15.99:0/2083366695 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878040260 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f77617fa640 1 -- 172.21.15.99:0/2083366695 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7878040400 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f77617fa640 1 -- 172.21.15.99:0/2083366695 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7878020720 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564678754a70 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.148+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564678754a70 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f77617fa640 1 -- 172.21.15.99:0/2083366695 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f787803b060 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f77617fa640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7748036b40 0x7f7748039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f77617fa640 1 -- 172.21.15.99:0/2083366695 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7878035ba0 con 0x56467862c460 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f787f279640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7748036b40 0x7f7748039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56467875fbe0 0x5646787620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.149+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5646787627f0 con 0x56467875fbe0 2024-09-13T23:27:18.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7877fff640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56467875fbe0 0x5646787620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f787f279640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7748036b40 0x7f7748039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7870044480 tx=0x7f7870039000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7877fff640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56467875fbe0 0x5646787620a0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 20 realm 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678762c20 con 0x56467875fbe0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.150+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5646787634c0 con 0x56467875fbe0 2024-09-13T23:27:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678763860 con 0x56467875fbe0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5646787645c0 0x5646787669b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678766ef0 con 0x5646787645c0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f787fa7a640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5646787645c0 0x5646787669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.151+0000 7f787fa7a640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5646787645c0 0x5646787669b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f7883529800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f7883529800 20 searching for the correct realm 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564678768f60 0x56467876b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f787f279640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564678768f60 0x56467876b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f787f279640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564678768f60 0x56467876b420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.152+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.153+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.153+0000 7f787fa7a640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f78780148a0 0x7f787803c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.153+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.153+0000 7f7877fff640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f78780148a0 0x7f787803c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.153+0000 7f7877fff640 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f78780148a0 0x7f787803c560 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.154+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.155+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.156+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.157+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.158+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.159+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f787800a4a0 con 0x5646787645c0 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.160+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x564678768f60 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x7f78780148a0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x56467875fbe0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.161+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x56467876baf0 con 0x5646787645c0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678767960 con 0x56467875fbe0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5646787675a0 con 0x56467875fbe0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678768280 con 0x5646787645c0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 zone default found 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 4 Realm: () 2024-09-13T23:27:18.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 zonegroup default 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.162+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678767e70 con 0x7f78780148a0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467876e330 con 0x564678768f60 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56467876e6d0 con 0x564678768f60 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 started sync module instance, tier type = 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.163+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d7c0 con 0x5646787645c0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.164+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.164+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94860668755216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d7c0 con 0x5646787645c0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.165+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876f190 con 0x56467875fbe0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.166+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94860668755216] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.166+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.166+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94860668759136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d7c0 con 0x56467875fbe0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.166+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876fc30 con 0x564678768f60 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.167+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94860668759136] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.167+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.167+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94860668752656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d730 con 0x564678768f60 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.167+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678770af0 con 0x5646787645c0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.168+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.168+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94860668766240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678771290 con 0x5646787645c0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.168+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94860668752656] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.168+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678771db0 con 0x56467875fbe0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.170+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94860668766240] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.170+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.170+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94860668764272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678770ce0 con 0x56467875fbe0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.170+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678772390 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.171+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94860668764272] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.171+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.171+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94860668770432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678772390 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.171+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678772d50 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.172+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.172+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94860668774560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678773170 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.172+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678773bb0 con 0x7f78780148a0 2024-09-13T23:27:18.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.172+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94860668770432] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94860668774560] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94860668778112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678772cc0 con 0x7f78780148a0 2024-09-13T23:27:18.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=0 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=1 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=2 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=3 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=4 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=5 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.173+0000 7f7883529800 20 add_watcher() i=6 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94860668778112] v33'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7883529800 20 add_watcher() i=7 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7883529800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x564678776cb0 con 0x56467875fbe0 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.174+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94860668772064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678774130 con 0x56467875fbe0 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94860668772064] v33'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 5 note: GC not initialized 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7734fe1640 20 reqs_thread_entry: start 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 20 Filter name: none 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f76ae7fc640 20 reqs_thread_entry: start 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.177+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5646787a9940 con 0x56467875fbe0 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.178+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.178+0000 7f7883529800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.178+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5646787aae90 con 0x7f78780148a0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.178+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.179+0000 7f7735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.179+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94860668772064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678773c80 con 0x56467875fbe0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.180+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94860668772064] v33'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.180+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94860668755216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678771ee0 con 0x5646787645c0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.181+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94860668755216] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.181+0000 7f7883529800 20 remove_watcher() i=0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.181+0000 7f7883529800 2 removed watcher, disabling cache 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.181+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94860668759136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876dd10 con 0x56467875fbe0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.182+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94860668759136] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.182+0000 7f7883529800 20 remove_watcher() i=1 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.182+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94860668752656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876ec60 con 0x564678768f60 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.183+0000 7f787f279640 1 -- 172.21.15.99:0/2083366695 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94860668752656] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7870018950 con 0x564678768f60 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.184+0000 7f7883529800 20 remove_watcher() i=2 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.184+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94860668766240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d310 con 0x5646787645c0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.184+0000 7f787fa7a640 1 -- 172.21.15.99:0/2083366695 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94860668766240] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7878060040 con 0x5646787645c0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.184+0000 7f7883529800 20 remove_watcher() i=3 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.184+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94860668764272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d310 con 0x56467875fbe0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.186+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94860668764272] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x56467875fbe0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.186+0000 7f7883529800 20 remove_watcher() i=4 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.186+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94860668770432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678770070 con 0x7f78780148a0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.187+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94860668770432] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.187+0000 7f7883529800 20 remove_watcher() i=5 2024-09-13T23:27:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.187+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94860668774560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x56467876d310 con 0x7f78780148a0 2024-09-13T23:27:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.188+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94860668774560] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.188+0000 7f7883529800 20 remove_watcher() i=6 2024-09-13T23:27:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.188+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94860668778112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x564678771880 con 0x7f78780148a0 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94860668778112] v33'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7868051070 con 0x7f78780148a0 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 20 remove_watcher() i=7 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f78780148a0 msgr2=0x7f787803c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f78780148a0 0x7f787803c560 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56467875fbe0 msgr2=0x5646787620a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56467875fbe0 0x5646787620a0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5646787645c0 msgr2=0x5646787669b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5646787645c0 0x5646787669b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564678768f60 msgr2=0x56467876b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x564678768f60 0x56467876b420 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7748036b40 msgr2=0x7f7748039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7748036b40 0x7f7748039000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7870044480 tx=0x7f7870039000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 msgr2=0x5646787542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7877fff640 1 -- 172.21.15.99:0/2083366695 reap_dead start 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7878021040 tx=0x7f787804cda0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 shutdown_connections 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/2083366695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467862c460 0x5646787542a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 >> 172.21.15.99:0/2083366695 conn(0x564678747060 msgr2=0x564678745130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 shutdown_connections 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/2083366695 wait complete. 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 msgr2=0x7f7758039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 0x7f7758039000 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x564678727790 tx=0x7f7870024ec0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 msgr2=0x56467873e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x5646787242e0 tx=0x7f78780167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 shutdown_connections 2024-09-13T23:27:18.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7758036b40 0x7f7758039000 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 --2- 172.21.15.99:0/3627846315 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467873df70 0x56467873e390 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.189+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 >> 172.21.15.99:0/3627846315 conn(0x564678732f00 msgr2=0x564678735a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 shutdown_connections 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/3627846315 wait complete. 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 msgr2=0x56467872a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 0x56467872a2a0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 msgr2=0x56467872ef20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 0x56467872ef20 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 msgr2=0x7f7764039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 0x7f7764039050 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7868057000 tx=0x7f7868052000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 msgr2=0x564678723230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f787000b7c0 tx=0x7f7870000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 shutdown_connections 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x56467872cb30 0x56467872ef20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x564678630900 0x56467872a2a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7764036b90 0x7f7764039050 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 --2- 172.21.15.99:0/703948159 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56467859fdf0 0x564678723230 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 >> 172.21.15.99:0/703948159 conn(0x564678626df0 msgr2=0x564678715b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 shutdown_connections 2024-09-13T23:27:18.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.190+0000 7f7883529800 1 -- 172.21.15.99:0/703948159 wait complete. 2024-09-13T23:27:18.201 INFO:teuthology.orchestra.run.smithi099.stdout:{"entries":[],"summary":[]} 2024-09-13T23:27:18.201 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T23:27:18.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:27:18.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T23:27:18.202 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T23:27:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.288 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.287+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.287+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488f70c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ad714caeb0 0x55ad7155a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488f70c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad71416b30 con 0x55ad7155a6a0 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488f70c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55ad713f8360 con 0x55ad714caeb0 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488d200640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ad714caeb0 0x55ad7155a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488c9ff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55ad7155a6a0 0x55ad7155cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55150/0 (socket says 172.21.15.99:55150) 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488c9ff640 1 -- 172.21.15.99:0/526094727 learned_addr learned my addr 172.21.15.99:0/526094727 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488d200640 1 -- 172.21.15.99:0/526094727 >> v1:172.21.15.43:6789/0 conn(0x55ad7155a6a0 legacy=0x55ad7155cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.288+0000 7f488d200640 1 -- 172.21.15.99:0/526094727 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad7141ee00 con 0x55ad714caeb0 2024-09-13T23:27:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.290+0000 7f488d200640 1 --2- 172.21.15.99:0/526094727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7155a160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4880005fd0 tx=0x7f4880045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a567e3ddf9b9b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.290+0000 7f487ffff640 1 -- 172.21.15.99:0/526094727 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880058530 con 0x55ad714caeb0 2024-09-13T23:27:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.290+0000 7f487ffff640 1 -- 172.21.15.99:0/526094727 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48800586d0 con 0x55ad714caeb0 2024-09-13T23:27:18.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.290+0000 7f487ffff640 1 -- 172.21.15.99:0/526094727 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48800589d0 con 0x55ad714caeb0 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 -- 172.21.15.99:0/526094727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 msgr2=0x55ad7155a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 --2- 172.21.15.99:0/526094727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7155a160 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f4880005fd0 tx=0x7f4880045c30 comp rx=0 tx=0).stop 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 -- 172.21.15.99:0/526094727 shutdown_connections 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 --2- 172.21.15.99:0/526094727 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7155a160 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 -- 172.21.15.99:0/526094727 >> 172.21.15.99:0/526094727 conn(0x55ad71551dd0 msgr2=0x55ad715541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 -- 172.21.15.99:0/526094727 shutdown_connections 2024-09-13T23:27:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.291+0000 7f488f70c800 1 -- 172.21.15.99:0/526094727 wait complete. 2024-09-13T23:27:18.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488f70c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488f70c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad714a3360 con 0x55ad714caeb0 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56772/0 (socket says 172.21.15.99:56772) 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488d200640 1 -- 172.21.15.99:0/3558516065 learned_addr learned my addr 172.21.15.99:0/3558516065 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.305+0000 7f488d200640 1 -- 172.21.15.99:0/3558516065 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad713f0bc0 con 0x55ad714caeb0 2024-09-13T23:27:18.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.306+0000 7f488d200640 1 --2- 172.21.15.99:0/3558516065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f488000a3f0 tx=0x7f4880051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d54617d087f9d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.306+0000 7f477b606640 1 -- 172.21.15.99:0/3558516065 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48800589b0 con 0x55ad714caeb0 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.306+0000 7f477b606640 1 -- 172.21.15.99:0/3558516065 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880068070 con 0x55ad714caeb0 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.306+0000 7f477b606640 1 -- 172.21.15.99:0/3558516065 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880058c80 con 0x55ad714caeb0 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- 172.21.15.99:0/3558516065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 msgr2=0x55ad71646910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 --2- 172.21.15.99:0/3558516065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f488000a3f0 tx=0x7f4880051000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- 172.21.15.99:0/3558516065 shutdown_connections 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 --2- 172.21.15.99:0/3558516065 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad71646910 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- 172.21.15.99:0/3558516065 >> 172.21.15.99:0/3558516065 conn(0x55ad71551dd0 msgr2=0x55ad716422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- 172.21.15.99:0/3558516065 shutdown_connections 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- 172.21.15.99:0/3558516065 wait complete. 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488f70c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad7155e610 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488d200640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56776/0 (socket says 172.21.15.99:56776) 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.307+0000 7f488d200640 1 -- 172.21.15.99:0/3213595406 learned_addr learned my addr 172.21.15.99:0/3213595406 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f488d200640 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71404fe0 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f488d200640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f488000a3f0 tx=0x7f4880003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f4779e03640 1 -- 172.21.15.99:0/3213595406 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880063570 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f4779e03640 1 -- 172.21.15.99:0/3213595406 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4880063710 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad7164e690 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f4779e03640 1 -- 172.21.15.99:0/3213595406 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48800639f0 con 0x55ad714caeb0 2024-09-13T23:27:18.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.308+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad7164ebb0 con 0x55ad714caeb0 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f4779e03640 1 -- 172.21.15.99:0/3213595406 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f4880075020 con 0x55ad714caeb0 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f4779e03640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 0x7f4774039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f4779e03640 1 -- 172.21.15.99:0/3213595406 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f4880090e90 con 0x55ad714caeb0 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f488c9ff640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 0x7f4774039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 0x55ad716551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.309+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71655700 con 0x55ad7155a6a0 2024-09-13T23:27:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488da01640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 0x55ad716551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488c9ff640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 0x7f4774039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4884000f60 tx=0x7f48840012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488da01640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 0x55ad716551c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488da01640 1 -- 172.21.15.99:0/3213595406 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48880083e0 con 0x55ad7155a6a0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71652770 con 0x55ad7155a6a0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488da01640 1 -- 172.21.15.99:0/3213595406 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48880083e0 con 0x55ad7155a6a0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 0x55ad71659e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.310+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad7165a4f0 con 0x55ad71657a10 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488d200640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 0x55ad71659e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488d200640 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 0x55ad71659e00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488d200640 1 -- 172.21.15.99:0/3213595406 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f488004fcf0 con 0x55ad71657a10 2024-09-13T23:27:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716568b0 con 0x55ad7155a6a0 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488da01640 1 -- 172.21.15.99:0/3213595406 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48880083e0 con 0x55ad7155a6a0 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.311+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71656d70 con 0x55ad71657a10 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488d200640 1 -- 172.21.15.99:0/3213595406 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f488004fcf0 con 0x55ad71657a10 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488f70c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488f70c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad713f2580 con 0x55ad71557b10 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56788/0 (socket says 172.21.15.99:56788) 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.312+0000 7f488da01640 1 -- 172.21.15.99:0/3958778884 learned_addr learned my addr 172.21.15.99:0/3958778884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f488da01640 1 -- 172.21.15.99:0/3958778884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71557f30 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f488da01640 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55ad7164f550 tx=0x7f488800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f4772ffd640 1 -- 172.21.15.99:0/3958778884 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f488801c020 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f4772ffd640 1 -- 172.21.15.99:0/3958778884 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4888007c30 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad71556760 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f4772ffd640 1 -- 172.21.15.99:0/3958778884 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4888018440 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.313+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad71556c60 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.314+0000 7f4772ffd640 1 -- 172.21.15.99:0/3958778884 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f488801f020 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.314+0000 7f4772ffd640 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.314+0000 7f4772ffd640 1 -- 172.21.15.99:0/3958778884 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f488804e230 con 0x55ad71557b10 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.314+0000 7f488d200640 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.314+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488d200640 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 0x7f4768039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ad71655bb0 tx=0x7f488008f300 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488f70c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488f70c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad71647000 con 0x55ad71677d30 2024-09-13T23:27:18.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56790/0 (socket says 172.21.15.99:56790) 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488da01640 1 -- 172.21.15.99:0/1883124347 learned_addr learned my addr 172.21.15.99:0/1883124347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488da01640 1 -- 172.21.15.99:0/1883124347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad71678700 con 0x55ad71677d30 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.315+0000 7f488da01640 1 --2- 172.21.15.99:0/1883124347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f488804c610 tx=0x7f488804c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74be9e204a0616e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f4770ff9640 1 -- 172.21.15.99:0/1883124347 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4888018b90 con 0x55ad71677d30 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f4770ff9640 1 -- 172.21.15.99:0/1883124347 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4888029350 con 0x55ad71677d30 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f4770ff9640 1 -- 172.21.15.99:0/1883124347 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4888018d30 con 0x55ad71677d30 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- 172.21.15.99:0/1883124347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 msgr2=0x55ad71678130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 --2- 172.21.15.99:0/1883124347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f488804c610 tx=0x7f488804c8e0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- 172.21.15.99:0/1883124347 shutdown_connections 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 --2- 172.21.15.99:0/1883124347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad71678130 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- 172.21.15.99:0/1883124347 >> 172.21.15.99:0/1883124347 conn(0x55ad71674090 msgr2=0x55ad71672190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- 172.21.15.99:0/1883124347 shutdown_connections 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- 172.21.15.99:0/1883124347 wait complete. 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 Processor -- start 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.316+0000 7f488f70c800 1 -- start start 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488f70c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad7167f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488f70c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad71678c80 con 0x55ad71677d30 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad7167f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488da01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad7167f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56804/0 (socket says 172.21.15.99:56804) 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 learned_addr learned my addr 172.21.15.99:0/417353831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad7167f650 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488da01640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad7167f110 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f488804c610 tx=0x7f488804c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f475effd640 1 -- 172.21.15.99:0/417353831 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f488803b070 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f475effd640 1 -- 172.21.15.99:0/417353831 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4888029500 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad7167f8e0 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.317+0000 7f475effd640 1 -- 172.21.15.99:0/417353831 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f488804cb70 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.318+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad71682590 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.318+0000 7f475effd640 1 -- 172.21.15.99:0/417353831 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f488803e070 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.318+0000 7f475effd640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4758036b90 0x7f4758039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f475effd640 1 -- 172.21.15.99:0/417353831 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f4888037c20 con 0x55ad71677d30 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488d200640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4758036b90 0x7f4758039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488d200640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4758036b90 0x7f4758039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55ad71655b80 tx=0x7f4880097000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7168ac00 0x55ad7168d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad7168d810 con 0x55ad7168ac00 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488c9ff640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7168ac00 0x55ad7168d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.319+0000 7f488c9ff640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7168ac00 0x55ad7168d0c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4884009050 con 0x55ad7168ac00 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 realm 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad7168a050 con 0x55ad7168ac00 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4884009050 con 0x55ad7168ac00 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad7168e300 con 0x55ad7168ac00 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4884009050 con 0x55ad7168ac00 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad7168ebd0 con 0x55ad7168ac00 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4884009050 con 0x55ad7168ac00 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad7168f5f0 0x55ad716919e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.320+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716920d0 con 0x55ad7168f5f0 2024-09-13T23:27:18.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488da01640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad7168f5f0 0x55ad716919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488da01640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad7168f5f0 0x55ad716919e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488f70c800 20 searching for the correct realm 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ad71694080 0x55ad71696540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488d200640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ad71694080 0x55ad71696540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.321+0000 7f488d200640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ad71694080 0x55ad71696540 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488da01640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f48880203b0 0x7f48880296e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.322+0000 7f488c9ff640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f48880203b0 0x7f48880296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.323+0000 7f488c9ff640 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f48880203b0 0x7f48880296e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.323+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884009050 con 0x7f48880203b0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.323+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.323+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884009050 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x7f48880203b0 2024-09-13T23:27:18.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.324+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x7f48880203b0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.325+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x7f48880203b0 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.326+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.327+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x7f48880203b0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.328+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884029040 con 0x55ad7168ac00 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.329+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad71694080 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x7f48880203b0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.330+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168ac00 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ad71696c10 con 0x55ad7168f5f0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:18.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71692a90 con 0x55ad7168ac00 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71693330 con 0x55ad7168ac00 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.331+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71697090 con 0x55ad7168f5f0 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 zone default found 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 4 Realm: () 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 zonegroup default 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71697540 con 0x7f48880203b0 2024-09-13T23:27:18.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.332+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71698f20 con 0x55ad71694080 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71699350 con 0x55ad71694080 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 20 started sync module instance, tier type = 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.333+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716983b0 con 0x55ad7168f5f0 2024-09-13T23:27:18.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.334+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.334+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203420444896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716983b0 con 0x55ad7168f5f0 2024-09-13T23:27:18.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.334+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71699e60 con 0x55ad7168ac00 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.335+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203420444896] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.336+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.336+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203420449104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716983b0 con 0x55ad7168ac00 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.336+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169a900 con 0x55ad71694080 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.337+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203420449104] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.337+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.337+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203420442368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71698320 con 0x55ad71694080 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.337+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169b7c0 con 0x55ad7168f5f0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.338+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.338+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203420442368] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.338+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203420455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169bbe0 con 0x55ad7168f5f0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.338+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169c4e0 con 0x55ad7168ac00 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.339+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203420455696] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.339+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.340+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203420456752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169bb90 con 0x55ad7168ac00 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.340+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169cb60 con 0x7f48880203b0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.341+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.341+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203420460624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169cb20 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.341+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169daa0 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.341+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203420456752] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.342+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203420460624] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.342+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.342+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203420464592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169cf50 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.342+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169df50 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203420464592] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203420459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169df50 con 0x7f48880203b0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=0 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=1 2024-09-13T23:27:18.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=2 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=3 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=4 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=5 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.343+0000 7f488f70c800 20 add_watcher() i=6 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203420459008] v33'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488f70c800 20 add_watcher() i=7 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488f70c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716a1370 con 0x55ad7168ac00 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.344+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203420466288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169e840 con 0x55ad7168ac00 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.345+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203420466288] v33'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.346+0000 7f47437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.346+0000 7f488f70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.346+0000 7f488f70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.346+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716a1160 con 0x55ad7168ac00 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.347+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.347+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716aa440 con 0x7f48880203b0 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.348+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.348+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716aa9b0 con 0x55ad71694080 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.349+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.349+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716aaa40 con 0x55ad7168ac00 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.350+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.350+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716aafb0 con 0x55ad7168f5f0 2024-09-13T23:27:18.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.351+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.351+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716aafb0 con 0x55ad71694080 2024-09-13T23:27:18.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.352+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.352+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab040 con 0x55ad7168ac00 2024-09-13T23:27:18.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.353+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.353+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab120 con 0x7f48880203b0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.354+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.354+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab120 con 0x55ad7168f5f0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.356+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.356+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x55ad71694080 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.357+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.357+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x55ad7168f5f0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.358+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.358+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x7f48880203b0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.359+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.359+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x55ad7168f5f0 2024-09-13T23:27:18.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.360+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.360+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x7f48880203b0 2024-09-13T23:27:18.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.361+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'57 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.361+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x55ad7168ac00 2024-09-13T23:27:18.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.362+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.362+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ab690 con 0x55ad71694080 2024-09-13T23:27:18.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.363+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'70 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.363+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad7168f5f0 2024-09-13T23:27:18.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.364+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.364+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.365+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.365+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad7168ac00 2024-09-13T23:27:18.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.366+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'37 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.366+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad7168ac00 2024-09-13T23:27:18.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.367+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.367+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.369+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'71 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.369+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad7168f5f0 2024-09-13T23:27:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.370+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.370+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.371+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.371+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.371+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.372+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.372+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.373+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.373+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.373+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x7f48880203b0 2024-09-13T23:27:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.374+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.374+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.375+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.375+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x7f48880203b0 2024-09-13T23:27:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.376+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.376+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad71694080 2024-09-13T23:27:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.378+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'72 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.378+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x7f48880203b0 2024-09-13T23:27:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.379+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.379+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716abae0 con 0x55ad7168f5f0 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.380+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'35 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.380+0000 7f47427e4640 20 reqs_thread_entry: start 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.380+0000 7f488f70c800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 20 Filter name: none 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f46b3fff640 20 reqs_thread_entry: start 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716d6870 con 0x55ad7168ac00 2024-09-13T23:27:18.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716d6820 con 0x55ad7168f5f0 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 : miss 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.381+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:96 8.8 8:1631cf3d:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716d8e00 con 0x55ad7168ac00 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(96 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 info.flags=0x17 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 to cache LRU end 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:97 4.11 4:8bf00e65:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad717564c0 con 0x7f48880203b0 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(97 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.382+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:98 4.21 4:8522768d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756500 con 0x7f48880203b0 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.383+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(98 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.383+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 4.24 4:27ebf4d1:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x7f48880203b0 2024-09-13T23:27:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.383+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(99 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.383+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 4.1e 4:79009d6e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x7f48880203b0 2024-09-13T23:27:18.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.384+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(100 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.384+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x7f48880203b0 2024-09-13T23:27:18.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.384+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(101 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [call out=424b] v0'0 uv5 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.384+0000 7f488f70c800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.384+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:102 4.13 4:c8b1c10d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x55ad7168f5f0 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(102 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:103 4.16 4:6a1e8315:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x55ad71694080 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(103 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:104 4.9 4:90a6d63e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756540 con 0x55ad7168ac00 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(104 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.385+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:105 4.1e 4:7b5fab37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756580 con 0x7f48880203b0 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(105 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 4.6 4:60ecf889:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756580 con 0x55ad71694080 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(106 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:107 4.29 4:9752a154:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71756580 con 0x55ad71694080 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(107 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488f70c800 20 get_obj_state: octx=0x7f4888021f60 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ad71754568 s->prefetch_data=0 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.386+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:108 3.c 3:32967b9f:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad71755390 con 0x55ad71694080 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(108 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 10 manifest: total_size = 6 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 20 get_obj_state: setting s->obj_tag to 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.747024357920256444 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 20 get_obj_state: octx=0x7f4888021f60 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ad71754568 s->prefetch_data=0 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 20 prepare_atomic_modification: state is not atomic. state=0x55ad71754568 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 20 bucket index object: :.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.387+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:109 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71755e60 con 0x7f48880203b0 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.388+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(109 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [stat,call,call] v33'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.388+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:110 3.c 3:32967b9f:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71755e60 con 0x55ad71694080 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(110 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7_15f6f8dc036519d7fe15b39338f6e5db [call] v33'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ddbb0 con 0x7f48880203b0 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 20 list_objects_ordered: starting attempt 1 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:112 4.11 4:8bf00e65:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ddbb0 con 0x7f48880203b0 2024-09-13T23:27:18.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:113 4.21 4:8522768d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e1eb0 con 0x7f48880203b0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:114 4.24 4:27ebf4d1:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ddbb0 con 0x7f48880203b0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:115 4.1e 4:79009d6e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e6cc0 con 0x7f48880203b0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:116 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e9620 con 0x7f48880203b0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:117 4.13 4:c8b1c10d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ec0f0 con 0x55ad7168f5f0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:118 4.16 4:6a1e8315:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716ee9c0 con 0x55ad71694080 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:119 4.9 4:90a6d63e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e9620 con 0x55ad7168ac00 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:120 4.1e 4:7b5fab37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f39e0 con 0x7f48880203b0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:121 4.6 4:60ecf889:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f63c0 con 0x55ad71694080 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:122 4.29 4:9752a154:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x55ad71694080 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(119 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(117 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(113 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(112 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(115 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(118 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.389+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(114 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(121 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(122 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(120 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(111 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [stat,call,call] v33'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f4770ff9640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.390+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(116 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T23:27:18.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7])"; uploads.size()=0; is_truncated=0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:123 4.11 4:8bf00e65:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad717559b0 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:124 4.21 4:8522768d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716eea20 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:125 4.24 4:27ebf4d1:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:126 4.1e 4:79009d6e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716eea20 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:127 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:128 4.13 4:c8b1c10d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e9450 con 0x55ad7168f5f0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:129 4.16 4:6a1e8315:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716eea20 con 0x55ad71694080 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:130 4.9 4:90a6d63e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x55ad7168ac00 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:131 4.1e 4:7b5fab37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716e2320 con 0x7f48880203b0 2024-09-13T23:27:18.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:132 4.6 4:60ecf889:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716eea20 con 0x55ad71694080 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:133 4.29 4:9752a154:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x55ad71694080 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(124 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(123 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(126 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(125 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(127 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(130 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(128 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(131 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(129 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(132 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(133 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.391+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.392+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(134 foo.buckets [call] v33'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.392+0000 7f488f70c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.392+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.392+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f9210 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.393+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.393+0000 7f488f70c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.393+0000 7f488f70c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.393+0000 7f488f70c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.393+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(136 myfoo [call,call,delete] v33'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488f70c800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T23:27:18.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94203421212128 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== watch-notify(notify (1) cookie 94203420464592 notify 141733920811 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ad716d8430 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f4770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 94203420464592 notifier 4787 bl.length()=149 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f4770ff9640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4750003d60 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(137 notify.6 [notify cookie 94203421212128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.394+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.395+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== watch-notify(notify_complete (2) cookie 94203421212128 notify 141733920811 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad716aa610 con 0x7f48880203b0 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.395+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:139 8.8 8:1631cf3d:root::.bucket.meta.myfoo%3a08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x55ad7168ac00 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(139 .bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 [call,call,delete] v33'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488f70c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 from cache 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7, ofs0, ns] 2024-09-13T23:27:18.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94203420706512 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 47 ==== watch-notify(notify (1) cookie 94203420464592 notify 141733920812 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ad716aa610 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f475ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920812 cookie 94203420464592 notifier 4787 bl.length()=206 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f475ffff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f46c00032c0 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 48 ==== osd_op_reply(140 notify.6 [notify cookie 94203420706512 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.396+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 49 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 50 ==== watch-notify(notify_complete (2) cookie 94203420706512 notify 141733920812 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f488405d040 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:142 4.11 4:8bf00e65:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:143 4.21 4:8522768d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716d7770 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:144 4.24 4:27ebf4d1:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:145 4.1e 4:79009d6e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f7180 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:146 4.23 4:c71a6a37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8a40 con 0x7f48880203b0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:147 4.13 4:c8b1c10d:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71754740 con 0x55ad7168f5f0 2024-09-13T23:27:18.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:148 4.16 4:6a1e8315:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716d7770 con 0x55ad71694080 2024-09-13T23:27:18.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:149 4.9 4:90a6d63e:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f8330 con 0x55ad7168ac00 2024-09-13T23:27:18.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:150 4.1e 4:7b5fab37:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x7f48880203b0 2024-09-13T23:27:18.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:151 4.6 4:60ecf889:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f7180 con 0x55ad71694080 2024-09-13T23:27:18.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.397+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:152 4.29 4:9752a154:::.dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71754740 con 0x55ad71694080 2024-09-13T23:27:18.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 51 ==== osd_op_reply(142 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.0 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(147 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.5 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(152 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.10 [delete] v33'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 52 ==== osd_op_reply(144 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.2 [delete] v33'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(148 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.6 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 53 ==== osd_op_reply(145 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.3 [delete] v33'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.398+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 54 ==== osd_op_reply(143 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.1 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(149 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.7 [delete] v33'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(151 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.9 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 55 ==== osd_op_reply(150 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.8 [delete] v33'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 56 ==== osd_op_reply(146 .dir.08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7.4 [delete] v33'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 : miss 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:153 6.5 6:a22ac86f:::pubsub..bucket.myfoo%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x55ad7168f5f0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(153 pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 info.flags=0x0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 10 adding default.rgw.log++pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 to cache LRU end 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.399+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:154 6.5 6:a22ac86f:::pubsub..bucket.myfoo%2f08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x55ad7168f5f0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.400+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(154 pubsub..bucket.myfoo/08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.7 [delete] v33'16 uv15 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.400+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f79d0 con 0x55ad7168f5f0 2024-09-13T23:27:18.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.402+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(155 foo.buckets [call] v33'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.402+0000 7f488f70c800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.402+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x7f48880203b0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 57 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v33'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94203420706384 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f89e0 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== watch-notify(notify (1) cookie 94203420455696 notify 141733920787 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ad7167f8e0 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f4770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920787 cookie 94203420455696 notifier 4787 bl.length()=170 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f4770ff9640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4750003d60 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(157 notify.3 [notify cookie 94203420706384 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== watch-notify(notify_complete (2) cookie 94203420706384 notify 141733920787 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad7167f650 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488f70c800 10 removing email index: foo@foo.com 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.403+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x55ad7168ac00 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.404+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(159 foo@foo.com [delete] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.404+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.404+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94203420706384 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f89e0 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== watch-notify(notify (1) cookie 94203420455696 notify 141733920788 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55ad7167f650 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f475ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920788 cookie 94203420455696 notifier 4787 bl.length()=162 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f475ffff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f46c00032a0 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(160 notify.3 [notify cookie 94203420706384 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== watch-notify(notify_complete (2) cookie 94203420706384 notify 141733920788 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad71678700 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488f70c800 10 removing user buckets index 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.405+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f68b0 con 0x55ad7168f5f0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(162 foo.buckets [delete] v33'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94203420706384 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f89e0 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 58 ==== watch-notify(notify (1) cookie 94203420460624 notify 141733920813 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7f488405d040 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f4770ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920813 cookie 94203420460624 notifier 4787 bl.length()=160 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f4770ff9640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f4750003d60 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.406+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 59 ==== osd_op_reply(163 notify.5 [notify cookie 94203420706384 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.407+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 60 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.407+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 61 ==== watch-notify(notify_complete (2) cookie 94203420706384 notify 141733920813 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad716aa7e0 con 0x7f48880203b0 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.407+0000 7f488f70c800 10 removing user index: foo 2024-09-13T23:27:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.407+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f89e0 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(165 foo [call,call,delete] v33'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488f70c800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488f70c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94203420706384 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad716f7e80 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== watch-notify(notify (1) cookie 94203420456752 notify 141733920798 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ad716aa7e0 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f475ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920798 cookie 94203420456752 notifier 4787 bl.length()=152 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f475ffff640 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f46c00032a0 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(166 notify.4 [notify cookie 94203420706384 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.408+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== watch-notify(notify_complete (2) cookie 94203420706384 notify 141733920798 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad716a1120 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.409+0000 7f47437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.409+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203420466288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716a6660 con 0x55ad7168ac00 2024-09-13T23:27:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.410+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94203420466288] v33'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.410+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203420444896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169dc40 con 0x55ad7168f5f0 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.411+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 40 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94203420444896] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.411+0000 7f488f70c800 20 remove_watcher() i=0 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.411+0000 7f488f70c800 2 removed watcher, disabling cache 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.411+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203420449104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716988e0 con 0x55ad7168ac00 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.413+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94203420449104] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.413+0000 7f488f70c800 20 remove_watcher() i=1 2024-09-13T23:27:18.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.413+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203420442368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716988e0 con 0x55ad71694080 2024-09-13T23:27:18.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.414+0000 7f488d200640 1 -- 172.21.15.99:0/417353831 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94203420442368] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4880093040 con 0x55ad71694080 2024-09-13T23:27:18.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.414+0000 7f488f70c800 20 remove_watcher() i=2 2024-09-13T23:27:18.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.414+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203420455696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71697f00 con 0x55ad7168f5f0 2024-09-13T23:27:18.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.415+0000 7f488da01640 1 -- 172.21.15.99:0/417353831 <== osd.2 v2:172.21.15.99:6800/2157953423 41 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94203420455696] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4888056040 con 0x55ad7168f5f0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.415+0000 7f488f70c800 20 remove_watcher() i=3 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.415+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203420456752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716988e0 con 0x55ad7168ac00 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.416+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94203420456752] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x55ad7168ac00 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.416+0000 7f488f70c800 20 remove_watcher() i=4 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.416+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203420460624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad71697f00 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.417+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 62 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94203420460624] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.417+0000 7f488f70c800 20 remove_watcher() i=5 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.417+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203420464592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad716988e0 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.418+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 63 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94203420464592] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.418+0000 7f488f70c800 20 remove_watcher() i=6 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.418+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203420459008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ad7169c650 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 <== osd.0 v2:172.21.15.43:6800/3849931173 64 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94203420459008] v33'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4884039040 con 0x7f48880203b0 2024-09-13T23:27:18.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 20 remove_watcher() i=7 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f48880203b0 msgr2=0x7f48880296e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f48880203b0 0x7f48880296e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7168ac00 msgr2=0x55ad7168d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7168ac00 0x55ad7168d0c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad7168f5f0 msgr2=0x55ad716919e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad7168f5f0 0x55ad716919e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ad71694080 msgr2=0x55ad71696540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ad71694080 0x55ad71696540 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4758036b90 msgr2=0x7f4758039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4758036b90 0x7f4758039050 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55ad71655b80 tx=0x7f4880097000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 msgr2=0x55ad7167f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/417353831 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71677d30 0x55ad7167f110 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f488804c610 tx=0x7f488804c5a0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488c9ff640 1 -- 172.21.15.99:0/417353831 reap_dead start 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 shutdown_connections 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 >> 172.21.15.99:0/417353831 conn(0x55ad71674090 msgr2=0x55ad71672160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 shutdown_connections 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/417353831 wait complete. 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 msgr2=0x7f4768039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 0x7f4768039000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ad71655bb0 tx=0x7f488008f300 comp rx=0 tx=0).stop 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 msgr2=0x55ad71556160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55ad7164f550 tx=0x7f488800beb0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 shutdown_connections 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4768036b40 0x7f4768039000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 --2- 172.21.15.99:0/3958778884 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad71557b10 0x55ad71556160 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 >> 172.21.15.99:0/3958778884 conn(0x55ad7165de30 msgr2=0x55ad716609b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 shutdown_connections 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.419+0000 7f488f70c800 1 -- 172.21.15.99:0/3958778884 wait complete. 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 msgr2=0x55ad716551c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 0x55ad716551c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 msgr2=0x55ad71659e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 0x55ad71659e00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 msgr2=0x7f4774039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 0x7f4774039000 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4884000f60 tx=0x7f48840012b0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 msgr2=0x55ad7164e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f488000a3f0 tx=0x7f4880003330 comp rx=0 tx=0).stop 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 shutdown_connections 2024-09-13T23:27:18.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad71657a10 0x55ad71659e00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad7155a6a0 0x55ad716551c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f4774036b40 0x7f4774039000 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 --2- 172.21.15.99:0/3213595406 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad714caeb0 0x55ad7164e150 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 >> 172.21.15.99:0/3213595406 conn(0x55ad71551dd0 msgr2=0x55ad71640b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 shutdown_connections 2024-09-13T23:27:18.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.420+0000 7f488f70c800 1 -- 172.21.15.99:0/3213595406 wait complete. 2024-09-13T23:27:18.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T23:27:18.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T23:27:18.430 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T23:27:18.474 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.475 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.474+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.474+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.474+0000 7f7d90faf800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b7f60db5f0 0x55b7f616c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.474+0000 7f7d90faf800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7f6026b30 con 0x55b7f616cbd0 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.474+0000 7f7d90faf800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b7f6008360 con 0x55b7f60db5f0 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d8eaa3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b7f60db5f0 0x55b7f616c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d87fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b7f616cbd0 0x55b7f616efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55156/0 (socket says 172.21.15.99:55156) 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d8eaa3640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b7f60db5f0 0x55b7f616c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56814/0 (socket says 172.21.15.99:56814) 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d87fff640 1 -- 172.21.15.99:0/779600932 learned_addr learned my addr 172.21.15.99:0/779600932 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/779600932 >> v1:172.21.15.43:6789/0 conn(0x55b7f616cbd0 legacy=0x55b7f616efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.475+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/779600932 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f602ee00 con 0x55b7f60db5f0 2024-09-13T23:27:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/779600932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f616c690 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000a470 tx=0x7f7d80045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b14f9a80fd28696 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d8e2a2640 1 -- 172.21.15.99:0/779600932 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d80053570 con 0x55b7f60db5f0 2024-09-13T23:27:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d8e2a2640 1 -- 172.21.15.99:0/779600932 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80058070 con 0x55b7f60db5f0 2024-09-13T23:27:18.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d8e2a2640 1 -- 172.21.15.99:0/779600932 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d80053880 con 0x55b7f60db5f0 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 -- 172.21.15.99:0/779600932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 msgr2=0x55b7f616c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 --2- 172.21.15.99:0/779600932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f616c690 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000a470 tx=0x7f7d80045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 -- 172.21.15.99:0/779600932 shutdown_connections 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 --2- 172.21.15.99:0/779600932 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f616c690 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 -- 172.21.15.99:0/779600932 >> 172.21.15.99:0/779600932 conn(0x55b7f6161de0 msgr2=0x55b7f6164200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 -- 172.21.15.99:0/779600932 shutdown_connections 2024-09-13T23:27:18.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.477+0000 7f7d90faf800 1 -- 172.21.15.99:0/779600932 wait complete. 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.491+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.491+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.491+0000 7f7d90faf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.491+0000 7f7d90faf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b7f60b3330 con 0x55b7f60db5f0 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7d8eaa3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7d8eaa3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56830/0 (socket says 172.21.15.99:56830) 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3216758750 learned_addr learned my addr 172.21.15.99:0/3216758750 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3216758750 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f6000bc0 con 0x55b7f60db5f0 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/3216758750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7d80025c20 tx=0x7f7d80051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aeb48128de6a6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7c7ce09640 1 -- 172.21.15.99:0/3216758750 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8005c580 con 0x55b7f60db5f0 2024-09-13T23:27:18.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7c7ce09640 1 -- 172.21.15.99:0/3216758750 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80063030 con 0x55b7f60db5f0 2024-09-13T23:27:18.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.492+0000 7f7c7ce09640 1 -- 172.21.15.99:0/3216758750 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8005c850 con 0x55b7f60db5f0 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 -- 172.21.15.99:0/3216758750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 msgr2=0x55b7f6258a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3216758750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7d80025c20 tx=0x7f7d80051000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 -- 172.21.15.99:0/3216758750 shutdown_connections 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3216758750 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f6258a70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 -- 172.21.15.99:0/3216758750 >> 172.21.15.99:0/3216758750 conn(0x55b7f6161de0 msgr2=0x55b7f6254430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 -- 172.21.15.99:0/3216758750 shutdown_connections 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 -- 172.21.15.99:0/3216758750 wait complete. 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.493+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d90faf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d90faf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6170980 con 0x55b7f60db5f0 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d8eaa3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d8eaa3640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56832/0 (socket says 172.21.15.99:56832) 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/394729852 learned_addr learned my addr 172.21.15.99:0/394729852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f6014fe0 con 0x55b7f60db5f0 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55b7f62598d0 tx=0x7f7d80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.494+0000 7f7c7b606640 1 -- 172.21.15.99:0/394729852 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d80054ad0 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7c7b606640 1 -- 172.21.15.99:0/394729852 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d80054c70 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7f6260920 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7c7b606640 1 -- 172.21.15.99:0/394729852 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d80068420 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f6260e40 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7c7b606640 1 -- 172.21.15.99:0/394729852 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d800685c0 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.495+0000 7f7c7b606640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 0x7f7c74039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7c7b606640 1 -- 172.21.15.99:0/394729852 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7d80070030 con 0x55b7f60db5f0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d87fff640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 0x7f7c74039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 0x55b7f6267450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f6267990 con 0x55b7f616cbd0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 0x55b7f6267450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d87fff640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 0x7f7c74039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000f60 tx=0x7f7d780012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 0x55b7f6267450 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/394729852 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d8800a4a0 con 0x55b7f616cbd0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.496+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f6264a20 con 0x55b7f616cbd0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/394729852 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d8800a4a0 con 0x55b7f616cbd0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 0x55b7f626c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f626c810 con 0x55b7f6269d30 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 0x55b7f626c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 0x55b7f626c120 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/394729852 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f6269d30 2024-09-13T23:27:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.497+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f6268bd0 con 0x55b7f616cbd0 2024-09-13T23:27:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/394729852 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d8800a4a0 con 0x55b7f616cbd0 2024-09-13T23:27:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62690b0 con 0x55b7f6269d30 2024-09-13T23:27:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/394729852 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f6269d30 2024-09-13T23:27:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d90faf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.498+0000 7f7d90faf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6002580 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56838/0 (socket says 172.21.15.99:56838) 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/2577001602 learned_addr learned my addr 172.21.15.99:0/2577001602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/2577001602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f627bb10 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55b7f6261030 tx=0x7f7d880163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7c78e01640 1 -- 172.21.15.99:0/2577001602 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d88016ea0 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7c78e01640 1 -- 172.21.15.99:0/2577001602 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88013450 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7f627bda0 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7c78e01640 1 -- 172.21.15.99:0/2577001602 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d88013770 con 0x55b7f627b1b0 2024-09-13T23:27:18.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.499+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f627ea80 con 0x55b7f627b1b0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.500+0000 7f7c78e01640 1 -- 172.21.15.99:0/2577001602 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d88011040 con 0x55b7f627b1b0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.500+0000 7f7c78e01640 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 0x7f7c68039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.500+0000 7f7c78e01640 1 -- 172.21.15.99:0/2577001602 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7d8800e040 con 0x55b7f627b1b0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.500+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 0x7f7c68039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 0x7f7c68039050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b7f62682e0 tx=0x7f7d80060ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d90faf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d90faf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b7f62591c0 con 0x55b7f6287eb0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56852/0 (socket says 172.21.15.99:56852) 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/2378705355 learned_addr learned my addr 172.21.15.99:0/2378705355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/2378705355 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f6288880 con 0x55b7f6287eb0 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.501+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/2378705355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804cdb0 tx=0x7f7d8804cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132af9da88475df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7c727fc640 1 -- 172.21.15.99:0/2378705355 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8802a570 con 0x55b7f6287eb0 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7c727fc640 1 -- 172.21.15.99:0/2378705355 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8801f390 con 0x55b7f6287eb0 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7c727fc640 1 -- 172.21.15.99:0/2378705355 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d88012cb0 con 0x55b7f6287eb0 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- 172.21.15.99:0/2378705355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 msgr2=0x55b7f62882b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2378705355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804cdb0 tx=0x7f7d8804cef0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- 172.21.15.99:0/2378705355 shutdown_connections 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2378705355 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f62882b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- 172.21.15.99:0/2378705355 >> 172.21.15.99:0/2378705355 conn(0x55b7f6284210 msgr2=0x55b7f6282310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- 172.21.15.99:0/2378705355 shutdown_connections 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- 172.21.15.99:0/2378705355 wait complete. 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 Processor -- start 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.502+0000 7f7d90faf800 1 -- start start 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d90faf800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f628f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d90faf800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b7f6288ef0 con 0x55b7f6287eb0 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f628f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d8f2a4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f628f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56866/0 (socket says 172.21.15.99:56866) 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 learned_addr learned my addr 172.21.15.99:0/3456105878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7f628f820 con 0x55b7f6287eb0 2024-09-13T23:27:18.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f628f2e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804cf30 tx=0x7f7d8804cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7c70ff9640 1 -- 172.21.15.99:0/3456105878 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d88013af0 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7c70ff9640 1 -- 172.21.15.99:0/3456105878 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88013c90 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7f628fab0 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7c70ff9640 1 -- 172.21.15.99:0/3456105878 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8804e240 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.503+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7f6292760 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.504+0000 7f7c70ff9640 1 -- 172.21.15.99:0/3456105878 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7d8804e3e0 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.504+0000 7f7c70ff9640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c58036b90 0x7f7c58039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.504+0000 7f7c70ff9640 1 -- 172.21.15.99:0/3456105878 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7d88015420 con 0x55b7f6287eb0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.504+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c58036b90 0x7f7c58039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f629ae20 0x55b7f629d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f629da30 con 0x55b7f629ae20 2024-09-13T23:27:18.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d87fff640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f629ae20 0x55b7f629d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c58036b90 0x7f7c58039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55b7f6267e80 tx=0x7f7d80088000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d87fff640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f629ae20 0x55b7f629d2e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d78009050 con 0x55b7f629ae20 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 20 realm 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.505+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f629a270 con 0x55b7f629ae20 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d78009050 con 0x55b7f629ae20 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f629e510 con 0x55b7f629ae20 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d78009050 con 0x55b7f629ae20 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f629ede0 con 0x55b7f629ae20 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7d78009050 con 0x55b7f629ae20 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f629f690 0x55b7f62a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a21c0 con 0x55b7f629f690 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f629f690 0x55b7f62a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.506+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f629f690 0x55b7f62a1a80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d90faf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:18.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d90faf800 20 searching for the correct realm 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b7f62a4270 0x55b7f62a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b7f62a4270 0x55b7f62a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d8eaa3640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b7f62a4270 0x55b7f62a6730 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.507+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.508+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.508+0000 7f7d8f2a4640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d88013070 0x7f7d8804b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.508+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.508+0000 7f7d87fff640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d88013070 0x7f7d8804b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.508+0000 7f7d87fff640 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d88013070 0x7f7d8804b570 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78009050 con 0x7f7d88013070 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78009050 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.509+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.510+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.511+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.512+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.513+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.514+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f62a4270 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x7f7d88013070 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629ae20 2024-09-13T23:27:18.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.515+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a6e00 con 0x55b7f629f690 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a2cd0 con 0x55b7f629ae20 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a28e0 con 0x55b7f629ae20 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a3640 con 0x55b7f629f690 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.516+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 zone default found 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 4 Realm: () 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:18.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 zonegroup default 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a7730 con 0x7f7d88013070 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a7370 con 0x55b7f62a4270 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a9a10 con 0x55b7f62a4270 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 started sync module instance, tier type = 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.517+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a8df0 con 0x55b7f629f690 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.518+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.518+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94248597361392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62a8df0 con 0x55b7f629f690 2024-09-13T23:27:18.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.519+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62aa580 con 0x55b7f629ae20 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.520+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94248597361392] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.520+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.520+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94248597358912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62aa540 con 0x55b7f629ae20 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.520+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62ab020 con 0x55b7f62a4270 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.521+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.521+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94248597367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62ab8f0 con 0x55b7f62a4270 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.521+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62ac3d0 con 0x55b7f629f690 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.521+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94248597358912] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.522+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94248597367600] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.522+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.522+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94248597369920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62aa090 con 0x55b7f629f690 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.522+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62acc70 con 0x55b7f629ae20 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.523+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.523+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94248597374912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62acc20 con 0x55b7f629ae20 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.523+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94248597369920] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.523+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62adc20 con 0x7f7d88013070 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.524+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.525+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94248597372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62adbe0 con 0x7f7d88013070 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.525+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62ae630 con 0x7f7d88013070 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.525+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94248597374912] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.526+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94248597372640] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.526+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.526+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94248597381504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62adbe0 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.526+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62ae5a0 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94248597381504] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94248597378864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62aea50 con 0x7f7d88013070 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=0 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=1 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=2 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=3 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=4 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=5 2024-09-13T23:27:18.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.527+0000 7f7d90faf800 20 add_watcher() i=6 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94248597378864] v33'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d90faf800 20 add_watcher() i=7 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d90faf800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62b1eb0 con 0x55b7f629ae20 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.528+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94248597379920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62af3a0 con 0x55b7f629ae20 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.529+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94248597379920] v33'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.529+0000 7f7c457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 5 note: GC not initialized 2024-09-13T23:27:18.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7bbffff640 20 reqs_thread_entry: start 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 Filter name: none 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7bbdffb640 20 reqs_thread_entry: start 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 rados->read ofs=0 len=0 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e4dc0 con 0x55b7f629ae20 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.530+0000 7f7d90faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:could not fetch user info: no user info saved 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.531+0000 7f7c457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.531+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94248597379920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e4d80 con 0x55b7f629ae20 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.532+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94248597379920] v33'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.532+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94248597361392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x55b7f629f690 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.533+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94248597361392] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.533+0000 7f7d90faf800 20 remove_watcher() i=0 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.533+0000 7f7d90faf800 2 removed watcher, disabling cache 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.533+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94248597358912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x55b7f629ae20 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.535+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94248597358912] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.535+0000 7f7d90faf800 20 remove_watcher() i=1 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.535+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94248597367600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x55b7f62a4270 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.536+0000 7f7d8eaa3640 1 -- 172.21.15.99:0/3456105878 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94248597367600] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d80051070 con 0x55b7f62a4270 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.536+0000 7f7d90faf800 20 remove_watcher() i=2 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.536+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94248597369920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x55b7f629f690 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.537+0000 7f7d8f2a4640 1 -- 172.21.15.99:0/3456105878 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94248597369920] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d88027020 con 0x55b7f629f690 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.537+0000 7f7d90faf800 20 remove_watcher() i=3 2024-09-13T23:27:18.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.537+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94248597374912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x55b7f629ae20 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.538+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94248597374912] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x55b7f629ae20 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.538+0000 7f7d90faf800 20 remove_watcher() i=4 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.538+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94248597372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.539+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94248597372640] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.539+0000 7f7d90faf800 20 remove_watcher() i=5 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.539+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94248597381504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.540+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94248597381504] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.540+0000 7f7d90faf800 20 remove_watcher() i=6 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.540+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94248597378864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55b7f62e2bd0 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94248597378864] v33'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7d78029040 con 0x7f7d88013070 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 20 remove_watcher() i=7 2024-09-13T23:27:18.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d88013070 msgr2=0x7f7d8804b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7d88013070 0x7f7d8804b570 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f629ae20 msgr2=0x55b7f629d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f629ae20 0x55b7f629d2e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f629f690 msgr2=0x55b7f62a1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f629f690 0x55b7f62a1a80 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b7f62a4270 msgr2=0x55b7f62a6730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55b7f62a4270 0x55b7f62a6730 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c58036b90 msgr2=0x7f7c58039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c58036b90 0x7f7c58039050 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55b7f6267e80 tx=0x7f7d80088000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 msgr2=0x55b7f628f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 --2- 172.21.15.99:0/3456105878 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f6287eb0 0x55b7f628f2e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7d8804cf30 tx=0x7f7d8804cd40 comp rx=0 tx=0).stop 2024-09-13T23:27:18.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 reap_dead start 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d87fff640 1 -- 172.21.15.99:0/3456105878 reap_dead start 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 shutdown_connections 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 >> 172.21.15.99:0/3456105878 conn(0x55b7f6284210 msgr2=0x55b7f62822e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 shutdown_connections 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.541+0000 7f7d90faf800 1 -- 172.21.15.99:0/3456105878 wait complete. 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 msgr2=0x7f7c68039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 0x7f7c68039050 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55b7f62682e0 tx=0x7f7d80060ee0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 msgr2=0x55b7f627b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55b7f6261030 tx=0x7f7d880163e0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 shutdown_connections 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c68036b90 0x7f7c68039050 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/2577001602 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f627b1b0 0x55b7f627b5d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 >> 172.21.15.99:0/2577001602 conn(0x55b7f6270140 msgr2=0x55b7f6272cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 shutdown_connections 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/2577001602 wait complete. 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 msgr2=0x55b7f6267450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 0x55b7f6267450 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 msgr2=0x55b7f626c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 0x55b7f626c120 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 msgr2=0x7f7c74039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 0x7f7c74039050 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000f60 tx=0x7f7d780012b0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 msgr2=0x55b7f62603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x55b7f62598d0 tx=0x7f7d80002fb0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 shutdown_connections 2024-09-13T23:27:18.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b7f6269d30 0x55b7f626c120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b7f616cbd0 0x55b7f6267450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7c74036b90 0x7f7c74039050 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 --2- 172.21.15.99:0/394729852 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b7f60db5f0 0x55b7f62603e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 >> 172.21.15.99:0/394729852 conn(0x55b7f6161de0 msgr2=0x55b7f6252ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 shutdown_connections 2024-09-13T23:27:18.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.542+0000 7f7d90faf800 1 -- 172.21.15.99:0/394729852 wait complete. 2024-09-13T23:27:18.560 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T23:27:18.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:27:18.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T23:27:18.561 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T23:27:18.604 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.604 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.603+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.603+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe84940f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b71e4bf990 0x55b71e4c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe84940f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b71e37ab30 con 0x55b71e42f720 2024-09-13T23:27:18.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe84940f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55b71e35c360 con 0x55b71e4bf990 2024-09-13T23:27:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe83c32b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55b71e4bf990 0x55b71e4c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe844b2c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55b71e42f720 0x55b71e4be270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55170/0 (socket says 172.21.15.99:55170) 2024-09-13T23:27:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe844b2c640 1 -- 172.21.15.99:0/2047577689 learned_addr learned my addr 172.21.15.99:0/2047577689 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe83c32b640 1 -- 172.21.15.99:0/2047577689 >> v1:172.21.15.43:6789/0 conn(0x55b71e42f720 legacy=0x55b71e4be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.604+0000 7fe83c32b640 1 -- 172.21.15.99:0/2047577689 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e382e00 con 0x55b71e4bf990 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.606+0000 7fe83c32b640 1 --2- 172.21.15.99:0/2047577689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bf990 0x55b71e4c1d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00a470 tx=0x7fe82c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cf1cda37a434af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe83ffff640 1 -- 172.21.15.99:0/2047577689 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe82c053570 con 0x55b71e4bf990 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe83ffff640 1 -- 172.21.15.99:0/2047577689 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82c058070 con 0x55b71e4bf990 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe83ffff640 1 -- 172.21.15.99:0/2047577689 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe82c053880 con 0x55b71e4bf990 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 -- 172.21.15.99:0/2047577689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bf990 msgr2=0x55b71e4c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 --2- 172.21.15.99:0/2047577689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bf990 0x55b71e4c1d80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00a470 tx=0x7fe82c045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 -- 172.21.15.99:0/2047577689 shutdown_connections 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 --2- 172.21.15.99:0/2047577689 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bf990 0x55b71e4c1d80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 -- 172.21.15.99:0/2047577689 >> 172.21.15.99:0/2047577689 conn(0x55b71e4b5e20 msgr2=0x55b71e4b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 -- 172.21.15.99:0/2047577689 shutdown_connections 2024-09-13T23:27:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.607+0000 7fe84940f800 1 -- 172.21.15.99:0/2047577689 wait complete. 2024-09-13T23:27:18.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe84940f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe84940f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b71e407330 con 0x55b71e42f720 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56882/0 (socket says 172.21.15.99:56882) 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.621+0000 7fe844b2c640 1 -- 172.21.15.99:0/1274182267 learned_addr learned my addr 172.21.15.99:0/1274182267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.622+0000 7fe844b2c640 1 -- 172.21.15.99:0/1274182267 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e354bc0 con 0x55b71e42f720 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.622+0000 7fe844b2c640 1 --2- 172.21.15.99:0/1274182267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe834001e10 tx=0x7fe83400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfc4cf9b255a068 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.622+0000 7fe732e0d640 1 -- 172.21.15.99:0/1274182267 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe834012020 con 0x55b71e42f720 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.622+0000 7fe732e0d640 1 -- 172.21.15.99:0/1274182267 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83400e5a0 con 0x55b71e42f720 2024-09-13T23:27:18.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.622+0000 7fe732e0d640 1 -- 172.21.15.99:0/1274182267 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe83400e8e0 con 0x55b71e42f720 2024-09-13T23:27:18.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- 172.21.15.99:0/1274182267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 msgr2=0x55b71e5aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 --2- 172.21.15.99:0/1274182267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe834001e10 tx=0x7fe83400b780 comp rx=0 tx=0).stop 2024-09-13T23:27:18.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- 172.21.15.99:0/1274182267 shutdown_connections 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 --2- 172.21.15.99:0/1274182267 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5aa960 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- 172.21.15.99:0/1274182267 >> 172.21.15.99:0/1274182267 conn(0x55b71e4b5e20 msgr2=0x55b71e5a6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- 172.21.15.99:0/1274182267 shutdown_connections 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- 172.21.15.99:0/1274182267 wait complete. 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.623+0000 7fe84940f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b71e4c26b0 con 0x55b71e42f720 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56894/0 (socket says 172.21.15.99:56894) 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe844b2c640 1 -- 172.21.15.99:0/4038390707 learned_addr learned my addr 172.21.15.99:0/4038390707 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe844b2c640 1 -- 172.21.15.99:0/4038390707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e368fe0 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe844b2c640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe834004170 tx=0x7fe834000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe73160a640 1 -- 172.21.15.99:0/4038390707 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe834012030 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe73160a640 1 -- 172.21.15.99:0/4038390707 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834001470 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b71e5b2840 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe73160a640 1 -- 172.21.15.99:0/4038390707 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe83401a8d0 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.624+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b71e5b2d60 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe73160a640 1 -- 172.21.15.99:0/4038390707 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe834015020 con 0x55b71e42f720 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84940f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84940f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b71e356580 con 0x55b71e4bbcf0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe73160a640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 0x7fe72c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84532d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84532d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56902/0 (socket says 172.21.15.99:56902) 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe84532d640 1 -- 172.21.15.99:0/4247901313 learned_addr learned my addr 172.21.15.99:0/4247901313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe73160a640 1 -- 172.21.15.99:0/4038390707 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe834020030 con 0x55b71e42f720 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.625+0000 7fe844b2c640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 0x7fe72c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84532d640 1 -- 172.21.15.99:0/4247901313 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e4ba780 con 0x55b71e4bbcf0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe844b2c640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 0x7fe72c039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe83401a6f0 tx=0x7fe834024ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84532d640 1 --2- 172.21.15.99:0/4247901313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe84000a430 tx=0x7fe84000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf164e9246e3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe72affd640 1 -- 172.21.15.99:0/4247901313 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe840015070 con 0x55b71e4bbcf0 2024-09-13T23:27:18.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe72affd640 1 -- 172.21.15.99:0/4247901313 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe840001670 con 0x55b71e4bbcf0 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe72affd640 1 -- 172.21.15.99:0/4247901313 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe840001990 con 0x55b71e4bbcf0 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 -- 172.21.15.99:0/4247901313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 msgr2=0x55b71e4ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 --2- 172.21.15.99:0/4247901313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe84000a430 tx=0x7fe84000a8f0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 -- 172.21.15.99:0/4247901313 shutdown_connections 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 --2- 172.21.15.99:0/4247901313 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e4ba240 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 -- 172.21.15.99:0/4247901313 >> 172.21.15.99:0/4247901313 conn(0x55b71e4bf990 msgr2=0x55b71e5ba820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 -- 172.21.15.99:0/4247901313 shutdown_connections 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.626+0000 7fe84940f800 1 -- 172.21.15.99:0/4247901313 wait complete. 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84940f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84940f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b71e4baa70 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84532d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84532d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56904/0 (socket says 172.21.15.99:56904) 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84532d640 1 -- 172.21.15.99:0/4284774745 learned_addr learned my addr 172.21.15.99:0/4284774745 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.627+0000 7fe84532d640 1 -- 172.21.15.99:0/4284774745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e5c8e20 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe84532d640 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe84000a930 tx=0x7fe840003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe7297fa640 1 -- 172.21.15.99:0/4284774745 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe840020020 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe7297fa640 1 -- 172.21.15.99:0/4284774745 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8400108b0 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b71e5c90b0 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe7297fa640 1 -- 172.21.15.99:0/4284774745 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe840015040 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.628+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b71e5cbd60 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe7297fa640 1 -- 172.21.15.99:0/4284774745 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe840023020 con 0x55b71e4bbcf0 2024-09-13T23:27:18.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe7297fa640 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 0x7fe71c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe7297fa640 1 -- 172.21.15.99:0/4284774745 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe84004c1b0 con 0x55b71e4bbcf0 2024-09-13T23:27:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe83c32b640 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 0x7fe71c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe84940f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe84940f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.629+0000 7fe83c32b640 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 0x7fe71c039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe82c057000 tx=0x7fe82c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe84940f800 1 Processor -- start 2024-09-13T23:27:18.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe84940f800 1 -- start start 2024-09-13T23:27:18.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe84940f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe84940f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55b71e5ab110 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe844b2c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56908/0 (socket says 172.21.15.99:56908) 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe844b2c640 1 -- 172.21.15.99:0/944096268 learned_addr learned my addr 172.21.15.99:0/944096268 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.630+0000 7fe844b2c640 1 -- 172.21.15.99:0/944096268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b71e5e32c0 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe844b2c640 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe83401a6a0 tx=0x7fe834026da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe7097e2640 1 -- 172.21.15.99:0/944096268 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe83403f050 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe7097e2640 1 -- 172.21.15.99:0/944096268 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe834049070 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe7097e2640 1 -- 172.21.15.99:0/944096268 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe834035040 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b71e5e5f10 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.631+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b71e5e62f0 con 0x55b71e5e28d0 2024-09-13T23:27:18.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe7097e2640 1 -- 172.21.15.99:0/944096268 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe83400d3d0 con 0x55b71e5e28d0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe7097e2640 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 0x7fe67c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe7097e2640 1 -- 172.21.15.99:0/944096268 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe83400f070 con 0x55b71e5e28d0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe83c32b640 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 0x7fe67c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe692ffd640 20 reqs_thread_entry: start 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe83c32b640 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 0x7fe67c038f60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55b71e42ee60 tx=0x7fe82c005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 0x55b71e5f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b71e5f2db0 con 0x55b71e5f02d0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.632+0000 7fe84532d640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 0x55b71e5f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe84532d640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 0x55b71e5f26e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe84532d640 1 -- 172.21.15.99:0/4038390707 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe84000e070 con 0x55b71e5f02d0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 0x55b71e5f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:2 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55b71e5f7610 con 0x55b71e5f4b80 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe844b2c640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 0x55b71e5f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.633+0000 7fe844b2c640 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 0x55b71e5f6f70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe844b2c640 1 -- 172.21.15.99:0/4038390707 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(2 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe834042070 con 0x55b71e5f4b80 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 msgr2=0x7fe71c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 0x7fe71c039000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe82c057000 tx=0x7fe82c052000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 msgr2=0x55b71e5c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe84000a930 tx=0x7fe840003370 comp rx=0 tx=0).stop 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 shutdown_connections 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe71c036b40 0x7fe71c039000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 --2- 172.21.15.99:0/4284774745 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e4bbcf0 0x55b71e5c88e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 >> 172.21.15.99:0/4284774745 conn(0x55b71e4bf990 msgr2=0x55b71e5bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 shutdown_connections 2024-09-13T23:27:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.634+0000 7fe84940f800 1 -- 172.21.15.99:0/4284774745 wait complete. 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 msgr2=0x7fe67c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 0x7fe67c038f60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55b71e42ee60 tx=0x7fe82c005a00 comp rx=0 tx=0).stop 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 msgr2=0x55b71e5e2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fe83401a6a0 tx=0x7fe834026da0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 shutdown_connections 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe67c036aa0 0x7fe67c038f60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/944096268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e5e28d0 0x55b71e5e2cf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 >> 172.21.15.99:0/944096268 conn(0x55b71e5d77b0 msgr2=0x55b71e5da0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 shutdown_connections 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/944096268 wait complete. 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 msgr2=0x55b71e5f26e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 0x55b71e5f26e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 msgr2=0x55b71e5f6f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 0x55b71e5f6f70 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 msgr2=0x7fe72c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 0x7fe72c039000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe83401a6f0 tx=0x7fe834024ec0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 msgr2=0x55b71e5b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe834004170 tx=0x7fe834000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 shutdown_connections 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55b71e5f4b80 0x55b71e5f6f70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55b71e5f02d0 0x55b71e5f26e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe72c036b40 0x7fe72c039000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 --2- 172.21.15.99:0/4038390707 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55b71e42f720 0x55b71e5b2300 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 >> 172.21.15.99:0/4038390707 conn(0x55b71e4b5e20 msgr2=0x55b71e5a4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 shutdown_connections 2024-09-13T23:27:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.635+0000 7fe84940f800 1 -- 172.21.15.99:0/4038390707 wait complete. 2024-09-13T23:27:18.648 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:27:18.648 DEBUG:tasks.util.rgw: json result: {'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:27:18.648 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T23:27:18.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T23:27:18.649 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T23:27:18.730 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.730 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefd0810800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5585f46ae4b0 0x5585f46ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefd0810800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5585f456eb30 con 0x5585f46aedf0 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefd0810800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5585f4550360 con 0x5585f46ae4b0 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefcbfc6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5585f46ae4b0 0x5585f46ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefc3fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5585f46aedf0 0x5585f46b3970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55180/0 (socket says 172.21.15.99:55180) 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.730+0000 7fefc3fff640 1 -- 172.21.15.99:0/602910477 learned_addr learned my addr 172.21.15.99:0/602910477 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.731+0000 7fefcbfc6640 1 -- 172.21.15.99:0/602910477 >> v1:172.21.15.43:6789/0 conn(0x5585f46aedf0 legacy=0x5585f46b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.731+0000 7fefcbfc6640 1 -- 172.21.15.99:0/602910477 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f4576e00 con 0x5585f46ae4b0 2024-09-13T23:27:18.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.732+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/602910477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f46ae8b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00a470 tx=0x7fefbc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f503807b9f7265 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.732+0000 7fefcb7c5640 1 -- 172.21.15.99:0/602910477 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc053570 con 0x5585f46ae4b0 2024-09-13T23:27:18.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefcb7c5640 1 -- 172.21.15.99:0/602910477 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc058070 con 0x5585f46ae4b0 2024-09-13T23:27:18.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefcb7c5640 1 -- 172.21.15.99:0/602910477 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc053880 con 0x5585f46ae4b0 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 -- 172.21.15.99:0/602910477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 msgr2=0x5585f46ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 --2- 172.21.15.99:0/602910477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f46ae8b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00a470 tx=0x7fefbc045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 -- 172.21.15.99:0/602910477 shutdown_connections 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 --2- 172.21.15.99:0/602910477 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f46ae8b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 -- 172.21.15.99:0/602910477 >> 172.21.15.99:0/602910477 conn(0x5585f46a9de0 msgr2=0x5585f46ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 -- 172.21.15.99:0/602910477 shutdown_connections 2024-09-13T23:27:18.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.733+0000 7fefd0810800 1 -- 172.21.15.99:0/602910477 wait complete. 2024-09-13T23:27:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefd0810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefd0810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585f45fb320 con 0x5585f46ae4b0 2024-09-13T23:27:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56928/0 (socket says 172.21.15.99:56928) 2024-09-13T23:27:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefcbfc6640 1 -- 172.21.15.99:0/1491887464 learned_addr learned my addr 172.21.15.99:0/1491887464 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.747+0000 7fefcbfc6640 1 -- 172.21.15.99:0/1491887464 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f4548bc0 con 0x5585f46ae4b0 2024-09-13T23:27:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/1491887464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fefbc025c20 tx=0x7fefbc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732531b951340a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7feeb9e0b640 1 -- 172.21.15.99:0/1491887464 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc05c580 con 0x5585f46ae4b0 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7feeb9e0b640 1 -- 172.21.15.99:0/1491887464 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc063030 con 0x5585f46ae4b0 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7feeb9e0b640 1 -- 172.21.15.99:0/1491887464 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc05c850 con 0x5585f46ae4b0 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefd0810800 1 -- 172.21.15.99:0/1491887464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 msgr2=0x5585f479c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefd0810800 1 --2- 172.21.15.99:0/1491887464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fefbc025c20 tx=0x7fefbc051000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefd0810800 1 -- 172.21.15.99:0/1491887464 shutdown_connections 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefd0810800 1 --2- 172.21.15.99:0/1491887464 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f479c660 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.748+0000 7fefd0810800 1 -- 172.21.15.99:0/1491887464 >> 172.21.15.99:0/1491887464 conn(0x5585f46a9de0 msgr2=0x5585f4798020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 -- 172.21.15.99:0/1491887464 shutdown_connections 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 -- 172.21.15.99:0/1491887464 wait complete. 2024-09-13T23:27:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefd0810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585f46b54d0 con 0x5585f46ae4b0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56930/0 (socket says 172.21.15.99:56930) 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 learned_addr learned my addr 172.21.15.99:0/341118579 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.749+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f455cfe0 con 0x5585f46ae4b0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5585f479d4c0 tx=0x7fefbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7feeb3fff640 1 -- 172.21.15.99:0/341118579 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc054ad0 con 0x5585f46ae4b0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7feeb3fff640 1 -- 172.21.15.99:0/341118579 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc054c70 con 0x5585f46ae4b0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7feeb3fff640 1 -- 172.21.15.99:0/341118579 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc068420 con 0x5585f46ae4b0 2024-09-13T23:27:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585f47a4500 con 0x5585f46ae4b0 2024-09-13T23:27:18.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585f47a4a20 con 0x5585f46ae4b0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.750+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefd0810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefd0810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585f454a580 con 0x5585f47b0da0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7feeb3fff640 1 -- 172.21.15.99:0/341118579 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fefbc0685c0 con 0x5585f46ae4b0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcc7c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7feeb3fff640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb4036b40 0x7feeb4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcc7c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56934/0 (socket says 172.21.15.99:56934) 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcc7c7640 1 -- 172.21.15.99:0/4276840386 learned_addr learned my addr 172.21.15.99:0/4276840386 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7feeb3fff640 1 -- 172.21.15.99:0/341118579 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fefbc070030 con 0x5585f46ae4b0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb4036b40 0x7feeb4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcc7c7640 1 -- 172.21.15.99:0/4276840386 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f47b16e0 con 0x5585f47b0da0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/4276840386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fefc400a430 tx=0x7fefc400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ad1acea0f93bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb4036b40 0x7feeb4039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fefbc08f110 tx=0x7fefbc0744a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.751+0000 7feeb1ffb640 1 -- 172.21.15.99:0/4276840386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4015070 con 0x5585f47b0da0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7feeb1ffb640 1 -- 172.21.15.99:0/4276840386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc4001670 con 0x5585f47b0da0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7feeb1ffb640 1 -- 172.21.15.99:0/4276840386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4001990 con 0x5585f47b0da0 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- 172.21.15.99:0/4276840386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 msgr2=0x5585f47b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 --2- 172.21.15.99:0/4276840386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fefc400a430 tx=0x7fefc400a8f0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- 172.21.15.99:0/4276840386 shutdown_connections 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 --2- 172.21.15.99:0/4276840386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b11a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- 172.21.15.99:0/4276840386 >> 172.21.15.99:0/4276840386 conn(0x5585f46aedf0 msgr2=0x5585f47ac520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- 172.21.15.99:0/4276840386 shutdown_connections 2024-09-13T23:27:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- 172.21.15.99:0/4276840386 wait complete. 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.752+0000 7fefd0810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585f47b2090 con 0x5585f47b0da0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefcc7c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefcc7c7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56938/0 (socket says 172.21.15.99:56938) 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefcc7c7640 1 -- 172.21.15.99:0/1135163578 learned_addr learned my addr 172.21.15.99:0/1135163578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefcc7c7640 1 -- 172.21.15.99:0/1135163578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f47b88e0 con 0x5585f47b0da0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fefc400a930 tx=0x7fefc4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7feeabfff640 1 -- 172.21.15.99:0/1135163578 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4020020 con 0x5585f47b0da0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7feeabfff640 1 -- 172.21.15.99:0/1135163578 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc40108b0 con 0x5585f47b0da0 2024-09-13T23:27:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7feeabfff640 1 -- 172.21.15.99:0/1135163578 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefc4015040 con 0x5585f47b0da0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585f47b8b70 con 0x5585f47b0da0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.753+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585f47bb820 con 0x5585f47b0da0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.754+0000 7feeabfff640 1 -- 172.21.15.99:0/1135163578 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fefc4023020 con 0x5585f47b0da0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.754+0000 7feeabfff640 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 0x7feea4039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.754+0000 7feeabfff640 1 -- 172.21.15.99:0/1135163578 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fefc404c240 con 0x5585f47b0da0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.754+0000 7fefc3fff640 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 0x7feea4039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefc3fff640 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 0x7feea4039050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fefb4000f60 tx=0x7fefb4001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 1 Processor -- start 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 1 -- start start 2024-09-13T23:27:18.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.755+0000 7fefd0810800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5585f479cdb0 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefcbfc6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56948/0 (socket says 172.21.15.99:56948) 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefcbfc6640 1 -- 172.21.15.99:0/1257148072 learned_addr learned my addr 172.21.15.99:0/1257148072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefcbfc6640 1 -- 172.21.15.99:0/1257148072 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585f47d2da0 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0547e0 tx=0x7fefbc05e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fee90fe1640 1 -- 172.21.15.99:0/1257148072 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc07d520 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fee90fe1640 1 -- 172.21.15.99:0/1257148072 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc094070 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fee90fe1640 1 -- 172.21.15.99:0/1257148072 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefbc07d7f0 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.756+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5585f47d59f0 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.757+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585f47d5dd0 con 0x5585f47d23b0 2024-09-13T23:27:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.757+0000 7fee90fe1640 1 -- 172.21.15.99:0/1257148072 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fefbc086070 con 0x5585f47d23b0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.757+0000 7fee90fe1640 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 0x7fee04039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.757+0000 7fee90fe1640 1 -- 172.21.15.99:0/1257148072 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fefbc08d0c0 con 0x5585f47d23b0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.757+0000 7fefc3fff640 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 0x7fee04039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fee89ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefc3fff640 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 0x7fee04039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001ed0 tx=0x7fefb400f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5585f47dfdb0 0x5585f47e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47e27b0 con 0x5585f47dfdb0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5585f47dfdb0 0x5585f47e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5585f47dfdb0 0x5585f47e21a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.758+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47e3090 con 0x5585f47dfdb0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5585f47e49a0 0x5585f47e6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47e7520 con 0x5585f47e49a0 2024-09-13T23:27:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5585f47e49a0 0x5585f47e6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5585f47e49a0 0x5585f47e6e30 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.759+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47f4660 con 0x5585f47dfdb0 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:NOTICE: set zone's realm_id= 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5585f47eba20 0x5585f47ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefc3fff640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5585f47eba20 0x5585f47ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefc3fff640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5585f47eba20 0x5585f47ee950 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(5 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.760+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.761+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.761+0000 7fefcbfc6640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fefbc089040 0x7fefbc0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.761+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.761+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fefbc089040 0x7fefbc0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.761+0000 7fefcc7c7640 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fefbc089040 0x7fefbc0ae7d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.762+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(12 [pgnls start_epoch 33 out=107b] v31'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(13 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.763+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(17 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.764+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(18 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.765+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=74b] v24'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(25 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.766+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.767+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47eba20 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb4009050 con 0x5585f47eba20 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.768+0000 7fefc3fff640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x7fefbc089040 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefc4010d70 con 0x7fefbc089040 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47dfdb0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(35 [pgnls start_epoch 33 out=115b] v24'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ee4d0 con 0x5585f47e49a0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(36 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47f2530 con 0x5585f47dfdb0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.769+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:38 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5585f47e3cb0 con 0x5585f47e49a0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.770+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(38 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.770+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:39 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585f47edd60 con 0x5585f47e49a0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.771+0000 7fefcbfc6640 1 -- 172.21.15.99:0/341118579 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(39 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [create,call,writefull 0~1155] v33'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fefbc085030 con 0x5585f47e49a0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.771+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585f47efb00 con 0x5585f47dfdb0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.772+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v33'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.772+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5585f47ed020 con 0x5585f47dfdb0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.773+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v33'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fefc4010d70 con 0x5585f47dfdb0 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 msgr2=0x7feea4039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 0x7feea4039050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fefb4000f60 tx=0x7fefb4001230 comp rx=0 tx=0).stop 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 msgr2=0x5585f47b83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fefc400a930 tx=0x7fefc4003370 comp rx=0 tx=0).stop 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 shutdown_connections 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feea4036b90 0x7feea4039050 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1135163578 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47b0da0 0x5585f47b83a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 >> 172.21.15.99:0/1135163578 conn(0x5585f46aedf0 msgr2=0x5585f47ac0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 shutdown_connections 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1135163578 wait complete. 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 msgr2=0x7fee04039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 0x7fee04039050 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fefb4001ed0 tx=0x7fefb400f000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 msgr2=0x5585f47d27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0547e0 tx=0x7fefbc05e9d0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 shutdown_connections 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fee04036b90 0x7fee04039050 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 --2- 172.21.15.99:0/1257148072 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f47d23b0 0x5585f47d27d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 >> 172.21.15.99:0/1257148072 conn(0x5585f47c72f0 msgr2=0x5585f47c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 shutdown_connections 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.774+0000 7fefd0810800 1 -- 172.21.15.99:0/1257148072 wait complete. 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fefbc089040 msgr2=0x7fefbc0ae7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fefbc089040 0x7fefbc0ae7d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5585f47dfdb0 msgr2=0x5585f47e21a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5585f47dfdb0 0x5585f47e21a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5585f47e49a0 msgr2=0x5585f47e6e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5585f47e49a0 0x5585f47e6e30 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5585f47eba20 msgr2=0x5585f47ee950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5585f47eba20 0x5585f47ee950 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb4036b40 msgr2=0x7feeb4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7feeb4036b40 0x7feeb4039000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fefbc08f110 tx=0x7fefbc0744a0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 msgr2=0x5585f47a3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x5585f479d4c0 tx=0x7fefbc002fb0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefcc7c7640 1 -- 172.21.15.99:0/341118579 reap_dead start 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 shutdown_connections 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 --2- 172.21.15.99:0/341118579 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5585f46ae4b0 0x5585f47a3fc0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 >> 172.21.15.99:0/341118579 conn(0x5585f46a9de0 msgr2=0x5585f47968d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 shutdown_connections 2024-09-13T23:27:18.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.775+0000 7fefd0810800 1 -- 172.21.15.99:0/341118579 wait complete. 2024-09-13T23:27:18.788 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T23:27:18.788 DEBUG:tasks.util.rgw: json result: {'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T23:27:18.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T23:27:18.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T23:27:18.789 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T23:27:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:18.870 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.869+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91bcf26800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56383821b8f0 0x56383821dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91bcf26800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638380d7b30 con 0x5638382174b0 2024-09-13T23:27:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91bcf26800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5638380b9360 con 0x56383821b8f0 2024-09-13T23:27:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91b0312640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x56383821b8f0 0x56383821dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91b8b13640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5638382174b0 0x5638382178b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55190/0 (socket says 172.21.15.99:55190) 2024-09-13T23:27:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91b8b13640 1 -- 172.21.15.99:0/3261941738 learned_addr learned my addr 172.21.15.99:0/3261941738 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91b0312640 1 -- 172.21.15.99:0/3261941738 >> v1:172.21.15.43:6789/0 conn(0x5638382174b0 legacy=0x5638382178b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.870+0000 7f91b0312640 1 -- 172.21.15.99:0/3261941738 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638380dfe00 con 0x56383821b8f0 2024-09-13T23:27:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.872+0000 7f91b0312640 1 --2- 172.21.15.99:0/3261941738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383821b8f0 0x56383821dce0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f91a000a470 tx=0x7f91a0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf0b0173daf4b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.872+0000 7f91b3fff640 1 -- 172.21.15.99:0/3261941738 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a0053570 con 0x56383821b8f0 2024-09-13T23:27:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.872+0000 7f91b3fff640 1 -- 172.21.15.99:0/3261941738 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a0058070 con 0x56383821b8f0 2024-09-13T23:27:18.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.872+0000 7f91b3fff640 1 -- 172.21.15.99:0/3261941738 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a0053880 con 0x56383821b8f0 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 -- 172.21.15.99:0/3261941738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383821b8f0 msgr2=0x56383821dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3261941738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383821b8f0 0x56383821dce0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f91a000a470 tx=0x7f91a0045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 -- 172.21.15.99:0/3261941738 shutdown_connections 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3261941738 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383821b8f0 0x56383821dce0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 -- 172.21.15.99:0/3261941738 >> 172.21.15.99:0/3261941738 conn(0x563838212de0 msgr2=0x563838215200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 -- 172.21.15.99:0/3261941738 shutdown_connections 2024-09-13T23:27:18.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.873+0000 7f91bcf26800 1 -- 172.21.15.99:0/3261941738 wait complete. 2024-09-13T23:27:18.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91bcf26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91bcf26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563838164320 con 0x5638382174b0 2024-09-13T23:27:18.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56972/0 (socket says 172.21.15.99:56972) 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.887+0000 7f91b8b13640 1 -- 172.21.15.99:0/3556449169 learned_addr learned my addr 172.21.15.99:0/3556449169 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.888+0000 7f91b8b13640 1 -- 172.21.15.99:0/3556449169 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638380b1bc0 con 0x5638382174b0 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.888+0000 7f91b8b13640 1 --2- 172.21.15.99:0/3556449169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001e10 tx=0x7f91a800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4395432ceb0c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.888+0000 7f90a6e0d640 1 -- 172.21.15.99:0/3556449169 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a8012020 con 0x5638382174b0 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.888+0000 7f90a6e0d640 1 -- 172.21.15.99:0/3556449169 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a800e5a0 con 0x5638382174b0 2024-09-13T23:27:18.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.888+0000 7f90a6e0d640 1 -- 172.21.15.99:0/3556449169 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a800e8e0 con 0x5638382174b0 2024-09-13T23:27:18.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- 172.21.15.99:0/3556449169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 msgr2=0x563838303600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3556449169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f91a8001e10 tx=0x7f91a800b780 comp rx=0 tx=0).stop 2024-09-13T23:27:18.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- 172.21.15.99:0/3556449169 shutdown_connections 2024-09-13T23:27:18.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3556449169 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838303600 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- 172.21.15.99:0/3556449169 >> 172.21.15.99:0/3556449169 conn(0x563838212de0 msgr2=0x563838305c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- 172.21.15.99:0/3556449169 shutdown_connections 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- 172.21.15.99:0/3556449169 wait complete. 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91bcf26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56383821e520 con 0x5638382174b0 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56982/0 (socket says 172.21.15.99:56982) 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.889+0000 7f91b8b13640 1 -- 172.21.15.99:0/2459382695 learned_addr learned my addr 172.21.15.99:0/2459382695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f91b8b13640 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638380c5fe0 con 0x5638382174b0 2024-09-13T23:27:18.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f91b8b13640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f91a800b7c0 tx=0x7f91a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f90a560a640 1 -- 172.21.15.99:0/2459382695 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a8012030 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f90a560a640 1 -- 172.21.15.99:0/2459382695 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8001470 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f90a560a640 1 -- 172.21.15.99:0/2459382695 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a801a8d0 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563838311980 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.890+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563838311ea0 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91bcf26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91bcf26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5638380b3580 con 0x56383831e1e0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f90a560a640 1 -- 172.21.15.99:0/2459382695 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91a8015020 con 0x5638382174b0 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f90a560a640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 0x7f90a0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f90a560a640 1 -- 172.21.15.99:0/2459382695 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f91a8020030 con 0x5638382174b0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91b9314640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91b8b13640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 0x7f90a0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91b9314640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:56990/0 (socket says 172.21.15.99:56990) 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.891+0000 7f91b9314640 1 -- 172.21.15.99:0/1361381895 learned_addr learned my addr 172.21.15.99:0/1361381895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91b9314640 1 -- 172.21.15.99:0/1361381895 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383831eb20 con 0x56383831e1e0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91b8b13640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 0x7f90a0039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91a8016fd0 tx=0x7f91a801acd0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91b9314640 1 --2- 172.21.15.99:0/1361381895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f91b400a430 tx=0x7f91b400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dbe8f231c78d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f909effd640 1 -- 172.21.15.99:0/1361381895 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4015070 con 0x56383831e1e0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f909effd640 1 -- 172.21.15.99:0/1361381895 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b4001670 con 0x56383831e1e0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f909effd640 1 -- 172.21.15.99:0/1361381895 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4001990 con 0x56383831e1e0 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 -- 172.21.15.99:0/1361381895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 msgr2=0x56383831e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 --2- 172.21.15.99:0/1361381895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f91b400a430 tx=0x7f91b400a8f0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 -- 172.21.15.99:0/1361381895 shutdown_connections 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 --2- 172.21.15.99:0/1361381895 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x56383831e5e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 -- 172.21.15.99:0/1361381895 >> 172.21.15.99:0/1361381895 conn(0x56383821b8f0 msgr2=0x563838319960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 -- 172.21.15.99:0/1361381895 shutdown_connections 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.892+0000 7f91bcf26800 1 -- 172.21.15.99:0/1361381895 wait complete. 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91bcf26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91bcf26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x56383831f4d0 con 0x56383831e1e0 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91b9314640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91b9314640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57004/0 (socket says 172.21.15.99:57004) 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91b9314640 1 -- 172.21.15.99:0/4060353103 learned_addr learned my addr 172.21.15.99:0/4060353103 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91b9314640 1 -- 172.21.15.99:0/4060353103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563838325cc0 con 0x56383831e1e0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.893+0000 7f91b9314640 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f91b4013040 tx=0x7f91b4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f909d7fa640 1 -- 172.21.15.99:0/4060353103 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4020020 con 0x56383831e1e0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f909d7fa640 1 -- 172.21.15.99:0/4060353103 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b40108e0 con 0x56383831e1e0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563838325f50 con 0x56383831e1e0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f909d7fa640 1 -- 172.21.15.99:0/4060353103 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91b4015040 con 0x56383831e1e0 2024-09-13T23:27:18.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563838328c00 con 0x56383831e1e0 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.894+0000 7f909d7fa640 1 -- 172.21.15.99:0/4060353103 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91b4023020 con 0x56383831e1e0 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f909d7fa640 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 0x7f9090039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f909d7fa640 1 -- 172.21.15.99:0/4060353103 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f91b404c300 con 0x56383831e1e0 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91b0312640 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 0x7f9090039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91bcf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91bcf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91bcf26800 1 Processor -- start 2024-09-13T23:27:18.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91b0312640 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 0x7f9090039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91a0057000 tx=0x7f91a0052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.895+0000 7f91bcf26800 1 -- start start 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91bcf26800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91bcf26800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x563838301d60 con 0x56383833f710 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91b8b13640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57018/0 (socket says 172.21.15.99:57018) 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91b8b13640 1 -- 172.21.15.99:0/3378153621 learned_addr learned my addr 172.21.15.99:0/3378153621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91b8b13640 1 -- 172.21.15.99:0/3378153621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563838340100 con 0x56383833f710 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.896+0000 7f91b8b13640 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f91a8016570 tx=0x7f91a802d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f907dfe3640 1 -- 172.21.15.99:0/3378153621 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a804a070 con 0x56383833f710 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f907dfe3640 1 -- 172.21.15.99:0/3378153621 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8018ad0 con 0x56383833f710 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f907dfe3640 1 -- 172.21.15.99:0/3378153621 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91a800d500 con 0x56383833f710 2024-09-13T23:27:18.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563838342d50 con 0x56383833f710 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563838343130 con 0x56383833f710 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f907dfe3640 1 -- 172.21.15.99:0/3378153621 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f91a80248b0 con 0x56383833f710 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.897+0000 7f907dfe3640 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 0x7f8ff0039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f907dfe3640 1 -- 172.21.15.99:0/3378153621 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f91a8035040 con 0x56383833f710 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91b0312640 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 0x7f8ff0039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f90777fe640 20 reqs_thread_entry: start 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91b0312640 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 0x7f8ff0039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5638382182b0 tx=0x7f91a0005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 0x56383834f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x56383834fbc0 con 0x56383834d170 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91b9314640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 0x56383834f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.898+0000 7f91b9314640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 0x56383834f560 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91b9314640 1 -- 172.21.15.99:0/2459382695 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f91b400e070 con 0x56383834d170 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5638383504a0 con 0x56383834d170 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91b9314640 1 -- 172.21.15.99:0/2459382695 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f91b400e070 con 0x56383834d170 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 0x563838354220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x563838354910 con 0x563838351db0 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91b8b13640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 0x563838354220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.899+0000 7f91b8b13640 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 0x563838354220 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91b8b13640 1 -- 172.21.15.99:0/2459382695 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f91a8043070 con 0x563838351db0 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 msgr2=0x7f9090039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 0x7f9090039000 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f91a0057000 tx=0x7f91a0052000 comp rx=0 tx=0).stop 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 msgr2=0x563838325780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f91b4013040 tx=0x7f91b4003370 comp rx=0 tx=0).stop 2024-09-13T23:27:18.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 shutdown_connections 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9090036b40 0x7f9090039000 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 --2- 172.21.15.99:0/4060353103 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383831e1e0 0x563838325780 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 >> 172.21.15.99:0/4060353103 conn(0x56383821b8f0 msgr2=0x563838319530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.900+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 shutdown_connections 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/4060353103 wait complete. 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 msgr2=0x7f8ff0039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 0x7f8ff0039050 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x5638382182b0 tx=0x7f91a0005a00 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 msgr2=0x56383833fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f91a8016570 tx=0x7f91a802d7c0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 shutdown_connections 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8ff0036b90 0x7f8ff0039050 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/3378153621 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x56383833f710 0x56383833fb30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 >> 172.21.15.99:0/3378153621 conn(0x563838334640 msgr2=0x563838336f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 shutdown_connections 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/3378153621 wait complete. 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 msgr2=0x56383834f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 0x56383834f560 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 msgr2=0x563838354220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 0x563838354220 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 msgr2=0x7f90a0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 0x7f90a0039000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f91a8016fd0 tx=0x7f91a801acd0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 msgr2=0x563838311440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f91a800b7c0 tx=0x7f91a8000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 shutdown_connections 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x563838351db0 0x563838354220 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x56383834d170 0x56383834f560 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f90a0036b40 0x7f90a0039000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 --2- 172.21.15.99:0/2459382695 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5638382174b0 0x563838311440 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:18.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 >> 172.21.15.99:0/2459382695 conn(0x563838212de0 msgr2=0x5638383009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:18.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 shutdown_connections 2024-09-13T23:27:18.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:18.901+0000 7f91bcf26800 1 -- 172.21.15.99:0/2459382695 wait complete. 2024-09-13T23:27:18.913 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T23:27:18.913 DEBUG:tasks.util.rgw: json result: {'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T23:27:18.913 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:27:18.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T23:27:18.913 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T23:27:19.001 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.001 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4d4bb800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5652a105c990 0x5652a105ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4d4bb800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5652a0f18b30 con 0x5652a1058550 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4d4bb800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5652a0efa360 con 0x5652a105c990 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4a7ae640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5652a105c990 0x5652a105ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4afaf640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5652a1058550 0x5652a1058950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55202/0 (socket says 172.21.15.99:55202) 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.001+0000 7f1f4afaf640 1 -- 172.21.15.99:0/1067496091 learned_addr learned my addr 172.21.15.99:0/1067496091 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.002+0000 7f1f4a7ae640 1 -- 172.21.15.99:0/1067496091 >> v1:172.21.15.43:6789/0 conn(0x5652a1058550 legacy=0x5652a1058950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.002+0000 7f1f4a7ae640 1 -- 172.21.15.99:0/1067496091 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a0f20e00 con 0x5652a105c990 2024-09-13T23:27:19.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.003+0000 7f1f4a7ae640 1 --2- 172.21.15.99:0/1067496091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a105c990 0x5652a105ed80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a470 tx=0x7f1f34045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ce44bb7ccd2c3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f49fad640 1 -- 172.21.15.99:0/1067496091 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f34053570 con 0x5652a105c990 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f49fad640 1 -- 172.21.15.99:0/1067496091 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f34058070 con 0x5652a105c990 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f49fad640 1 -- 172.21.15.99:0/1067496091 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f34053880 con 0x5652a105c990 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/1067496091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a105c990 msgr2=0x5652a105ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/1067496091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a105c990 0x5652a105ed80 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400a470 tx=0x7f1f34045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/1067496091 shutdown_connections 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/1067496091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a105c990 0x5652a105ed80 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/1067496091 >> 172.21.15.99:0/1067496091 conn(0x5652a1053e40 msgr2=0x5652a1056260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/1067496091 shutdown_connections 2024-09-13T23:27:19.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.004+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/1067496091 wait complete. 2024-09-13T23:27:19.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4d4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4d4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5652a0fa5350 con 0x5652a1058550 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57038/0 (socket says 172.21.15.99:57038) 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.018+0000 7f1f4afaf640 1 -- 172.21.15.99:0/3205669657 learned_addr learned my addr 172.21.15.99:0/3205669657 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.019+0000 7f1f4afaf640 1 -- 172.21.15.99:0/3205669657 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a0ef2bc0 con 0x5652a1058550 2024-09-13T23:27:19.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.019+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/3205669657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001d80 tx=0x7f1f3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b705aeb3500d2350 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.019+0000 7f1e38e09640 1 -- 172.21.15.99:0/3205669657 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c013030 con 0x5652a1058550 2024-09-13T23:27:19.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.019+0000 7f1e38e09640 1 -- 172.21.15.99:0/3205669657 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c00e470 con 0x5652a1058550 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.019+0000 7f1e38e09640 1 -- 172.21.15.99:0/3205669657 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c00e810 con 0x5652a1058550 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/3205669657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 msgr2=0x5652a0fcce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/3205669657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001d80 tx=0x7f1f3c001e70 comp rx=0 tx=0).stop 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/3205669657 shutdown_connections 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/3205669657 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a0fcce90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/3205669657 >> 172.21.15.99:0/3205669657 conn(0x5652a1053e40 msgr2=0x5652a1143210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/3205669657 shutdown_connections 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/3205669657 wait complete. 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4d4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5652a105f5c0 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57048/0 (socket says 172.21.15.99:57048) 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.020+0000 7f1f4afaf640 1 -- 172.21.15.99:0/2063866627 learned_addr learned my addr 172.21.15.99:0/2063866627 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1f4afaf640 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a0f06fe0 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c004000 tx=0x7f1f3c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1e37606640 1 -- 172.21.15.99:0/2063866627 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c027070 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1e37606640 1 -- 172.21.15.99:0/2063866627 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c019900 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1e37606640 1 -- 172.21.15.99:0/2063866627 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c019c60 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652a1152ab0 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.021+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652a1152fd0 con 0x5652a1058550 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4d4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4d4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5652a0ef4580 con 0x5652a115f310 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1e37606640 1 -- 172.21.15.99:0/2063866627 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1f3c02a070 con 0x5652a1058550 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4b7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1e37606640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 0x7f1e30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4b7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57064/0 (socket says 172.21.15.99:57064) 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4b7b0640 1 -- 172.21.15.99:0/2374812499 learned_addr learned my addr 172.21.15.99:0/2374812499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1e37606640 1 -- 172.21.15.99:0/2063866627 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f1f3c01f070 con 0x5652a1058550 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.022+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 0x7f1e30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1f4b7b0640 1 -- 172.21.15.99:0/2374812499 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a115fc50 con 0x5652a115f310 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 0x7f1e30039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00efd0 tx=0x7f1f3c017450 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1f4b7b0640 1 --2- 172.21.15.99:0/2374812499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400a430 tx=0x7f1f4400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d945380e39b50f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1e35602640 1 -- 172.21.15.99:0/2374812499 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f44015070 con 0x5652a115f310 2024-09-13T23:27:19.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1e35602640 1 -- 172.21.15.99:0/2374812499 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44001670 con 0x5652a115f310 2024-09-13T23:27:19.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1e35602640 1 -- 172.21.15.99:0/2374812499 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f44001990 con 0x5652a115f310 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2374812499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 msgr2=0x5652a115f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.023+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2374812499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400a430 tx=0x7f1f4400a8f0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2374812499 shutdown_connections 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2374812499 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a115f710 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2374812499 >> 172.21.15.99:0/2374812499 conn(0x5652a105c990 msgr2=0x5652a115aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2374812499 shutdown_connections 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2374812499 wait complete. 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4d4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5652a1160600 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4b7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4b7b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57080/0 (socket says 172.21.15.99:57080) 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.024+0000 7f1f4b7b0640 1 -- 172.21.15.99:0/2465372388 learned_addr learned my addr 172.21.15.99:0/2465372388 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1f4b7b0640 1 -- 172.21.15.99:0/2465372388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a1166e50 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1f4b7b0640 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400a930 tx=0x7f1f44003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1e2f7fe640 1 -- 172.21.15.99:0/2465372388 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f44020020 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652a11670e0 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1e2f7fe640 1 -- 172.21.15.99:0/2465372388 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f440108b0 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652a1169d90 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.025+0000 7f1e2f7fe640 1 -- 172.21.15.99:0/2465372388 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f44015040 con 0x5652a115f310 2024-09-13T23:27:19.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.026+0000 7f1e2f7fe640 1 -- 172.21.15.99:0/2465372388 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1f44023020 con 0x5652a115f310 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.026+0000 7f1e2f7fe640 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 0x7f1e24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.026+0000 7f1e2f7fe640 1 -- 172.21.15.99:0/2465372388 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f1f4404c1c0 con 0x5652a115f310 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4a7ae640 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 0x7f1e24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 1 Processor -- start 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 1 -- start start 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4a7ae640 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 0x7f1e24039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f34057000 tx=0x7f1f34052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4d4bb800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5652a114da80 con 0x5652a1180980 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.027+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1f4afaf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57096/0 (socket says 172.21.15.99:57096) 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1f4afaf640 1 -- 172.21.15.99:0/116539268 learned_addr learned my addr 172.21.15.99:0/116539268 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1f4afaf640 1 -- 172.21.15.99:0/116539268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652a1181370 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c016fd0 tx=0x7f1f3c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1e0f7e6640 1 -- 172.21.15.99:0/116539268 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c017c70 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1e0f7e6640 1 -- 172.21.15.99:0/116539268 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c017e10 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5652a1183f40 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.028+0000 7f1e0f7e6640 1 -- 172.21.15.99:0/116539268 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f3c02ac00 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.029+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652a1184320 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.029+0000 7f1e0f7e6640 1 -- 172.21.15.99:0/116539268 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1f3c049020 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.029+0000 7f1e0f7e6640 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 0x7f1d8c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.029+0000 7f1e0f7e6640 1 -- 172.21.15.99:0/116539268 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f1f3c047020 con 0x5652a1180980 2024-09-13T23:27:19.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.029+0000 7f1f4a7ae640 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 0x7f1d8c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1e0d7e2640 20 reqs_thread_entry: start 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4a7ae640 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 0x7f1d8c038fb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f34045a60 tx=0x7f1f34005a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 0x5652a1190850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5652a1190f20 con 0x5652a118e390 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4b7b0640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 0x5652a1190850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4b7b0640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 0x5652a1190850 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4b7b0640 1 -- 172.21.15.99:0/2063866627 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f4400e070 con 0x5652a118e390 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 0x5652a11950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:2 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5652a1195740 con 0x5652a1192cf0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.030+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 0x5652a11950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.031+0000 7f1f4afaf640 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 0x5652a11950e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.031+0000 7f1f4afaf640 1 -- 172.21.15.99:0/2063866627 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(2 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f1f3c029030 con 0x5652a1192cf0 2024-09-13T23:27:19.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.031+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5652a1192390 con 0x5652a1192cf0 2024-09-13T23:27:19.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4afaf640 1 -- 172.21.15.99:0/2063866627 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [stat,call,call,writefull 0~993] v33'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f1f3c029030 con 0x5652a1192cf0 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 msgr2=0x7f1e24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 0x7f1e24039000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1f34057000 tx=0x7f1f34052000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 msgr2=0x5652a1166910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400a930 tx=0x7f1f44003370 comp rx=0 tx=0).stop 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 shutdown_connections 2024-09-13T23:27:19.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e24036b40 0x7f1e24039000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2465372388 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a115f310 0x5652a1166910 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 >> 172.21.15.99:0/2465372388 conn(0x5652a105c990 msgr2=0x5652a115a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 shutdown_connections 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.033+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2465372388 wait complete. 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 msgr2=0x7f1d8c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 0x7f1d8c038fb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1f34045a60 tx=0x7f1f34005a00 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 msgr2=0x5652a1180da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c016fd0 tx=0x7f1f3c00c960 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 shutdown_connections 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1d8c036af0 0x7f1d8c038fb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/116539268 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1180980 0x5652a1180da0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 >> 172.21.15.99:0/116539268 conn(0x5652a1175880 msgr2=0x5652a11781c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 shutdown_connections 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/116539268 wait complete. 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 msgr2=0x5652a1190850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 0x5652a1190850 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 msgr2=0x5652a11950e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 0x5652a11950e0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 msgr2=0x7f1e30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 0x7f1e30039000 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00efd0 tx=0x7f1f3c017450 comp rx=0 tx=0).stop 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 msgr2=0x5652a1152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c004000 tx=0x7f1f3c000bc0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 shutdown_connections 2024-09-13T23:27:19.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5652a1192cf0 0x5652a11950e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5652a118e390 0x5652a1190850 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1e30036b40 0x7f1e30039000 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 --2- 172.21.15.99:0/2063866627 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5652a1058550 0x5652a1152570 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 >> 172.21.15.99:0/2063866627 conn(0x5652a1053e40 msgr2=0x5652a1141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 shutdown_connections 2024-09-13T23:27:19.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.034+0000 7f1f4d4bb800 1 -- 172.21.15.99:0/2063866627 wait complete. 2024-09-13T23:27:19.045 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T23:27:19.045 DEBUG:tasks.util.rgw: json result: {'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T23:27:19.045 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T23:27:19.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T23:27:19.046 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T23:27:19.087 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.088 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.087+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.087+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.087+0000 7f22dbb3f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ad6375cd60 0x55ad637ec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.087+0000 7f22dbb3f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad636a8b30 con 0x55ad637ec790 2024-09-13T23:27:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.087+0000 7f22dbb3f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55ad6368a360 con 0x55ad6375cd60 2024-09-13T23:27:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.088+0000 7f22d7890640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ad6375cd60 0x55ad637ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.088+0000 7f22d708f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55ad637ec790 0x55ad637eeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55204/0 (socket says 172.21.15.99:55204) 2024-09-13T23:27:19.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.088+0000 7f22d708f640 1 -- 172.21.15.99:0/1268242179 learned_addr learned my addr 172.21.15.99:0/1268242179 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.088+0000 7f22d7890640 1 -- 172.21.15.99:0/1268242179 >> v1:172.21.15.43:6789/0 conn(0x55ad637ec790 legacy=0x55ad637eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.088+0000 7f22d7890640 1 -- 172.21.15.99:0/1268242179 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad636b0e00 con 0x55ad6375cd60 2024-09-13T23:27:19.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.090+0000 7f22d7890640 1 --2- 172.21.15.99:0/1268242179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad637ec250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f22c8005fd0 tx=0x7f22c8045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa4735f9a974cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.090+0000 7f22d688e640 1 -- 172.21.15.99:0/1268242179 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8058530 con 0x55ad6375cd60 2024-09-13T23:27:19.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.090+0000 7f22d688e640 1 -- 172.21.15.99:0/1268242179 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c80586d0 con 0x55ad6375cd60 2024-09-13T23:27:19.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.090+0000 7f22d688e640 1 -- 172.21.15.99:0/1268242179 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c80589d0 con 0x55ad6375cd60 2024-09-13T23:27:19.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1268242179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 msgr2=0x55ad637ec250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1268242179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad637ec250 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f22c8005fd0 tx=0x7f22c8045c30 comp rx=0 tx=0).stop 2024-09-13T23:27:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1268242179 shutdown_connections 2024-09-13T23:27:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1268242179 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad637ec250 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1268242179 >> 172.21.15.99:0/1268242179 conn(0x55ad637e3de0 msgr2=0x55ad637e6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1268242179 shutdown_connections 2024-09-13T23:27:19.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.091+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1268242179 wait complete. 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.104+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.104+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.104+0000 7f22dbb3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.104+0000 7f22dbb3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad63735320 con 0x55ad6375cd60 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.105+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.105+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57122/0 (socket says 172.21.15.99:57122) 2024-09-13T23:27:19.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.105+0000 7f22d7890640 1 -- 172.21.15.99:0/4188766006 learned_addr learned my addr 172.21.15.99:0/4188766006 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.105+0000 7f22d7890640 1 -- 172.21.15.99:0/4188766006 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad63682bc0 con 0x55ad6375cd60 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.105+0000 7f22d7890640 1 --2- 172.21.15.99:0/4188766006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f22c800a3f0 tx=0x7f22c8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e000fba0c10f95cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f21c5e0b640 1 -- 172.21.15.99:0/4188766006 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8068070 con 0x55ad6375cd60 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f21c5e0b640 1 -- 172.21.15.99:0/4188766006 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8058880 con 0x55ad6375cd60 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f21c5e0b640 1 -- 172.21.15.99:0/4188766006 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8058b60 con 0x55ad6375cd60 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 -- 172.21.15.99:0/4188766006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 msgr2=0x55ad638d8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/4188766006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f22c800a3f0 tx=0x7f22c8051000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 -- 172.21.15.99:0/4188766006 shutdown_connections 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/4188766006 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638d8860 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 -- 172.21.15.99:0/4188766006 >> 172.21.15.99:0/4188766006 conn(0x55ad637e3de0 msgr2=0x55ad638d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 -- 172.21.15.99:0/4188766006 shutdown_connections 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.106+0000 7f22dbb3f800 1 -- 172.21.15.99:0/4188766006 wait complete. 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22dbb3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22dbb3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad637f0630 con 0x55ad6375cd60 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57132/0 (socket says 172.21.15.99:57132) 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22d7890640 1 -- 172.21.15.99:0/636549630 learned_addr learned my addr 172.21.15.99:0/636549630 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22d7890640 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad63696fe0 con 0x55ad6375cd60 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.107+0000 7f22d7890640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f22c8066040 tx=0x7f22c8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f21bffff640 1 -- 172.21.15.99:0/636549630 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8071070 con 0x55ad6375cd60 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f21bffff640 1 -- 172.21.15.99:0/636549630 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8063780 con 0x55ad6375cd60 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad638e0760 con 0x55ad6375cd60 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f21bffff640 1 -- 172.21.15.99:0/636549630 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8068040 con 0x55ad6375cd60 2024-09-13T23:27:19.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad638e0c80 con 0x55ad6375cd60 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.108+0000 7f22dbb3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad63684580 con 0x55ad638ecf90 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bffff640 1 -- 172.21.15.99:0/636549630 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22c8074070 con 0x55ad6375cd60 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d8091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d8091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57148/0 (socket says 172.21.15.99:57148) 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d8091640 1 -- 172.21.15.99:0/3727274110 learned_addr learned my addr 172.21.15.99:0/3727274110 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bffff640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 0x7f21c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bffff640 1 -- 172.21.15.99:0/636549630 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f22c808f8c0 con 0x55ad6375cd60 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d7890640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 0x7f21c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d8091640 1 -- 172.21.15.99:0/3727274110 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad638ed8d0 con 0x55ad638ecf90 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d8091640 1 --2- 172.21.15.99:0/3727274110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f22d000a400 tx=0x7f22d000a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4622bcfa0d735f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f22d7890640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 0x7f21c0039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f22c804ec00 tx=0x7f22c804df70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bdffb640 1 -- 172.21.15.99:0/3727274110 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d00087e0 con 0x55ad638ecf90 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bdffb640 1 -- 172.21.15.99:0/3727274110 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d00089a0 con 0x55ad638ecf90 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.109+0000 7f21bdffb640 1 -- 172.21.15.99:0/3727274110 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0008d00 con 0x55ad638ecf90 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- 172.21.15.99:0/3727274110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 msgr2=0x55ad638ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/3727274110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f22d000a400 tx=0x7f22d000a8c0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- 172.21.15.99:0/3727274110 shutdown_connections 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/3727274110 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad638ed390 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- 172.21.15.99:0/3727274110 >> 172.21.15.99:0/3727274110 conn(0x55ad637ec790 msgr2=0x55ad638e8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- 172.21.15.99:0/3727274110 shutdown_connections 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- 172.21.15.99:0/3727274110 wait complete. 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.110+0000 7f22dbb3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad638ee280 con 0x55ad638ecf90 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22d8091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22d8091640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57154/0 (socket says 172.21.15.99:57154) 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22d8091640 1 -- 172.21.15.99:0/1564424340 learned_addr learned my addr 172.21.15.99:0/1564424340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22d8091640 1 -- 172.21.15.99:0/1564424340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad637e8270 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22d8091640 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c010 tx=0x7f22d0002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f21b7fff640 1 -- 172.21.15.99:0/1564424340 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0022020 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f21b7fff640 1 -- 172.21.15.99:0/1564424340 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22d0019040 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad637e8500 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f21b7fff640 1 -- 172.21.15.99:0/1564424340 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22d0013a70 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.111+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad637e8a00 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.112+0000 7f21b7fff640 1 -- 172.21.15.99:0/1564424340 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22d0025020 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.112+0000 7f21b7fff640 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 0x7f21b0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.112+0000 7f21b7fff640 1 -- 172.21.15.99:0/1564424340 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f22d004c6c0 con 0x55ad638ecf90 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22d708f640 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 0x7f21b0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22d708f640 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 0x7f21b0039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000f60 tx=0x7f22c0001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 1 Processor -- start 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 1 -- start start 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22dbb3f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ad638d8f50 con 0x55ad63910700 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22d7890640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57162/0 (socket says 172.21.15.99:57162) 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.113+0000 7f22d7890640 1 -- 172.21.15.99:0/1545859420 learned_addr learned my addr 172.21.15.99:0/1545859420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f22d7890640 1 -- 172.21.15.99:0/1545859420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad639110f0 con 0x55ad63910700 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f22d7890640 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f22c808dd90 tx=0x7f22c8069620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f2157fff640 1 -- 172.21.15.99:0/1545859420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8094070 con 0x55ad63910700 2024-09-13T23:27:19.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f2157fff640 1 -- 172.21.15.99:0/1545859420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8074e70 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad63913d40 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f2157fff640 1 -- 172.21.15.99:0/1545859420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f22c8075c40 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.114+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad63914120 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f2157fff640 1 -- 172.21.15.99:0/1545859420 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f22c8097070 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f2157fff640 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 0x7f2110038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f2157fff640 1 -- 172.21.15.99:0/1545859420 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f22c808a070 con 0x55ad63910700 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f22d708f640 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 0x7f2110038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f2155ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f22d708f640 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 0x7f2110038f60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001ed0 tx=0x7f22c000f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 0x55ad63920510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.115+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad63920b90 con 0x55ad6391e100 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22d8091640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 0x55ad63920510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22d8091640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 0x55ad63920510 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22d8091640 1 -- 172.21.15.99:0/636549630 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f22d001ecc0 con 0x55ad6391e100 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad63921470 con 0x55ad6391e100 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22d8091640 1 -- 172.21.15.99:0/636549630 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f22d001ecc0 con 0x55ad6391e100 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 0x55ad63925250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.116+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ad63925910 con 0x55ad63922dc0 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.117+0000 7f22d7890640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 0x55ad63925250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.117+0000 7f22d7890640 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 0x55ad63925250 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.117+0000 7f22d7890640 1 -- 172.21.15.99:0/636549630 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f22c8096030 con 0x55ad63922dc0 2024-09-13T23:27:19.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 msgr2=0x7f21b0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 0x7f21b0039000 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000f60 tx=0x7f22c0001230 comp rx=0 tx=0).stop 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 msgr2=0x55ad637e9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f22d000c010 tx=0x7f22d0002ff0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 shutdown_connections 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21b0036b40 0x7f21b0039000 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1564424340 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad638ecf90 0x55ad637e9b80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 >> 172.21.15.99:0/1564424340 conn(0x55ad637ec790 msgr2=0x55ad638e82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 shutdown_connections 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1564424340 wait complete. 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 msgr2=0x7f2110038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 0x7f2110038f60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001ed0 tx=0x7f22c000f000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 msgr2=0x55ad63910b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f22c808dd90 tx=0x7f22c8069620 comp rx=0 tx=0).stop 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 shutdown_connections 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f2110036aa0 0x7f2110038f60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/1545859420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad63910700 0x55ad63910b20 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 >> 172.21.15.99:0/1545859420 conn(0x55ad63905630 msgr2=0x55ad63907f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 shutdown_connections 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.118+0000 7f22dbb3f800 1 -- 172.21.15.99:0/1545859420 wait complete. 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 msgr2=0x55ad63920510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 0x55ad63920510 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 msgr2=0x55ad63925250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 0x55ad63925250 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 msgr2=0x7f21c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 0x7f21c0039000 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f22c804ec00 tx=0x7f22c804df70 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 msgr2=0x55ad638e0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f22c8066040 tx=0x7f22c8003330 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 shutdown_connections 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ad63922dc0 0x55ad63925250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ad6391e100 0x55ad63920510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f21c0036b40 0x7f21c0039000 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 --2- 172.21.15.99:0/636549630 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ad6375cd60 0x55ad638e0220 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 >> 172.21.15.99:0/636549630 conn(0x55ad637e3de0 msgr2=0x55ad638d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 shutdown_connections 2024-09-13T23:27:19.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.119+0000 7f22dbb3f800 1 -- 172.21.15.99:0/636549630 wait complete. 2024-09-13T23:27:19.130 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"30ca56dc-5661-43d6-a109-42ef24013139","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","zones":[{"id":"08e5ebbf-96cb-421f-911b-a0c32cceba7e","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T23:27:19.130 DEBUG:tasks.util.rgw: json result: {'id': '30ca56dc-5661-43d6-a109-42ef24013139', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'zones': [{'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T23:27:19.134 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T23:27:19.151 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:27:19.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T23:27:19.152 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T23:27:19.225 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.225 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.224+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.224+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.224+0000 7f8a56123800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556b552468b0 0x556b55248cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.224+0000 7f8a56123800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b55101b30 con 0x556b551b5ee0 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.224+0000 7f8a56123800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x556b550e3360 con 0x556b552468b0 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.225+0000 7f8a5164d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556b552468b0 0x556b55248cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.225+0000 7f8a51e4e640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x556b551b5ee0 0x556b55245190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55216/0 (socket says 172.21.15.99:55216) 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.225+0000 7f8a51e4e640 1 -- 172.21.15.99:0/1654148138 learned_addr learned my addr 172.21.15.99:0/1654148138 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.225+0000 7f8a5164d640 1 -- 172.21.15.99:0/1654148138 >> v1:172.21.15.43:6789/0 conn(0x556b551b5ee0 legacy=0x556b55245190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.225+0000 7f8a5164d640 1 -- 172.21.15.99:0/1654148138 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b55109e00 con 0x556b552468b0 2024-09-13T23:27:19.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.227+0000 7f8a5164d640 1 --2- 172.21.15.99:0/1654148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b552468b0 0x556b55248cc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800a470 tx=0x7f8a48045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a838b63825a60dee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.227+0000 7f8a50e4c640 1 -- 172.21.15.99:0/1654148138 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a48053570 con 0x556b552468b0 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.227+0000 7f8a50e4c640 1 -- 172.21.15.99:0/1654148138 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a48058070 con 0x556b552468b0 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a50e4c640 1 -- 172.21.15.99:0/1654148138 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a48053880 con 0x556b552468b0 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 -- 172.21.15.99:0/1654148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b552468b0 msgr2=0x556b55248cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 --2- 172.21.15.99:0/1654148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b552468b0 0x556b55248cc0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800a470 tx=0x7f8a48045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 -- 172.21.15.99:0/1654148138 shutdown_connections 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 --2- 172.21.15.99:0/1654148138 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b552468b0 0x556b55248cc0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 -- 172.21.15.99:0/1654148138 >> 172.21.15.99:0/1654148138 conn(0x556b5523ce00 msgr2=0x556b5523f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 -- 172.21.15.99:0/1654148138 shutdown_connections 2024-09-13T23:27:19.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.228+0000 7f8a56123800 1 -- 172.21.15.99:0/1654148138 wait complete. 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.242+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.242+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.242+0000 7f8a56123800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.242+0000 7f8a56123800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556b5518e450 con 0x556b551b5ee0 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f8a51e4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f8a51e4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57182/0 (socket says 172.21.15.99:57182) 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3135639109 learned_addr learned my addr 172.21.15.99:0/3135639109 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3135639109 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b550dbbc0 con 0x556b551b5ee0 2024-09-13T23:27:19.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/3135639109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8a440017a0 tx=0x7f8a44001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff5e214afc6991b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f893fe07640 1 -- 172.21.15.99:0/3135639109 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a44016070 con 0x556b551b5ee0 2024-09-13T23:27:19.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f893fe07640 1 -- 172.21.15.99:0/3135639109 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44004520 con 0x556b551b5ee0 2024-09-13T23:27:19.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.243+0000 7f893fe07640 1 -- 172.21.15.99:0/3135639109 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a44004820 con 0x556b551b5ee0 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- 172.21.15.99:0/3135639109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 msgr2=0x556b55331a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 --2- 172.21.15.99:0/3135639109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8a440017a0 tx=0x7f8a44001c60 comp rx=0 tx=0).stop 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- 172.21.15.99:0/3135639109 shutdown_connections 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 --2- 172.21.15.99:0/3135639109 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55331a40 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- 172.21.15.99:0/3135639109 >> 172.21.15.99:0/3135639109 conn(0x556b5523ce00 msgr2=0x556b5532d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- 172.21.15.99:0/3135639109 shutdown_connections 2024-09-13T23:27:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- 172.21.15.99:0/3135639109 wait complete. 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.244+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a56123800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a56123800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556b55249640 con 0x556b551b5ee0 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a51e4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a51e4e640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57192/0 (socket says 172.21.15.99:57192) 2024-09-13T23:27:19.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a51e4e640 1 -- 172.21.15.99:0/4196300434 learned_addr learned my addr 172.21.15.99:0/4196300434 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a51e4e640 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b550effe0 con 0x556b551b5ee0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8a44000f80 tx=0x7f8a44001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f893e604640 1 -- 172.21.15.99:0/4196300434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a44016040 con 0x556b551b5ee0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f893e604640 1 -- 172.21.15.99:0/4196300434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a44011530 con 0x556b551b5ee0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f893e604640 1 -- 172.21.15.99:0/4196300434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a44011890 con 0x556b551b5ee0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.245+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b552411b0 con 0x556b551b5ee0 2024-09-13T23:27:19.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.246+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b55241730 con 0x556b551b5ee0 2024-09-13T23:27:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.246+0000 7f893e604640 1 -- 172.21.15.99:0/4196300434 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a4401c3f0 con 0x556b551b5ee0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f893e604640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 0x7f8938039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f893e604640 1 -- 172.21.15.99:0/4196300434 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8a4404bc30 con 0x556b551b5ee0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a5164d640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 0x7f8938039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 0x556b55342880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55342dc0 con 0x556b552468b0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a5264f640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 0x556b55342880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a5164d640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 0x7f8938039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48057000 tx=0x7f8a48052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a5264f640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 0x556b55342880 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.247+0000 7f8a5264f640 1 -- 172.21.15.99:0/4196300434 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a4c0083e0 con 0x556b552468b0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55343610 con 0x556b552468b0 2024-09-13T23:27:19.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a5264f640 1 -- 172.21.15.99:0/4196300434 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a4c0083e0 con 0x556b552468b0 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 0x556b55347490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55347c20 con 0x556b55345040 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 0x556b55347490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.248+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 0x556b55347490 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a51e4e640 1 -- 172.21.15.99:0/4196300434 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a44019050 con 0x556b55345040 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55343e60 con 0x556b552468b0 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a5264f640 1 -- 172.21.15.99:0/4196300434 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a4c0083e0 con 0x556b552468b0 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55344200 con 0x556b55345040 2024-09-13T23:27:19.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a51e4e640 1 -- 172.21.15.99:0/4196300434 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a44019050 con 0x556b55345040 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.249+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a56123800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a56123800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556b55243000 con 0x556b553565c0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57196/0 (socket says 172.21.15.99:57196) 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a5264f640 1 -- 172.21.15.99:0/842809812 learned_addr learned my addr 172.21.15.99:0/842809812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a5264f640 1 -- 172.21.15.99:0/842809812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b55356f20 con 0x556b553565c0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.250+0000 7f8a5264f640 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x556b55242800 tx=0x7f8a4c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f89377fe640 1 -- 172.21.15.99:0/842809812 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c01c020 con 0x556b553565c0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f89377fe640 1 -- 172.21.15.99:0/842809812 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c007cf0 con 0x556b553565c0 2024-09-13T23:27:19.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f89377fe640 1 -- 172.21.15.99:0/842809812 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c018440 con 0x556b553565c0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b553571b0 con 0x556b553565c0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b55359e90 con 0x556b553565c0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.251+0000 7f89377fe640 1 -- 172.21.15.99:0/842809812 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a4c01f020 con 0x556b553565c0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f89377fe640 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 0x7f892c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f89377fe640 1 -- 172.21.15.99:0/842809812 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8a4c04e280 con 0x556b553565c0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 0x7f892c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 0x7f892c039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556b55241c00 tx=0x7f8a4401c830 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a56123800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a56123800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556b550dd580 con 0x556b55363250 2024-09-13T23:27:19.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57202/0 (socket says 172.21.15.99:57202) 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.252+0000 7f8a5264f640 1 -- 172.21.15.99:0/4027471011 learned_addr learned my addr 172.21.15.99:0/4027471011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f8a5264f640 1 -- 172.21.15.99:0/4027471011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b55363c20 con 0x556b55363250 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f8a5264f640 1 --2- 172.21.15.99:0/4027471011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c04c660 tx=0x7f8a4c04c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423346bc6005f0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f89357fa640 1 -- 172.21.15.99:0/4027471011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c020890 con 0x556b55363250 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f89357fa640 1 -- 172.21.15.99:0/4027471011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c021400 con 0x556b55363250 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f89357fa640 1 -- 172.21.15.99:0/4027471011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c018b50 con 0x556b55363250 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f8a56123800 1 -- 172.21.15.99:0/4027471011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 msgr2=0x556b55363650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.253+0000 7f8a56123800 1 --2- 172.21.15.99:0/4027471011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c04c660 tx=0x7f8a4c04c910 comp rx=0 tx=0).stop 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- 172.21.15.99:0/4027471011 shutdown_connections 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 --2- 172.21.15.99:0/4027471011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b55363650 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- 172.21.15.99:0/4027471011 >> 172.21.15.99:0/4027471011 conn(0x556b5535f5b0 msgr2=0x556b5535d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- 172.21.15.99:0/4027471011 shutdown_connections 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- 172.21.15.99:0/4027471011 wait complete. 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 Processor -- start 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- start start 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b5536a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a56123800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556b55364020 con 0x556b55363250 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b5536a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a5264f640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b5536a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57204/0 (socket says 172.21.15.99:57204) 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.254+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 learned_addr learned my addr 172.21.15.99:0/3454386270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b5536a9b0 con 0x556b55363250 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f8a5264f640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b5536a470 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c04c950 tx=0x7f8a4c04b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f89237fe640 1 -- 172.21.15.99:0/3454386270 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c020890 con 0x556b55363250 2024-09-13T23:27:19.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f89237fe640 1 -- 172.21.15.99:0/3454386270 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c016b50 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f89237fe640 1 -- 172.21.15.99:0/3454386270 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a4c016e30 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b5536ac40 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.255+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b5536ac40 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f89237fe640 1 -- 172.21.15.99:0/3454386270 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f8a4c016040 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f89237fe640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f891c036aa0 0x7f891c038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f89237fe640 1 -- 172.21.15.99:0/3454386270 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f8a4c04fd50 con 0x556b55363250 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f891c036aa0 0x7f891c038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f891c036aa0 0x7f891c038f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8a44019860 tx=0x7f8a44045070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b55375e50 0x556b55378310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.256+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55378a60 con 0x556b55375e50 2024-09-13T23:27:19.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a5164d640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b55375e50 0x556b55378310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a5164d640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b55375e50 0x556b55378310 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 20 realm 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55378e90 con 0x556b55375e50 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.257+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55379760 con 0x556b55375e50 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55379b00 con 0x556b55375e50 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b5537a860 0x556b5537cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b5537d260 con 0x556b5537a860 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a5264f640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b5537a860 0x556b5537cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a5264f640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b5537a860 0x556b5537cc50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.258+0000 7f8a56123800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a56123800 20 searching for the correct realm 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556b5537f1f0 0x556b553816b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537f1f0 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556b5537f1f0 0x556b553816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a51e4e640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556b5537f1f0 0x556b553816b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537a860 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a5264f640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8a4c021020 0x7f8a4c02b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.259+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x7f8a4c021020 2024-09-13T23:27:19.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.260+0000 7f8a5164d640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8a4c021020 0x7f8a4c02b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.260+0000 7f8a5164d640 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8a4c021020 0x7f8a4c02b810 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.261+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x7f8a4c021020 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537a860 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537f1f0 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b55375e50 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.262+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x7f8a4c021020 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b55375e50 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537a860 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556b55381d80 con 0x556b5537f1f0 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.263+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x7f8a4c021020 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.264+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b55375e50 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b55375e50 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x7f8a4c021020 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.265+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537a860 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b55375e50 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x7f8a4c021020 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.266+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x7f8a4c021020 2024-09-13T23:27:19.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537a860 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537f1f0 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x7f8a4c021020 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.267+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b55375e50 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x7f8a44059040 con 0x556b5537a860 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:19.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b5537e740 con 0x556b55375e50 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.268+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b5537dfb0 con 0x556b55375e50 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55382200 con 0x556b5537a860 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 zone default found 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 4 Realm: () 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 zonegroup default 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55382a50 con 0x7f8a4c021020 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.269+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b553847d0 con 0x556b5537f1f0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b55384c10 con 0x556b5537f1f0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 20 started sync module instance, tier type = 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.270+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55383c70 con 0x556b5537a860 2024-09-13T23:27:19.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.271+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.271+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93919479611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55383c70 con 0x556b5537a860 2024-09-13T23:27:19.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.271+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553856f0 con 0x556b55375e50 2024-09-13T23:27:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.272+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93919479611760] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.272+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.272+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93919479609280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55383be0 con 0x556b55375e50 2024-09-13T23:27:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.272+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553865e0 con 0x556b5537f1f0 2024-09-13T23:27:19.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.273+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93919479609280] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.274+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.274+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93919479619888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553869d0 con 0x556b5537f1f0 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.274+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553873d0 con 0x556b5537a860 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.275+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93919479619888] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.275+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.275+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93919479618320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553877c0 con 0x556b5537a860 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.275+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55388220 con 0x556b55375e50 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.276+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93919479618320] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.276+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.276+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93919479623392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55388220 con 0x556b55375e50 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.276+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55388c90 con 0x7f8a4c021020 2024-09-13T23:27:19.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.277+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.277+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93919479629696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55388c50 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.277+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55389bb0 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.277+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93919479623392] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.278+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93919479629696] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.278+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.278+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93919479627008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b55389700 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.279+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b5538a0c0 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93919479627008] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93919479632000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b5538a0c0 con 0x7f8a4c021020 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=0 2024-09-13T23:27:19.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=1 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=2 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=3 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=4 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=5 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.280+0000 7f8a56123800 20 add_watcher() i=6 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93919479632000] v33'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a56123800 20 add_watcher() i=7 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a56123800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b5538d3e0 con 0x556b55375e50 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.281+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93919479647776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b5538a230 con 0x556b55375e50 2024-09-13T23:27:19.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.282+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93919479647776] v33'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.282+0000 7f89037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.282+0000 7f8a56123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.282+0000 7f8a56123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.282+0000 7f8a56123800 5 note: GC not initialized 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f89027fc640 20 reqs_thread_entry: start 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8a56123800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8a56123800 20 Filter name: none 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8873fff640 20 reqs_thread_entry: start 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8a56123800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.283+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b553c08b0 con 0x7f8a4c021020 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b553beef0 con 0x556b55375e50 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.284+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553bf830 con 0x7f8a4c021020 2024-09-13T23:27:19.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v33'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a56123800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a56123800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a56123800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93919479853792 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b553c4350 con 0x556b55375e50 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.285+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== watch-notify(notify (1) cookie 93919479623392 notify 141733920799 ret 0) ==== 691+0+0 (crc 0 0 0) 0x556b553bfbd0 con 0x556b55375e50 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f89357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920799 cookie 93919479623392 notifier 4836 bl.length()=649 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f89357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f89357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify cookie 93919479853792 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f89357fa640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f8914003ea0 con 0x556b55375e50 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== watch-notify(notify_complete (2) cookie 93919479853792 notify 141733920799 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b553c04d0 con 0x556b55375e50 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.286+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553bf270 con 0x556b55375e50 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v33'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a56123800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a56123800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a56123800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93919479853680 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556b553c4760 con 0x556b5537f1f0 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== watch-notify(notify (1) cookie 93919479619888 notify 141733920776 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f8a44053040 con 0x556b5537f1f0 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8934ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920776 cookie 93919479619888 notifier 4836 bl.length()=177 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8934ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8934ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8934ff9640 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f887c003400 con 0x556b5537f1f0 2024-09-13T23:27:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.287+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(68 notify.2 [notify cookie 93919479853680 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.288+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== watch-notify(notify_complete (2) cookie 93919479853680 notify 141733920776 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b55241730 con 0x556b5537f1f0 2024-09-13T23:27:19.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.288+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.306 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.289+0000 7f89037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.289+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93919479647776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b55375e50 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.290+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93919479647776] v33'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.290+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93919479611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b5537a860 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.291+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93919479611760] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.291+0000 7f8a56123800 20 remove_watcher() i=0 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.291+0000 7f8a56123800 2 removed watcher, disabling cache 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.291+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93919479609280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b55375e50 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.292+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93919479609280] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.292+0000 7f8a56123800 20 remove_watcher() i=1 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.292+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93919479619888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b5537f1f0 2024-09-13T23:27:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.293+0000 7f8a51e4e640 1 -- 172.21.15.99:0/3454386270 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93919479619888] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a44019050 con 0x556b5537f1f0 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.293+0000 7f8a56123800 20 remove_watcher() i=2 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.293+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93919479618320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b5537a860 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.294+0000 7f8a5264f640 1 -- 172.21.15.99:0/3454386270 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93919479618320] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a4c03d020 con 0x556b5537a860 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.294+0000 7f8a56123800 20 remove_watcher() i=3 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.294+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93919479623392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x556b55375e50 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.295+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93919479623392] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x556b55375e50 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.296+0000 7f8a56123800 20 remove_watcher() i=4 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.296+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93919479629696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x7f8a4c021020 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.297+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93919479629696] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.297+0000 7f8a56123800 20 remove_watcher() i=5 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.297+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93919479627008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x7f8a4c021020 2024-09-13T23:27:19.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.298+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93919479627008] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.298+0000 7f8a56123800 20 remove_watcher() i=6 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.298+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93919479632000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556b553be590 con 0x7f8a4c021020 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93919479632000] v33'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a48051070 con 0x7f8a4c021020 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 20 remove_watcher() i=7 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8a4c021020 msgr2=0x7f8a4c02b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f8a4c021020 0x7f8a4c02b810 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b55375e50 msgr2=0x556b55378310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b55375e50 0x556b55378310 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b5537a860 msgr2=0x556b5537cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b5537a860 0x556b5537cc50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556b5537f1f0 msgr2=0x556b553816b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556b5537f1f0 0x556b553816b0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f891c036aa0 msgr2=0x7f891c038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f891c036aa0 0x7f891c038f60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8a44019860 tx=0x7f8a44045070 comp rx=0 tx=0).stop 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 msgr2=0x556b5536a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 --2- 172.21.15.99:0/3454386270 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b55363250 0x556b5536a470 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c04c950 tx=0x7f8a4c04b000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a5164d640 1 -- 172.21.15.99:0/3454386270 reap_dead start 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 shutdown_connections 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.299+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 >> 172.21.15.99:0/3454386270 conn(0x556b5535f5b0 msgr2=0x556b5535d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 shutdown_connections 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/3454386270 wait complete. 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 msgr2=0x7f892c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 0x7f892c039000 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x556b55241c00 tx=0x7f8a4401c830 comp rx=0 tx=0).stop 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 msgr2=0x556b553569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x556b55242800 tx=0x7f8a4c00beb0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 shutdown_connections 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f892c036b40 0x7f892c039000 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/842809812 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b553565c0 0x556b553569e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 >> 172.21.15.99:0/842809812 conn(0x556b5534b550 msgr2=0x556b5534e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 shutdown_connections 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/842809812 wait complete. 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 msgr2=0x556b55342880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 0x556b55342880 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 msgr2=0x556b55347490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 0x556b55347490 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 msgr2=0x7f8938039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 0x7f8938039000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8a48057000 tx=0x7f8a48052000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 msgr2=0x556b55242ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8a44000f80 tx=0x7f8a44001250 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 shutdown_connections 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556b55345040 0x556b55347490 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556b552468b0 0x556b55342880 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f8938036b40 0x7f8938039000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 --2- 172.21.15.99:0/4196300434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556b551b5ee0 0x556b55242ac0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.300+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 >> 172.21.15.99:0/4196300434 conn(0x556b5523ce00 msgr2=0x556b5532bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.301+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 shutdown_connections 2024-09-13T23:27:19.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.301+0000 7f8a56123800 1 -- 172.21.15.99:0/4196300434 wait complete. 2024-09-13T23:27:19.318 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.318 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.318 ERROR:root:0 2024-09-13T23:27:19.319 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:19.333 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000b1c98a0c85e910aa-0066e4ca57-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:27:19.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T23:27:19.353 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:19.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T23:27:19.375 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T23:27:19.375 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T23:27:19.398 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:27:19.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T23:27:19.415 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T23:27:19.416 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:19.427 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:19.428 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T23:27:19.441 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:19.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:19.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:19.442 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T23:27:19.488 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.488 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.487+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.487+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadc8430800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5651fd916900 0x5651fd918cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadc8430800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5651fd7d1b30 con 0x5651fd886650 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadc8430800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5651fd7b3360 con 0x5651fd916900 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadbaf66640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5651fd916900 0x5651fd918cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadc3767640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5651fd886650 0x5651fd9151e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55226/0 (socket says 172.21.15.99:55226) 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadc3767640 1 -- 172.21.15.99:0/455421911 learned_addr learned my addr 172.21.15.99:0/455421911 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadbaf66640 1 -- 172.21.15.99:0/455421911 >> v1:172.21.15.43:6789/0 conn(0x5651fd886650 legacy=0x5651fd9151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.488+0000 7fadbaf66640 1 -- 172.21.15.99:0/455421911 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fd7d9e00 con 0x5651fd916900 2024-09-13T23:27:19.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.490+0000 7fadbaf66640 1 --2- 172.21.15.99:0/455421911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd916900 0x5651fd918cf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a470 tx=0x7fadac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5079c0d910e222df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.490+0000 7fadc2f66640 1 -- 172.21.15.99:0/455421911 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadac053570 con 0x5651fd916900 2024-09-13T23:27:19.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.490+0000 7fadc2f66640 1 -- 172.21.15.99:0/455421911 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac058070 con 0x5651fd916900 2024-09-13T23:27:19.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.490+0000 7fadc2f66640 1 -- 172.21.15.99:0/455421911 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadac053880 con 0x5651fd916900 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 -- 172.21.15.99:0/455421911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd916900 msgr2=0x5651fd918cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 --2- 172.21.15.99:0/455421911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd916900 0x5651fd918cf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fadac00a470 tx=0x7fadac045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 -- 172.21.15.99:0/455421911 shutdown_connections 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 --2- 172.21.15.99:0/455421911 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd916900 0x5651fd918cf0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 -- 172.21.15.99:0/455421911 >> 172.21.15.99:0/455421911 conn(0x5651fd90cdb0 msgr2=0x5651fd90f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 -- 172.21.15.99:0/455421911 shutdown_connections 2024-09-13T23:27:19.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.491+0000 7fadc8430800 1 -- 172.21.15.99:0/455421911 wait complete. 2024-09-13T23:27:19.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.504+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.504+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc8430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc8430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651fd85e360 con 0x5651fd886650 2024-09-13T23:27:19.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc3767640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc3767640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57210/0 (socket says 172.21.15.99:57210) 2024-09-13T23:27:19.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc3767640 1 -- 172.21.15.99:0/874203762 learned_addr learned my addr 172.21.15.99:0/874203762 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc3767640 1 -- 172.21.15.99:0/874203762 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fd7abbc0 con 0x5651fd886650 2024-09-13T23:27:19.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.505+0000 7fadc3767640 1 --2- 172.21.15.99:0/874203762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fadb4001d80 tx=0x7fadb4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a334aa4321eab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7facb160a640 1 -- 172.21.15.99:0/874203762 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4013030 con 0x5651fd886650 2024-09-13T23:27:19.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7facb160a640 1 -- 172.21.15.99:0/874203762 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb400e470 con 0x5651fd886650 2024-09-13T23:27:19.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7facb160a640 1 -- 172.21.15.99:0/874203762 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb400e810 con 0x5651fd886650 2024-09-13T23:27:19.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 -- 172.21.15.99:0/874203762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 msgr2=0x5651fda018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 --2- 172.21.15.99:0/874203762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fadb4001d80 tx=0x7fadb4001e70 comp rx=0 tx=0).stop 2024-09-13T23:27:19.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 -- 172.21.15.99:0/874203762 shutdown_connections 2024-09-13T23:27:19.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 --2- 172.21.15.99:0/874203762 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda018c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 -- 172.21.15.99:0/874203762 >> 172.21.15.99:0/874203762 conn(0x5651fd90cdb0 msgr2=0x5651fd9fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 -- 172.21.15.99:0/874203762 shutdown_connections 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.506+0000 7fadc8430800 1 -- 172.21.15.99:0/874203762 wait complete. 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc8430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc8430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651fd919620 con 0x5651fd886650 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc3767640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc3767640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57216/0 (socket says 172.21.15.99:57216) 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc3767640 1 -- 172.21.15.99:0/1538646733 learned_addr learned my addr 172.21.15.99:0/1538646733 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc3767640 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fd7bffe0 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.507+0000 7fadc3767640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fadb4004000 tx=0x7fadb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7facafe07640 1 -- 172.21.15.99:0/1538646733 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4027070 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7facafe07640 1 -- 172.21.15.99:0/1538646733 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb4019900 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651fda09810 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7facafe07640 1 -- 172.21.15.99:0/1538646733 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadb4019c60 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fda09d30 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.508+0000 7facafe07640 1 -- 172.21.15.99:0/1538646733 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fadb402a070 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7facafe07640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 0x7faca8039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7facafe07640 1 -- 172.21.15.99:0/1538646733 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fadb401f070 con 0x5651fd886650 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadbaf66640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 0x7faca8039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 0x5651fda10340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda10910 con 0x5651fd916900 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadc3f68640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 0x5651fda10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadbaf66640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 0x7faca8039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fadac057000 tx=0x7fadac052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.509+0000 7fadc3f68640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 0x5651fda10340 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc3f68640 1 -- 172.21.15.99:0/1538646733 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadbc00a4a0 con 0x5651fd916900 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda0d910 con 0x5651fd916900 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc3f68640 1 -- 172.21.15.99:0/1538646733 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadbc00a4a0 con 0x5651fd916900 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 0x5651fda15000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda156f0 con 0x5651fda12c10 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc3767640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 0x5651fda15000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc3767640 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 0x5651fda15000 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.510+0000 7fadc3767640 1 -- 172.21.15.99:0/1538646733 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fadb4029030 con 0x5651fda12c10 2024-09-13T23:27:19.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.511+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda11ab0 con 0x5651fd916900 2024-09-13T23:27:19.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.511+0000 7fadc3f68640 1 -- 172.21.15.99:0/1538646733 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadbc00a4a0 con 0x5651fd916900 2024-09-13T23:27:19.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.511+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda11f90 con 0x5651fda12c10 2024-09-13T23:27:19.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.511+0000 7fadc3767640 1 -- 172.21.15.99:0/1538646733 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fadb4029030 con 0x5651fda12c10 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.511+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc8430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc8430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651fd7ad580 con 0x5651fda24080 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57218/0 (socket says 172.21.15.99:57218) 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc3f68640 1 -- 172.21.15.99:0/2359484160 learned_addr learned my addr 172.21.15.99:0/2359484160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc3f68640 1 -- 172.21.15.99:0/2359484160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fda249e0 con 0x5651fda24080 2024-09-13T23:27:19.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.512+0000 7fadc3f68640 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5651fda09f20 tx=0x7fadbc0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7facad602640 1 -- 172.21.15.99:0/2359484160 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc013450 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7facad602640 1 -- 172.21.15.99:0/2359484160 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc0135f0 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651fda24c70 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7facad602640 1 -- 172.21.15.99:0/2359484160 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc013910 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fda27950 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.513+0000 7facad602640 1 -- 172.21.15.99:0/2359484160 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fadbc011040 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7facad602640 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 0x7fac9c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7facad602640 1 -- 172.21.15.99:0/2359484160 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fadbc00e040 con 0x5651fda24080 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc3767640 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 0x7fac9c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc3767640 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 0x7fac9c039050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5651fda111c0 tx=0x7fadb404ad80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc8430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc8430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651fda02070 con 0x5651fd912410 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57220/0 (socket says 172.21.15.99:57220) 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.514+0000 7fadc3f68640 1 -- 172.21.15.99:0/1454426137 learned_addr learned my addr 172.21.15.99:0/1454426137 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc3f68640 1 -- 172.21.15.99:0/1454426137 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fd912de0 con 0x5651fd912410 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc3f68640 1 --2- 172.21.15.99:0/1454426137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04ce00 tx=0x7fadbc029fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce5921e542444cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7faca6ffd640 1 -- 172.21.15.99:0/1454426137 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc046120 con 0x5651fd912410 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7faca6ffd640 1 -- 172.21.15.99:0/1454426137 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc01f390 con 0x5651fd912410 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7faca6ffd640 1 -- 172.21.15.99:0/1454426137 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc012cb0 con 0x5651fd912410 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc8430800 1 -- 172.21.15.99:0/1454426137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 msgr2=0x5651fd912810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc8430800 1 --2- 172.21.15.99:0/1454426137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04ce00 tx=0x7fadbc029fb0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc8430800 1 -- 172.21.15.99:0/1454426137 shutdown_connections 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc8430800 1 --2- 172.21.15.99:0/1454426137 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fd912810 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.515+0000 7fadc8430800 1 -- 172.21.15.99:0/1454426137 >> 172.21.15.99:0/1454426137 conn(0x5651fda2d130 msgr2=0x5651fda2b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 -- 172.21.15.99:0/1454426137 shutdown_connections 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 -- 172.21.15.99:0/1454426137 wait complete. 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 Processor -- start 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 -- start start 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc8430800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5651fd911140 con 0x5651fd912410 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc3f68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57226/0 (socket says 172.21.15.99:57226) 2024-09-13T23:27:19.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.516+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 learned_addr learned my addr 172.21.15.99:0/3366234924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651fda3a970 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7fadc3f68640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04bcd0 tx=0x7fadbc04cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7faca57fa640 1 -- 172.21.15.99:0/3366234924 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc038020 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7faca57fa640 1 -- 172.21.15.99:0/3366234924 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadbc030040 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651fda3ac00 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7faca57fa640 1 -- 172.21.15.99:0/3366234924 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadbc02f070 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.517+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fda3d8b0 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.518+0000 7faca57fa640 1 -- 172.21.15.99:0/3366234924 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fadbc03b020 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.518+0000 7faca57fa640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac8c036b40 0x7fac8c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.518+0000 7faca57fa640 1 -- 172.21.15.99:0/3366234924 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fadbc03ebb0 con 0x5651fd912410 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.518+0000 7fadc3767640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac8c036b40 0x7fac8c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.518+0000 7fadc3767640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac8c036b40 0x7fac8c039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb4016fd0 tx=0x7fadb4037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fda460d0 0x5651fda48590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda48ce0 con 0x5651fda460d0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadbaf66640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fda460d0 0x5651fda48590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadbaf66640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fda460d0 0x5651fda48590 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 realm 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda49110 con 0x5651fda460d0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:19.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.519+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda499e0 con 0x5651fda460d0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda49d80 con 0x5651fda460d0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda4aae0 0x5651fda4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda4d520 con 0x5651fda4aae0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc3f68640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda4aae0 0x5651fda4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.520+0000 7fadc3f68640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda4aae0 0x5651fda4ced0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc8430800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc8430800 20 searching for the correct realm 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651fda4f4d0 0x5651fda51990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3767640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651fda4f4d0 0x5651fda51990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3767640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651fda4f4d0 0x5651fda51990 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3f68640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fadbc03d020 0x7fadbc0464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.521+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.522+0000 7fadbaf66640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fadbc03d020 0x7fadbc0464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.522+0000 7fadbaf66640 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fadbc03d020 0x7fadbc0464b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.522+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.522+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.523+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.524+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.525+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.526+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.527+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.528+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4f4d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x7fadbc03d020 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda460d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.529+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52060 con 0x5651fda4aae0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda4dee0 con 0x5651fda460d0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda4e780 con 0x5651fda460d0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda524e0 con 0x5651fda4aae0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 zone default found 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 4 Realm: () 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:19.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 zonegroup default 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.530+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda52d30 con 0x7fadbc03d020 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda54ab0 con 0x5651fda4f4d0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda54ec0 con 0x5651fda4f4d0 2024-09-13T23:27:19.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 started sync module instance, tier type = 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.531+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda53f50 con 0x5651fda4aae0 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.532+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.532+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910147806288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda53f50 con 0x5651fda4aae0 2024-09-13T23:27:19.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.532+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda559f0 con 0x5651fda460d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.533+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910147806288] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.534+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.534+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910147810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda53f50 con 0x5651fda460d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.534+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda56480 con 0x5651fda4f4d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.535+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910147810496] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.535+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.535+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910147803808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda53ec0 con 0x5651fda4f4d0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.535+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda57340 con 0x5651fda4aae0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.536+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.536+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910147817584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda57b00 con 0x5651fda4aae0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.536+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda58600 con 0x5651fda460d0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.536+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910147803808] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.537+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910147817584] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.537+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.538+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910147821808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda585c0 con 0x5651fda460d0 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.538+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda58ed0 con 0x7fadbc03d020 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.539+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.539+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910147824080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda592a0 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.539+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910147821808] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.539+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda56870 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.540+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910147824080] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.540+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.540+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910147825136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda596c0 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.540+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda59f10 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910147827872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda5a340 con 0x7fadbc03d020 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=0 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=1 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=2 2024-09-13T23:27:19.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=3 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=4 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=5 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910147825136] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.541+0000 7fadc8430800 20 add_watcher() i=6 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910147827872] v33'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadc8430800 20 add_watcher() i=7 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadc8430800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda59210 con 0x5651fda460d0 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.542+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910147829088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda59210 con 0x5651fda460d0 2024-09-13T23:27:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.543+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910147829088] v33'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.543+0000 7fac79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 5 note: GC not initialized 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fac78fe1640 20 reqs_thread_entry: start 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 20 Filter name: none 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fabf27fc640 20 reqs_thread_entry: start 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:19.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.544+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda90770 con 0x7fadbc03d020 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadc8430800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadc8430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadc8430800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadc8430800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.545+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda970b0 con 0x7fadbc03d020 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.546+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.546+0000 7fadc8430800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.546+0000 7fadc8430800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.546+0000 7fadc8430800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:19.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.546+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94910148078192 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5651fda926b0 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 94910147821808 notify 141733920801 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fadac083040 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7faca6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920801 cookie 94910147821808 notifier 4843 bl.length()=636 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 94910148078192 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7faca6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7faca6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7faca6ffd640 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fac88003ea0 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.547+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94910148078192 notify 141733920801 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5651fd7d9e00 con 0x5651fda460d0 2024-09-13T23:27:19.562 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:19.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.548+0000 7fac79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.548+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910147829088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda460d0 2024-09-13T23:27:19.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.549+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94910147829088] v33'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.549+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910147806288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda4aae0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.550+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94910147806288] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.550+0000 7fadc8430800 20 remove_watcher() i=0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.550+0000 7fadc8430800 2 removed watcher, disabling cache 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.550+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910147810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda460d0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.551+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94910147810496] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.551+0000 7fadc8430800 20 remove_watcher() i=1 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.551+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910147803808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda4f4d0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.553+0000 7fadc3767640 1 -- 172.21.15.99:0/3366234924 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94910147803808] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadb4043050 con 0x5651fda4f4d0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.553+0000 7fadc8430800 20 remove_watcher() i=2 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.553+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910147817584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda4aae0 2024-09-13T23:27:19.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.554+0000 7fadc3f68640 1 -- 172.21.15.99:0/3366234924 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94910147817584] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadbc032070 con 0x5651fda4aae0 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.554+0000 7fadc8430800 20 remove_watcher() i=3 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.554+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910147821808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x5651fda460d0 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.555+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94910147821808] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x5651fda460d0 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.555+0000 7fadc8430800 20 remove_watcher() i=4 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.555+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910147824080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x7fadbc03d020 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.556+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94910147824080] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.556+0000 7fadc8430800 20 remove_watcher() i=5 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.556+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910147825136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x7fadbc03d020 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.557+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94910147825136] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.557+0000 7fadc8430800 20 remove_watcher() i=6 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.557+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910147827872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5651fda8e490 con 0x7fadbc03d020 2024-09-13T23:27:19.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.558+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94910147827872] v33'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadac051070 con 0x7fadbc03d020 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 20 remove_watcher() i=7 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fadbc03d020 msgr2=0x7fadbc0464b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fadbc03d020 0x7fadbc0464b0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fda460d0 msgr2=0x5651fda48590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fda460d0 0x5651fda48590 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda4aae0 msgr2=0x5651fda4ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda4aae0 0x5651fda4ced0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651fda4f4d0 msgr2=0x5651fda51990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5651fda4f4d0 0x5651fda51990 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac8c036b40 msgr2=0x7fac8c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac8c036b40 0x7fac8c039000 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fadb4016fd0 tx=0x7fadb4037000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 msgr2=0x5651fda3a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadbaf66640 1 -- 172.21.15.99:0/3366234924 reap_dead start 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fadbc04bcd0 tx=0x7fadbc04cd90 comp rx=0 tx=0).stop 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 shutdown_connections 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/3366234924 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd912410 0x5651fda3a430 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 >> 172.21.15.99:0/3366234924 conn(0x5651fda2d130 msgr2=0x5651fda2b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 shutdown_connections 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/3366234924 wait complete. 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 msgr2=0x7fac9c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 0x7fac9c039050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5651fda111c0 tx=0x7fadb404ad80 comp rx=0 tx=0).stop 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 msgr2=0x5651fda244a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5651fda09f20 tx=0x7fadbc0163e0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 shutdown_connections 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fac9c036b90 0x7fac9c039050 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 --2- 172.21.15.99:0/2359484160 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fda24080 0x5651fda244a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 >> 172.21.15.99:0/2359484160 conn(0x5651fda19010 msgr2=0x5651fda1bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 shutdown_connections 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.559+0000 7fadc8430800 1 -- 172.21.15.99:0/2359484160 wait complete. 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 msgr2=0x5651fda10340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 0x5651fda10340 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 msgr2=0x5651fda15000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 0x5651fda15000 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 msgr2=0x7faca8039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 0x7faca8039000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fadac057000 tx=0x7fadac052000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 msgr2=0x5651fda092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fadb4004000 tx=0x7fadb4000bc0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 shutdown_connections 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5651fda12c10 0x5651fda15000 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5651fd916900 0x5651fda10340 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7faca8036b40 0x7faca8039000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 --2- 172.21.15.99:0/1538646733 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5651fd886650 0x5651fda092d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 >> 172.21.15.99:0/1538646733 conn(0x5651fd90cdb0 msgr2=0x5651fd9fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 shutdown_connections 2024-09-13T23:27:19.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.560+0000 7fadc8430800 1 -- 172.21.15.99:0/1538646733 wait complete. 2024-09-13T23:27:19.574 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.574 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.574 ERROR:root:0 2024-09-13T23:27:19.574 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T23:27:19.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T23:27:19.575 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T23:27:19.628 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.628 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.627+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.627+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd439b0c800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5568215a6930 0x5568215a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd439b0c800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556821461b30 con 0x556821516680 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd439b0c800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x556821443360 con 0x5568215a6930 2024-09-13T23:27:19.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd436dff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5568215a6930 0x5568215a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd437600640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x556821516680 0x5568215a5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55228/0 (socket says 172.21.15.99:55228) 2024-09-13T23:27:19.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd437600640 1 -- 172.21.15.99:0/2369376998 learned_addr learned my addr 172.21.15.99:0/2369376998 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd436dff640 1 -- 172.21.15.99:0/2369376998 >> v1:172.21.15.43:6789/0 conn(0x556821516680 legacy=0x5568215a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.628+0000 7fd436dff640 1 -- 172.21.15.99:0/2369376998 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556821469e00 con 0x5568215a6930 2024-09-13T23:27:19.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.630+0000 7fd436dff640 1 --2- 172.21.15.99:0/2369376998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568215a6930 0x5568215a8d20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a470 tx=0x7fd42c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e5439b87ded4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.630+0000 7fd4365fe640 1 -- 172.21.15.99:0/2369376998 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd42c053570 con 0x5568215a6930 2024-09-13T23:27:19.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.630+0000 7fd4365fe640 1 -- 172.21.15.99:0/2369376998 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c058070 con 0x5568215a6930 2024-09-13T23:27:19.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.630+0000 7fd4365fe640 1 -- 172.21.15.99:0/2369376998 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd42c053880 con 0x5568215a6930 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 -- 172.21.15.99:0/2369376998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568215a6930 msgr2=0x5568215a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2369376998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568215a6930 0x5568215a8d20 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a470 tx=0x7fd42c045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 -- 172.21.15.99:0/2369376998 shutdown_connections 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2369376998 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568215a6930 0x5568215a8d20 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 -- 172.21.15.99:0/2369376998 >> 172.21.15.99:0/2369376998 conn(0x55682159cde0 msgr2=0x55682159f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 -- 172.21.15.99:0/2369376998 shutdown_connections 2024-09-13T23:27:19.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.631+0000 7fd439b0c800 1 -- 172.21.15.99:0/2369376998 wait complete. 2024-09-13T23:27:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.644+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd439b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd439b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568214ee450 con 0x556821516680 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd437600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd437600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57234/0 (socket says 172.21.15.99:57234) 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd437600640 1 -- 172.21.15.99:0/3095938415 learned_addr learned my addr 172.21.15.99:0/3095938415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.645+0000 7fd437600640 1 -- 172.21.15.99:0/3095938415 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682143bbc0 con 0x556821516680 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.646+0000 7fd437600640 1 --2- 172.21.15.99:0/3095938415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd428001e10 tx=0x7fd42800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54551078e8060b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.646+0000 7fd32560a640 1 -- 172.21.15.99:0/3095938415 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd428012020 con 0x556821516680 2024-09-13T23:27:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.646+0000 7fd32560a640 1 -- 172.21.15.99:0/3095938415 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42800e5a0 con 0x556821516680 2024-09-13T23:27:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.646+0000 7fd32560a640 1 -- 172.21.15.99:0/3095938415 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd42800e8e0 con 0x556821516680 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- 172.21.15.99:0/3095938415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 msgr2=0x5568215a2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 --2- 172.21.15.99:0/3095938415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd428001e10 tx=0x7fd42800b780 comp rx=0 tx=0).stop 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- 172.21.15.99:0/3095938415 shutdown_connections 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 --2- 172.21.15.99:0/3095938415 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x5568215a2b40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- 172.21.15.99:0/3095938415 >> 172.21.15.99:0/3095938415 conn(0x55682159cde0 msgr2=0x55682168d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- 172.21.15.99:0/3095938415 shutdown_connections 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- 172.21.15.99:0/3095938415 wait complete. 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd439b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568215a9650 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd437600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd437600640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57246/0 (socket says 172.21.15.99:57246) 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.647+0000 7fd437600640 1 -- 172.21.15.99:0/2733356356 learned_addr learned my addr 172.21.15.99:0/2733356356 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd437600640 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55682144ffe0 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd437600640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b7c0 tx=0x7fd428000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd323e07640 1 -- 172.21.15.99:0/2733356356 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd428012030 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd323e07640 1 -- 172.21.15.99:0/2733356356 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd428001470 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55682169ba30 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd323e07640 1 -- 172.21.15.99:0/2733356356 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd42801a8d0 con 0x556821516680 2024-09-13T23:27:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.648+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55682169bf50 con 0x556821516680 2024-09-13T23:27:19.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd323e07640 1 -- 172.21.15.99:0/2733356356 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd428015020 con 0x556821516680 2024-09-13T23:27:19.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd323e07640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 0x7fd31c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd323e07640 1 -- 172.21.15.99:0/2733356356 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd428020030 con 0x556821516680 2024-09-13T23:27:19.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd436dff640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 0x7fd31c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 0x5568216a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216a2b30 con 0x5568215a6930 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.649+0000 7fd437e01640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 0x5568216a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd436dff640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 0x7fd31c039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd42c057000 tx=0x7fd42c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd437e01640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 0x5568216a2560 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd437e01640 1 -- 172.21.15.99:0/2733356356 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd43000a4a0 con 0x5568215a6930 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55682169fb30 con 0x5568215a6930 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd437e01640 1 -- 172.21.15.99:0/2733356356 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd43000a4a0 con 0x5568215a6930 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.650+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 0x5568216a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.651+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216a78d0 con 0x5568216a4e40 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.651+0000 7fd437600640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 0x5568216a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.651+0000 7fd437600640 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 0x5568216a7230 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.651+0000 7fd437600640 1 -- 172.21.15.99:0/2733356356 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd428018950 con 0x5568216a4e40 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.651+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216a3ce0 con 0x5568215a6930 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd437e01640 1 -- 172.21.15.99:0/2733356356 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd43000a4a0 con 0x5568215a6930 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216a41c0 con 0x5568216a4e40 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd437600640 1 -- 172.21.15.99:0/2733356356 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd428018950 con 0x5568216a4e40 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd439b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.652+0000 7fd439b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55682143d580 con 0x5568216b6260 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57258/0 (socket says 172.21.15.99:57258) 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd437e01640 1 -- 172.21.15.99:0/1583905352 learned_addr learned my addr 172.21.15.99:0/1583905352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd437e01640 1 -- 172.21.15.99:0/1583905352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568216b6bc0 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd437e01640 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5568216a2ef0 tx=0x7fd4300167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd321602640 1 -- 172.21.15.99:0/1583905352 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430013640 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd321602640 1 -- 172.21.15.99:0/1583905352 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4300137e0 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568216b6e50 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd321602640 1 -- 172.21.15.99:0/1583905352 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430013ae0 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.653+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568216b9b30 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.654+0000 7fd321602640 1 -- 172.21.15.99:0/1583905352 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd430011040 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.654+0000 7fd321602640 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 0x7fd310039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.654+0000 7fd321602640 1 -- 172.21.15.99:0/1583905352 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd43000e040 con 0x5568216b6260 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.654+0000 7fd437600640 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 0x7fd310039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd437600640 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 0x7fd310039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd428000fd0 tx=0x7fd42800e530 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd439b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd439b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568215a1210 con 0x5568216c2f20 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57268/0 (socket says 172.21.15.99:57268) 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd437e01640 1 -- 172.21.15.99:0/528115638 learned_addr learned my addr 172.21.15.99:0/528115638 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.655+0000 7fd437e01640 1 -- 172.21.15.99:0/528115638 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568216c38f0 con 0x5568216c2f20 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd437e01640 1 --2- 172.21.15.99:0/528115638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd43004cde0 tx=0x7fd430020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4112839148ae8442 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd31affd640 1 -- 172.21.15.99:0/528115638 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430014c70 con 0x5568216c2f20 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd31affd640 1 -- 172.21.15.99:0/528115638 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43001cd50 con 0x5568216c2f20 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd31affd640 1 -- 172.21.15.99:0/528115638 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd43002aa60 con 0x5568216c2f20 2024-09-13T23:27:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 -- 172.21.15.99:0/528115638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 msgr2=0x5568216c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 --2- 172.21.15.99:0/528115638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd43004cde0 tx=0x7fd430020f60 comp rx=0 tx=0).stop 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 -- 172.21.15.99:0/528115638 shutdown_connections 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 --2- 172.21.15.99:0/528115638 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216c3320 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 -- 172.21.15.99:0/528115638 >> 172.21.15.99:0/528115638 conn(0x5568216bf310 msgr2=0x5568216bd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 -- 172.21.15.99:0/528115638 shutdown_connections 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.656+0000 7fd439b0c800 1 -- 172.21.15.99:0/528115638 wait complete. 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd439b0c800 1 Processor -- start 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd439b0c800 1 -- start start 2024-09-13T23:27:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd439b0c800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd439b0c800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5568216c3f30 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd437e01640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57278/0 (socket says 172.21.15.99:57278) 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 learned_addr learned my addr 172.21.15.99:0/62704209 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568216ca910 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.657+0000 7fd437e01640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216ca3d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd43004cce0 tx=0x7fd43004cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd3197fa640 1 -- 172.21.15.99:0/62704209 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430038020 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd3197fa640 1 -- 172.21.15.99:0/62704209 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd430040130 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568216caba0 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd3197fa640 1 -- 172.21.15.99:0/62704209 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd430040430 con 0x5568216c2f20 2024-09-13T23:27:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568216caba0 con 0x5568216c2f20 2024-09-13T23:27:19.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.658+0000 7fd3197fa640 1 -- 172.21.15.99:0/62704209 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd43003b070 con 0x5568216c2f20 2024-09-13T23:27:19.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd3197fa640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd300036af0 0x7fd300038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd3197fa640 1 -- 172.21.15.99:0/62704209 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd430035c00 con 0x5568216c2f20 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd437600640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd300036af0 0x7fd300038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd437600640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd300036af0 0x7fd300038fb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4280444b0 tx=0x7fd428035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568216d5d50 0x5568216d8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216d8960 con 0x5568216d5d50 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.659+0000 7fd436dff640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568216d5d50 0x5568216d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd436dff640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568216d5d50 0x5568216d8210 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 realm 2024-09-13T23:27:19.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216d8d90 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216d9660 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.660+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216d9a00 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216da760 0x5568216dcb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216dd160 con 0x5568216da760 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd437e01640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216da760 0x5568216dcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd437e01640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216da760 0x5568216dcb50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 20 searching for the correct realm 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5568216df0f0 0x5568216e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.661+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437600640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5568216df0f0 0x5568216e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437600640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5568216df0f0 0x5568216e15b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437e01640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd430034070 0x7fd43004b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.662+0000 7fd436dff640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd430034070 0x7fd43004b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.663+0000 7fd436dff640 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd430034070 0x7fd43004b4d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.663+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.663+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.663+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.663+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.664+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.665+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.666+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.667+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.668+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.669+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216df0f0 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x7fd430034070 2024-09-13T23:27:19.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216d5d50 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.670+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5568216e1c80 con 0x5568216da760 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216de640 con 0x5568216d5d50 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216ddeb0 con 0x5568216d5d50 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216e2100 con 0x5568216da760 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 zone default found 2024-09-13T23:27:19.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 4 Realm: () 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 zonegroup default 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.671+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216e2550 con 0x7fd430034070 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216e4820 con 0x5568216df0f0 2024-09-13T23:27:19.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216e4bc0 con 0x5568216df0f0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 started sync module instance, tier type = 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.672+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e3c60 con 0x5568216da760 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.673+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.673+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93905725833296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e4470 con 0x5568216da760 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.673+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e5a30 con 0x5568216d5d50 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.674+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93905725833296] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.675+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.675+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93905725837152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e6280 con 0x5568216d5d50 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.675+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e6b30 con 0x5568216df0f0 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.676+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93905725837152] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.676+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.676+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93905725841328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e6f50 con 0x5568216df0f0 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.676+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e7970 con 0x5568216da760 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.677+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.677+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93905725846624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e8210 con 0x5568216da760 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.677+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e8cf0 con 0x5568216d5d50 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.677+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93905725841328] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.678+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.678+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93905725846624] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.678+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93905725851648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e8210 con 0x5568216d5d50 2024-09-13T23:27:19.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.678+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e7d80 con 0x7fd430034070 2024-09-13T23:27:19.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.679+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.679+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93905725851648] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.679+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93905725849968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e9700 con 0x7fd430034070 2024-09-13T23:27:19.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.679+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e6430 con 0x7fd430034070 2024-09-13T23:27:19.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.680+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93905725849968] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.680+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.680+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93905725854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216e9670 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.680+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216ea5a0 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93905725854288] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93905725856832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216ea510 con 0x7fd430034070 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=0 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=1 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=2 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=3 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=4 2024-09-13T23:27:19.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=5 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.682+0000 7fd439b0c800 20 add_watcher() i=6 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93905725856832] v33'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd439b0c800 20 add_watcher() i=7 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd439b0c800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568216ed9d0 con 0x5568216d5d50 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.683+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93905725858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5568216eae90 con 0x5568216d5d50 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.684+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93905725858352] v33'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.684+0000 7fd2edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.684+0000 7fd439b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.684+0000 7fd439b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.684+0000 7fd439b0c800 5 note: GC not initialized 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd2ecfe1640 20 reqs_thread_entry: start 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 20 Filter name: none 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd2667fc640 20 reqs_thread_entry: start 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556821720e10 con 0x7fd430034070 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:27:19.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.685+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55682171f450 con 0x5568216df0f0 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.686+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171fcf0 con 0x7fd430034070 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.687+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v33'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.687+0000 7fd439b0c800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.687+0000 7fd439b0c800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.687+0000 7fd439b0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.687+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93905726076992 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5568217248b0 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== watch-notify(notify (1) cookie 93905725833296 notify 141733920791 ret 0) ==== 575+0+0 (crc 0 0 0) 0x5568216ca910 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd31affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920791 cookie 93905725833296 notifier 4850 bl.length()=533 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd31affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd31affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd31affd640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd2fc003ea0 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(65 notify.0 [notify cookie 93905726076992 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== watch-notify(notify_complete (2) cookie 93905726076992 notify 141733920791 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd430030040 con 0x5568216da760 2024-09-13T23:27:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.688+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171fc80 con 0x5568216df0f0 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v33'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd439b0c800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd439b0c800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd439b0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93905726092272 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55682171fc80 con 0x5568216d5d50 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 93905725837152 notify 141733920802 ret 0) ==== 218+0+0 (crc 0 0 0) 0x556821720090 con 0x5568216d5d50 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd31a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920802 cookie 93905725837152 notifier 4850 bl.length()=176 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd31a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd31a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd31a7fc640 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fd26c003400 con 0x5568216d5d50 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.689+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(68 notify.1 [notify cookie 93905726092272 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.690+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== watch-notify(notify_complete (2) cookie 93905726092272 notify 141733920802 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556821720860 con 0x5568216d5d50 2024-09-13T23:27:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.690+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.705 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T23:27:19.687267Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.687256Z","tags":[],"group_ids":[]} 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.691+0000 7fd2edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.691+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93905725858352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216d5d50 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.692+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93905725858352] v33'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.692+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93905725833296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216da760 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.693+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93905725833296] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.693+0000 7fd439b0c800 20 remove_watcher() i=0 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.693+0000 7fd439b0c800 2 removed watcher, disabling cache 2024-09-13T23:27:19.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.693+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93905725837152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216d5d50 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.694+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93905725837152] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.694+0000 7fd439b0c800 20 remove_watcher() i=1 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.694+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93905725841328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216df0f0 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.695+0000 7fd437600640 1 -- 172.21.15.99:0/62704209 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93905725841328] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd428018950 con 0x5568216df0f0 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.695+0000 7fd439b0c800 20 remove_watcher() i=2 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.695+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93905725846624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216da760 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.696+0000 7fd437e01640 1 -- 172.21.15.99:0/62704209 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93905725846624] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd43003a030 con 0x5568216da760 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.696+0000 7fd439b0c800 20 remove_watcher() i=3 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.696+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93905725851648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x5568216d5d50 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.697+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93905725851648] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x5568216d5d50 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.697+0000 7fd439b0c800 20 remove_watcher() i=4 2024-09-13T23:27:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.697+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93905725849968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.698+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93905725849968] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.698+0000 7fd439b0c800 20 remove_watcher() i=5 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.698+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93905725854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.699+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93905725854288] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.699+0000 7fd439b0c800 20 remove_watcher() i=6 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.699+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93905725856832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55682171eb30 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93905725856832] v33'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd42c051070 con 0x7fd430034070 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 20 remove_watcher() i=7 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd430034070 msgr2=0x7fd43004b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fd430034070 0x7fd43004b4d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568216d5d50 msgr2=0x5568216d8210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568216d5d50 0x5568216d8210 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216da760 msgr2=0x5568216dcb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216da760 0x5568216dcb50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5568216df0f0 msgr2=0x5568216e15b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5568216df0f0 0x5568216e15b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd300036af0 msgr2=0x7fd300038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd300036af0 0x7fd300038fb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4280444b0 tx=0x7fd428035000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 msgr2=0x5568216ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/62704209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216c2f20 0x5568216ca3d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd43004cce0 tx=0x7fd43004cd40 comp rx=0 tx=0).stop 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 reap_dead start 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd436dff640 1 -- 172.21.15.99:0/62704209 reap_dead start 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 shutdown_connections 2024-09-13T23:27:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 >> 172.21.15.99:0/62704209 conn(0x5568216bf310 msgr2=0x5568216bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 shutdown_connections 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/62704209 wait complete. 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 msgr2=0x7fd310039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 0x7fd310039000 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd428000fd0 tx=0x7fd42800e530 comp rx=0 tx=0).stop 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 msgr2=0x5568216b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x5568216a2ef0 tx=0x7fd4300167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 shutdown_connections 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd310036b40 0x7fd310039000 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 --2- 172.21.15.99:0/1583905352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5568216b6260 0x5568216b6680 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 >> 172.21.15.99:0/1583905352 conn(0x5568216ab1f0 msgr2=0x5568216add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 shutdown_connections 2024-09-13T23:27:19.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.701+0000 7fd439b0c800 1 -- 172.21.15.99:0/1583905352 wait complete. 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 msgr2=0x5568216a2560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 0x5568216a2560 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 msgr2=0x5568216a7230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 0x5568216a7230 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 msgr2=0x7fd31c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 0x7fd31c039000 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd42c057000 tx=0x7fd42c052000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 msgr2=0x55682169b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b7c0 tx=0x7fd428000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 shutdown_connections 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5568216a4e40 0x5568216a7230 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5568215a6930 0x5568216a2560 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd31c036b40 0x7fd31c039000 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 --2- 172.21.15.99:0/2733356356 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556821516680 0x55682169b4f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 >> 172.21.15.99:0/2733356356 conn(0x55682159cde0 msgr2=0x55682168ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 shutdown_connections 2024-09-13T23:27:19.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.702+0000 7fd439b0c800 1 -- 172.21.15.99:0/2733356356 wait complete. 2024-09-13T23:27:19.717 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T23:27:19.687267Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.687256Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.717 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T23:27:19.687267Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.687256Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:19.717 ERROR:root:0 2024-09-13T23:27:19.718 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:19.730 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:19.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T23:27:19.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T23:27:19.731 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T23:27:19.775 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.775 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.774+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.774+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.774+0000 7fac5ff22800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d47aa84d00 0x55d47aa870f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.774+0000 7fac5ff22800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d47a93db30 con 0x55d47a9f1df0 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.774+0000 7fac5ff22800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55d47a91f360 con 0x55d47aa84d00 2024-09-13T23:27:19.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.775+0000 7fac53415640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55d47aa84d00 0x55d47aa870f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.775+0000 7fac5bc16640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55d47a9f1df0 0x55d47aa835e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55230/0 (socket says 172.21.15.99:55230) 2024-09-13T23:27:19.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.775+0000 7fac5bc16640 1 -- 172.21.15.99:0/341329420 learned_addr learned my addr 172.21.15.99:0/341329420 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.775+0000 7fac53415640 1 -- 172.21.15.99:0/341329420 >> v1:172.21.15.43:6789/0 conn(0x55d47a9f1df0 legacy=0x55d47aa835e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.775+0000 7fac53415640 1 -- 172.21.15.99:0/341329420 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47a945e00 con 0x55d47aa84d00 2024-09-13T23:27:19.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac53415640 1 --2- 172.21.15.99:0/341329420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47aa84d00 0x55d47aa870f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a470 tx=0x7fac44045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45482577f20b9e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5b415640 1 -- 172.21.15.99:0/341329420 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44053570 con 0x55d47aa84d00 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5b415640 1 -- 172.21.15.99:0/341329420 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac44058070 con 0x55d47aa84d00 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5b415640 1 -- 172.21.15.99:0/341329420 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac44053880 con 0x55d47aa84d00 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 -- 172.21.15.99:0/341329420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47aa84d00 msgr2=0x55d47aa870f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 --2- 172.21.15.99:0/341329420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47aa84d00 0x55d47aa870f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fac4400a470 tx=0x7fac44045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 -- 172.21.15.99:0/341329420 shutdown_connections 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 --2- 172.21.15.99:0/341329420 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47aa84d00 0x55d47aa870f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 -- 172.21.15.99:0/341329420 >> 172.21.15.99:0/341329420 conn(0x55d47aa78df0 msgr2=0x55d47aa7b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 -- 172.21.15.99:0/341329420 shutdown_connections 2024-09-13T23:27:19.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.777+0000 7fac5ff22800 1 -- 172.21.15.99:0/341329420 wait complete. 2024-09-13T23:27:19.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.791+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.791+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.791+0000 7fac5ff22800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.791+0000 7fac5ff22800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d47a9ca330 con 0x55d47a9f1df0 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fac5bc16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fac5bc16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57306/0 (socket says 172.21.15.99:57306) 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fac5bc16640 1 -- 172.21.15.99:0/1707827847 learned_addr learned my addr 172.21.15.99:0/1707827847 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fac5bc16640 1 -- 172.21.15.99:0/1707827847 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47a917bc0 con 0x55d47a9f1df0 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fac5bc16640 1 --2- 172.21.15.99:0/1707827847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fac4c001d80 tx=0x7fac4c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6766ec468eaa1230 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fab49e0b640 1 -- 172.21.15.99:0/1707827847 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c013030 con 0x55d47a9f1df0 2024-09-13T23:27:19.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fab49e0b640 1 -- 172.21.15.99:0/1707827847 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c00e470 con 0x55d47a9f1df0 2024-09-13T23:27:19.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.792+0000 7fab49e0b640 1 -- 172.21.15.99:0/1707827847 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c00e810 con 0x55d47a9f1df0 2024-09-13T23:27:19.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- 172.21.15.99:0/1707827847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 msgr2=0x55d47ab6fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1707827847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fac4c001d80 tx=0x7fac4c001e70 comp rx=0 tx=0).stop 2024-09-13T23:27:19.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- 172.21.15.99:0/1707827847 shutdown_connections 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1707827847 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab6fa60 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- 172.21.15.99:0/1707827847 >> 172.21.15.99:0/1707827847 conn(0x55d47aa78df0 msgr2=0x55d47ab6b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- 172.21.15.99:0/1707827847 shutdown_connections 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- 172.21.15.99:0/1707827847 wait complete. 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.793+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5ff22800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5ff22800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d47aa87900 con 0x55d47a9f1df0 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5bc16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5bc16640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57318/0 (socket says 172.21.15.99:57318) 2024-09-13T23:27:19.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5bc16640 1 -- 172.21.15.99:0/2163826867 learned_addr learned my addr 172.21.15.99:0/2163826867 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5bc16640 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47a92bfe0 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.794+0000 7fac5bc16640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fac4c004000 tx=0x7fac4c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.795+0000 7fab43fff640 1 -- 172.21.15.99:0/2163826867 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c027070 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.795+0000 7fab43fff640 1 -- 172.21.15.99:0/2163826867 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c019900 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.795+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d47ab779b0 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.795+0000 7fab43fff640 1 -- 172.21.15.99:0/2163826867 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c019c60 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.795+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47ab77ed0 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fab43fff640 1 -- 172.21.15.99:0/2163826867 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac4c02a070 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fab43fff640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 0x7fab44039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fab43fff640 1 -- 172.21.15.99:0/2163826867 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fac4c01f070 con 0x55d47a9f1df0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac53415640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 0x7fab44039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 0x55d47ab7e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ab7eab0 con 0x55d47aa84d00 2024-09-13T23:27:19.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac5c417640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 0x55d47ab7e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac53415640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 0x7fab44039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fac44057000 tx=0x7fac44052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.796+0000 7fac5c417640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 0x55d47ab7e4e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5c417640 1 -- 172.21.15.99:0/2163826867 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac5400a4a0 con 0x55d47aa84d00 2024-09-13T23:27:19.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ab7ba90 con 0x55d47aa84d00 2024-09-13T23:27:19.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5c417640 1 -- 172.21.15.99:0/2163826867 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac5400a4a0 con 0x55d47aa84d00 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 0x55d47ab831b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ab83850 con 0x55d47ab80dc0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5bc16640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 0x55d47ab831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.797+0000 7fac5bc16640 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 0x55d47ab831b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5bc16640 1 -- 172.21.15.99:0/2163826867 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac4c029030 con 0x55d47ab80dc0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ab7fc60 con 0x55d47aa84d00 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5c417640 1 -- 172.21.15.99:0/2163826867 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac5400a4a0 con 0x55d47aa84d00 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ab80140 con 0x55d47ab80dc0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5bc16640 1 -- 172.21.15.99:0/2163826867 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac4c029030 con 0x55d47ab80dc0 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.798+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5ff22800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5ff22800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d47a919580 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57320/0 (socket says 172.21.15.99:57320) 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5c417640 1 -- 172.21.15.99:0/3655330210 learned_addr learned my addr 172.21.15.99:0/3655330210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5c417640 1 -- 172.21.15.99:0/3655330210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47ab92b40 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.799+0000 7fac5c417640 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55d47ab7ee90 tx=0x7fac540167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.800+0000 7fab417fa640 1 -- 172.21.15.99:0/3655330210 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54013640 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.800+0000 7fab417fa640 1 -- 172.21.15.99:0/3655330210 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac540137e0 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.800+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d47ab92dd0 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.800+0000 7fab417fa640 1 -- 172.21.15.99:0/3655330210 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54013ae0 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.800+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47ab95ab0 con 0x55d47ab921e0 2024-09-13T23:27:19.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fab417fa640 1 -- 172.21.15.99:0/3655330210 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac54011040 con 0x55d47ab921e0 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fab417fa640 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 0x7fab34039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fab417fa640 1 -- 172.21.15.99:0/3655330210 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fac5400e040 con 0x55d47ab921e0 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5bc16640 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 0x7fab34039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5bc16640 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 0x7fab34039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d47ab7b9d0 tx=0x7fac4c02ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5ff22800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5ff22800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d47ab70210 con 0x55d47ab9ef30 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.801+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57326/0 (socket says 172.21.15.99:57326) 2024-09-13T23:27:19.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fac5c417640 1 -- 172.21.15.99:0/2041193439 learned_addr learned my addr 172.21.15.99:0/2041193439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fac5c417640 1 -- 172.21.15.99:0/2041193439 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47ab9f900 con 0x55d47ab9ef30 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fac5c417640 1 --2- 172.21.15.99:0/2041193439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fac5400b010 tx=0x7fac5404d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294cf09acf5d49d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fab3affd640 1 -- 172.21.15.99:0/2041193439 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54021a90 con 0x55d47ab9ef30 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fab3affd640 1 -- 172.21.15.99:0/2041193439 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5404a030 con 0x55d47ab9ef30 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.802+0000 7fab3affd640 1 -- 172.21.15.99:0/2041193439 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54021570 con 0x55d47ab9ef30 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- 172.21.15.99:0/2041193439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 msgr2=0x55d47ab9f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2041193439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fac5400b010 tx=0x7fac5404d060 comp rx=0 tx=0).stop 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- 172.21.15.99:0/2041193439 shutdown_connections 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2041193439 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47ab9f330 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- 172.21.15.99:0/2041193439 >> 172.21.15.99:0/2041193439 conn(0x55d47ab9b290 msgr2=0x55d47ab99390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- 172.21.15.99:0/2041193439 shutdown_connections 2024-09-13T23:27:19.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- 172.21.15.99:0/2041193439 wait complete. 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 Processor -- start 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- start start 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47aba6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5ff22800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55d47ab9ff70 con 0x55d47ab9ef30 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47aba6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5c417640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47aba6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57342/0 (socket says 172.21.15.99:57342) 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.803+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 learned_addr learned my addr 172.21.15.99:0/1297833824 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d47aba68a0 con 0x55d47ab9ef30 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fac5c417640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47aba6360 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fac54012ea0 tx=0x7fac5404cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fab397fa640 1 -- 172.21.15.99:0/1297833824 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54021440 con 0x55d47ab9ef30 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fab397fa640 1 -- 172.21.15.99:0/1297833824 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5404e040 con 0x55d47ab9ef30 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d47aba6b30 con 0x55d47ab9ef30 2024-09-13T23:27:19.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fab397fa640 1 -- 172.21.15.99:0/1297833824 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac54013c80 con 0x55d47ab9ef30 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.804+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d47aba97e0 con 0x55d47ab9ef30 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fab397fa640 1 -- 172.21.15.99:0/1297833824 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fac540400e0 con 0x55d47ab9ef30 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fab397fa640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab24036b40 0x7fab24039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fab397fa640 1 -- 172.21.15.99:0/1297833824 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fac54031070 con 0x55d47ab9ef30 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fac5bc16640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab24036b40 0x7fab24039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fac5bc16640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab24036b40 0x7fab24039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac4c016fd0 tx=0x7fac4c038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.805+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47abb1dd0 0x55d47abb4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb49e0 con 0x55d47abb1dd0 2024-09-13T23:27:19.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac53415640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47abb1dd0 0x55d47abb4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac53415640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47abb1dd0 0x55d47abb4290 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 20 realm 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb4e10 con 0x55d47abb1dd0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.806+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb56e0 con 0x55d47abb1dd0 2024-09-13T23:27:19.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb5a80 con 0x55d47abb1dd0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47abb67e0 0x55d47abb8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb9220 con 0x55d47abb67e0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5c417640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47abb67e0 0x55d47abb8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.807+0000 7fac5c417640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47abb67e0 0x55d47abb8bd0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5ff22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5ff22800 20 searching for the correct realm 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d47abbb200 0x55d47abbd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5bc16640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d47abbb200 0x55d47abbd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5bc16640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d47abbb200 0x55d47abbd6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.808+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac5c417640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fac5404b440 0x7fac540143c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac53415640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fac5404b440 0x7fac540143c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac53415640 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fac5404b440 0x7fac540143c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.809+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.810+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.811+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.812+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.813+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.814+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.815+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abbb200 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x7fac5404b440 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.816+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb1dd0 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbdd90 con 0x55d47abb67e0 2024-09-13T23:27:19.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb9ae0 con 0x55d47abb1dd0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abb9ed0 con 0x55d47abb1dd0 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.817+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbe210 con 0x55d47abb67e0 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 zone default found 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 4 Realm: () 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 zonegroup default 2024-09-13T23:27:19.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbea60 con 0x7fac5404b440 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc07e0 con 0x55d47abbb200 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.818+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc0bf0 con 0x55d47abbb200 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.819+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.819+0000 7fac5ff22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.819+0000 7fac5ff22800 20 started sync module instance, tier type = 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.819+0000 7fac5ff22800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.819+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbfc80 con 0x55d47abb67e0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.820+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.820+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94371080569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbfc80 con 0x55d47abb67e0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.820+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc1700 con 0x55d47abb1dd0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.821+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94371080569264] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.821+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.821+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94371080573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbfc80 con 0x55d47abb1dd0 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.821+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc2180 con 0x55d47abbb200 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.822+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.822+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94371080576144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc2a50 con 0x55d47abbb200 2024-09-13T23:27:19.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.822+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94371080573424] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.822+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abbf7d0 con 0x55d47abb67e0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.823+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.823+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94371080581184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc39e0 con 0x55d47abb67e0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.823+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc43a0 con 0x55d47abb1dd0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.824+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94371080576144] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.825+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94371080581184] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.825+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.825+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94371080582448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc3950 con 0x55d47abb1dd0 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.825+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc4850 con 0x7fac5404b440 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.826+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.826+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94371080582448] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.826+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94371080586144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc47c0 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.826+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc3f10 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.827+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94371080586144] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.827+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.827+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94371080584976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc52e0 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.827+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc5ca0 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94371080584976] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94371080588352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc5ca0 con 0x7fac5404b440 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=0 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=1 2024-09-13T23:27:19.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=2 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=3 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=4 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=5 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.828+0000 7fac5ff22800 20 add_watcher() i=6 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.829+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94371080588352] v33'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.829+0000 7fac5ff22800 20 add_watcher() i=7 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.829+0000 7fac5ff22800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.829+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc90a0 con 0x55d47abb1dd0 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.830+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.830+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94371080591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc6560 con 0x55d47abb1dd0 2024-09-13T23:27:19.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.831+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94371080591808] v33'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.831+0000 7fab11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.831+0000 7fac5ff22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.831+0000 7fac5ff22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.831+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc8e90 con 0x55d47abb1dd0 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.832+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.832+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd21f0 con 0x7fac5404b440 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.833+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.833+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd2630 con 0x55d47abbb200 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.834+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.834+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd2ba0 con 0x55d47abb1dd0 2024-09-13T23:27:19.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.835+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.835+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd3050 con 0x55d47abb67e0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.836+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.836+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd3050 con 0x55d47abbb200 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.837+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.837+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd1780 con 0x55d47abb1dd0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.838+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.838+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd1780 con 0x7fac5404b440 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.839+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.839+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd16c0 con 0x55d47abb67e0 2024-09-13T23:27:19.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.841+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.841+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd16c0 con 0x55d47abbb200 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.841+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.841+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd1190 con 0x55d47abb67e0 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.842+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.842+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd1190 con 0x7fac5404b440 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.844+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'36 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.844+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd1190 con 0x55d47abb67e0 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.845+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.845+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x7fac5404b440 2024-09-13T23:27:19.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.846+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'59 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.846+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb1dd0 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.847+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.847+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.848+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'73 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.848+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb67e0 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.849+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.849+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.850+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.850+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb1dd0 2024-09-13T23:27:19.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.851+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'38 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.851+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb1dd0 2024-09-13T23:27:19.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.852+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.852+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.853+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'74 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.853+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb67e0 2024-09-13T23:27:19.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.854+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.854+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.855+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.855+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.856+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.856+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.857+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.857+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.857+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.857+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x7fac5404b440 2024-09-13T23:27:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.859+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.859+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.860+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.860+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x7fac5404b440 2024-09-13T23:27:19.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.861+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.861+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abbb200 2024-09-13T23:27:19.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.862+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'75 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.862+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x7fac5404b440 2024-09-13T23:27:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.863+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.863+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd39e0 con 0x55d47abb67e0 2024-09-13T23:27:19.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.864+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'36 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.864+0000 7fab10fe1640 20 reqs_thread_entry: start 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 20 Filter name: none 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7faa8a7fc640 20 reqs_thread_entry: start 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47abfe690 con 0x7fac5404b440 2024-09-13T23:27:19.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.865+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ac00f70 con 0x7fac5404b440 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.866+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.866+0000 7fac5ff22800 10 removing key index: system_akey 2024-09-13T23:27:19.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.866+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abfe670 con 0x55d47abbb200 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(96 system_akey [delete] v33'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5ff22800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94371080829616 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ac01390 con 0x55d47abb1dd0 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== watch-notify(notify (1) cookie 94371080573424 notify 141733920803 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55d47abd1f30 con 0x55d47abb1dd0 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fab3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920803 cookie 94371080573424 notifier 4857 bl.length()=161 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(97 notify.1 [notify cookie 94371080829616 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fab3affd640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fab20003d60 con 0x55d47abb1dd0 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== watch-notify(notify_complete (2) cookie 94371080829616 notify 141733920803 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d47abc9020 con 0x55d47abb1dd0 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5ff22800 10 removing email index: 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5ff22800 10 removing user buckets index 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.867+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abfef00 con 0x7fac5404b440 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.868+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(99 system_user.buckets [delete] v33'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.869+0000 7fac5ff22800 10 removing user index: system_user 2024-09-13T23:27:19.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.869+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47ac030a0 con 0x7fac5404b440 2024-09-13T23:27:19.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.869+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(100 system_user [call,call,delete] v33'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.869+0000 7fac5ff22800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.869+0000 7fac5ff22800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94371080842224 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55d47ac03010 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== watch-notify(notify (1) cookie 94371080569264 notify 141733920792 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d47aba6b30 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fab3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920792 cookie 94371080569264 notifier 4857 bl.length()=160 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(101 notify.0 [notify cookie 94371080842224 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fab3affd640 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fab20003d60 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== watch-notify(notify_complete (2) cookie 94371080842224 notify 141733920792 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d47aba68a0 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.870+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.871+0000 7fab11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:19.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.871+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94371080591808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abd0770 con 0x55d47abb1dd0 2024-09-13T23:27:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.872+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94371080591808] v33'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.872+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94371080569264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc5990 con 0x55d47abb67e0 2024-09-13T23:27:19.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.873+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94371080569264] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.873+0000 7fac5ff22800 20 remove_watcher() i=0 2024-09-13T23:27:19.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.873+0000 7fac5ff22800 2 removed watcher, disabling cache 2024-09-13T23:27:19.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.873+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94371080573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc01b0 con 0x55d47abb1dd0 2024-09-13T23:27:19.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.874+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94371080573424] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.874+0000 7fac5ff22800 20 remove_watcher() i=1 2024-09-13T23:27:19.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.874+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94371080576144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc01b0 con 0x55d47abbb200 2024-09-13T23:27:19.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.876+0000 7fac5bc16640 1 -- 172.21.15.99:0/1297833824 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94371080576144] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c029030 con 0x55d47abbb200 2024-09-13T23:27:19.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.876+0000 7fac5ff22800 20 remove_watcher() i=2 2024-09-13T23:27:19.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.876+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94371080581184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc01b0 con 0x55d47abb67e0 2024-09-13T23:27:19.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.877+0000 7fac5c417640 1 -- 172.21.15.99:0/1297833824 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94371080581184] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5403b020 con 0x55d47abb67e0 2024-09-13T23:27:19.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.877+0000 7fac5ff22800 20 remove_watcher() i=3 2024-09-13T23:27:19.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.877+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94371080582448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc3040 con 0x55d47abb1dd0 2024-09-13T23:27:19.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.878+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94371080582448] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x55d47abb1dd0 2024-09-13T23:27:19.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.878+0000 7fac5ff22800 20 remove_watcher() i=4 2024-09-13T23:27:19.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.878+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94371080586144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc01b0 con 0x7fac5404b440 2024-09-13T23:27:19.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.879+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94371080586144] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.879+0000 7fac5ff22800 20 remove_watcher() i=5 2024-09-13T23:27:19.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.879+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94371080584976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc3530 con 0x7fac5404b440 2024-09-13T23:27:19.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.880+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94371080584976] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.880+0000 7fac5ff22800 20 remove_watcher() i=6 2024-09-13T23:27:19.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.880+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94371080588352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55d47abc43a0 con 0x7fac5404b440 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94371080588352] v33'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac44051070 con 0x7fac5404b440 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 20 remove_watcher() i=7 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fac5404b440 msgr2=0x7fac540143c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fac5404b440 0x7fac540143c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47abb1dd0 msgr2=0x55d47abb4290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47abb1dd0 0x55d47abb4290 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47abb67e0 msgr2=0x55d47abb8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47abb67e0 0x55d47abb8bd0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d47abbb200 msgr2=0x55d47abbd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55d47abbb200 0x55d47abbd6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab24036b40 msgr2=0x7fab24039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab24036b40 0x7fab24039000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac4c016fd0 tx=0x7fac4c038000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 msgr2=0x55d47aba6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 --2- 172.21.15.99:0/1297833824 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab9ef30 0x55d47aba6360 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fac54012ea0 tx=0x7fac5404cd40 comp rx=0 tx=0).stop 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac53415640 1 -- 172.21.15.99:0/1297833824 reap_dead start 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 shutdown_connections 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 >> 172.21.15.99:0/1297833824 conn(0x55d47ab9b290 msgr2=0x55d47ab99360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.881+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 shutdown_connections 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/1297833824 wait complete. 2024-09-13T23:27:19.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 msgr2=0x7fab34039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 0x7fab34039000 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55d47ab7b9d0 tx=0x7fac4c02ae80 comp rx=0 tx=0).stop 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 msgr2=0x55d47ab92600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x55d47ab7ee90 tx=0x7fac540167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 shutdown_connections 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab34036b40 0x7fab34039000 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/3655330210 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47ab921e0 0x55d47ab92600 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 >> 172.21.15.99:0/3655330210 conn(0x55d47ab87170 msgr2=0x55d47ab89cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 shutdown_connections 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/3655330210 wait complete. 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 msgr2=0x55d47ab7e4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 0x55d47ab7e4e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 msgr2=0x55d47ab831b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 0x55d47ab831b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 msgr2=0x7fab44039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 0x7fab44039000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fac44057000 tx=0x7fac44052000 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 msgr2=0x55d47ab77470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fac4c004000 tx=0x7fac4c000bc0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 shutdown_connections 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55d47ab80dc0 0x55d47ab831b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55d47aa84d00 0x55d47ab7e4e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fab44036b40 0x7fab44039000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 --2- 172.21.15.99:0/2163826867 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55d47a9f1df0 0x55d47ab77470 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 >> 172.21.15.99:0/2163826867 conn(0x55d47aa78df0 msgr2=0x55d47ab69cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 shutdown_connections 2024-09-13T23:27:19.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.882+0000 7fac5ff22800 1 -- 172.21.15.99:0/2163826867 wait complete. 2024-09-13T23:27:19.892 ERROR:root:None 2024-09-13T23:27:19.892 ERROR:root:0 2024-09-13T23:27:19.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T23:27:19.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T23:27:19.893 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T23:27:19.945 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:19.946 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2dce0f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559b8d983950 0x559b8d985d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2dce0f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b8d83fb30 con 0x559b8d97f510 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2dce0f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x559b8d821360 con 0x559b8d983950 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.945+0000 7ff2d3fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x559b8d983950 0x559b8d985d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.946+0000 7ff2da903640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x559b8d97f510 0x559b8d97f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55242/0 (socket says 172.21.15.99:55242) 2024-09-13T23:27:19.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.946+0000 7ff2da903640 1 -- 172.21.15.99:0/392083386 learned_addr learned my addr 172.21.15.99:0/392083386 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.946+0000 7ff2d3fff640 1 -- 172.21.15.99:0/392083386 >> v1:172.21.15.43:6789/0 conn(0x559b8d97f510 legacy=0x559b8d97f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.946+0000 7ff2d3fff640 1 -- 172.21.15.99:0/392083386 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8d847e00 con 0x559b8d983950 2024-09-13T23:27:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/392083386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d983950 0x559b8d985d40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400a470 tx=0x7ff2c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adb62a626e6253e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2da102640 1 -- 172.21.15.99:0/392083386 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c4053570 con 0x559b8d983950 2024-09-13T23:27:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2da102640 1 -- 172.21.15.99:0/392083386 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c4058070 con 0x559b8d983950 2024-09-13T23:27:19.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2da102640 1 -- 172.21.15.99:0/392083386 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2c4053880 con 0x559b8d983950 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 -- 172.21.15.99:0/392083386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d983950 msgr2=0x559b8d985d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/392083386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d983950 0x559b8d985d40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400a470 tx=0x7ff2c4045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 -- 172.21.15.99:0/392083386 shutdown_connections 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/392083386 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d983950 0x559b8d985d40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 -- 172.21.15.99:0/392083386 >> 172.21.15.99:0/392083386 conn(0x559b8d97ae00 msgr2=0x559b8d97d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 -- 172.21.15.99:0/392083386 shutdown_connections 2024-09-13T23:27:19.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.948+0000 7ff2dce0f800 1 -- 172.21.15.99:0/392083386 wait complete. 2024-09-13T23:27:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.962+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.962+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.962+0000 7ff2dce0f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.962+0000 7ff2dce0f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b8d8cc450 con 0x559b8d97f510 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff2da903640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff2da903640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57354/0 (socket says 172.21.15.99:57354) 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff2da903640 1 -- 172.21.15.99:0/918742833 learned_addr learned my addr 172.21.15.99:0/918742833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff2da903640 1 -- 172.21.15.99:0/918742833 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8d819bc0 con 0x559b8d97f510 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff2da903640 1 --2- 172.21.15.99:0/918742833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001e10 tx=0x7ff2cc00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82588a1efc72ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff1c8e09640 1 -- 172.21.15.99:0/918742833 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc012020 con 0x559b8d97f510 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff1c8e09640 1 -- 172.21.15.99:0/918742833 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00e5a0 con 0x559b8d97f510 2024-09-13T23:27:19.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.963+0000 7ff1c8e09640 1 -- 172.21.15.99:0/918742833 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc00e8e0 con 0x559b8d97f510 2024-09-13T23:27:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- 172.21.15.99:0/918742833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 msgr2=0x559b8d8f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/918742833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001e10 tx=0x7ff2cc00b780 comp rx=0 tx=0).stop 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- 172.21.15.99:0/918742833 shutdown_connections 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/918742833 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8d8f3dd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- 172.21.15.99:0/918742833 >> 172.21.15.99:0/918742833 conn(0x559b8d97ae00 msgr2=0x559b8da6a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- 172.21.15.99:0/918742833 shutdown_connections 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- 172.21.15.99:0/918742833 wait complete. 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.964+0000 7ff2dce0f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b8d986580 con 0x559b8d97f510 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2da903640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2da903640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57358/0 (socket says 172.21.15.99:57358) 2024-09-13T23:27:19.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2da903640 1 -- 172.21.15.99:0/164339716 learned_addr learned my addr 172.21.15.99:0/164339716 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2da903640 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8d82dfe0 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2da903640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001e10 tx=0x7ff2cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff1c7606640 1 -- 172.21.15.99:0/164339716 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc012030 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff1c7606640 1 -- 172.21.15.99:0/164339716 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc01a7a0 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8da79a50 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff1c7606640 1 -- 172.21.15.99:0/164339716 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc01aac0 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.965+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8da79f70 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff1c7606640 1 -- 172.21.15.99:0/164339716 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff2cc015020 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff1c7606640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 0x7ff1c0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff1c7606640 1 -- 172.21.15.99:0/164339716 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ff2cc020030 con 0x559b8d97f510 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 0x7ff1c0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 0x559b8da80580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8da80ac0 con 0x559b8d983950 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.966+0000 7ff2db104640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 0x559b8da80580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 0x7ff1c0039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4057000 tx=0x7ff2c4052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2db104640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 0x559b8da80580 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2db104640 1 -- 172.21.15.99:0/164339716 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2d400a4a0 con 0x559b8d983950 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8da7db30 con 0x559b8d983950 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2db104640 1 -- 172.21.15.99:0/164339716 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2d400a4a0 con 0x559b8d983950 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 0x559b8da851c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8da85860 con 0x559b8da82dd0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.967+0000 7ff2da903640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 0x559b8da851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.968+0000 7ff2da903640 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 0x559b8da851c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.968+0000 7ff2da903640 1 -- 172.21.15.99:0/164339716 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2cc00dcd0 con 0x559b8da82dd0 2024-09-13T23:27:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.968+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8da81c70 con 0x559b8d983950 2024-09-13T23:27:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.968+0000 7ff2db104640 1 -- 172.21.15.99:0/164339716 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2d400a4a0 con 0x559b8d983950 2024-09-13T23:27:19.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.968+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8da82150 con 0x559b8da82dd0 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2da903640 1 -- 172.21.15.99:0/164339716 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2cc00dcd0 con 0x559b8da82dd0 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2dce0f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2dce0f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b8d81b580 con 0x559b8da941e0 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.969+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57360/0 (socket says 172.21.15.99:57360) 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff2db104640 1 -- 172.21.15.99:0/3001261920 learned_addr learned my addr 172.21.15.99:0/3001261920 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff2db104640 1 -- 172.21.15.99:0/3001261920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8da94b40 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff2db104640 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x559b8da7a5c0 tx=0x7ff2d40167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff1c4e01640 1 -- 172.21.15.99:0/3001261920 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4013640 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff1c4e01640 1 -- 172.21.15.99:0/3001261920 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d40137e0 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff1c4e01640 1 -- 172.21.15.99:0/3001261920 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4013ae0 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8da94dd0 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.970+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8da97ab0 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.971+0000 7ff1c4e01640 1 -- 172.21.15.99:0/3001261920 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff2d4011040 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.971+0000 7ff1c4e01640 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 0x7ff1b40390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.971+0000 7ff1c4e01640 1 -- 172.21.15.99:0/3001261920 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ff2d400e040 con 0x559b8da941e0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.971+0000 7ff2da903640 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 0x7ff1b40390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.971+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2da903640 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 0x7ff1b40390c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc04b040 tx=0x7ff2cc024000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2dce0f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2dce0f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b8da74a30 con 0x559b8daa0e50 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57376/0 (socket says 172.21.15.99:57376) 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2db104640 1 -- 172.21.15.99:0/3691962928 learned_addr learned my addr 172.21.15.99:0/3691962928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.972+0000 7ff2db104640 1 -- 172.21.15.99:0/3691962928 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8daa1820 con 0x559b8daa0e50 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2db104640 1 --2- 172.21.15.99:0/3691962928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400afb0 tx=0x7ff2d401fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49eca54777386fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff1be7fc640 1 -- 172.21.15.99:0/3691962928 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4021440 con 0x559b8daa0e50 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff1be7fc640 1 -- 172.21.15.99:0/3691962928 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d401f340 con 0x559b8daa0e50 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff1be7fc640 1 -- 172.21.15.99:0/3691962928 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40215e0 con 0x559b8daa0e50 2024-09-13T23:27:19.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3691962928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 msgr2=0x559b8daa1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3691962928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400afb0 tx=0x7ff2d401fce0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3691962928 shutdown_connections 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3691962928 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa1250 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3691962928 >> 172.21.15.99:0/3691962928 conn(0x559b8da9d1b0 msgr2=0x559b8da9b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3691962928 shutdown_connections 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3691962928 wait complete. 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.973+0000 7ff2dce0f800 1 Processor -- start 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2dce0f800 1 -- start start 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2dce0f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2dce0f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x559b8daa1df0 con 0x559b8daa0e50 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2db104640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57388/0 (socket says 172.21.15.99:57388) 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 learned_addr learned my addr 172.21.15.99:0/1452331158 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b8daa8840 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2db104640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa8300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4048010 tx=0x7ff2d404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff1bcff9640 1 -- 172.21.15.99:0/1452331158 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4040360 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff1bcff9640 1 -- 172.21.15.99:0/1452331158 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d404e2b0 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.974+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b8daa8ad0 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.975+0000 7ff1bcff9640 1 -- 172.21.15.99:0/1452331158 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d404e5b0 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.975+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b8daa8ad0 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.975+0000 7ff1bcff9640 1 -- 172.21.15.99:0/1452331158 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ff2d404eac0 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.975+0000 7ff1bcff9640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1a4036b40 0x7ff1a4039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.975+0000 7ff1bcff9640 1 -- 172.21.15.99:0/1452331158 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ff2d4045c60 con 0x559b8daa0e50 2024-09-13T23:27:19.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2da903640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1a4036b40 0x7ff1a4039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2da903640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1a4036b40 0x7ff1a4039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001620 tx=0x7ff2cc036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8dab3c80 0x559b8dab6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dab6890 con 0x559b8dab3c80 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.976+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8dab3c80 0x559b8dab6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8dab3c80 0x559b8dab6140 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 realm 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dab6cc0 con 0x559b8dab3c80 2024-09-13T23:27:19.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dab7590 con 0x559b8dab3c80 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dab7930 con 0x559b8dab3c80 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:19.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.977+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8dab8690 0x559b8dabaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabb090 con 0x559b8dab8690 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2db104640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8dab8690 0x559b8dabaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2db104640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8dab8690 0x559b8dabaa80 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2dce0f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2dce0f800 20 searching for the correct realm 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559b8dabd020 0x559b8dabf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.978+0000 7ff2da903640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559b8dabd020 0x559b8dabf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2da903640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559b8dabd020 0x559b8dabf4e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:19.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2db104640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff2d4044070 0x7ff2d4017e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.979+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff2d4044070 0x7ff2d4017e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff2d4044070 0x7ff2d4017e80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.980+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.981+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.982+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.983+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.984+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.985+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dabd020 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.986+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x7ff2d4044070 2024-09-13T23:27:20.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab3c80 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabfbb0 con 0x559b8dab8690 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabc570 con 0x559b8dab3c80 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.987+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabbde0 con 0x559b8dab3c80 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac0030 con 0x559b8dab8690 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 zone default found 2024-09-13T23:27:20.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 4 Realm: () 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 zonegroup default 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dabb9f0 con 0x7ff2d4044070 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.988+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac2760 con 0x559b8dabd020 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac2b00 con 0x559b8dabd020 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 20 started sync module instance, tier type = 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.989+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac1bf0 con 0x559b8dab8690 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.990+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.990+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94126585159696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac1850 con 0x559b8dab8690 2024-09-13T23:27:20.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.990+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac3840 con 0x559b8dab3c80 2024-09-13T23:27:20.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.991+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94126585159696] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.992+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.992+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94126585163424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac3c30 con 0x559b8dab3c80 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.992+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac4660 con 0x559b8dabd020 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.993+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.993+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94126585168240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac4f00 con 0x559b8dabd020 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.993+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac5a00 con 0x559b8dab8690 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.993+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94126585163424] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.994+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94126585168240] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.994+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.994+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94126585170512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac32c0 con 0x559b8dab8690 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.994+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac6410 con 0x559b8dab3c80 2024-09-13T23:27:20.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.995+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.995+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94126585170512] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.995+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94126585175904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac6830 con 0x559b8dab3c80 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.995+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac54f0 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.996+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.996+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94126585173232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac71f0 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.996+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac7c30 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.996+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94126585175904] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.997+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94126585173232] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.997+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.997+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94126585181952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac6d40 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.997+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac82c0 con 0x7ff2d4044070 2024-09-13T23:27:20.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.998+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94126585181952] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94126585176960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac82c0 con 0x7ff2d4044070 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=0 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=1 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=2 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=3 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=4 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=5 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=6 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94126585176960] v33'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 20 add_watcher() i=7 2024-09-13T23:27:20.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:19.999+0000 7ff2dce0f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.000+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dacb4b0 con 0x559b8dab3c80 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.000+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.000+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94126585183760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dac86e0 con 0x559b8dab3c80 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94126585183760] v33'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff1917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2dce0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2dce0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2dce0f800 5 note: GC not initialized 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff10bfff640 20 reqs_thread_entry: start 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2dce0f800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.001+0000 7ff2dce0f800 20 Filter name: none 2024-09-13T23:27:20.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff109ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafe900 con 0x559b8dabd020 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafd3f0 con 0x559b8dabd020 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.002+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafd3f0 con 0x559b8dabd020 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v33'5 uv5 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2dce0f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2dce0f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2dce0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94126585401472 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8db02670 con 0x559b8dabd020 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== watch-notify(notify (1) cookie 94126585168240 notify 141733920777 ret 0) ==== 584+0+0 (crc 0 0 0) 0x559b8db01ef0 con 0x559b8dabd020 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff1be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920777 cookie 94126585168240 notifier 4864 bl.length()=542 2024-09-13T23:27:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff1be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff1be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.003+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(65 notify.2 [notify cookie 94126585401472 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.004+0000 7ff1be7fc640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff1a0003ea0 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.004+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.004+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== watch-notify(notify_complete (2) cookie 94126585401472 notify 141733920777 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b8dafdab0 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.004+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafd080 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.005+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v33'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.005+0000 7ff2dce0f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.005+0000 7ff2dce0f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.005+0000 7ff2dce0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T23:27:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.005+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94126585401472 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x559b8db02aa0 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== watch-notify(notify (1) cookie 94126585173232 notify 141733920814 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7ff2c4083040 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff1bdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920814 cookie 94126585173232 notifier 4864 bl.length()=175 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff1bdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff1bdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff1bdffb640 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ff110003400 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(68 notify.5 [notify cookie 94126585401472 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.006+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== watch-notify(notify_complete (2) cookie 94126585401472 notify 141733920814 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b8d847e00 con 0x7ff2d4044070 2024-09-13T23:27:20.023 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T23:27:20.003701Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:20.003690Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.007+0000 7ff1917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.007+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94126585183760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dab3c80 2024-09-13T23:27:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.008+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94126585183760] v33'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.008+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94126585159696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dab8690 2024-09-13T23:27:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.009+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94126585159696] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.009+0000 7ff2dce0f800 20 remove_watcher() i=0 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.009+0000 7ff2dce0f800 2 removed watcher, disabling cache 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.009+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94126585163424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dab3c80 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.010+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94126585163424] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.010+0000 7ff2dce0f800 20 remove_watcher() i=1 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.010+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94126585168240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dabd020 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.011+0000 7ff2da903640 1 -- 172.21.15.99:0/1452331158 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94126585168240] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc053040 con 0x559b8dabd020 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.011+0000 7ff2dce0f800 20 remove_watcher() i=2 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.011+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94126585170512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dab8690 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.012+0000 7ff2db104640 1 -- 172.21.15.99:0/1452331158 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94126585170512] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d403b020 con 0x559b8dab8690 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.012+0000 7ff2dce0f800 20 remove_watcher() i=3 2024-09-13T23:27:20.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.012+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94126585175904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x559b8dab3c80 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.013+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94126585175904] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x559b8dab3c80 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.013+0000 7ff2dce0f800 20 remove_watcher() i=4 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.013+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94126585173232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.014+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94126585173232] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.014+0000 7ff2dce0f800 20 remove_watcher() i=5 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.014+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94126585181952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.015+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94126585181952] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.015+0000 7ff2dce0f800 20 remove_watcher() i=6 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.015+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94126585176960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x559b8dafc620 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.016+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94126585176960] v33'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2c4051070 con 0x7ff2d4044070 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.016+0000 7ff2dce0f800 20 remove_watcher() i=7 2024-09-13T23:27:20.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.016+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff2d4044070 msgr2=0x7ff2d4017e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.016+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ff2d4044070 0x7ff2d4017e80 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8dab3c80 msgr2=0x559b8dab6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8dab3c80 0x559b8dab6140 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8dab8690 msgr2=0x559b8dabaa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8dab8690 0x559b8dabaa80 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559b8dabd020 msgr2=0x559b8dabf4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x559b8dabd020 0x559b8dabf4e0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1a4036b40 msgr2=0x7ff1a4039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1a4036b40 0x7ff1a4039000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001620 tx=0x7ff2cc036000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 msgr2=0x559b8daa8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/1452331158 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8daa0e50 0x559b8daa8300 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4048010 tx=0x7ff2d404cd90 comp rx=0 tx=0).stop 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 reap_dead start 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2d3fff640 1 -- 172.21.15.99:0/1452331158 reap_dead start 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 shutdown_connections 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 >> 172.21.15.99:0/1452331158 conn(0x559b8da9d1b0 msgr2=0x559b8da9b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 shutdown_connections 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/1452331158 wait complete. 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 msgr2=0x7ff1b40390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 0x7ff1b40390c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc04b040 tx=0x7ff2cc024000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 msgr2=0x559b8da94600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x559b8da7a5c0 tx=0x7ff2d40167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 shutdown_connections 2024-09-13T23:27:20.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1b4036c00 0x7ff1b40390c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/3001261920 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8da941e0 0x559b8da94600 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 >> 172.21.15.99:0/3001261920 conn(0x559b8da89170 msgr2=0x559b8da8bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 shutdown_connections 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/3001261920 wait complete. 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 msgr2=0x559b8da80580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.017+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 0x559b8da80580 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 msgr2=0x559b8da851c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 0x559b8da851c0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 msgr2=0x7ff1c0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 0x7ff1c0039000 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4057000 tx=0x7ff2c4052000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 msgr2=0x559b8da79510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc001e10 tx=0x7ff2cc000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 shutdown_connections 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x559b8da82dd0 0x559b8da851c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x559b8d983950 0x559b8da80580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ff1c0036b40 0x7ff1c0039000 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 --2- 172.21.15.99:0/164339716 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x559b8d97f510 0x559b8da79510 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 >> 172.21.15.99:0/164339716 conn(0x559b8d97ae00 msgr2=0x559b8da68a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 shutdown_connections 2024-09-13T23:27:20.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.018+0000 7ff2dce0f800 1 -- 172.21.15.99:0/164339716 wait complete. 2024-09-13T23:27:20.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T23:27:20.003701Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:20.003690Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.036 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T23:27:20.003701Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:20.003690Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.036 ERROR:root:0 2024-09-13T23:27:20.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:20.049 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:20.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T23:27:20.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T23:27:20.050 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T23:27:20.093 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.094 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61b332d800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557203344df0 0x5572033d65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61b332d800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557203290b30 con 0x5572033d6b20 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61b332d800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x557203272360 con 0x557203344df0 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61af080640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557203344df0 0x5572033d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61ae87f640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5572033d6b20 0x5572033d8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55258/0 (socket says 172.21.15.99:55258) 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61af080640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x557203344df0 0x5572033d65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57398/0 (socket says 172.21.15.99:57398) 2024-09-13T23:27:20.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.093+0000 7f61ae87f640 1 -- 172.21.15.99:0/991501379 learned_addr learned my addr 172.21.15.99:0/991501379 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.094+0000 7f61af080640 1 -- 172.21.15.99:0/991501379 >> v1:172.21.15.43:6789/0 conn(0x5572033d6b20 legacy=0x5572033d8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.094+0000 7f61af080640 1 -- 172.21.15.99:0/991501379 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557203298e00 con 0x557203344df0 2024-09-13T23:27:20.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.095+0000 7f61af080640 1 --2- 172.21.15.99:0/991501379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572033d65e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f2f9aa1612e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61ae07e640 1 -- 172.21.15.99:0/991501379 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a0058530 con 0x557203344df0 2024-09-13T23:27:20.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61ae07e640 1 -- 172.21.15.99:0/991501379 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a00586d0 con 0x557203344df0 2024-09-13T23:27:20.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61ae07e640 1 -- 172.21.15.99:0/991501379 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a00589d0 con 0x557203344df0 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 -- 172.21.15.99:0/991501379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 msgr2=0x5572033d65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 --2- 172.21.15.99:0/991501379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572033d65e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005fd0 tx=0x7f61a0045c30 comp rx=0 tx=0).stop 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 -- 172.21.15.99:0/991501379 shutdown_connections 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 --2- 172.21.15.99:0/991501379 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572033d65e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 -- 172.21.15.99:0/991501379 >> 172.21.15.99:0/991501379 conn(0x5572033cbdf0 msgr2=0x5572033ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 -- 172.21.15.99:0/991501379 shutdown_connections 2024-09-13T23:27:20.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.096+0000 7f61b332d800 1 -- 172.21.15.99:0/991501379 wait complete. 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61b332d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61b332d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55720331d330 con 0x557203344df0 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61af080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61af080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57406/0 (socket says 172.21.15.99:57406) 2024-09-13T23:27:20.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.110+0000 7f61af080640 1 -- 172.21.15.99:0/2408284479 learned_addr learned my addr 172.21.15.99:0/2408284479 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.111+0000 7f61af080640 1 -- 172.21.15.99:0/2408284479 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55720326abc0 con 0x557203344df0 2024-09-13T23:27:20.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.111+0000 7f61af080640 1 --2- 172.21.15.99:0/2408284479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f61a000a3f0 tx=0x7f61a0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e2c40d2be21563 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.111+0000 7f609d60a640 1 -- 172.21.15.99:0/2408284479 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a00589b0 con 0x557203344df0 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.111+0000 7f609d60a640 1 -- 172.21.15.99:0/2408284479 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0068070 con 0x557203344df0 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.111+0000 7f609d60a640 1 -- 172.21.15.99:0/2408284479 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a0058c80 con 0x557203344df0 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- 172.21.15.99:0/2408284479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 msgr2=0x5572034c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 --2- 172.21.15.99:0/2408284479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f61a000a3f0 tx=0x7f61a0051000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- 172.21.15.99:0/2408284479 shutdown_connections 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 --2- 172.21.15.99:0/2408284479 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034c2aa0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- 172.21.15.99:0/2408284479 >> 172.21.15.99:0/2408284479 conn(0x5572033cbdf0 msgr2=0x5572034be460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- 172.21.15.99:0/2408284479 shutdown_connections 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- 172.21.15.99:0/2408284479 wait complete. 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.112+0000 7f61b332d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5572033da900 con 0x557203344df0 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61af080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61af080640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57414/0 (socket says 172.21.15.99:57414) 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61af080640 1 -- 172.21.15.99:0/3060758549 learned_addr learned my addr 172.21.15.99:0/3060758549 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61af080640 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55720327efe0 con 0x557203344df0 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61af080640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61a0065040 tx=0x7f61a0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f609be07640 1 -- 172.21.15.99:0/3060758549 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a0063570 con 0x557203344df0 2024-09-13T23:27:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f609be07640 1 -- 172.21.15.99:0/3060758549 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a0063710 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f609be07640 1 -- 172.21.15.99:0/3060758549 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a0063a10 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572034ca820 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.113+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572034cad40 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f609be07640 1 -- 172.21.15.99:0/3060758549 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f61a0075020 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f609be07640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 0x7f6094039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f609be07640 1 -- 172.21.15.99:0/3060758549 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f61a0090c40 con 0x557203344df0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f61ae87f640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 0x7f6094039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 0x5572034d1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.114+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572034d1890 con 0x5572033d6b20 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61af881640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 0x5572034d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61ae87f640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 0x7f6094039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000f60 tx=0x7f61a40012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61af881640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 0x5572034d1350 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61af881640 1 -- 172.21.15.99:0/3060758549 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a80083e0 con 0x5572033d6b20 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572034ce900 con 0x5572033d6b20 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.115+0000 7f61af881640 1 -- 172.21.15.99:0/3060758549 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61a80083e0 con 0x5572033d6b20 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 0x5572034d5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572034d66a0 con 0x5572034d3bc0 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61af080640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 0x5572034d5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61af080640 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 0x5572034d5fb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61af080640 1 -- 172.21.15.99:0/3060758549 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f61a0077410 con 0x5572034d3bc0 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572034d2a60 con 0x5572033d6b20 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.116+0000 7f61af881640 1 -- 172.21.15.99:0/3060758549 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61a80083e0 con 0x5572033d6b20 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572034d2f00 con 0x5572034d3bc0 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61af080640 1 -- 172.21.15.99:0/3060758549 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f61a0077410 con 0x5572034d3bc0 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61b332d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61b332d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55720326c580 con 0x5572034e5000 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.117+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57426/0 (socket says 172.21.15.99:57426) 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61af881640 1 -- 172.21.15.99:0/4162054956 learned_addr learned my addr 172.21.15.99:0/4162054956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61af881640 1 -- 172.21.15.99:0/4162054956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572034e5960 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61af881640 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x5572034cb390 tx=0x7f61a800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f6099602640 1 -- 172.21.15.99:0/4162054956 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a801c020 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f6099602640 1 -- 172.21.15.99:0/4162054956 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a8007c30 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572034e5bf0 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f6099602640 1 -- 172.21.15.99:0/4162054956 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a8018440 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.118+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572034e88d0 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.119+0000 7f6099602640 1 -- 172.21.15.99:0/4162054956 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f61a801f020 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.119+0000 7f6099602640 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 0x7f60880390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.119+0000 7f6099602640 1 -- 172.21.15.99:0/4162054956 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f61a804e1f0 con 0x5572034e5000 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.119+0000 7f61af080640 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 0x7f60880390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.119+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af080640 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 0x7f60880390c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f61a000a3f0 tx=0x7f61a004ff90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61b332d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61b332d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5572034c3190 con 0x5572034f1c40 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57430/0 (socket says 172.21.15.99:57430) 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af881640 1 -- 172.21.15.99:0/3720682044 learned_addr learned my addr 172.21.15.99:0/3720682044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af881640 1 -- 172.21.15.99:0/3720682044 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572034f2610 con 0x5572034f1c40 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.120+0000 7f61af881640 1 --2- 172.21.15.99:0/3720682044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f61a804c600 tx=0x7f61a8016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38820aff6138a99e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f6092ffd640 1 -- 172.21.15.99:0/3720682044 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a8045070 con 0x5572034f1c40 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f6092ffd640 1 -- 172.21.15.99:0/3720682044 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80188f0 con 0x5572034f1c40 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f6092ffd640 1 -- 172.21.15.99:0/3720682044 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a8021550 con 0x5572034f1c40 2024-09-13T23:27:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- 172.21.15.99:0/3720682044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 msgr2=0x5572034f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 --2- 172.21.15.99:0/3720682044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f61a804c600 tx=0x7f61a8016630 comp rx=0 tx=0).stop 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- 172.21.15.99:0/3720682044 shutdown_connections 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 --2- 172.21.15.99:0/3720682044 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f2040 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- 172.21.15.99:0/3720682044 >> 172.21.15.99:0/3720682044 conn(0x5572034ee030 msgr2=0x5572034ec130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- 172.21.15.99:0/3720682044 shutdown_connections 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- 172.21.15.99:0/3720682044 wait complete. 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 Processor -- start 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.121+0000 7f61b332d800 1 -- start start 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61b332d800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61b332d800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5572034f2c50 con 0x5572034f1c40 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61af881640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57434/0 (socket says 172.21.15.99:57434) 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 learned_addr learned my addr 172.21.15.99:0/2331827027 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572034f9690 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61af881640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f9150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f61a8043040 tx=0x7f61a804c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f60917fa640 1 -- 172.21.15.99:0/2331827027 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a8045030 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572034f9920 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f60917fa640 1 -- 172.21.15.99:0/2331827027 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a80296e0 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f60917fa640 1 -- 172.21.15.99:0/2331827027 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61a803fe60 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.122+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572034fc5d0 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.123+0000 7f60917fa640 1 -- 172.21.15.99:0/2331827027 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f61a8016040 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.123+0000 7f60917fa640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6078036b40 0x7f6078039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.123+0000 7f60917fa640 1 -- 172.21.15.99:0/2331827027 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f61a8046070 con 0x5572034f1c40 2024-09-13T23:27:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.123+0000 7f61af080640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6078036b40 0x7f6078039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61af080640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6078036b40 0x7f6078039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61a0059f90 tx=0x7f61a0098000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557203504ba0 0x557203507060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572035077b0 con 0x557203504ba0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61ae87f640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557203504ba0 0x557203507060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.124+0000 7f61ae87f640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557203504ba0 0x557203507060 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a4009050 con 0x557203504ba0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 realm 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203503ff0 con 0x557203504ba0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a4009050 con 0x557203504ba0 2024-09-13T23:27:20.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5572035082a0 con 0x557203504ba0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a4009050 con 0x557203504ba0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203508b70 con 0x557203504ba0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f61a4009050 con 0x557203504ba0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572035094b0 0x55720350b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.125+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55720350c030 con 0x5572035094b0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61af881640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572035094b0 0x55720350b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61af881640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572035094b0 0x55720350b8a0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61b332d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61b332d800 20 searching for the correct realm 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55720350e000 0x5572035104c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61af080640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55720350e000 0x5572035104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.126+0000 7f61af080640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55720350e000 0x5572035104c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61af881640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f61a8021020 0x7f61a8028ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.127+0000 7f61ae87f640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f61a8021020 0x7f61a8028ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f61a8021020 0x7f61a8028ac0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4009050 con 0x7f61a8021020 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4009050 con 0x557203504ba0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.128+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.129+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.130+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.131+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.132+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.133+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x55720350e000 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.134+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x7f61a8021020 2024-09-13T23:27:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x557203504ba0 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x557203510b90 con 0x5572035094b0 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55720350c9f0 con 0x557203504ba0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.135+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55720350d290 con 0x557203504ba0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203511010 con 0x5572035094b0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 zone default found 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 4 Realm: () 2024-09-13T23:27:20.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 zonegroup default 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203511460 con 0x7f61a8021020 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.136+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203513730 con 0x55720350e000 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203513ad0 con 0x55720350e000 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 started sync module instance, tier type = 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.137+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203512bc0 con 0x5572035094b0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.138+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.138+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93948170285248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203512bc0 con 0x5572035094b0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.138+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203514490 con 0x557203504ba0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.139+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93948170285248] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.139+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.139+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93948170289600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203512bc0 con 0x557203504ba0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.139+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203514fd0 con 0x55720350e000 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.140+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.140+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93948170291872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203515870 con 0x55720350e000 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.140+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203516330 con 0x5572035094b0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.141+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93948170289600] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.141+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93948170291872] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.142+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.142+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93948170294208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203512710 con 0x5572035094b0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.142+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203516c10 con 0x557203504ba0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.143+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.143+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93948170294208] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.143+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93948170296832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203516bd0 con 0x557203504ba0 2024-09-13T23:27:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.143+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203517620 con 0x7f61a8021020 2024-09-13T23:27:20.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.144+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.144+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93948170301808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203517590 con 0x7f61a8021020 2024-09-13T23:27:20.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.144+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518550 con 0x7f61a8021020 2024-09-13T23:27:20.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.144+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93948170296832] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.145+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93948170301808] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.145+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.145+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93948170304016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203516720 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.145+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518a00 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93948170306896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518e20 con 0x7f61a8021020 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=0 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=1 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=2 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=3 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=4 2024-09-13T23:27:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=5 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93948170304016] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.146+0000 7f61b332d800 20 add_watcher() i=6 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.147+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93948170306896] v33'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.147+0000 7f61b332d800 20 add_watcher() i=7 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.147+0000 7f61b332d800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.147+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203518e20 con 0x557203504ba0 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.148+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.148+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93948170307952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518d90 con 0x557203504ba0 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.149+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93948170307952] v33'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.149+0000 7f6065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.149+0000 7f61b332d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.149+0000 7f61b332d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.149+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035248d0 con 0x557203504ba0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.150+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.150+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203524fa0 con 0x7f61a8021020 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.151+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.151+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035253c0 con 0x55720350e000 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.152+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.152+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525930 con 0x557203504ba0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.153+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.153+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525ea0 con 0x5572035094b0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.154+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.154+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525f30 con 0x55720350e000 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.155+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.155+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525f30 con 0x557203504ba0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.156+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.156+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525fc0 con 0x7f61a8021020 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.157+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.157+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203525fc0 con 0x5572035094b0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.158+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.159+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526050 con 0x55720350e000 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.159+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.159+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035265e0 con 0x5572035094b0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.160+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.160+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035265c0 con 0x7f61a8021020 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.162+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'37 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.162+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526590 con 0x5572035094b0 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.163+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.163+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526590 con 0x7f61a8021020 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.164+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'61 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.164+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526500 con 0x557203504ba0 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.165+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.165+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526500 con 0x55720350e000 2024-09-13T23:27:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.166+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'76 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.166+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526500 con 0x5572035094b0 2024-09-13T23:27:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.167+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.167+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526500 con 0x55720350e000 2024-09-13T23:27:20.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.168+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.168+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526500 con 0x557203504ba0 2024-09-13T23:27:20.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.169+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'39 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.169+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203526470 con 0x557203504ba0 2024-09-13T23:27:20.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.170+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.170+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.171+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'77 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.171+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x5572035094b0 2024-09-13T23:27:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.172+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.172+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.174+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.174+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.174+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.174+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.175+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.175+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.176+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.176+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x7f61a8021020 2024-09-13T23:27:20.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.177+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.177+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.179+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.179+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x7f61a8021020 2024-09-13T23:27:20.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.180+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.180+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x55720350e000 2024-09-13T23:27:20.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.181+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'78 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.181+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x7f61a8021020 2024-09-13T23:27:20.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.182+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.182+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035263e0 con 0x5572035094b0 2024-09-13T23:27:20.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.183+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'37 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f6064fe1640 20 reqs_thread_entry: start 2024-09-13T23:27:20.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f61b332d800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f61b332d800 20 Filter name: none 2024-09-13T23:27:20.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f5fde7fc640 20 reqs_thread_entry: start 2024-09-13T23:27:20.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f61b332d800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T23:27:20.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f61b332d800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.184+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203551350 con 0x55720350e000 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203553c80 con 0x55720350e000 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f61a0077410 con 0x55720350e000 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 10 removing key index: true_admin_akey 2024-09-13T23:27:20.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.185+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203551c60 con 0x55720350e000 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(96 true_admin_akey [delete] v33'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61b332d800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93948170545008 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203554290 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== watch-notify(notify (1) cookie 93948170301808 notify 141733920815 ret 0) ==== 207+0+0 (crc 0 0 0) 0x557203525aa0 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f6092ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920815 cookie 93948170301808 notifier 4871 bl.length()=165 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f6092ffd640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f6074003d60 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(97 notify.5 [notify cookie 93948170545008 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.186+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.187+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== watch-notify(notify_complete (2) cookie 93948170545008 notify 141733920815 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557203525410 con 0x7f61a8021020 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.187+0000 7f61b332d800 10 removing email index: 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.187+0000 7f61b332d800 10 removing user buckets index 2024-09-13T23:27:20.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.187+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203551c10 con 0x55720350e000 2024-09-13T23:27:20.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.188+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(99 a_user.buckets [delete] v33'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.188+0000 7f61b332d800 10 removing user index: a_user 2024-09-13T23:27:20.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.188+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035561b0 con 0x55720350e000 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(100 a_user [call,call,delete] v33'6 uv6 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61b332d800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61b332d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93948170540896 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557203553040 con 0x55720350e000 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== watch-notify(notify (1) cookie 93948170291872 notify 141733920778 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5572035258d0 con 0x55720350e000 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f60927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920778 cookie 93948170291872 notifier 4871 bl.length()=155 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(101 notify.2 [notify cookie 93948170540896 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.191+0000 7f60927fc640 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f5fe40032c0 con 0x55720350e000 2024-09-13T23:27:20.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.192+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.192+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== watch-notify(notify_complete (2) cookie 93948170540896 notify 141733920778 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557203524fa0 con 0x55720350e000 2024-09-13T23:27:20.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.192+0000 7f6065fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.192+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93948170307952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035201d0 con 0x557203504ba0 2024-09-13T23:27:20.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.194+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93948170307952] v33'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.194+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93948170285248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518970 con 0x5572035094b0 2024-09-13T23:27:20.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.195+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93948170285248] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.195+0000 7f61b332d800 20 remove_watcher() i=0 2024-09-13T23:27:20.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.195+0000 7f61b332d800 2 removed watcher, disabling cache 2024-09-13T23:27:20.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.195+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93948170289600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518970 con 0x557203504ba0 2024-09-13T23:27:20.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.196+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93948170289600] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.196+0000 7f61b332d800 20 remove_watcher() i=1 2024-09-13T23:27:20.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.196+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93948170291872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035141c0 con 0x55720350e000 2024-09-13T23:27:20.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.197+0000 7f61af080640 1 -- 172.21.15.99:0/2331827027 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93948170291872] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a00af040 con 0x55720350e000 2024-09-13T23:27:20.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.197+0000 7f61b332d800 20 remove_watcher() i=2 2024-09-13T23:27:20.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.197+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93948170294208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518970 con 0x5572035094b0 2024-09-13T23:27:20.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.198+0000 7f61af881640 1 -- 172.21.15.99:0/2331827027 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93948170294208] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a8028070 con 0x5572035094b0 2024-09-13T23:27:20.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.198+0000 7f61b332d800 20 remove_watcher() i=3 2024-09-13T23:27:20.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.198+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93948170296832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203514aa0 con 0x557203504ba0 2024-09-13T23:27:20.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.199+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93948170296832] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x557203504ba0 2024-09-13T23:27:20.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.199+0000 7f61b332d800 20 remove_watcher() i=4 2024-09-13T23:27:20.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.199+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93948170301808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035141c0 con 0x7f61a8021020 2024-09-13T23:27:20.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.200+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93948170301808] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.200+0000 7f61b332d800 20 remove_watcher() i=5 2024-09-13T23:27:20.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.200+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93948170304016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5572035153c0 con 0x7f61a8021020 2024-09-13T23:27:20.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.201+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93948170304016] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.201+0000 7f61b332d800 20 remove_watcher() i=6 2024-09-13T23:27:20.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.201+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93948170306896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557203518970 con 0x7f61a8021020 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93948170306896] v33'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f61a4029040 con 0x7f61a8021020 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 20 remove_watcher() i=7 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f61a8021020 msgr2=0x7f61a8028ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f61a8021020 0x7f61a8028ac0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557203504ba0 msgr2=0x557203507060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x557203504ba0 0x557203507060 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572035094b0 msgr2=0x55720350b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572035094b0 0x55720350b8a0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55720350e000 msgr2=0x5572035104c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.202+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55720350e000 0x5572035104c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6078036b40 msgr2=0x7f6078039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6078036b40 0x7f6078039000 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61a0059f90 tx=0x7f61a0098000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 msgr2=0x5572034f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/2331827027 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034f1c40 0x5572034f9150 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f61a8043040 tx=0x7f61a804c560 comp rx=0 tx=0).stop 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 reap_dead start 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61ae87f640 1 -- 172.21.15.99:0/2331827027 reap_dead start 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 shutdown_connections 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 >> 172.21.15.99:0/2331827027 conn(0x5572034ee030 msgr2=0x5572034ec100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 shutdown_connections 2024-09-13T23:27:20.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/2331827027 wait complete. 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 msgr2=0x7f60880390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 0x7f60880390c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f61a000a3f0 tx=0x7f61a004ff90 comp rx=0 tx=0).stop 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 msgr2=0x5572034e5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x5572034cb390 tx=0x7f61a800beb0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 shutdown_connections 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6088036c00 0x7f60880390c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/4162054956 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5572034e5000 0x5572034e5420 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 >> 172.21.15.99:0/4162054956 conn(0x5572034d9f90 msgr2=0x5572034dcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 shutdown_connections 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/4162054956 wait complete. 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 msgr2=0x5572034d1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 0x5572034d1350 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 msgr2=0x5572034d5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.203+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 0x5572034d5fb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 msgr2=0x7f6094039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 0x7f6094039000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000f60 tx=0x7f61a40012b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 msgr2=0x5572034ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f61a0065040 tx=0x7f61a0003330 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 shutdown_connections 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5572034d3bc0 0x5572034d5fb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5572033d6b20 0x5572034d1350 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6094036b40 0x7f6094039000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 --2- 172.21.15.99:0/3060758549 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x557203344df0 0x5572034ca2e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 >> 172.21.15.99:0/3060758549 conn(0x5572033cbdf0 msgr2=0x5572034bcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 shutdown_connections 2024-09-13T23:27:20.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.204+0000 7f61b332d800 1 -- 172.21.15.99:0/3060758549 wait complete. 2024-09-13T23:27:20.214 ERROR:root:None 2024-09-13T23:27:20.214 ERROR:root:0 2024-09-13T23:27:20.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T23:27:20.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T23:27:20.214 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T23:27:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.260 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.259+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.259+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.259+0000 7f9254640800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fffb7a4a20 0x55fffb7a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.259+0000 7f9254640800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fffb65fb30 con 0x55fffb79e940 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.259+0000 7f9254640800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55fffb641360 con 0x55fffb7a4a20 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.260+0000 7f924bfff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55fffb7a4a20 0x55fffb7a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.260+0000 7f9252134640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55fffb79e940 0x55fffb79ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55268/0 (socket says 172.21.15.99:55268) 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.260+0000 7f9252134640 1 -- 172.21.15.99:0/1636161130 learned_addr learned my addr 172.21.15.99:0/1636161130 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.260+0000 7f924bfff640 1 -- 172.21.15.99:0/1636161130 >> v1:172.21.15.43:6789/0 conn(0x55fffb79e940 legacy=0x55fffb79ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.260+0000 7f924bfff640 1 -- 172.21.15.99:0/1636161130 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb667e00 con 0x55fffb7a4a20 2024-09-13T23:27:20.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.262+0000 7f924bfff640 1 --2- 172.21.15.99:0/1636161130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a4a20 0x55fffb7a6e10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f923c00a470 tx=0x7f923c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153684b007a8c249 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.262+0000 7f9251933640 1 -- 172.21.15.99:0/1636161130 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c053570 con 0x55fffb7a4a20 2024-09-13T23:27:20.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.262+0000 7f9251933640 1 -- 172.21.15.99:0/1636161130 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c058070 con 0x55fffb7a4a20 2024-09-13T23:27:20.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.262+0000 7f9251933640 1 -- 172.21.15.99:0/1636161130 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f923c053880 con 0x55fffb7a4a20 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 -- 172.21.15.99:0/1636161130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a4a20 msgr2=0x55fffb7a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 --2- 172.21.15.99:0/1636161130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a4a20 0x55fffb7a6e10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f923c00a470 tx=0x7f923c045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 -- 172.21.15.99:0/1636161130 shutdown_connections 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 --2- 172.21.15.99:0/1636161130 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a4a20 0x55fffb7a6e10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 -- 172.21.15.99:0/1636161130 >> 172.21.15.99:0/1636161130 conn(0x55fffb79a550 msgr2=0x55fffb79c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 -- 172.21.15.99:0/1636161130 shutdown_connections 2024-09-13T23:27:20.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.263+0000 7f9254640800 1 -- 172.21.15.99:0/1636161130 wait complete. 2024-09-13T23:27:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9254640800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9254640800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fffb6ec360 con 0x55fffb79e940 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9252134640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9252134640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57454/0 (socket says 172.21.15.99:57454) 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.277+0000 7f9252134640 1 -- 172.21.15.99:0/2615989708 learned_addr learned my addr 172.21.15.99:0/2615989708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.278+0000 7f9252134640 1 -- 172.21.15.99:0/2615989708 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb639bc0 con 0x55fffb79e940 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.278+0000 7f9252134640 1 --2- 172.21.15.99:0/2615989708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9244001e10 tx=0x7f924400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d0b761be2f9110 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.278+0000 7f9140608640 1 -- 172.21.15.99:0/2615989708 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244012020 con 0x55fffb79e940 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.278+0000 7f9140608640 1 -- 172.21.15.99:0/2615989708 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924400e5a0 con 0x55fffb79e940 2024-09-13T23:27:20.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.278+0000 7f9140608640 1 -- 172.21.15.99:0/2615989708 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924400e8e0 con 0x55fffb79e940 2024-09-13T23:27:20.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- 172.21.15.99:0/2615989708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 msgr2=0x55fffb88f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 --2- 172.21.15.99:0/2615989708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9244001e10 tx=0x7f924400b780 comp rx=0 tx=0).stop 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- 172.21.15.99:0/2615989708 shutdown_connections 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 --2- 172.21.15.99:0/2615989708 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb88f8c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- 172.21.15.99:0/2615989708 >> 172.21.15.99:0/2615989708 conn(0x55fffb79a550 msgr2=0x55fffb88b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- 172.21.15.99:0/2615989708 shutdown_connections 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- 172.21.15.99:0/2615989708 wait complete. 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9254640800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fffb7a7650 con 0x55fffb79e940 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9252134640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9252134640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57468/0 (socket says 172.21.15.99:57468) 2024-09-13T23:27:20.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.279+0000 7f9252134640 1 -- 172.21.15.99:0/1419530180 learned_addr learned my addr 172.21.15.99:0/1419530180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f9252134640 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb64dfe0 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f9252134640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f924400b7c0 tx=0x7f9244000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f913ee05640 1 -- 172.21.15.99:0/1419530180 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9244012030 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f913ee05640 1 -- 172.21.15.99:0/1419530180 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244001470 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fffb8977e0 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f913ee05640 1 -- 172.21.15.99:0/1419530180 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924401a8d0 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.280+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb897d00 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f913ee05640 1 -- 172.21.15.99:0/1419530180 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9244015020 con 0x55fffb79e940 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f913ee05640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 0x7f9138039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f913ee05640 1 -- 172.21.15.99:0/1419530180 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f9244020030 con 0x55fffb79e940 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f924bfff640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 0x7f9138039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 0x55fffb89e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb89e890 con 0x55fffb7a4a20 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.281+0000 7f9252935640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 0x55fffb89e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f924bfff640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 0x7f9138039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f923c057000 tx=0x7f923c052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9252935640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 0x55fffb89e310 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9252935640 1 -- 172.21.15.99:0/1419530180 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f924c00a4a0 con 0x55fffb7a4a20 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb89b8e0 con 0x55fffb7a4a20 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9252935640 1 -- 172.21.15.99:0/1419530180 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f924c00a4a0 con 0x55fffb7a4a20 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 0x55fffb8a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8a3630 con 0x55fffb8a0ba0 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9252134640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 0x55fffb8a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.282+0000 7f9252134640 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 0x55fffb8a2f90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.283+0000 7f9252134640 1 -- 172.21.15.99:0/1419530180 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8a0ba0 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.283+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb89fa40 con 0x55fffb7a4a20 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.283+0000 7f9252935640 1 -- 172.21.15.99:0/1419530180 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f924c00a4a0 con 0x55fffb7a4a20 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.283+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb89ff20 con 0x55fffb8a0ba0 2024-09-13T23:27:20.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.283+0000 7f9252134640 1 -- 172.21.15.99:0/1419530180 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8a0ba0 2024-09-13T23:27:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9254640800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9254640800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fffb63b580 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57476/0 (socket says 172.21.15.99:57476) 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9252935640 1 -- 172.21.15.99:0/3153408571 learned_addr learned my addr 172.21.15.99:0/3153408571 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9252935640 1 -- 172.21.15.99:0/3153408571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb8b2920 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.284+0000 7f9252935640 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55fffb89ec50 tx=0x7f924c0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9137fff640 1 -- 172.21.15.99:0/3153408571 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c021440 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9137fff640 1 -- 172.21.15.99:0/3153408571 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924c0215e0 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fffb8b2bb0 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9137fff640 1 -- 172.21.15.99:0/3153408571 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c0218e0 con 0x55fffb8b1fc0 2024-09-13T23:27:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb8b5890 con 0x55fffb8b1fc0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.285+0000 7f9137fff640 1 -- 172.21.15.99:0/3153408571 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f924c011040 con 0x55fffb8b1fc0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9137fff640 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 0x7f912c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9137fff640 1 -- 172.21.15.99:0/3153408571 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f924c00e040 con 0x55fffb8b1fc0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9252134640 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 0x7f912c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9252134640 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 0x7f912c039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55fffb89b800 tx=0x7f924404b030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9254640800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9254640800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fffb890070 con 0x55fffb7a0c00 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57482/0 (socket says 172.21.15.99:57482) 2024-09-13T23:27:20.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.286+0000 7f9252935640 1 -- 172.21.15.99:0/2128963260 learned_addr learned my addr 172.21.15.99:0/2128963260 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9252935640 1 -- 172.21.15.99:0/2128963260 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb7a15d0 con 0x55fffb7a0c00 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9252935640 1 --2- 172.21.15.99:0/2128963260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f924c04cb30 tx=0x7f924c01f400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccef1e7d99f6a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9135ffb640 1 -- 172.21.15.99:0/2128963260 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c013dd0 con 0x55fffb7a0c00 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9135ffb640 1 -- 172.21.15.99:0/2128963260 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924c014580 con 0x55fffb7a0c00 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9135ffb640 1 -- 172.21.15.99:0/2128963260 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c01c340 con 0x55fffb7a0c00 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 -- 172.21.15.99:0/2128963260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 msgr2=0x55fffb7a1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 --2- 172.21.15.99:0/2128963260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f924c04cb30 tx=0x7f924c01f400 comp rx=0 tx=0).stop 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 -- 172.21.15.99:0/2128963260 shutdown_connections 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 --2- 172.21.15.99:0/2128963260 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb7a1000 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 -- 172.21.15.99:0/2128963260 >> 172.21.15.99:0/2128963260 conn(0x55fffb8bb020 msgr2=0x55fffb8b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 -- 172.21.15.99:0/2128963260 shutdown_connections 2024-09-13T23:27:20.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.287+0000 7f9254640800 1 -- 172.21.15.99:0/2128963260 wait complete. 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9254640800 1 Processor -- start 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9254640800 1 -- start start 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9254640800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9254640800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55fffb79f930 con 0x55fffb7a0c00 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9252935640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57492/0 (socket says 172.21.15.99:57492) 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 learned_addr learned my addr 172.21.15.99:0/3130247486 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.288+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fffb8c8860 con 0x55fffb7a0c00 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9252935640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f924c020740 tx=0x7f924c04ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9123fff640 1 -- 172.21.15.99:0/3130247486 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c021c90 con 0x55fffb7a0c00 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fffb8c8af0 con 0x55fffb7a0c00 2024-09-13T23:27:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9123fff640 1 -- 172.21.15.99:0/3130247486 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924c021e30 con 0x55fffb7a0c00 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9123fff640 1 -- 172.21.15.99:0/3130247486 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f924c04e200 con 0x55fffb7a0c00 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fffb8cb7a0 con 0x55fffb7a0c00 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.289+0000 7f9123fff640 1 -- 172.21.15.99:0/3130247486 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f924c03a060 con 0x55fffb7a0c00 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9123fff640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f911c036b40 0x7f911c039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9123fff640 1 -- 172.21.15.99:0/3130247486 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f924c02b640 con 0x55fffb7a0c00 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9252134640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f911c036b40 0x7f911c039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9252134640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f911c036b40 0x7f911c039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f924401a6f0 tx=0x7f9244035000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb8d4040 0x55fffb8d6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8d6c50 con 0x55fffb8d4040 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.290+0000 7f924bfff640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb8d4040 0x55fffb8d6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f924bfff640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb8d4040 0x55fffb8d6500 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 20 realm 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8d7080 con 0x55fffb8d4040 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.291+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8d7950 con 0x55fffb8d4040 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8d7cf0 con 0x55fffb8d4040 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8d8a50 0x55fffb8dae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8db450 con 0x55fffb8d8a50 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9252935640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8d8a50 0x55fffb8dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9252935640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8d8a50 0x55fffb8dae40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 20 searching for the correct realm 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fffb8dd430 0x55fffb8df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.292+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252134640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fffb8dd430 0x55fffb8df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252134640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fffb8dd430 0x55fffb8df8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252935640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f924c01c580 0x7f924c02b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.293+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.294+0000 7f924bfff640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f924c01c580 0x7f924c02b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.294+0000 7f924bfff640 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f924c01c580 0x7f924c02b960 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.294+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.294+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.294+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.295+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.296+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.297+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.298+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.299+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.300+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8dd430 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x7f924c01c580 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d4040 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dffc0 con 0x55fffb8d8a50 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.301+0000 7f9254640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dbcd0 con 0x55fffb8d4040 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8dc0c0 con 0x55fffb8d4040 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e0440 con 0x55fffb8d8a50 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 zone default found 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 4 Realm: () 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 zonegroup default 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.302+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e0840 con 0x7f924c01c580 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e2b10 con 0x55fffb8dd430 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e2eb0 con 0x55fffb8dd430 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 started sync module instance, tier type = 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.303+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e1fa0 con 0x55fffb8d8a50 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.304+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.304+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94557925417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e1c00 con 0x55fffb8d8a50 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.304+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e3d70 con 0x55fffb8d4040 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.305+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94557925417920] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.306+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.306+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94557925421728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e3d70 con 0x55fffb8d4040 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.306+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e4790 con 0x55fffb8dd430 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.307+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.307+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94557925425792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e5030 con 0x55fffb8dd430 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.307+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e5b30 con 0x55fffb8d8a50 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.307+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94557925421728] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.308+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94557925425792] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.308+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.308+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94557925428096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e38c0 con 0x55fffb8d8a50 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.308+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e6540 con 0x55fffb8d4040 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.309+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.309+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94557925433488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e6960 con 0x55fffb8d4040 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.309+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e73a0 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.309+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94557925428096] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.310+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94557925433488] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.310+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.310+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94557925437040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e64b0 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.310+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e7c40 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.311+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.311+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94557925439376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e64b0 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.311+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e8730 con 0x7f924c01c580 2024-09-13T23:27:20.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.311+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94557925437040] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94557925439376] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94557925440432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e5620 con 0x7f924c01c580 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=0 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=1 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=2 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=3 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=4 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=5 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.312+0000 7f9254640800 20 add_watcher() i=6 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94557925440432] v33'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f9254640800 20 add_watcher() i=7 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f9254640800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8eb720 con 0x55fffb8d4040 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.315+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94557925442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e8ba0 con 0x55fffb8d4040 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94557925442048] v33'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f9108fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f9254640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f9254640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f9254640800 5 note: GC not initialized 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.316+0000 7f90837fe640 20 reqs_thread_entry: start 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 20 Filter name: none 2024-09-13T23:27:20.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f90817fa640 20 reqs_thread_entry: start 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb91e9e0 con 0x7f924c01c580 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.317+0000 7f9254640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.318+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb925080 con 0x7f924c01c580 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9254640800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9254640800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9254640800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94557925689920 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55fffb920700 con 0x55fffb8d4040 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 94557925433488 notify 141733920804 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f923c082040 con 0x55fffb8d4040 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9135ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920804 cookie 94557925433488 notifier 4878 bl.length()=666 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9135ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 94557925689920 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9135ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f9135ffb640 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f9118003ea0 con 0x55fffb8d4040 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.319+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94557925689920 notify 141733920804 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fffb667e00 con 0x55fffb8d4040 2024-09-13T23:27:20.333 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.320+0000 7f9108fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.320+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94557925442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb91c700 con 0x55fffb8d4040 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.321+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94557925442048] v33'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.321+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94557925417920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb91c700 con 0x55fffb8d8a50 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.322+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94557925417920] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.322+0000 7f9254640800 20 remove_watcher() i=0 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.322+0000 7f9254640800 2 removed watcher, disabling cache 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.322+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94557925421728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb91c700 con 0x55fffb8d4040 2024-09-13T23:27:20.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.324+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94557925421728] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.324+0000 7f9254640800 20 remove_watcher() i=1 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.324+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94557925425792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb91c700 con 0x55fffb8dd430 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.325+0000 7f9252134640 1 -- 172.21.15.99:0/3130247486 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94557925425792] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924402dcf0 con 0x55fffb8dd430 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.325+0000 7f9254640800 20 remove_watcher() i=2 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.325+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94557925428096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e8200 con 0x55fffb8d8a50 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.326+0000 7f9252935640 1 -- 172.21.15.99:0/3130247486 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94557925428096] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f924c057040 con 0x55fffb8d8a50 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.326+0000 7f9254640800 20 remove_watcher() i=3 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.326+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94557925433488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e8200 con 0x55fffb8d4040 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.327+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94557925433488] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x55fffb8d4040 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.327+0000 7f9254640800 20 remove_watcher() i=4 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.327+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94557925437040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e6090 con 0x7f924c01c580 2024-09-13T23:27:20.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.328+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94557925437040] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.328+0000 7f9254640800 20 remove_watcher() i=5 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.328+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94557925439376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e6e70 con 0x7f924c01c580 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.329+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94557925439376] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.329+0000 7f9254640800 20 remove_watcher() i=6 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.329+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94557925440432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55fffb8e6090 con 0x7f924c01c580 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94557925440432] v33'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f923c051070 con 0x7f924c01c580 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 20 remove_watcher() i=7 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f924c01c580 msgr2=0x7f924c02b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f924c01c580 0x7f924c02b960 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb8d4040 msgr2=0x55fffb8d6500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb8d4040 0x55fffb8d6500 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8d8a50 msgr2=0x55fffb8dae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8d8a50 0x55fffb8dae40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fffb8dd430 msgr2=0x55fffb8df8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55fffb8dd430 0x55fffb8df8f0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f911c036b40 msgr2=0x7f911c039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f911c036b40 0x7f911c039000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f924401a6f0 tx=0x7f9244035000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 msgr2=0x55fffb8c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f924c020740 tx=0x7f924c04ca90 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f924bfff640 1 -- 172.21.15.99:0/3130247486 reap_dead start 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 shutdown_connections 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 --2- 172.21.15.99:0/3130247486 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb7a0c00 0x55fffb8c8320 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 >> 172.21.15.99:0/3130247486 conn(0x55fffb8bb020 msgr2=0x55fffb8b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 shutdown_connections 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.330+0000 7f9254640800 1 -- 172.21.15.99:0/3130247486 wait complete. 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 msgr2=0x7f912c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 0x7f912c039050 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55fffb89b800 tx=0x7f924404b030 comp rx=0 tx=0).stop 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 msgr2=0x55fffb8b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55fffb89ec50 tx=0x7f924c0167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 shutdown_connections 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f912c036b90 0x7f912c039050 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/3153408571 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb8b1fc0 0x55fffb8b23e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 >> 172.21.15.99:0/3153408571 conn(0x55fffb8a6f50 msgr2=0x55fffb8a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 shutdown_connections 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/3153408571 wait complete. 2024-09-13T23:27:20.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 msgr2=0x55fffb89e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 0x55fffb89e310 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 msgr2=0x55fffb8a2f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 0x55fffb8a2f90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 msgr2=0x7f9138039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 0x7f9138039050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f923c057000 tx=0x7f923c052000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 msgr2=0x55fffb8972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f924400b7c0 tx=0x7f9244000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 shutdown_connections 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55fffb8a0ba0 0x55fffb8a2f90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55fffb7a4a20 0x55fffb89e310 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f9138036b90 0x7f9138039050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 --2- 172.21.15.99:0/1419530180 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55fffb79e940 0x55fffb8972a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 >> 172.21.15.99:0/1419530180 conn(0x55fffb79a550 msgr2=0x55fffb889b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 shutdown_connections 2024-09-13T23:27:20.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.331+0000 7f9254640800 1 -- 172.21.15.99:0/1419530180 wait complete. 2024-09-13T23:27:20.344 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.345 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.345 ERROR:root:0 2024-09-13T23:27:20.345 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:20.358 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:20.358 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T23:27:20.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T23:27:20.358 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T23:27:20.405 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.405 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.404+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.404+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.404+0000 7fb1c8836800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55642cd97a10 0x55642cd99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.404+0000 7fb1c8836800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55642cc52b30 con 0x55642cd93710 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.404+0000 7fb1c8836800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55642cc34360 con 0x55642cd97a10 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1bb351640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55642cd97a10 0x55642cd99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1c3b52640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55642cd93710 0x55642cd93b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55274/0 (socket says 172.21.15.99:55274) 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1bb351640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55642cd97a10 0x55642cd99e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57494/0 (socket says 172.21.15.99:57494) 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1c3b52640 1 -- 172.21.15.99:0/3333298293 learned_addr learned my addr 172.21.15.99:0/3333298293 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1bb351640 1 -- 172.21.15.99:0/3333298293 >> v1:172.21.15.43:6789/0 conn(0x55642cd93710 legacy=0x55642cd93b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.405+0000 7fb1bb351640 1 -- 172.21.15.99:0/3333298293 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cc5ae00 con 0x55642cd97a10 2024-09-13T23:27:20.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1bb351640 1 --2- 172.21.15.99:0/3333298293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd97a10 0x55642cd99e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00a470 tx=0x7fb1ac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e9ff09ab275256 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c3351640 1 -- 172.21.15.99:0/3333298293 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac053570 con 0x55642cd97a10 2024-09-13T23:27:20.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c3351640 1 -- 172.21.15.99:0/3333298293 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac058070 con 0x55642cd97a10 2024-09-13T23:27:20.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c3351640 1 -- 172.21.15.99:0/3333298293 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1ac053880 con 0x55642cd97a10 2024-09-13T23:27:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 -- 172.21.15.99:0/3333298293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd97a10 msgr2=0x55642cd99e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3333298293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd97a10 0x55642cd99e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00a470 tx=0x7fb1ac045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 -- 172.21.15.99:0/3333298293 shutdown_connections 2024-09-13T23:27:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3333298293 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd97a10 0x55642cd99e00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 -- 172.21.15.99:0/3333298293 >> 172.21.15.99:0/3333298293 conn(0x55642cd8efe0 msgr2=0x55642cd91400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 -- 172.21.15.99:0/3333298293 shutdown_connections 2024-09-13T23:27:20.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.407+0000 7fb1c8836800 1 -- 172.21.15.99:0/3333298293 wait complete. 2024-09-13T23:27:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.421+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c8836800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c8836800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55642ccdf360 con 0x55642cd93710 2024-09-13T23:27:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c3b52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c3b52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57502/0 (socket says 172.21.15.99:57502) 2024-09-13T23:27:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c3b52640 1 -- 172.21.15.99:0/2835407362 learned_addr learned my addr 172.21.15.99:0/2835407362 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.422+0000 7fb1c3b52640 1 -- 172.21.15.99:0/2835407362 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cc2cbc0 con 0x55642cd93710 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/2835407362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001e10 tx=0x7fb1b400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b1be23c5b0dc74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb0b1e0b640 1 -- 172.21.15.99:0/2835407362 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4012020 con 0x55642cd93710 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb0b1e0b640 1 -- 172.21.15.99:0/2835407362 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b400e5a0 con 0x55642cd93710 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb0b1e0b640 1 -- 172.21.15.99:0/2835407362 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1b400e8e0 con 0x55642cd93710 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb1c8836800 1 -- 172.21.15.99:0/2835407362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 msgr2=0x55642ce828d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb1c8836800 1 --2- 172.21.15.99:0/2835407362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001e10 tx=0x7fb1b400b780 comp rx=0 tx=0).stop 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.423+0000 7fb1c8836800 1 -- 172.21.15.99:0/2835407362 shutdown_connections 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 --2- 172.21.15.99:0/2835407362 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce828d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 -- 172.21.15.99:0/2835407362 >> 172.21.15.99:0/2835407362 conn(0x55642cd8efe0 msgr2=0x55642ce7e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 -- 172.21.15.99:0/2835407362 shutdown_connections 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 -- 172.21.15.99:0/2835407362 wait complete. 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c8836800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55642cd9a640 con 0x55642cd93710 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c3b52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c3b52640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57518/0 (socket says 172.21.15.99:57518) 2024-09-13T23:27:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c3b52640 1 -- 172.21.15.99:0/1588503757 learned_addr learned my addr 172.21.15.99:0/1588503757 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.424+0000 7fb1c3b52640 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cc40fe0 con 0x55642cd93710 2024-09-13T23:27:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.425+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001e10 tx=0x7fb1b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.425+0000 7fb0abfff640 1 -- 172.21.15.99:0/1588503757 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4012030 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.425+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55642ce8a7f0 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.425+0000 7fb0abfff640 1 -- 172.21.15.99:0/1588503757 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b401a7a0 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.426+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55642ce8ad10 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.426+0000 7fb0abfff640 1 -- 172.21.15.99:0/1588503757 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1b401a990 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.426+0000 7fb0abfff640 1 -- 172.21.15.99:0/1588503757 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb1b4015020 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.426+0000 7fb0abfff640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 0x7fb0ac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.426+0000 7fb0abfff640 1 -- 172.21.15.99:0/1588503757 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fb1b4020030 con 0x55642cd93710 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1bb351640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 0x7fb0ac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 0x55642ce91320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ce91860 con 0x55642cd97a10 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c4353640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 0x55642ce91320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c4353640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 0x55642ce91320 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1bb351640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 0x7fb0ac039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac057000 tx=0x7fb1ac052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c4353640 1 -- 172.21.15.99:0/1588503757 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1bc00a4a0 con 0x55642cd97a10 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.427+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ce8e8f0 con 0x55642cd97a10 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c4353640 1 -- 172.21.15.99:0/1588503757 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1bc00a4a0 con 0x55642cd97a10 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 0x55642ce95f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ce96620 con 0x55642ce93b90 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 0x55642ce95f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 0x55642ce95f80 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c3b52640 1 -- 172.21.15.99:0/1588503757 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ce93b90 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.428+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ce92a30 con 0x55642cd97a10 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c4353640 1 -- 172.21.15.99:0/1588503757 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1bc00a4a0 con 0x55642cd97a10 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ce92ed0 con 0x55642ce93b90 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c3b52640 1 -- 172.21.15.99:0/1588503757 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ce93b90 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c8836800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.429+0000 7fb1c8836800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55642cc2e580 con 0x55642cea4fd0 2024-09-13T23:27:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57534/0 (socket says 172.21.15.99:57534) 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c4353640 1 -- 172.21.15.99:0/3922955520 learned_addr learned my addr 172.21.15.99:0/3922955520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c4353640 1 -- 172.21.15.99:0/3922955520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cea5930 con 0x55642cea4fd0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c4353640 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55642ce8b360 tx=0x7fb1bc0167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb0a97fa640 1 -- 172.21.15.99:0/3922955520 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc013640 con 0x55642cea4fd0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb0a97fa640 1 -- 172.21.15.99:0/3922955520 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0137e0 con 0x55642cea4fd0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb0a97fa640 1 -- 172.21.15.99:0/3922955520 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc013ac0 con 0x55642cea4fd0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55642cea5bc0 con 0x55642cea4fd0 2024-09-13T23:27:20.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.430+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55642cea88a0 con 0x55642cea4fd0 2024-09-13T23:27:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.431+0000 7fb0a97fa640 1 -- 172.21.15.99:0/3922955520 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb1bc011040 con 0x55642cea4fd0 2024-09-13T23:27:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.431+0000 7fb0a97fa640 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 0x7fb09c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.431+0000 7fb0a97fa640 1 -- 172.21.15.99:0/3922955520 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fb1bc00e040 con 0x55642cea4fd0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.431+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 0x7fb09c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.431+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 0x7fb09c039050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55642ce92a00 tx=0x7fb1b400bf70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c8836800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c8836800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55642ce83080 con 0x55642cd08fe0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57550/0 (socket says 172.21.15.99:57550) 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c4353640 1 -- 172.21.15.99:0/2792511422 learned_addr learned my addr 172.21.15.99:0/2792511422 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c4353640 1 -- 172.21.15.99:0/2792511422 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cd099b0 con 0x55642cd08fe0 2024-09-13T23:27:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb1c4353640 1 --2- 172.21.15.99:0/2792511422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc005a10 tx=0x7fb1bc012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fc981a5edaf34b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb0a2ffd640 1 -- 172.21.15.99:0/2792511422 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc020c50 con 0x55642cd08fe0 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb0a2ffd640 1 -- 172.21.15.99:0/2792511422 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc020df0 con 0x55642cd08fe0 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.432+0000 7fb0a2ffd640 1 -- 172.21.15.99:0/2792511422 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc040150 con 0x55642cd08fe0 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- 172.21.15.99:0/2792511422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 msgr2=0x55642cd093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 --2- 172.21.15.99:0/2792511422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc005a10 tx=0x7fb1bc012f20 comp rx=0 tx=0).stop 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- 172.21.15.99:0/2792511422 shutdown_connections 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 --2- 172.21.15.99:0/2792511422 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cd093e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- 172.21.15.99:0/2792511422 >> 172.21.15.99:0/2792511422 conn(0x55642ceae050 msgr2=0x55642ceac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- 172.21.15.99:0/2792511422 shutdown_connections 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- 172.21.15.99:0/2792511422 wait complete. 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 Processor -- start 2024-09-13T23:27:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- start start 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.433+0000 7fb1c8836800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55642cd07d10 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c4353640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57556/0 (socket says 172.21.15.99:57556) 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 learned_addr learned my addr 172.21.15.99:0/900956505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55642cebb910 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c4353640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc01fbf0 tx=0x7fb1bc04ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb0a17fa640 1 -- 172.21.15.99:0/900956505 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc020c50 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb0a17fa640 1 -- 172.21.15.99:0/900956505 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc01f620 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55642cebbba0 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb0a17fa640 1 -- 172.21.15.99:0/900956505 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1bc013e40 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.434+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55642cebe850 con 0x55642cd08fe0 2024-09-13T23:27:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.435+0000 7fb0a17fa640 1 -- 172.21.15.99:0/900956505 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fb1bc04e9b0 con 0x55642cd08fe0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.435+0000 7fb0a17fa640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb08c036af0 0x7fb08c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.435+0000 7fb0a17fa640 1 -- 172.21.15.99:0/900956505 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fb1bc04f020 con 0x55642cd08fe0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.435+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb08c036af0 0x7fb08c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb08c036af0 0x7fb08c038fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401a6a0 tx=0x7fb1b4032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cec6e50 0x55642cec9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cec9a60 con 0x55642cec6e50 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1bb351640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cec6e50 0x55642cec9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1bb351640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cec6e50 0x55642cec9310 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 20 realm 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.436+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cec9e90 con 0x55642cec6e50 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ceca760 con 0x55642cec6e50 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cecab00 con 0x55642cec6e50 2024-09-13T23:27:20.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642cecb860 0x55642cecdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cece260 con 0x55642cecb860 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.437+0000 7fb1c4353640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642cecb860 0x55642cecdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c4353640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642cecb860 0x55642cecdc50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c8836800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c8836800 20 searching for the correct realm 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55642ced01f0 0x55642ced26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55642ced01f0 0x55642ced26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.438+0000 7fb1c3b52640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55642ced01f0 0x55642ced26b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1c4353640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb1bc03b8e0 0x7fb1bc045870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1bb351640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb1bc03b8e0 0x7fb1bc045870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.439+0000 7fb1bb351640 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb1bc03b8e0 0x7fb1bc045870 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.440+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.441+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.442+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.443+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.444+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.445+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642ced01f0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cec6e50 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55642ced2d80 con 0x55642cecb860 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.446+0000 7fb1c8836800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ceceab0 con 0x55642cec6e50 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ceceea0 con 0x55642cec6e50 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ced3200 con 0x55642cecb860 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 zone default found 2024-09-13T23:27:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 4 Realm: () 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 zonegroup default 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.447+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cece6e0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ced5960 con 0x55642ced01f0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642ced5d00 con 0x55642ced01f0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 started sync module instance, tier type = 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.448+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced4da0 con 0x55642cecb860 2024-09-13T23:27:20.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.449+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.449+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93888738840976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced55b0 con 0x55642cecb860 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.449+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced6b70 con 0x55642cec6e50 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.450+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93888738840976] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.451+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.451+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93888738846400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced6f90 con 0x55642cec6e50 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.451+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced7950 con 0x55642ced01f0 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.452+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93888738846400] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.452+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.452+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93888738847456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced6f00 con 0x55642ced01f0 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.452+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced87c0 con 0x55642cecb860 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.453+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93888738847456] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.453+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.453+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93888738853648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced8730 con 0x55642cecb860 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.453+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced9680 con 0x55642cec6e50 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.455+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.455+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93888738857424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced9aa0 con 0x55642cec6e50 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.455+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ceda560 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.455+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93888738853648] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.456+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93888738857424] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.456+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.456+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93888738861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced95f0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.456+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cedabf0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.457+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93888738861104] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.457+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.457+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93888738855856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cedabf0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.457+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cedb440 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93888738855856] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93888738863392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cedb230 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=0 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=1 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=2 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=3 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=4 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=5 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.458+0000 7fb1c8836800 20 add_watcher() i=6 2024-09-13T23:27:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.459+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93888738863392] v33'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.459+0000 7fb1c8836800 20 add_watcher() i=7 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.459+0000 7fb1c8836800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.459+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cede7a0 con 0x55642cec6e50 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.460+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.460+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93888738864448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cedbcc0 con 0x55642cec6e50 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93888738864448] v33'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 5 note: GC not initialized 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb078fe1640 20 reqs_thread_entry: start 2024-09-13T23:27:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 20 Filter name: none 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7faff27fc640 20 reqs_thread_entry: start 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.461+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cf11bc0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1c8836800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1c8836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1c8836800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1c8836800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.462+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cf18390 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.463+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.463+0000 7fb1c8836800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.463+0000 7fb1c8836800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.463+0000 7fb1c8836800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.463+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93888739114320 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55642cf139d0 con 0x55642cec6e50 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 93888738857424 notify 141733920805 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fb1ac083040 con 0x55642cec6e50 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb0a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920805 cookie 93888738857424 notifier 4885 bl.length()=666 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb0a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb0a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 93888739114320 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb0a2ffd640 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fb088003ea0 con 0x55642cec6e50 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.464+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 93888739114320 notify 141733920805 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55642cc5ae00 con 0x55642cec6e50 2024-09-13T23:27:20.478 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.465+0000 7fb079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.465+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93888738864448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cf0f8e0 con 0x55642cec6e50 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.466+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93888738864448] v33'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.466+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93888738840976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cf0f8e0 con 0x55642cecb860 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.467+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93888738840976] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.467+0000 7fb1c8836800 20 remove_watcher() i=0 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.467+0000 7fb1c8836800 2 removed watcher, disabling cache 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.467+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93888738846400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cf0f8e0 con 0x55642cec6e50 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.468+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93888738846400] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.468+0000 7fb1c8836800 20 remove_watcher() i=1 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.468+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93888738847456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642cf0f8e0 con 0x55642ced01f0 2024-09-13T23:27:20.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.469+0000 7fb1c3b52640 1 -- 172.21.15.99:0/900956505 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93888738847456] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1b4018430 con 0x55642ced01f0 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.469+0000 7fb1c8836800 20 remove_watcher() i=2 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.469+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93888738853648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced5190 con 0x55642cecb860 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.470+0000 7fb1c4353640 1 -- 172.21.15.99:0/900956505 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93888738853648] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1bc030070 con 0x55642cecb860 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.470+0000 7fb1c8836800 20 remove_watcher() i=3 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.470+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93888738857424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced5190 con 0x55642cec6e50 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.471+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93888738857424] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x55642cec6e50 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.471+0000 7fb1c8836800 20 remove_watcher() i=4 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.471+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93888738861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced91d0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.472+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93888738861104] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.472+0000 7fb1c8836800 20 remove_watcher() i=5 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.472+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93888738855856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced5190 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.473+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93888738855856] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.473+0000 7fb1c8836800 20 remove_watcher() i=6 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.473+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93888738863392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55642ced91d0 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.474+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93888738863392] v33'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1ac051070 con 0x7fb1bc03b8e0 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.474+0000 7fb1c8836800 20 remove_watcher() i=7 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.474+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb1bc03b8e0 msgr2=0x7fb1bc045870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fb1bc03b8e0 0x7fb1bc045870 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cec6e50 msgr2=0x55642cec9310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cec6e50 0x55642cec9310 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642cecb860 msgr2=0x55642cecdc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642cecb860 0x55642cecdc50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55642ced01f0 msgr2=0x55642ced26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55642ced01f0 0x55642ced26b0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb08c036af0 msgr2=0x7fb08c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb08c036af0 0x7fb08c038fb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb1b401a6a0 tx=0x7fb1b4032000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 msgr2=0x55642cebb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1bb351640 1 -- 172.21.15.99:0/900956505 reap_dead start 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc01fbf0 tx=0x7fb1bc04ccc0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 shutdown_connections 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/900956505 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd08fe0 0x55642cebb3d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 >> 172.21.15.99:0/900956505 conn(0x55642ceae050 msgr2=0x55642ceac120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 shutdown_connections 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/900956505 wait complete. 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 msgr2=0x7fb09c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 0x7fb09c039050 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55642ce92a00 tx=0x7fb1b400bf70 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 msgr2=0x55642cea53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55642ce8b360 tx=0x7fb1bc0167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 shutdown_connections 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb09c036b90 0x7fb09c039050 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 --2- 172.21.15.99:0/3922955520 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cea4fd0 0x55642cea53f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 >> 172.21.15.99:0/3922955520 conn(0x55642ce99f60 msgr2=0x55642ce9cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 shutdown_connections 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/3922955520 wait complete. 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.475+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 msgr2=0x55642ce91320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 0x55642ce91320 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 msgr2=0x55642ce95f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 0x55642ce95f80 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 msgr2=0x7fb0ac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 0x7fb0ac039000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac057000 tx=0x7fb1ac052000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 msgr2=0x55642ce8a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4001e10 tx=0x7fb1b4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 shutdown_connections 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55642ce93b90 0x55642ce95f80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55642cd97a10 0x55642ce91320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fb0ac036b40 0x7fb0ac039000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 --2- 172.21.15.99:0/1588503757 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55642cd93710 0x55642ce8a2b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 >> 172.21.15.99:0/1588503757 conn(0x55642cd8efe0 msgr2=0x55642ce7cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 shutdown_connections 2024-09-13T23:27:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.476+0000 7fb1c8836800 1 -- 172.21.15.99:0/1588503757 wait complete. 2024-09-13T23:27:20.489 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.489 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.490 ERROR:root:0 2024-09-13T23:27:20.490 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:20.502 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:20.502 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:20.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:20.503 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:27:20.548 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.549 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff5cc13800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55751452d610 0x55751452bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff5cc13800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557514476b30 con 0x55751452c330 2024-09-13T23:27:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff5cc13800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x557514458360 con 0x55751452d610 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff58267640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55751452d610 0x55751452bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff57a66640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55751452c330 0x5575145bf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55280/0 (socket says 172.21.15.99:55280) 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.548+0000 7eff57a66640 1 -- 172.21.15.99:0/342601306 learned_addr learned my addr 172.21.15.99:0/342601306 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.549+0000 7eff57265640 1 -- 172.21.15.99:0/342601306 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879353092 0 0) 0x557514476b30 con 0x55751452c330 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.549+0000 7eff57265640 1 -- 172.21.15.99:0/342601306 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff40001e10 con 0x55751452c330 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.549+0000 7eff58267640 1 -- 172.21.15.99:0/342601306 >> v1:172.21.15.43:6789/0 conn(0x55751452c330 legacy=0x5575145bf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.549+0000 7eff58267640 1 -- 172.21.15.99:0/342601306 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55751447ee00 con 0x55751452d610 2024-09-13T23:27:20.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff58267640 1 --2- 172.21.15.99:0/342601306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452d610 0x55751452bdf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff4800a470 tx=0x7eff48045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f0d57bcadf94c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff57265640 1 -- 172.21.15.99:0/342601306 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48059070 con 0x55751452d610 2024-09-13T23:27:20.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff57265640 1 -- 172.21.15.99:0/342601306 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff48054570 con 0x55751452d610 2024-09-13T23:27:20.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff57265640 1 -- 172.21.15.99:0/342601306 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48054850 con 0x55751452d610 2024-09-13T23:27:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 -- 172.21.15.99:0/342601306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452d610 msgr2=0x55751452bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 --2- 172.21.15.99:0/342601306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452d610 0x55751452bdf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7eff4800a470 tx=0x7eff48045920 comp rx=0 tx=0).stop 2024-09-13T23:27:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 -- 172.21.15.99:0/342601306 shutdown_connections 2024-09-13T23:27:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 --2- 172.21.15.99:0/342601306 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452d610 0x55751452bdf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 -- 172.21.15.99:0/342601306 >> 172.21.15.99:0/342601306 conn(0x5575145b2fe0 msgr2=0x5575145b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 -- 172.21.15.99:0/342601306 shutdown_connections 2024-09-13T23:27:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.551+0000 7eff5cc13800 1 -- 172.21.15.99:0/342601306 wait complete. 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.565+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.565+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.565+0000 7eff5cc13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.565+0000 7eff5cc13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557514503360 con 0x55751452c330 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7eff58267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7eff58267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57572/0 (socket says 172.21.15.99:57572) 2024-09-13T23:27:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7eff58267640 1 -- 172.21.15.99:0/3492011705 learned_addr learned my addr 172.21.15.99:0/3492011705 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7eff58267640 1 -- 172.21.15.99:0/3492011705 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557514450bc0 con 0x55751452c330 2024-09-13T23:27:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7eff58267640 1 --2- 172.21.15.99:0/3492011705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff48025b20 tx=0x7eff4804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9cbcb803e384df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7efe4660c640 1 -- 172.21.15.99:0/3492011705 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48062070 con 0x55751452c330 2024-09-13T23:27:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7efe4660c640 1 -- 172.21.15.99:0/3492011705 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4800a230 con 0x55751452c330 2024-09-13T23:27:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.566+0000 7efe4660c640 1 -- 172.21.15.99:0/3492011705 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48059040 con 0x55751452c330 2024-09-13T23:27:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- 172.21.15.99:0/3492011705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 msgr2=0x5575146a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 --2- 172.21.15.99:0/3492011705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff48025b20 tx=0x7eff4804e000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- 172.21.15.99:0/3492011705 shutdown_connections 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 --2- 172.21.15.99:0/3492011705 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146a88e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- 172.21.15.99:0/3492011705 >> 172.21.15.99:0/3492011705 conn(0x5575145b2fe0 msgr2=0x5575146a42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- 172.21.15.99:0/3492011705 shutdown_connections 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- 172.21.15.99:0/3492011705 wait complete. 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.567+0000 7eff5cc13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55751452ca20 con 0x55751452c330 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff58267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff58267640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57584/0 (socket says 172.21.15.99:57584) 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff58267640 1 -- 172.21.15.99:0/2429389173 learned_addr learned my addr 172.21.15.99:0/2429389173 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff58267640 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557514464fe0 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff58267640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff48045960 tx=0x7eff48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7efe44e09640 1 -- 172.21.15.99:0/2429389173 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48062070 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7efe44e09640 1 -- 172.21.15.99:0/2429389173 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff48054910 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575146b07d0 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7efe44e09640 1 -- 172.21.15.99:0/2429389173 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff48059040 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.568+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575146b0cf0 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7efe44e09640 1 -- 172.21.15.99:0/2429389173 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff48065040 con 0x55751452c330 2024-09-13T23:27:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7efe44e09640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 0x7efe40039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7efe44e09640 1 -- 172.21.15.99:0/2429389173 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7eff4808fa10 con 0x55751452c330 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7eff57a66640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 0x7efe40039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 0x5575146b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146b7840 con 0x55751452d610 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.569+0000 7eff58a68640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 0x5575146b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff57a66640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 0x7efe40039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000f60 tx=0x7eff4c0010a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff58a68640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 0x5575146b7300 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff58a68640 1 -- 172.21.15.99:0/2429389173 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff5000a4a0 con 0x55751452d610 2024-09-13T23:27:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146b48b0 con 0x55751452d610 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff58a68640 1 -- 172.21.15.99:0/2429389173 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff5000a4a0 con 0x55751452d610 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 0x5575146bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.570+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146bc5e0 con 0x5575146b9b50 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.571+0000 7eff58267640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 0x5575146bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.571+0000 7eff58267640 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 0x5575146bbf40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.571+0000 7eff58267640 1 -- 172.21.15.99:0/2429389173 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff4805c040 con 0x5575146b9b50 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.571+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146b89f0 con 0x55751452d610 2024-09-13T23:27:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.571+0000 7eff58a68640 1 -- 172.21.15.99:0/2429389173 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff5000a4a0 con 0x55751452d610 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146b8ed0 con 0x5575146b9b50 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff58267640 1 -- 172.21.15.99:0/2429389173 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff4805c040 con 0x5575146b9b50 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff5cc13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.572+0000 7eff5cc13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557514452580 con 0x5575146caf70 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57590/0 (socket says 172.21.15.99:57590) 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff58a68640 1 -- 172.21.15.99:0/624015108 learned_addr learned my addr 172.21.15.99:0/624015108 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff58a68640 1 -- 172.21.15.99:0/624015108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575146cb8d0 con 0x5575146caf70 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff58a68640 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x5575146b7c20 tx=0x7eff500167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7efe3dffb640 1 -- 172.21.15.99:0/624015108 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff50013640 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7efe3dffb640 1 -- 172.21.15.99:0/624015108 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff500137e0 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575146cbb60 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7efe3dffb640 1 -- 172.21.15.99:0/624015108 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff50013ae0 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.573+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575146ce840 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7efe3dffb640 1 -- 172.21.15.99:0/624015108 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff50011040 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7efe3dffb640 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 0x7efe30039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7efe3dffb640 1 -- 172.21.15.99:0/624015108 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7eff5000e040 con 0x5575146caf70 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7eff58267640 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 0x7efe30039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7eff58267640 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 0x7efe30039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5575146b47f0 tx=0x7eff4808dd80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.574+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff5cc13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff5cc13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5575146a8fd0 con 0x5575146d7cc0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57592/0 (socket says 172.21.15.99:57592) 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff58a68640 1 -- 172.21.15.99:0/2483422990 learned_addr learned my addr 172.21.15.99:0/2483422990 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff58a68640 1 -- 172.21.15.99:0/2483422990 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575146d8690 con 0x5575146d7cc0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7eff58a68640 1 --2- 172.21.15.99:0/2483422990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7eff5004cde0 tx=0x7eff50020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d184fba19d543f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7efe377fe640 1 -- 172.21.15.99:0/2483422990 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff50014c70 con 0x5575146d7cc0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7efe377fe640 1 -- 172.21.15.99:0/2483422990 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff5001cd50 con 0x5575146d7cc0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.575+0000 7efe377fe640 1 -- 172.21.15.99:0/2483422990 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff5002aa60 con 0x5575146d7cc0 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- 172.21.15.99:0/2483422990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 msgr2=0x5575146d80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2483422990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7eff5004cde0 tx=0x7eff50020f60 comp rx=0 tx=0).stop 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- 172.21.15.99:0/2483422990 shutdown_connections 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2483422990 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146d80c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- 172.21.15.99:0/2483422990 >> 172.21.15.99:0/2483422990 conn(0x5575146d4020 msgr2=0x5575146d2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- 172.21.15.99:0/2483422990 shutdown_connections 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- 172.21.15.99:0/2483422990 wait complete. 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 Processor -- start 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- start start 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff5cc13800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5575146d8d00 con 0x5575146d7cc0 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff58a68640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57594/0 (socket says 172.21.15.99:57594) 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.576+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 learned_addr learned my addr 172.21.15.99:0/2660059688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575146df610 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7eff58a68640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7eff5004cce0 tx=0x7eff5004cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7efe35ffb640 1 -- 172.21.15.99:0/2660059688 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff50038020 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7efe35ffb640 1 -- 172.21.15.99:0/2660059688 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff50040130 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575146df8a0 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7efe35ffb640 1 -- 172.21.15.99:0/2660059688 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff50040430 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.577+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575146df8a0 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.578+0000 7efe35ffb640 1 -- 172.21.15.99:0/2660059688 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7eff5003b070 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.578+0000 7efe35ffb640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe28036af0 0x7efe28038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.578+0000 7efe35ffb640 1 -- 172.21.15.99:0/2660059688 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7eff50035c00 con 0x5575146d7cc0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.578+0000 7eff58267640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe28036af0 0x7efe28038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.578+0000 7eff58267640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe28036af0 0x7efe28038fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7eff480057c0 tx=0x7eff48090000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5575146ea9f0 0x5575146eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146ed600 con 0x5575146ea9f0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff57a66640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5575146ea9f0 0x5575146eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff57a66640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5575146ea9f0 0x5575146eceb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.579+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4c009050 con 0x5575146ea9f0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 realm 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146e9e40 con 0x5575146ea9f0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4c009050 con 0x5575146ea9f0 2024-09-13T23:27:20.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146ee0f0 con 0x5575146ea9f0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4c009050 con 0x5575146ea9f0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146ee9c0 con 0x5575146ea9f0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff4c009050 con 0x5575146ea9f0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146ef3e0 0x5575146f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f1ec0 con 0x5575146ef3e0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.580+0000 7eff58a68640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146ef3e0 0x5575146f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff58a68640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146ef3e0 0x5575146f17d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff5cc13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff5cc13800 20 searching for the correct realm 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5575146f3e90 0x5575146f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff58267640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5575146f3e90 0x5575146f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.581+0000 7eff58267640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5575146f3e90 0x5575146f6350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff58a68640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7eff50034070 0x7eff50040800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff57a66640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7eff50034070 0x7eff50040800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.582+0000 7eff57a66640 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7eff50034070 0x7eff50040800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c009050 con 0x7eff50034070 2024-09-13T23:27:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c009050 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.583+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.584+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.585+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.586+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.587+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.588+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.589+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.589+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.589+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.589+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146f3e90 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x7eff50034070 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ea9f0 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.590+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6a20 con 0x5575146ef3e0 2024-09-13T23:27:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f28e0 con 0x5575146ea9f0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f3180 con 0x5575146ea9f0 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f6ea0 con 0x5575146ef3e0 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 zone default found 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 4 Realm: () 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 zonegroup default 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.591+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f76f0 con 0x7eff50034070 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f9470 con 0x5575146f3e90 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146f9900 con 0x5575146f3e90 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 started sync module instance, tier type = 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.592+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146f8910 con 0x5575146ef3e0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.593+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.593+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93961342389504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146f8570 con 0x5575146ef3e0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.593+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fa830 con 0x5575146ea9f0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.594+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93961342389504] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.595+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.595+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93961342393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fa830 con 0x5575146ea9f0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.595+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fb250 con 0x5575146f3e90 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.596+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93961342393696] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.596+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.596+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93961342395264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fa7a0 con 0x5575146f3e90 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.596+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fc110 con 0x5575146ef3e0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.597+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93961342395264] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.597+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.597+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93961342401632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fc080 con 0x5575146ef3e0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.597+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fcfd0 con 0x5575146ea9f0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.598+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.598+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93961342405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fcf40 con 0x5575146ea9f0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.598+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fdef0 con 0x7eff50034070 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.598+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93961342401632] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.599+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.599+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93961342405408] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.599+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93961342403840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fdec0 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.599+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fd3c0 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.600+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93961342403840] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.600+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.600+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93961342409232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fde30 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.600+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146fedb0 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93961342413056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146ff1d0 con 0x7eff50034070 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=0 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=1 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=2 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=3 2024-09-13T23:27:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=4 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=5 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93961342409232] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.601+0000 7eff5cc13800 20 add_watcher() i=6 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.602+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93961342413056] v33'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.602+0000 7eff5cc13800 20 add_watcher() i=7 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.602+0000 7eff5cc13800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.602+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575146ff1d0 con 0x5575146ea9f0 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.603+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.603+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93961342414112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575146ff140 con 0x5575146ea9f0 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93961342414112] v33'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7efe0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 5 note: GC not initialized 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7efe0d7e2640 20 reqs_thread_entry: start 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 20 Filter name: none 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7efd7effd640 20 reqs_thread_entry: start 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.604+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575147355b0 con 0x7eff50034070 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff5cc13800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff5cc13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff5cc13800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff5cc13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.605+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55751473bd90 con 0x7eff50034070 2024-09-13T23:27:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.606+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v33'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.606+0000 7eff5cc13800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.606+0000 7eff5cc13800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.606+0000 7eff5cc13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.606+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93961342662480 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5575147373b0 con 0x5575146ea9f0 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 93961342405408 notify 141733920806 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7eff40001e10 con 0x5575146ea9f0 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7efe377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920806 cookie 93961342405408 notifier 4892 bl.length()=679 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7efe377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7efe377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7efe377fe640 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7efe1c003ea0 con 0x5575146ea9f0 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 93961342662480 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.607+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 93961342662480 notify 141733920806 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff4c02d8c0 con 0x5575146ea9f0 2024-09-13T23:27:20.622 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.608+0000 7efe0e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.608+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93961342414112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146ea9f0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.609+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93961342414112] v33'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.609+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93961342389504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146ef3e0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.610+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93961342389504] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.610+0000 7eff5cc13800 20 remove_watcher() i=0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.610+0000 7eff5cc13800 2 removed watcher, disabling cache 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.610+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93961342393696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146ea9f0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.611+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93961342393696] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.611+0000 7eff5cc13800 20 remove_watcher() i=1 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.611+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93961342395264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146f3e90 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.612+0000 7eff58267640 1 -- 172.21.15.99:0/2660059688 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93961342395264] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff48098070 con 0x5575146f3e90 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.612+0000 7eff5cc13800 20 remove_watcher() i=2 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.612+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93961342401632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146ef3e0 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.613+0000 7eff58a68640 1 -- 172.21.15.99:0/2660059688 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93961342401632] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff5003a030 con 0x5575146ef3e0 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.613+0000 7eff5cc13800 20 remove_watcher() i=3 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.613+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93961342405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x5575146ea9f0 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.614+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93961342405408] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x5575146ea9f0 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.614+0000 7eff5cc13800 20 remove_watcher() i=4 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.614+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93961342403840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x7eff50034070 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.615+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93961342403840] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.615+0000 7eff5cc13800 20 remove_watcher() i=5 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.615+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93961342409232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x7eff50034070 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.616+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93961342409232] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.616+0000 7eff5cc13800 20 remove_watcher() i=6 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.616+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93961342413056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5575147332f0 con 0x7eff50034070 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93961342413056] v33'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff4c029040 con 0x7eff50034070 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 20 remove_watcher() i=7 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7eff50034070 msgr2=0x7eff50040800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7eff50034070 0x7eff50040800 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5575146ea9f0 msgr2=0x5575146eceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5575146ea9f0 0x5575146eceb0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146ef3e0 msgr2=0x5575146f17d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146ef3e0 0x5575146f17d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5575146f3e90 msgr2=0x5575146f6350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5575146f3e90 0x5575146f6350 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe28036af0 msgr2=0x7efe28038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe28036af0 0x7efe28038fb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7eff480057c0 tx=0x7eff48090000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 msgr2=0x5575146df0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7eff5004cce0 tx=0x7eff5004cd40 comp rx=0 tx=0).stop 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff57a66640 1 -- 172.21.15.99:0/2660059688 reap_dead start 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 shutdown_connections 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2660059688 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146d7cc0 0x5575146df0d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 >> 172.21.15.99:0/2660059688 conn(0x5575146d4020 msgr2=0x5575146d20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 shutdown_connections 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.617+0000 7eff5cc13800 1 -- 172.21.15.99:0/2660059688 wait complete. 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 msgr2=0x7efe30039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 0x7efe30039000 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x5575146b47f0 tx=0x7eff4808dd80 comp rx=0 tx=0).stop 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 msgr2=0x5575146cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x5575146b7c20 tx=0x7eff500167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 shutdown_connections 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe30036b40 0x7efe30039000 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/624015108 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5575146caf70 0x5575146cb390 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 >> 172.21.15.99:0/624015108 conn(0x5575146bff00 msgr2=0x5575146c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 shutdown_connections 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/624015108 wait complete. 2024-09-13T23:27:20.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 msgr2=0x5575146b7300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 0x5575146b7300 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 msgr2=0x5575146bbf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 0x5575146bbf40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 msgr2=0x7efe40039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 0x7efe40039050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7eff4c000f60 tx=0x7eff4c0010a0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 msgr2=0x5575146b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7eff48045960 tx=0x7eff48002fb0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 shutdown_connections 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5575146b9b50 0x5575146bbf40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55751452d610 0x5575146b7300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7efe40036b90 0x7efe40039050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 --2- 172.21.15.99:0/2429389173 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55751452c330 0x5575146b0290 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 >> 172.21.15.99:0/2429389173 conn(0x5575145b2fe0 msgr2=0x5575146a2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 shutdown_connections 2024-09-13T23:27:20.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.618+0000 7eff5cc13800 1 -- 172.21.15.99:0/2429389173 wait complete. 2024-09-13T23:27:20.634 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.634 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.634 ERROR:root:0 2024-09-13T23:27:20.634 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:20.647 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:20.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T23:27:20.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T23:27:20.647 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T23:27:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717d40f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556ae44fd920 0x556ae44ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717d40f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ae43b9b30 con 0x556ae44f94e0 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717d40f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x556ae439b360 con 0x556ae44fd920 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f7173fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x556ae44fd920 0x556ae44ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717af03640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x556ae44f94e0 0x556ae44f98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55294/0 (socket says 172.21.15.99:55294) 2024-09-13T23:27:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.693+0000 7f717af03640 1 -- 172.21.15.99:0/309064251 learned_addr learned my addr 172.21.15.99:0/309064251 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.694+0000 7f717a702640 1 -- 172.21.15.99:0/309064251 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512436927 0 0) 0x556ae43b9b30 con 0x556ae44f94e0 2024-09-13T23:27:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.694+0000 7f717a702640 1 -- 172.21.15.99:0/309064251 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7168001e10 con 0x556ae44f94e0 2024-09-13T23:27:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.694+0000 7f7173fff640 1 -- 172.21.15.99:0/309064251 >> v1:172.21.15.43:6789/0 conn(0x556ae44f94e0 legacy=0x556ae44f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.694+0000 7f7173fff640 1 -- 172.21.15.99:0/309064251 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae43c1e00 con 0x556ae44fd920 2024-09-13T23:27:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.695+0000 7f7173fff640 1 --2- 172.21.15.99:0/309064251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44fd920 0x556ae44ffd10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f716400a470 tx=0x7f7164045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a96da51415de1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717a702640 1 -- 172.21.15.99:0/309064251 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164059070 con 0x556ae44fd920 2024-09-13T23:27:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717a702640 1 -- 172.21.15.99:0/309064251 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164054570 con 0x556ae44fd920 2024-09-13T23:27:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717a702640 1 -- 172.21.15.99:0/309064251 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7164054870 con 0x556ae44fd920 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 -- 172.21.15.99:0/309064251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44fd920 msgr2=0x556ae44ffd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 --2- 172.21.15.99:0/309064251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44fd920 0x556ae44ffd10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f716400a470 tx=0x7f7164045920 comp rx=0 tx=0).stop 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 -- 172.21.15.99:0/309064251 shutdown_connections 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 --2- 172.21.15.99:0/309064251 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44fd920 0x556ae44ffd10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 -- 172.21.15.99:0/309064251 >> 172.21.15.99:0/309064251 conn(0x556ae44f4db0 msgr2=0x556ae44f71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 -- 172.21.15.99:0/309064251 shutdown_connections 2024-09-13T23:27:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.696+0000 7f717d40f800 1 -- 172.21.15.99:0/309064251 wait complete. 2024-09-13T23:27:20.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717d40f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717d40f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556ae4446360 con 0x556ae44f94e0 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717af03640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717af03640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57604/0 (socket says 172.21.15.99:57604) 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717af03640 1 -- 172.21.15.99:0/2529295532 learned_addr learned my addr 172.21.15.99:0/2529295532 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.710+0000 7f717af03640 1 -- 172.21.15.99:0/2529295532 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae4393bc0 con 0x556ae44f94e0 2024-09-13T23:27:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.711+0000 7f717af03640 1 --2- 172.21.15.99:0/2529295532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f716c001e30 tx=0x7f716c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db5aab10cde9920 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.711+0000 7f7068e09640 1 -- 172.21.15.99:0/2529295532 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f716c00b200 con 0x556ae44f94e0 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.711+0000 7f7068e09640 1 -- 172.21.15.99:0/2529295532 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c009460 con 0x556ae44f94e0 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.711+0000 7f7068e09640 1 -- 172.21.15.99:0/2529295532 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f716c0097a0 con 0x556ae44f94e0 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- 172.21.15.99:0/2529295532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 msgr2=0x556ae45e8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 --2- 172.21.15.99:0/2529295532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f716c001e30 tx=0x7f716c00b910 comp rx=0 tx=0).stop 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- 172.21.15.99:0/2529295532 shutdown_connections 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 --2- 172.21.15.99:0/2529295532 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45e8630 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- 172.21.15.99:0/2529295532 >> 172.21.15.99:0/2529295532 conn(0x556ae44f4db0 msgr2=0x556ae45e3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- 172.21.15.99:0/2529295532 shutdown_connections 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- 172.21.15.99:0/2529295532 wait complete. 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717d40f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556ae4500550 con 0x556ae44f94e0 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717af03640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717af03640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57608/0 (socket says 172.21.15.99:57608) 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.712+0000 7f717af03640 1 -- 172.21.15.99:0/3924021181 learned_addr learned my addr 172.21.15.99:0/3924021181 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f717af03640 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae43a7fe0 con 0x556ae44f94e0 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f717af03640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f716c0011e0 tx=0x7f716c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f7067606640 1 -- 172.21.15.99:0/3924021181 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f716c01b040 con 0x556ae44f94e0 2024-09-13T23:27:20.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f7067606640 1 -- 172.21.15.99:0/3924021181 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f716c025070 con 0x556ae44f94e0 2024-09-13T23:27:20.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f7067606640 1 -- 172.21.15.99:0/3924021181 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f716c009d00 con 0x556ae44f94e0 2024-09-13T23:27:20.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae45ef470 con 0x556ae44f94e0 2024-09-13T23:27:20.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.713+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae45ef990 con 0x556ae44f94e0 2024-09-13T23:27:20.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f7067606640 1 -- 172.21.15.99:0/3924021181 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f716c02a460 con 0x556ae44f94e0 2024-09-13T23:27:20.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f7067606640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 0x7f7060039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f7067606640 1 -- 172.21.15.99:0/3924021181 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f716c011070 con 0x556ae44f94e0 2024-09-13T23:27:20.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f7173fff640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 0x7f7060039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 0x556ae45f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae45f64e0 con 0x556ae44fd920 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f717b704640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 0x556ae45f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.714+0000 7f7173fff640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 0x7f7060039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x556ae44fa2e0 tx=0x7f7164050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717b704640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 0x556ae45f5fa0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717b704640 1 -- 172.21.15.99:0/3924021181 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f717400a4a0 con 0x556ae44fd920 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae45f34c0 con 0x556ae44fd920 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717b704640 1 -- 172.21.15.99:0/3924021181 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f717400a4a0 con 0x556ae44fd920 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 0x556ae45faa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae45fb200 con 0x556ae45f85b0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.715+0000 7f717af03640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 0x556ae45faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717af03640 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 0x556ae45faa70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717af03640 1 -- 172.21.15.99:0/3924021181 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f716c01e040 con 0x556ae45f85b0 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae45f6dc0 con 0x556ae44fd920 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717b704640 1 -- 172.21.15.99:0/3924021181 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f717400a4a0 con 0x556ae44fd920 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae45f71e0 con 0x556ae45f85b0 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.716+0000 7f717af03640 1 -- 172.21.15.99:0/3924021181 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f716c01e040 con 0x556ae45f85b0 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717d40f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717d40f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556ae4395580 con 0x556ae4609bb0 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57620/0 (socket says 172.21.15.99:57620) 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.717+0000 7f717b704640 1 -- 172.21.15.99:0/1031656607 learned_addr learned my addr 172.21.15.99:0/1031656607 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f717b704640 1 -- 172.21.15.99:0/1031656607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae460a510 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f717b704640 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x556ae45effe0 tx=0x7f71740167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f7064e01640 1 -- 172.21.15.99:0/1031656607 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174013640 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f7064e01640 1 -- 172.21.15.99:0/1031656607 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71740137e0 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae460a7a0 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f7064e01640 1 -- 172.21.15.99:0/1031656607 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174013ae0 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.718+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae460d480 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f7064e01640 1 -- 172.21.15.99:0/1031656607 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f7174011040 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f7064e01640 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 0x7f7054039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f7064e01640 1 -- 172.21.15.99:0/1031656607 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f717400e040 con 0x556ae4609bb0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717af03640 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 0x7f7054039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717af03640 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 0x7f7054039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x556ae45f3490 tx=0x7f716c04c4b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717d40f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.719+0000 7f717d40f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556ae45e8de0 con 0x556ae461ac80 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57636/0 (socket says 172.21.15.99:57636) 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f717b704640 1 -- 172.21.15.99:0/2991955482 learned_addr learned my addr 172.21.15.99:0/2991955482 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f717b704640 1 -- 172.21.15.99:0/2991955482 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae461b650 con 0x556ae461ac80 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f717b704640 1 --2- 172.21.15.99:0/2991955482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f717400afb0 tx=0x7f717401fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66c38f0fc6f8728 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f705e7fc640 1 -- 172.21.15.99:0/2991955482 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174021570 con 0x556ae461ac80 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f705e7fc640 1 -- 172.21.15.99:0/2991955482 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f717401f340 con 0x556ae461ac80 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.720+0000 7f705e7fc640 1 -- 172.21.15.99:0/2991955482 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174014cc0 con 0x556ae461ac80 2024-09-13T23:27:20.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- 172.21.15.99:0/2991955482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 msgr2=0x556ae461b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 --2- 172.21.15.99:0/2991955482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f717400afb0 tx=0x7f717401fcc0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- 172.21.15.99:0/2991955482 shutdown_connections 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 --2- 172.21.15.99:0/2991955482 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae461b080 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- 172.21.15.99:0/2991955482 >> 172.21.15.99:0/2991955482 conn(0x556ae4612bd0 msgr2=0x556ae4610cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- 172.21.15.99:0/2991955482 shutdown_connections 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- 172.21.15.99:0/2991955482 wait complete. 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 Processor -- start 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- start start 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717d40f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x556ae461bcc0 con 0x556ae461ac80 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717b704640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57650/0 (socket says 172.21.15.99:57650) 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.721+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 learned_addr learned my addr 172.21.15.99:0/4133827352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae4622630 con 0x556ae461ac80 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f717b704640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7174048010 tx=0x7f717404cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f705cff9640 1 -- 172.21.15.99:0/4133827352 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7174013e60 con 0x556ae461ac80 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f705cff9640 1 -- 172.21.15.99:0/4133827352 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7174040360 con 0x556ae461ac80 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae46228c0 con 0x556ae461ac80 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f705cff9640 1 -- 172.21.15.99:0/4133827352 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f717404e2b0 con 0x556ae461ac80 2024-09-13T23:27:20.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.722+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae46228c0 con 0x556ae461ac80 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.723+0000 7f705cff9640 1 -- 172.21.15.99:0/4133827352 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f717404e470 con 0x556ae461ac80 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.723+0000 7f705cff9640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7044036b40 0x7f7044039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.723+0000 7f705cff9640 1 -- 172.21.15.99:0/4133827352 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f7174007050 con 0x556ae461ac80 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.723+0000 7f717af03640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7044036b40 0x7f7044039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.723+0000 7f717af03640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7044036b40 0x7f7044039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f716c014ff0 tx=0x7f716c038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae462d9b0 0x556ae462fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae46305c0 con 0x556ae462d9b0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f7173fff640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae462d9b0 0x556ae462fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f7173fff640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae462d9b0 0x556ae462fe70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 20 realm 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.724+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae46309f0 con 0x556ae462d9b0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae46312c0 con 0x556ae462d9b0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4631660 con 0x556ae462d9b0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae46323c0 0x556ae46347b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4634e00 con 0x556ae46323c0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717b704640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae46323c0 0x556ae46347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.725+0000 7f717b704640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae46323c0 0x556ae46347b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717d40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717d40f800 20 searching for the correct realm 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556ae4636db0 0x556ae4639270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717af03640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556ae4636db0 0x556ae4639270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717af03640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556ae4636db0 0x556ae4639270 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.726+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.727+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.727+0000 7f717b704640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7174044070 0x7f717403b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.727+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.727+0000 7f7173fff640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7174044070 0x7f717403b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.727+0000 7f7173fff640 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7174044070 0x7f717403b470 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.728+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.729+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.730+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.731+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.732+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.733+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae4636db0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x7f7174044070 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae462d9b0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639940 con 0x556ae46323c0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.734+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae46357c0 con 0x556ae462d9b0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4636060 con 0x556ae462d9b0 2024-09-13T23:27:20.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4639dc0 con 0x556ae46323c0 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 zone default found 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 4 Realm: () 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 zonegroup default 2024-09-13T23:27:20.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.735+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4635ca0 con 0x7f7174044070 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae463c070 con 0x556ae4636db0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae463c440 con 0x556ae4636db0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 started sync module instance, tier type = 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.736+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463b510 con 0x556ae46323c0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.737+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.737+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917586635008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463b170 con 0x556ae46323c0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.737+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463d350 con 0x556ae462d9b0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.738+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917586635008] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.738+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.739+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917586638976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463d350 con 0x556ae462d9b0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.739+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463dd10 con 0x556ae4636db0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.740+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917586638976] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.740+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.740+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917586640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463d2c0 con 0x556ae4636db0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.740+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463ebd0 con 0x556ae46323c0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.741+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917586640544] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.741+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.741+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917586645248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463ebd0 con 0x556ae46323c0 2024-09-13T23:27:20.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.741+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463f640 con 0x556ae462d9b0 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.743+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917586645248] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.743+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.743+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917586649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae463f600 con 0x556ae462d9b0 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.743+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46400b0 con 0x7f7174044070 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.744+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917586649392] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.744+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.744+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917586646816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46400b0 con 0x7f7174044070 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.744+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae4640ac0 con 0x7f7174044070 2024-09-13T23:27:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.745+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(56 notify.6 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.745+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917586654736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae4640ee0 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.745+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46419c0 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.745+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917586646816] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917586654736] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917586658512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae4640a30 con 0x7f7174044070 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=0 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=1 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=2 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=3 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=4 2024-09-13T23:27:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=5 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.746+0000 7f717d40f800 20 add_watcher() i=6 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.747+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917586658512] v33'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716405c040 con 0x7f7174044070 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.747+0000 7f717d40f800 20 add_watcher() i=7 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.747+0000 7f717d40f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.747+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4644ac0 con 0x556ae462d9b0 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.748+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.748+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917586652048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae4641f40 con 0x556ae462d9b0 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917586652048] v33'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f716405c040 con 0x556ae462d9b0 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f70317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f717d40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f717d40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f717d40f800 5 note: GC not initialized 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f6fabfff640 20 reqs_thread_entry: start 2024-09-13T23:27:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f717d40f800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.749+0000 7f717d40f800 20 Filter name: none 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f6fa9ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4677cd0 con 0x7f7174044070 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f7164082040 con 0x7f7174044070 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.750+0000 7f717d40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.751+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae467e750 con 0x7f7174044070 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7164082040 con 0x7f7174044070 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f717d40f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f717d40f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f717d40f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93917586907408 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x556ae4679db0 con 0x556ae462d9b0 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 93917586649392 notify 141733920807 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f7164075040 con 0x556ae462d9b0 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f705e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920807 cookie 93917586649392 notifier 4899 bl.length()=636 2024-09-13T23:27:20.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f705e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 93917586907408 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7164082040 con 0x556ae462d9b0 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f705e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.752+0000 7f705e7fc640 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f7040003ea0 con 0x556ae462d9b0 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.753+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x556ae462d9b0 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.753+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 93917586907408 notify 141733920807 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7164068040 con 0x556ae462d9b0 2024-09-13T23:27:20.766 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.753+0000 7f70317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.754+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917586652048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae462d9b0 2024-09-13T23:27:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.754+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93917586652048] v33'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7164082040 con 0x556ae462d9b0 2024-09-13T23:27:20.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.755+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917586635008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae46323c0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.756+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93917586635008] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.756+0000 7f717d40f800 20 remove_watcher() i=0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.756+0000 7f717d40f800 2 removed watcher, disabling cache 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.756+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917586638976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae462d9b0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.757+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93917586638976] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x556ae462d9b0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.757+0000 7f717d40f800 20 remove_watcher() i=1 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.757+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917586640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae4636db0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.758+0000 7f717af03640 1 -- 172.21.15.99:0/4133827352 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93917586640544] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f716c04f070 con 0x556ae4636db0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.758+0000 7f717d40f800 20 remove_watcher() i=2 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.758+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917586645248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae46323c0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.759+0000 7f717b704640 1 -- 172.21.15.99:0/4133827352 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93917586645248] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7174055070 con 0x556ae46323c0 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.759+0000 7f717d40f800 20 remove_watcher() i=3 2024-09-13T23:27:20.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.759+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917586649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x556ae462d9b0 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.760+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93917586649392] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x556ae462d9b0 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.760+0000 7f717d40f800 20 remove_watcher() i=4 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.760+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917586646816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.761+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93917586646816] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.761+0000 7f717d40f800 20 remove_watcher() i=5 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.761+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917586654736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.762+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93917586654736] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.762+0000 7f717d40f800 20 remove_watcher() i=6 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.762+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917586658512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x556ae46759e0 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93917586658512] v33'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7164082040 con 0x7f7174044070 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 20 remove_watcher() i=7 2024-09-13T23:27:20.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7174044070 msgr2=0x7f717403b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f7174044070 0x7f717403b470 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae462d9b0 msgr2=0x556ae462fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae462d9b0 0x556ae462fe70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae46323c0 msgr2=0x556ae46347b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae46323c0 0x556ae46347b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556ae4636db0 msgr2=0x556ae4639270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x556ae4636db0 0x556ae4639270 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7044036b40 msgr2=0x7f7044039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7044036b40 0x7f7044039000 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f716c014ff0 tx=0x7f716c038000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f7173fff640 1 -- 172.21.15.99:0/4133827352 reap_dead start 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 msgr2=0x556ae46220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.763+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7174048010 tx=0x7f717404cd90 comp rx=0 tx=0).stop 2024-09-13T23:27:20.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 shutdown_connections 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/4133827352 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae461ac80 0x556ae46220f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 >> 172.21.15.99:0/4133827352 conn(0x556ae4612bd0 msgr2=0x556ae4610ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 shutdown_connections 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/4133827352 wait complete. 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 msgr2=0x7f7054039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 0x7f7054039050 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x556ae45f3490 tx=0x7f716c04c4b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 msgr2=0x556ae4609fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x556ae45effe0 tx=0x7f71740167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 shutdown_connections 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7054036b90 0x7f7054039050 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/1031656607 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae4609bb0 0x556ae4609fd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 >> 172.21.15.99:0/1031656607 conn(0x556ae45feb40 msgr2=0x556ae46016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 shutdown_connections 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/1031656607 wait complete. 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 msgr2=0x556ae45f5fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 0x556ae45f5fa0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 msgr2=0x556ae45faa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 0x556ae45faa70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 msgr2=0x7f7060039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 0x7f7060039000 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x556ae44fa2e0 tx=0x7f7164050000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 msgr2=0x556ae45eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f716c0011e0 tx=0x7f716c000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 shutdown_connections 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x556ae45f85b0 0x556ae45faa70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x556ae44fd920 0x556ae45f5fa0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7060036b40 0x7f7060039000 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 --2- 172.21.15.99:0/3924021181 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x556ae44f94e0 0x556ae45eef30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.764+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 >> 172.21.15.99:0/3924021181 conn(0x556ae44f4db0 msgr2=0x556ae45e28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.765+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 shutdown_connections 2024-09-13T23:27:20.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.765+0000 7f717d40f800 1 -- 172.21.15.99:0/3924021181 wait complete. 2024-09-13T23:27:20.778 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.778 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.778 ERROR:root:0 2024-09-13T23:27:20.778 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:27:20.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:27:20.779 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T23:27:20.825 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.825 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.824+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.824+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbc6e87800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5594fd078930 0x5594fd07ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbc6e87800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594fcf34b30 con 0x5594fd074a70 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbc6e87800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x5594fcf16360 con 0x5594fd078930 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbc497b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5594fd074a70 0x5594fd074e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55298/0 (socket says 172.21.15.99:55298) 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbbc17a640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5594fd078930 0x5594fd07ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbc497b640 1 -- 172.21.15.99:0/3243676345 learned_addr learned my addr 172.21.15.99:0/3243676345 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3243676345 >> v1:172.21.15.43:6789/0 conn(0x5594fd074a70 legacy=0x5594fd074e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.825+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3243676345 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fcf3ce00 con 0x5594fd078930 2024-09-13T23:27:20.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.827+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3243676345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd078930 0x5594fd07ad20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00a470 tx=0x7ffbac045ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5bc683d51eb3e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.827+0000 7ffbbffff640 1 -- 172.21.15.99:0/3243676345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbac056020 con 0x5594fd078930 2024-09-13T23:27:20.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.827+0000 7ffbbffff640 1 -- 172.21.15.99:0/3243676345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac052590 con 0x5594fd078930 2024-09-13T23:27:20.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.827+0000 7ffbbffff640 1 -- 172.21.15.99:0/3243676345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbac0528b0 con 0x5594fd078930 2024-09-13T23:27:20.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3243676345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd078930 msgr2=0x5594fd07ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3243676345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd078930 0x5594fd07ad20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00a470 tx=0x7ffbac045ae0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3243676345 shutdown_connections 2024-09-13T23:27:20.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3243676345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd078930 0x5594fd07ad20 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3243676345 >> 172.21.15.99:0/3243676345 conn(0x5594fd06f550 msgr2=0x5594fd071970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3243676345 shutdown_connections 2024-09-13T23:27:20.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.828+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3243676345 wait complete. 2024-09-13T23:27:20.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc6e87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc6e87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5594fcfc1360 con 0x5594fd074a70 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc497b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc497b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57664/0 (socket says 172.21.15.99:57664) 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc497b640 1 -- 172.21.15.99:0/956102209 learned_addr learned my addr 172.21.15.99:0/956102209 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.842+0000 7ffbc497b640 1 -- 172.21.15.99:0/956102209 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fcf0ebc0 con 0x5594fd074a70 2024-09-13T23:27:20.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.843+0000 7ffbc497b640 1 --2- 172.21.15.99:0/956102209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001e10 tx=0x7ffbb400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4315b1fc7e5af3e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.843+0000 7ffab2e0d640 1 -- 172.21.15.99:0/956102209 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4012020 con 0x5594fd074a70 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.843+0000 7ffab2e0d640 1 -- 172.21.15.99:0/956102209 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb400e5a0 con 0x5594fd074a70 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.843+0000 7ffab2e0d640 1 -- 172.21.15.99:0/956102209 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb400e8e0 con 0x5594fd074a70 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- 172.21.15.99:0/956102209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 msgr2=0x5594fd1637e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/956102209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001e10 tx=0x7ffbb400b780 comp rx=0 tx=0).stop 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- 172.21.15.99:0/956102209 shutdown_connections 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/956102209 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd1637e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- 172.21.15.99:0/956102209 >> 172.21.15.99:0/956102209 conn(0x5594fd06f550 msgr2=0x5594fd15f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- 172.21.15.99:0/956102209 shutdown_connections 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- 172.21.15.99:0/956102209 wait complete. 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc6e87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5594fd07b5c0 con 0x5594fd074a70 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc497b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc497b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57674/0 (socket says 172.21.15.99:57674) 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.844+0000 7ffbc497b640 1 -- 172.21.15.99:0/3994231134 learned_addr learned my addr 172.21.15.99:0/3994231134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffbc497b640 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fcf22fe0 con 0x5594fd074a70 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001e10 tx=0x7ffbb4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffab160a640 1 -- 172.21.15.99:0/3994231134 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4012030 con 0x5594fd074a70 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffab160a640 1 -- 172.21.15.99:0/3994231134 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb401c320 con 0x5594fd074a70 2024-09-13T23:27:20.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd16b6f0 con 0x5594fd074a70 2024-09-13T23:27:20.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffab160a640 1 -- 172.21.15.99:0/3994231134 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbb401c9b0 con 0x5594fd074a70 2024-09-13T23:27:20.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.845+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd16bc10 con 0x5594fd074a70 2024-09-13T23:27:20.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffab160a640 1 -- 172.21.15.99:0/3994231134 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbb4015020 con 0x5594fd074a70 2024-09-13T23:27:20.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffab160a640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 0x7ffaac039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffab160a640 1 -- 172.21.15.99:0/3994231134 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ffbb4022030 con 0x5594fd074a70 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 0x7ffaac039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 0x5594fd171170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1716b0 con 0x5594fd078930 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.846+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 0x5594fd171170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 0x7ffaac039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffbac057000 tx=0x7ffbac052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 0x5594fd171170 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc517c640 1 -- 172.21.15.99:0/3994231134 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd078930 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd16e700 con 0x5594fd078930 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc517c640 1 -- 172.21.15.99:0/3994231134 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd078930 2024-09-13T23:27:20.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 0x5594fd175d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd176410 con 0x5594fd173980 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.847+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 0x5594fd175d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 0x5594fd175d70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc497b640 1 -- 172.21.15.99:0/3994231134 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd173980 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd172820 con 0x5594fd078930 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc517c640 1 -- 172.21.15.99:0/3994231134 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd078930 2024-09-13T23:27:20.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd172cc0 con 0x5594fd173980 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.848+0000 7ffbc497b640 1 -- 172.21.15.99:0/3994231134 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd173980 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc6e87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc6e87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5594fcf10580 con 0x5594fd184d70 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57682/0 (socket says 172.21.15.99:57682) 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc517c640 1 -- 172.21.15.99:0/4042982345 learned_addr learned my addr 172.21.15.99:0/4042982345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.849+0000 7ffbc517c640 1 -- 172.21.15.99:0/4042982345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd1856d0 con 0x5594fd184d70 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffbc517c640 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5594fd16c260 tx=0x7ffbc00167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffaaa7fc640 1 -- 172.21.15.99:0/4042982345 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0013640 con 0x5594fd184d70 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffaaa7fc640 1 -- 172.21.15.99:0/4042982345 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc00137e0 con 0x5594fd184d70 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd185960 con 0x5594fd184d70 2024-09-13T23:27:20.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffaaa7fc640 1 -- 172.21.15.99:0/4042982345 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0013ac0 con 0x5594fd184d70 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.850+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd188640 con 0x5594fd184d70 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffaaa7fc640 1 -- 172.21.15.99:0/4042982345 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc0011040 con 0x5594fd184d70 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffaaa7fc640 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 0x7ffa9c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffaaa7fc640 1 -- 172.21.15.99:0/4042982345 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ffbc000e040 con 0x5594fd184d70 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffbc497b640 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 0x7ffa9c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffbc497b640 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 0x7ffa9c039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffbb404d240 tx=0x7ffbb400deb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.851+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc6e87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc6e87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5594fd163f90 con 0x5594fd1919c0 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57694/0 (socket says 172.21.15.99:57694) 2024-09-13T23:27:20.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc517c640 1 -- 172.21.15.99:0/2910467664 learned_addr learned my addr 172.21.15.99:0/2910467664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc517c640 1 -- 172.21.15.99:0/2910467664 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd192390 con 0x5594fd1919c0 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffbc517c640 1 --2- 172.21.15.99:0/2910467664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005a10 tx=0x7ffbc004cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d6b4ecdca6fd70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffa9bfff640 1 -- 172.21.15.99:0/2910467664 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc0021440 con 0x5594fd1919c0 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffa9bfff640 1 -- 172.21.15.99:0/2910467664 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc004a030 con 0x5594fd1919c0 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.852+0000 7ffa9bfff640 1 -- 172.21.15.99:0/2910467664 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc001f340 con 0x5594fd1919c0 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- 172.21.15.99:0/2910467664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 msgr2=0x5594fd191dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/2910467664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005a10 tx=0x7ffbc004cf30 comp rx=0 tx=0).stop 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- 172.21.15.99:0/2910467664 shutdown_connections 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/2910467664 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd191dc0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- 172.21.15.99:0/2910467664 >> 172.21.15.99:0/2910467664 conn(0x5594fd18dd20 msgr2=0x5594fd18be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- 172.21.15.99:0/2910467664 shutdown_connections 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- 172.21.15.99:0/2910467664 wait complete. 2024-09-13T23:27:20.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 Processor -- start 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- start start 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.853+0000 7ffbc6e87800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5594fd192960 con 0x5594fd1919c0 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc517c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57700/0 (socket says 172.21.15.99:57700) 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 learned_addr learned my addr 172.21.15.99:0/3856151804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd199390 con 0x5594fd1919c0 2024-09-13T23:27:20.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd198e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0021040 tx=0x7ffbc004ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffa9a7fc640 1 -- 172.21.15.99:0/3856151804 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc001f7f0 con 0x5594fd1919c0 2024-09-13T23:27:20.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffa9a7fc640 1 -- 172.21.15.99:0/3856151804 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc001f990 con 0x5594fd1919c0 2024-09-13T23:27:20.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffa9a7fc640 1 -- 172.21.15.99:0/3856151804 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc004e2e0 con 0x5594fd1919c0 2024-09-13T23:27:20.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd199620 con 0x5594fd1919c0 2024-09-13T23:27:20.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.854+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd19c2d0 con 0x5594fd1919c0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.855+0000 7ffa9a7fc640 1 -- 172.21.15.99:0/3856151804 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7ffbc003a020 con 0x5594fd1919c0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.855+0000 7ffa9a7fc640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa90036b40 0x7ffa90039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.855+0000 7ffa9a7fc640 1 -- 172.21.15.99:0/3856151804 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7ffbc0038020 con 0x5594fd1919c0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.855+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa90036b40 0x7ffa90039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.855+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa90036b40 0x7ffa90039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffbb401c8b0 tx=0x7ffbb4036000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd1a49c0 0x5594fd1a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1a75d0 con 0x5594fd1a49c0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd1a49c0 0x5594fd1a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd1a49c0 0x5594fd1a6e80 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 20 realm 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.856+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1a7a00 con 0x5594fd1a49c0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:20.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1a82d0 con 0x5594fd1a49c0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1a8670 con 0x5594fd1a49c0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd1a93d0 0x5594fd1ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1abdd0 con 0x5594fd1a93d0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd1a93d0 0x5594fd1ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.857+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd1a93d0 0x5594fd1ab7c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc6e87800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc6e87800 20 searching for the correct realm 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5594fd1add60 0x5594fd1b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5594fd1add60 0x5594fd1b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc497b640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5594fd1add60 0x5594fd1b0220 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.858+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbc517c640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ffbc002bc20 0x7ffbc0040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ffbc002bc20 0x7ffbc0040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbbc17a640 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ffbc002bc20 0x7ffbc0040a20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.859+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.860+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.861+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.862+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.863+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.864+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.865+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1add60 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x7ffbc002bc20 2024-09-13T23:27:20.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a49c0 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b08f0 con 0x5594fd1a93d0 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:20.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.866+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ad2b0 con 0x5594fd1a49c0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1acb20 con 0x5594fd1a49c0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ac260 con 0x5594fd1a93d0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:20.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 zone default found 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 4 Realm: () 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 zonegroup default 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.867+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b1240 con 0x7ffbc002bc20 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b3510 con 0x5594fd1add60 2024-09-13T23:27:20.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b38b0 con 0x5594fd1add60 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 started sync module instance, tier type = 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.868+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b2950 con 0x5594fd1a93d0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.869+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.869+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098389937472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b3160 con 0x5594fd1a93d0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.869+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b45b0 con 0x5594fd1a49c0 2024-09-13T23:27:20.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.870+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098389937472] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.870+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.871+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098389941808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b49a0 con 0x5594fd1a49c0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.871+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b53f0 con 0x5594fd1add60 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.872+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098389941808] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.872+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.872+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098389946080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b57e0 con 0x5594fd1add60 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.872+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b6200 con 0x5594fd1a93d0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.873+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098389946080] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.873+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.873+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098389949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b6620 con 0x5594fd1a93d0 2024-09-13T23:27:20.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.873+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b7020 con 0x5594fd1a49c0 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.874+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098389949680] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.874+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.874+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098389942992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b6fe0 con 0x5594fd1a49c0 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.874+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b7a60 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.875+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098389942992] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.875+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.875+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098389956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b6fe0 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.875+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b84a0 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.876+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098389956496] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.876+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.876+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098389953808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b84a0 con 0x7ffbc002bc20 2024-09-13T23:27:20.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.876+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b8e60 con 0x7ffbc002bc20 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098389953808] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098389959120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b8e60 con 0x7ffbc002bc20 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=0 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=1 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=2 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=3 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=4 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=5 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.877+0000 7ffbc6e87800 20 add_watcher() i=6 2024-09-13T23:27:20.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.878+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098389959120] v33'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.879+0000 7ffbc6e87800 20 add_watcher() i=7 2024-09-13T23:27:20.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.879+0000 7ffbc6e87800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:20.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.879+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1bc260 con 0x5594fd1a49c0 2024-09-13T23:27:20.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.879+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.879+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098389961600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b9780 con 0x5594fd1a49c0 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098389961600] v33'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbac052960 con 0x5594fd1a49c0 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffa7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffbc6e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffbc6e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffbc6e87800 5 note: GC not initialized 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffa79fe3640 20 reqs_thread_entry: start 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.880+0000 7ffbc6e87800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.881+0000 7ffbc6e87800 20 Filter name: none 2024-09-13T23:27:20.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.881+0000 7ff9eb7fe640 20 reqs_thread_entry: start 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.881+0000 7ffbc6e87800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.881+0000 7ffbc6e87800 20 rados->read ofs=0 len=0 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.881+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ef680 con 0x7ffbc002bc20 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7ffbac052960 con 0x7ffbc002bc20 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbc6e87800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbc6e87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbc6e87800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbc6e87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.882+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1f5d40 con 0x7ffbc002bc20 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v33'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x7ffbc002bc20 2024-09-13T23:27:20.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbc6e87800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbc6e87800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbc6e87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94098390210304 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1f13a0 con 0x5594fd1a49c0 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 94098389942992 notify 141733920808 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5594fcf3ce00 con 0x5594fd1a49c0 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.883+0000 7ffa9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920808 cookie 94098389942992 notifier 4906 bl.length()=666 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffa9bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffa9bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 94098390210304 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffbac07f040 con 0x5594fd1a49c0 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffa9bfff640 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7ffa88003ea0 con 0x5594fd1a49c0 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x5594fd1a49c0 2024-09-13T23:27:20.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.884+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94098390210304 notify 141733920808 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffbac05c460 con 0x5594fd1a49c0 2024-09-13T23:27:20.903 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:20.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.885+0000 7ffa7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:20.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.885+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098389961600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ed3a0 con 0x5594fd1a49c0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.886+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94098389961600] v33'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x5594fd1a49c0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.886+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098389937472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ed3a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.887+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94098389937472] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.887+0000 7ffbc6e87800 20 remove_watcher() i=0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.887+0000 7ffbc6e87800 2 removed watcher, disabling cache 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.887+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098389941808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ed3a0 con 0x5594fd1a49c0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.888+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94098389941808] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x5594fd1a49c0 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.888+0000 7ffbc6e87800 20 remove_watcher() i=1 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.888+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098389946080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1ed3a0 con 0x5594fd1add60 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.889+0000 7ffbc497b640 1 -- 172.21.15.99:0/3856151804 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94098389946080] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbb401cd30 con 0x5594fd1add60 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.889+0000 7ffbc6e87800 20 remove_watcher() i=2 2024-09-13T23:27:20.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.889+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098389949680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b3e30 con 0x5594fd1a93d0 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.890+0000 7ffbc517c640 1 -- 172.21.15.99:0/3856151804 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94098389949680] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbc000a4a0 con 0x5594fd1a93d0 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.890+0000 7ffbc6e87800 20 remove_watcher() i=3 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.890+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098389942992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b4ee0 con 0x5594fd1a49c0 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.891+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94098389942992] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x5594fd1a49c0 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.891+0000 7ffbc6e87800 20 remove_watcher() i=4 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.891+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098389956496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b5cf0 con 0x7ffbc002bc20 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.893+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94098389956496] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x7ffbc002bc20 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.893+0000 7ffbc6e87800 20 remove_watcher() i=5 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.893+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098389953808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b3e30 con 0x7ffbc002bc20 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.894+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94098389953808] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x7ffbc002bc20 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.894+0000 7ffbc6e87800 20 remove_watcher() i=6 2024-09-13T23:27:20.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.894+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098389959120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5594fd1b4ee0 con 0x7ffbc002bc20 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94098389959120] v33'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffbac07f040 con 0x7ffbc002bc20 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 20 remove_watcher() i=7 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ffbc002bc20 msgr2=0x7ffbc0040a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7ffbc002bc20 0x7ffbc0040a20 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd1a49c0 msgr2=0x5594fd1a6e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd1a49c0 0x5594fd1a6e80 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd1a93d0 msgr2=0x5594fd1ab7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd1a93d0 0x5594fd1ab7c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5594fd1add60 msgr2=0x5594fd1b0220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5594fd1add60 0x5594fd1b0220 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa90036b40 msgr2=0x7ffa90039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa90036b40 0x7ffa90039000 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ffbb401c8b0 tx=0x7ffbb4036000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 msgr2=0x5594fd198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3856151804 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd1919c0 0x5594fd198e50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0021040 tx=0x7ffbc004ccc0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 reap_dead start 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbbc17a640 1 -- 172.21.15.99:0/3856151804 reap_dead start 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 shutdown_connections 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 >> 172.21.15.99:0/3856151804 conn(0x5594fd18dd20 msgr2=0x5594fd18bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 shutdown_connections 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.895+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3856151804 wait complete. 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 msgr2=0x7ffa9c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 0x7ffa9c039050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffbb404d240 tx=0x7ffbb400deb0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 msgr2=0x5594fd185190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5594fd16c260 tx=0x7ffbc00167b0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 shutdown_connections 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffa9c036b90 0x7ffa9c039050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/4042982345 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd184d70 0x5594fd185190 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 >> 172.21.15.99:0/4042982345 conn(0x5594fd179d00 msgr2=0x5594fd17c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 shutdown_connections 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/4042982345 wait complete. 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 msgr2=0x5594fd171170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 0x5594fd171170 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 msgr2=0x5594fd175d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 0x5594fd175d70 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 msgr2=0x7ffaac039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 0x7ffaac039000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ffbac057000 tx=0x7ffbac052000 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 msgr2=0x5594fd16b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4001e10 tx=0x7ffbb4000ed0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 shutdown_connections 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5594fd173980 0x5594fd175d70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5594fd078930 0x5594fd171170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7ffaac036b40 0x7ffaac039000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 --2- 172.21.15.99:0/3994231134 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5594fd074a70 0x5594fd16b1b0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 >> 172.21.15.99:0/3994231134 conn(0x5594fd06f550 msgr2=0x5594fd15dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 shutdown_connections 2024-09-13T23:27:20.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.896+0000 7ffbc6e87800 1 -- 172.21.15.99:0/3994231134 wait complete. 2024-09-13T23:27:20.915 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.915 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:20.915 ERROR:root:0 2024-09-13T23:27:20.915 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:20.927 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000c3ba2c60d8898ea5-0066e4ca58-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:27:20.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:27:20.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T23:27:20.928 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T23:27:20.974 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:20.974 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:20.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:20.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:20.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe166c10800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ed02469920 0x55ed0246bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe166c10800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ed02325b30 con 0x55ed024654e0 2024-09-13T23:27:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe166c10800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55ed02307360 con 0x55ed02469920 2024-09-13T23:27:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe159af6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55ed02469920 0x55ed0246bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe1622f7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55ed024654e0 0x55ed024658e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55314/0 (socket says 172.21.15.99:55314) 2024-09-13T23:27:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe1622f7640 1 -- 172.21.15.99:0/1162811088 learned_addr learned my addr 172.21.15.99:0/1162811088 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:20.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe161af6640 1 -- 172.21.15.99:0/1162811088 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554586378 0 0) 0x55ed02325b30 con 0x55ed024654e0 2024-09-13T23:27:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe161af6640 1 -- 172.21.15.99:0/1162811088 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe150004020 con 0x55ed024654e0 2024-09-13T23:27:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.974+0000 7fe159af6640 1 -- 172.21.15.99:0/1162811088 >> v1:172.21.15.43:6789/0 conn(0x55ed024654e0 legacy=0x55ed024658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.975+0000 7fe159af6640 1 -- 172.21.15.99:0/1162811088 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed0232de00 con 0x55ed02469920 2024-09-13T23:27:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.976+0000 7fe159af6640 1 --2- 172.21.15.99:0/1162811088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02469920 0x55ed0246bd10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00a470 tx=0x7fe14c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acac322807979cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.976+0000 7fe161af6640 1 -- 172.21.15.99:0/1162811088 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c059070 con 0x55ed02469920 2024-09-13T23:27:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.976+0000 7fe161af6640 1 -- 172.21.15.99:0/1162811088 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe14c054570 con 0x55ed02469920 2024-09-13T23:27:20.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.976+0000 7fe161af6640 1 -- 172.21.15.99:0/1162811088 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe14c054850 con 0x55ed02469920 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 -- 172.21.15.99:0/1162811088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02469920 msgr2=0x55ed0246bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 --2- 172.21.15.99:0/1162811088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02469920 0x55ed0246bd10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00a470 tx=0x7fe14c045920 comp rx=0 tx=0).stop 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 -- 172.21.15.99:0/1162811088 shutdown_connections 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 --2- 172.21.15.99:0/1162811088 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02469920 0x55ed0246bd10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 -- 172.21.15.99:0/1162811088 >> 172.21.15.99:0/1162811088 conn(0x55ed02460dd0 msgr2=0x55ed024631f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 -- 172.21.15.99:0/1162811088 shutdown_connections 2024-09-13T23:27:20.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.977+0000 7fe166c10800 1 -- 172.21.15.99:0/1162811088 wait complete. 2024-09-13T23:27:20.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.991+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.991+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.991+0000 7fe166c10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.991+0000 7fe166c10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed023b2360 con 0x55ed024654e0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe1622f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe1622f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57710/0 (socket says 172.21.15.99:57710) 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe1622f7640 1 -- 172.21.15.99:0/95760199 learned_addr learned my addr 172.21.15.99:0/95760199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe1622f7640 1 -- 172.21.15.99:0/95760199 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed022ffbc0 con 0x55ed024654e0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe1622f7640 1 --2- 172.21.15.99:0/95760199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe154001db0 tx=0x7fe15400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e7bfefe2381221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe050608640 1 -- 172.21.15.99:0/95760199 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe154012020 con 0x55ed024654e0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe050608640 1 -- 172.21.15.99:0/95760199 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15400e5a0 con 0x55ed024654e0 2024-09-13T23:27:20.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.992+0000 7fe050608640 1 -- 172.21.15.99:0/95760199 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15400e940 con 0x55ed024654e0 2024-09-13T23:27:20.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 -- 172.21.15.99:0/95760199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 msgr2=0x55ed025534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:20.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 --2- 172.21.15.99:0/95760199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe154001db0 tx=0x7fe15400b6c0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 -- 172.21.15.99:0/95760199 shutdown_connections 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 --2- 172.21.15.99:0/95760199 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed025534f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 -- 172.21.15.99:0/95760199 >> 172.21.15.99:0/95760199 conn(0x55ed02460dd0 msgr2=0x55ed0254eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 -- 172.21.15.99:0/95760199 shutdown_connections 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 -- 172.21.15.99:0/95760199 wait complete. 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.993+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe166c10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe166c10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed0246c550 con 0x55ed024654e0 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe1622f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:20.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe1622f7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57718/0 (socket says 172.21.15.99:57718) 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe1622f7640 1 -- 172.21.15.99:0/993860336 learned_addr learned my addr 172.21.15.99:0/993860336 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.994+0000 7fe1622f7640 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed02313fe0 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe1622f7640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55ed02554350 tx=0x7fe154000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe04ee05640 1 -- 172.21.15.99:0/993860336 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe154012030 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe04ee05640 1 -- 172.21.15.99:0/993860336 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe154001430 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe04ee05640 1 -- 172.21.15.99:0/993860336 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15401a8a0 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed0255f8b0 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.995+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed0255fdd0 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe04ee05640 1 -- 172.21.15.99:0/993860336 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe154015020 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe04ee05640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 0x7fe048039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe04ee05640 1 -- 172.21.15.99:0/993860336 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe154020030 con 0x55ed024654e0 2024-09-13T23:27:21.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe159af6640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 0x7fe048039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 0x55ed02566390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed02566910 con 0x55ed02469920 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe162af8640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 0x55ed02566390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe159af6640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 0x7fe048039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55ed024662e0 tx=0x7fe14c050000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.996+0000 7fe162af8640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 0x55ed02566390 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe162af8640 1 -- 172.21.15.99:0/993860336 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe15c00a4a0 con 0x55ed02469920 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed02563910 con 0x55ed02469920 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe162af8640 1 -- 172.21.15.99:0/993860336 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe15c00a4a0 con 0x55ed02469920 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 0x55ed0256afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed0256b6d0 con 0x55ed02568bf0 2024-09-13T23:27:21.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe1622f7640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 0x55ed0256afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.997+0000 7fe1622f7640 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 0x55ed0256afe0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.998+0000 7fe1622f7640 1 -- 172.21.15.99:0/993860336 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe154018430 con 0x55ed02568bf0 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.998+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed02567a90 con 0x55ed02469920 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.998+0000 7fe162af8640 1 -- 172.21.15.99:0/993860336 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe15c00a4a0 con 0x55ed02469920 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.998+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed02567f70 con 0x55ed02568bf0 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.998+0000 7fe1622f7640 1 -- 172.21.15.99:0/993860336 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe154018430 con 0x55ed02568bf0 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe166c10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe166c10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed02301580 con 0x55ed0257a060 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57724/0 (socket says 172.21.15.99:57724) 2024-09-13T23:27:21.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe162af8640 1 -- 172.21.15.99:0/1272903141 learned_addr learned my addr 172.21.15.99:0/1272903141 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe162af8640 1 -- 172.21.15.99:0/1272903141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed0257a9c0 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:20.999+0000 7fe162af8640 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55ed02566cf0 tx=0x7fe15c0163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe047fff640 1 -- 172.21.15.99:0/1272903141 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c013450 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe047fff640 1 -- 172.21.15.99:0/1272903141 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c0135f0 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed0257ac50 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe047fff640 1 -- 172.21.15.99:0/1272903141 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c0138d0 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed0257d930 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.000+0000 7fe047fff640 1 -- 172.21.15.99:0/1272903141 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe15c011040 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe047fff640 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 0x7fe03c039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe047fff640 1 -- 172.21.15.99:0/1272903141 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe15c00e040 con 0x55ed0257a060 2024-09-13T23:27:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe1622f7640 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 0x7fe03c039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe1622f7640 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 0x7fe03c039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ed02563cd0 tx=0x7fe15404b0a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe166c10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe166c10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed02553ca0 con 0x55ed02586db0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57740/0 (socket says 172.21.15.99:57740) 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.001+0000 7fe162af8640 1 -- 172.21.15.99:0/906928710 learned_addr learned my addr 172.21.15.99:0/906928710 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe162af8640 1 -- 172.21.15.99:0/906928710 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed02587780 con 0x55ed02586db0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe162af8640 1 --2- 172.21.15.99:0/906928710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe15c04cd90 tx=0x7fe15c04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a7f422ec7b836a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe045ffb640 1 -- 172.21.15.99:0/906928710 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c04a070 con 0x55ed02586db0 2024-09-13T23:27:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe045ffb640 1 -- 172.21.15.99:0/906928710 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c02a570 con 0x55ed02586db0 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe045ffb640 1 -- 172.21.15.99:0/906928710 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c01f4c0 con 0x55ed02586db0 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 -- 172.21.15.99:0/906928710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 msgr2=0x55ed025871b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 --2- 172.21.15.99:0/906928710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fe15c04cd90 tx=0x7fe15c04cf90 comp rx=0 tx=0).stop 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 -- 172.21.15.99:0/906928710 shutdown_connections 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 --2- 172.21.15.99:0/906928710 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed025871b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 -- 172.21.15.99:0/906928710 >> 172.21.15.99:0/906928710 conn(0x55ed02583110 msgr2=0x55ed02581210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 -- 172.21.15.99:0/906928710 shutdown_connections 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.002+0000 7fe166c10800 1 -- 172.21.15.99:0/906928710 wait complete. 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe166c10800 1 Processor -- start 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe166c10800 1 -- start start 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe166c10800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe166c10800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55ed02587df0 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe162af8640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57750/0 (socket says 172.21.15.99:57750) 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 learned_addr learned my addr 172.21.15.99:0/3947587335 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.003+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed0258e820 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe162af8640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe15c02a040 tx=0x7fe15c04cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe033fff640 1 -- 172.21.15.99:0/3947587335 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c01f710 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe033fff640 1 -- 172.21.15.99:0/3947587335 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c039070 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ed0258eab0 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe033fff640 1 -- 172.21.15.99:0/3947587335 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe15c01f9e0 con 0x55ed02586db0 2024-09-13T23:27:21.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed0258eab0 con 0x55ed02586db0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.004+0000 7fe033fff640 1 -- 172.21.15.99:0/3947587335 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe15c013a70 con 0x55ed02586db0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe033fff640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe02c036af0 0x7fe02c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe033fff640 1 -- 172.21.15.99:0/3947587335 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe15c041040 con 0x55ed02586db0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe1622f7640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe02c036af0 0x7fe02c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe1622f7640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe02c036af0 0x7fe02c038fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe154000fb0 tx=0x7fe154037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02599b80 0x55ed0259c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.005+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed0259c790 con 0x55ed02599b80 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe159af6640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02599b80 0x55ed0259c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe159af6640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02599b80 0x55ed0259c040 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 realm 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed0259cbc0 con 0x55ed02599b80 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed0259d490 con 0x55ed02599b80 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.006+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed0259d830 con 0x55ed02599b80 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed0259e590 0x55ed025a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a0f90 con 0x55ed0259e590 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe162af8640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed0259e590 0x55ed025a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe162af8640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed0259e590 0x55ed025a0980 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 20 searching for the correct realm 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ed025a2f20 0x55ed025a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.007+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe1622f7640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ed025a2f20 0x55ed025a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe1622f7640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ed025a2f20 0x55ed025a53e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe162af8640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe15c034070 0x7fe15c04ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.008+0000 7fe159af6640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe15c034070 0x7fe15c04ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.009+0000 7fe159af6640 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe15c034070 0x7fe15c04ea50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.009+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.009+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.009+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.009+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.010+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.011+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.012+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.013+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.014+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed025a2f20 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.015+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x7fe15c034070 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed02599b80 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5ab0 con 0x55ed0259e590 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a17e0 con 0x55ed02599b80 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.016+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a1bd0 con 0x55ed02599b80 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a5f30 con 0x55ed0259e590 2024-09-13T23:27:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 zone default found 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 4 Realm: () 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 zonegroup default 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a6780 con 0x7fe15c034070 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.017+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a8160 con 0x55ed025a2f20 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a8640 con 0x55ed025a2f20 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 20 started sync module instance, tier type = 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.018+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a75f0 con 0x55ed0259e590 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.019+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.019+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94476435094032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a7250 con 0x55ed0259e590 2024-09-13T23:27:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.019+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a9570 con 0x55ed02599b80 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.020+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94476435094032] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.020+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.020+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94476435098272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a9570 con 0x55ed02599b80 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.020+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a9f70 con 0x55ed025a2f20 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.021+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94476435098272] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.021+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.021+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94476435099840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a94e0 con 0x55ed025a2f20 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.021+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025aae30 con 0x55ed0259e590 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.022+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94476435099840] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.022+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.022+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94476435106176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025aada0 con 0x55ed0259e590 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.023+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025abcf0 con 0x55ed02599b80 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.024+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.024+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94476435109952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025ac110 con 0x55ed02599b80 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.024+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94476435106176] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.024+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025acbe0 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.024+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94476435109952] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.025+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.025+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94476435113680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025abc60 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.025+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025ad480 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.026+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94476435113680] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.026+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.026+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94476435108384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025abc60 con 0x7fe15c034070 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.026+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025adaa0 con 0x7fe15c034070 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(58 notify.7 [create] v33'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94476435108384] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94476435117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025ada10 con 0x7fe15c034070 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=0 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=1 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=2 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=3 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=4 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=5 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.027+0000 7fe166c10800 20 add_watcher() i=6 2024-09-13T23:27:21.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94476435117552] v33'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe166c10800 20 add_watcher() i=7 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe166c10800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025b0e70 con 0x55ed02599b80 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.028+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94476435115984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025ae330 con 0x55ed02599b80 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.029+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94476435115984] v33'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x55ed02599b80 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe018fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 5 note: GC not initialized 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fdf937fe640 20 reqs_thread_entry: start 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:21.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 20 Filter name: none 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fdf917fa640 20 reqs_thread_entry: start 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.030+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e42b0 con 0x7fe15c034070 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe166c10800 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe166c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe166c10800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe166c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.031+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025eaa80 con 0x7fe15c034070 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.033+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v33'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe14c05c040 con 0x7fe15c034070 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.033+0000 7fe166c10800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.033+0000 7fe166c10800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.033+0000 7fe166c10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.033+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94476435366976 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e60c0 con 0x55ed02599b80 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 94476435109952 notify 141733920809 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fe14c075040 con 0x55ed02599b80 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920809 cookie 94476435109952 notifier 4913 bl.length()=636 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe045ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe045ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 94476435366976 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe14c082040 con 0x55ed02599b80 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe045ffb640 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fe028003ea0 con 0x55ed02599b80 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x55ed02599b80 2024-09-13T23:27:21.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.034+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94476435366976 notify 141733920809 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe14c068040 con 0x55ed02599b80 2024-09-13T23:27:21.049 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.035+0000 7fe018fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.035+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94476435115984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e1fd0 con 0x55ed02599b80 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.036+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94476435115984] v33'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x55ed02599b80 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.036+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94476435094032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e1fd0 con 0x55ed0259e590 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.037+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94476435094032] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.037+0000 7fe166c10800 20 remove_watcher() i=0 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.037+0000 7fe166c10800 2 removed watcher, disabling cache 2024-09-13T23:27:21.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.037+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94476435098272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e1fd0 con 0x55ed02599b80 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.038+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94476435098272] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x55ed02599b80 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.038+0000 7fe166c10800 20 remove_watcher() i=1 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.038+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94476435099840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025e1fd0 con 0x55ed025a2f20 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.039+0000 7fe1622f7640 1 -- 172.21.15.99:0/3947587335 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94476435099840] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe154018430 con 0x55ed025a2f20 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.039+0000 7fe166c10800 20 remove_watcher() i=2 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.039+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94476435106176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a90c0 con 0x55ed0259e590 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.040+0000 7fe162af8640 1 -- 172.21.15.99:0/3947587335 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94476435106176] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe15c027020 con 0x55ed0259e590 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.040+0000 7fe166c10800 20 remove_watcher() i=3 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.040+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94476435109952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025aa980 con 0x55ed02599b80 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.041+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94476435109952] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x55ed02599b80 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.041+0000 7fe166c10800 20 remove_watcher() i=4 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.041+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94476435113680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025a90c0 con 0x7fe15c034070 2024-09-13T23:27:21.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.042+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94476435113680] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x7fe15c034070 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.042+0000 7fe166c10800 20 remove_watcher() i=5 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.042+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94476435108384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025ab840 con 0x7fe15c034070 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.043+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94476435108384] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x7fe15c034070 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.043+0000 7fe166c10800 20 remove_watcher() i=6 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.043+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94476435117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55ed025aa980 con 0x7fe15c034070 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.044+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94476435117552] v33'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe14c082040 con 0x7fe15c034070 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.044+0000 7fe166c10800 20 remove_watcher() i=7 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe15c034070 msgr2=0x7fe15c04ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe15c034070 0x7fe15c04ea50 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02599b80 msgr2=0x55ed0259c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02599b80 0x55ed0259c040 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed0259e590 msgr2=0x55ed025a0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed0259e590 0x55ed025a0980 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ed025a2f20 msgr2=0x55ed025a53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55ed025a2f20 0x55ed025a53e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe02c036af0 msgr2=0x7fe02c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe02c036af0 0x7fe02c038fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe154000fb0 tx=0x7fe154037000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe159af6640 1 -- 172.21.15.99:0/3947587335 reap_dead start 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 msgr2=0x55ed0258e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe15c02a040 tx=0x7fe15c04cd20 comp rx=0 tx=0).stop 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 shutdown_connections 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/3947587335 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed02586db0 0x55ed0258e2e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 >> 172.21.15.99:0/3947587335 conn(0x55ed02583110 msgr2=0x55ed025811e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 shutdown_connections 2024-09-13T23:27:21.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/3947587335 wait complete. 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 msgr2=0x7fe03c039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 0x7fe03c039050 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55ed02563cd0 tx=0x7fe15404b0a0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 msgr2=0x55ed0257a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x55ed02566cf0 tx=0x7fe15c0163e0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 shutdown_connections 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe03c036b90 0x7fe03c039050 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 --2- 172.21.15.99:0/1272903141 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed0257a060 0x55ed0257a480 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 >> 172.21.15.99:0/1272903141 conn(0x55ed0256eff0 msgr2=0x55ed02571b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 shutdown_connections 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.045+0000 7fe166c10800 1 -- 172.21.15.99:0/1272903141 wait complete. 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 msgr2=0x55ed02566390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 0x55ed02566390 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 msgr2=0x55ed0256afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 0x55ed0256afe0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 msgr2=0x7fe048039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 0x7fe048039000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55ed024662e0 tx=0x7fe14c050000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 msgr2=0x55ed0255f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x55ed02554350 tx=0x7fe154000bc0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 shutdown_connections 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55ed02568bf0 0x55ed0256afe0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55ed02469920 0x55ed02566390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe048036b40 0x7fe048039000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 --2- 172.21.15.99:0/993860336 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55ed024654e0 0x55ed0255f370 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 >> 172.21.15.99:0/993860336 conn(0x55ed02460dd0 msgr2=0x55ed0254d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 shutdown_connections 2024-09-13T23:27:21.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.046+0000 7fe166c10800 1 -- 172.21.15.99:0/993860336 wait complete. 2024-09-13T23:27:21.060 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.061 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.061 ERROR:root:0 2024-09-13T23:27:21.061 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:21.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:21.061 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:27:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:21.108 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:21.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.107+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.107+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.107+0000 7fef08951800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a0056e4940 0x55a0056e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.107+0000 7fef08951800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a0055a5b30 con 0x55a0056e5280 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef08951800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55a005587360 con 0x55a0056e4940 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef06445640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55a0056e4940 0x55a0056e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef05c44640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55a0056e5280 0x55a0056ebaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55318/0 (socket says 172.21.15.99:55318) 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef05c44640 1 -- 172.21.15.99:0/1398143392 learned_addr learned my addr 172.21.15.99:0/1398143392 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef06445640 1 -- 172.21.15.99:0/1398143392 >> v1:172.21.15.43:6789/0 conn(0x55a0056e5280 legacy=0x55a0056ebaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.108+0000 7fef06445640 1 -- 172.21.15.99:0/1398143392 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0055ade00 con 0x55a0056e4940 2024-09-13T23:27:21.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.110+0000 7fef06445640 1 --2- 172.21.15.99:0/1398143392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e4d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feef800a470 tx=0x7feef8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e517e230f1aa324b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.110+0000 7fef05443640 1 -- 172.21.15.99:0/1398143392 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8053570 con 0x55a0056e4940 2024-09-13T23:27:21.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.110+0000 7fef05443640 1 -- 172.21.15.99:0/1398143392 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef8058070 con 0x55a0056e4940 2024-09-13T23:27:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.110+0000 7fef05443640 1 -- 172.21.15.99:0/1398143392 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8053880 con 0x55a0056e4940 2024-09-13T23:27:21.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 -- 172.21.15.99:0/1398143392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 msgr2=0x55a0056e4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 --2- 172.21.15.99:0/1398143392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e4d40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7feef800a470 tx=0x7feef8045a20 comp rx=0 tx=0).stop 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 -- 172.21.15.99:0/1398143392 shutdown_connections 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 --2- 172.21.15.99:0/1398143392 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e4d40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 -- 172.21.15.99:0/1398143392 >> 172.21.15.99:0/1398143392 conn(0x55a0056e0550 msgr2=0x55a0056e2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 -- 172.21.15.99:0/1398143392 shutdown_connections 2024-09-13T23:27:21.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.111+0000 7fef08951800 1 -- 172.21.15.99:0/1398143392 wait complete. 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.124+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.124+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.124+0000 7fef08951800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.124+0000 7fef08951800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a005632360 con 0x55a0056e4940 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.124+0000 7fef06445640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fef06445640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57768/0 (socket says 172.21.15.99:57768) 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fef06445640 1 -- 172.21.15.99:0/4007329665 learned_addr learned my addr 172.21.15.99:0/4007329665 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fef06445640 1 -- 172.21.15.99:0/4007329665 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00557fbc0 con 0x55a0056e4940 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fef06445640 1 --2- 172.21.15.99:0/4007329665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feef8025c20 tx=0x7feef8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ecd72cd092a6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fedf4608640 1 -- 172.21.15.99:0/4007329665 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8053ba0 con 0x55a0056e4940 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fedf4608640 1 -- 172.21.15.99:0/4007329665 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef8063030 con 0x55a0056e4940 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.125+0000 7fedf4608640 1 -- 172.21.15.99:0/4007329665 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8053440 con 0x55a0056e4940 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- 172.21.15.99:0/4007329665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 msgr2=0x55a0056e7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 --2- 172.21.15.99:0/4007329665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feef8025c20 tx=0x7feef8051000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- 172.21.15.99:0/4007329665 shutdown_connections 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 --2- 172.21.15.99:0/4007329665 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0056e7300 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- 172.21.15.99:0/4007329665 >> 172.21.15.99:0/4007329665 conn(0x55a0056e0550 msgr2=0x55a0057d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- 172.21.15.99:0/4007329665 shutdown_connections 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- 172.21.15.99:0/4007329665 wait complete. 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef08951800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0056ed600 con 0x55a0056e4940 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.126+0000 7fef06445640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef06445640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57784/0 (socket says 172.21.15.99:57784) 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef06445640 1 -- 172.21.15.99:0/1281566064 learned_addr learned my addr 172.21.15.99:0/1281566064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef06445640 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a005593fe0 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef06445640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x55a0056e6a00 tx=0x7feef8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fedf2e05640 1 -- 172.21.15.99:0/1281566064 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8078070 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fedf2e05640 1 -- 172.21.15.99:0/1281566064 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef8053570 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0057df910 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fedf2e05640 1 -- 172.21.15.99:0/1281566064 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef8053850 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.127+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0057dfe90 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fedf2e05640 1 -- 172.21.15.99:0/1281566064 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7feef807b070 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fedf2e05640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 0x7fedec039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fedf2e05640 1 -- 172.21.15.99:0/1281566064 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7feef8070070 con 0x55a0056e4940 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fef05c44640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 0x7fedec039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 0x55a0057e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0057e6a10 con 0x55a0056e5280 2024-09-13T23:27:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.128+0000 7fef06c46640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 0x55a0057e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef05c44640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 0x7fedec039050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feefc000f60 tx=0x7feefc0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef06c46640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 0x55a0057e6440 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef06c46640 1 -- 172.21.15.99:0/1281566064 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef0000a4a0 con 0x55a0056e5280 2024-09-13T23:27:21.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0057e3a10 con 0x55a0056e5280 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef06c46640 1 -- 172.21.15.99:0/1281566064 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef0000a4a0 con 0x55a0056e5280 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 0x55a0057eb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0057eb840 con 0x55a0057e8d60 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.129+0000 7fef06445640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 0x55a0057eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.130+0000 7fef06445640 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 0x55a0057eb150 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.130+0000 7fef06445640 1 -- 172.21.15.99:0/1281566064 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feef807a030 con 0x55a0057e8d60 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.130+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0057e7b40 con 0x55a0056e5280 2024-09-13T23:27:21.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.130+0000 7fef06c46640 1 -- 172.21.15.99:0/1281566064 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef0000a4a0 con 0x55a0056e5280 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.130+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0057e8020 con 0x55a0057e8d60 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef06445640 1 -- 172.21.15.99:0/1281566064 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feef807a030 con 0x55a0057e8d60 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef08951800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef08951800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a005581580 con 0x55a0057fa160 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57800/0 (socket says 172.21.15.99:57800) 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.131+0000 7fef06c46640 1 -- 172.21.15.99:0/2511071197 learned_addr learned my addr 172.21.15.99:0/2511071197 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fef06c46640 1 -- 172.21.15.99:0/2511071197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0057faac0 con 0x55a0057fa160 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fef06c46640 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x55a0057e05f0 tx=0x7fef000163e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fedebfff640 1 -- 172.21.15.99:0/2511071197 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef00013450 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fedebfff640 1 -- 172.21.15.99:0/2511071197 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef000135f0 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fedebfff640 1 -- 172.21.15.99:0/2511071197 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef00013910 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0057fad50 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.132+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0057fda30 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fedebfff640 1 -- 172.21.15.99:0/2511071197 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fef00011040 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fedebfff640 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 0x7fede00390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fedebfff640 1 -- 172.21.15.99:0/2511071197 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fef0000e040 con 0x55a0057fa160 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef06445640 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 0x7fede00390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef06445640 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 0x7fede00390c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feef8090010 tx=0x7feef808ebc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef08951800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.133+0000 7fef08951800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a0056e5970 con 0x55a005806eb0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57806/0 (socket says 172.21.15.99:57806) 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fef06c46640 1 -- 172.21.15.99:0/2760328764 learned_addr learned my addr 172.21.15.99:0/2760328764 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fef06c46640 1 -- 172.21.15.99:0/2760328764 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a005807880 con 0x55a005806eb0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fef06c46640 1 --2- 172.21.15.99:0/2760328764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fef0004ce00 tx=0x7fef0004d0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab4890e1a5266bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fede9ffb640 1 -- 172.21.15.99:0/2760328764 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef00046250 con 0x55a005806eb0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fede9ffb640 1 -- 172.21.15.99:0/2760328764 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0002a440 con 0x55a005806eb0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.134+0000 7fede9ffb640 1 -- 172.21.15.99:0/2760328764 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0001f390 con 0x55a005806eb0 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- 172.21.15.99:0/2760328764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 msgr2=0x55a0058072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 --2- 172.21.15.99:0/2760328764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fef0004ce00 tx=0x7fef0004d0b0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- 172.21.15.99:0/2760328764 shutdown_connections 2024-09-13T23:27:21.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 --2- 172.21.15.99:0/2760328764 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a0058072b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- 172.21.15.99:0/2760328764 >> 172.21.15.99:0/2760328764 conn(0x55a005803210 msgr2=0x55a005801310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- 172.21.15.99:0/2760328764 shutdown_connections 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- 172.21.15.99:0/2760328764 wait complete. 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 Processor -- start 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- start start 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef08951800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55a005807ef0 con 0x55a005806eb0 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef06c46640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57820/0 (socket says 172.21.15.99:57820) 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 learned_addr learned my addr 172.21.15.99:0/4191522840 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.135+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a00580e860 con 0x55a005806eb0 2024-09-13T23:27:21.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fef06c46640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fef0004d0f0 tx=0x7fef0004cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fedd7fff640 1 -- 172.21.15.99:0/4191522840 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0003a020 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fedd7fff640 1 -- 172.21.15.99:0/4191522840 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0004e250 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a00580eaf0 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fedd7fff640 1 -- 172.21.15.99:0/4191522840 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef0004e570 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.136+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0058117a0 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fedd7fff640 1 -- 172.21.15.99:0/4191522840 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fef0003d020 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fedd7fff640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedd0036b40 0x7fedd0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fedd7fff640 1 -- 172.21.15.99:0/4191522840 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fef0004e050 con 0x55a005806eb0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fef06445640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedd0036b40 0x7fedd0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fef06445640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedd0036b40 0x7fedd0039000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feef8050020 tx=0x7feef8092000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.137+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a005819dc0 0x55a00581c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a00581c9d0 con 0x55a005819dc0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef05c44640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a005819dc0 0x55a00581c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef05c44640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a005819dc0 0x55a00581c280 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc009050 con 0x55a005819dc0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 20 realm 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005819210 con 0x55a005819dc0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc009050 con 0x55a005819dc0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.138+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a00581d4c0 con 0x55a005819dc0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc009050 con 0x55a005819dc0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a00581dd90 con 0x55a005819dc0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feefc009050 con 0x55a005819dc0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a00581e6d0 0x55a005820ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005821250 con 0x55a00581e6d0 2024-09-13T23:27:21.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef06c46640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a00581e6d0 0x55a005820ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef06c46640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a00581e6d0 0x55a005820ac0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 20 searching for the correct realm 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.139+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a005823200 0x55a0058256c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06445640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a005823200 0x55a0058256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06445640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a005823200 0x55a0058256c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06c46640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fef00058040 0x7fef00040040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.140+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fef00058040 0x7fef00040040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fef00058040 0x7fef00040040 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc009050 con 0x7fef00058040 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc009050 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.141+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.142+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.143+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.144+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.145+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.146+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005823200 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.147+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x7fef00058040 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a005819dc0 2024-09-13T23:27:21.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55a005825d90 con 0x55a00581e6d0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005821c10 con 0x55a005819dc0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.148+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0058224b0 con 0x55a005819dc0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005826210 con 0x55a00581e6d0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 zone default found 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 4 Realm: () 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:21.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 zonegroup default 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005826a60 con 0x7fef00058040 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0058287e0 con 0x55a005823200 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.149+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005828c10 con 0x55a005823200 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.150+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.150+0000 7fef08951800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.150+0000 7fef08951800 20 started sync module instance, tier type = 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.150+0000 7fef08951800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.150+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005827c80 con 0x55a00581e6d0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.151+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.151+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94145775567280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005827c80 con 0x55a00581e6d0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.151+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005829710 con 0x55a005819dc0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.152+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.152+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94145775571424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005829710 con 0x55a005819dc0 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.152+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582a6d0 con 0x55a005823200 2024-09-13T23:27:21.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.152+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94145775567280] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.153+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94145775571424] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.153+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.153+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94145775573760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0058277d0 con 0x55a005823200 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.153+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582b110 con 0x55a00581e6d0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.154+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94145775573760] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.154+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.154+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94145775578208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582b530 con 0x55a00581e6d0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.154+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582bde0 con 0x55a005819dc0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.155+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94145775578208] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.156+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.156+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94145775579264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582b950 con 0x55a005819dc0 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.156+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582c850 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.156+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94145775579264] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.157+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.157+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94145775584064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582b950 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.157+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582d260 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.158+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94145775584064] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.158+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.158+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94145775580320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582d440 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.158+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582dc90 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94145775580320] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94145775587696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582db20 con 0x7fef00058040 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=0 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=1 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=2 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=3 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=4 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=5 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.159+0000 7fef08951800 20 add_watcher() i=6 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94145775587696] v33'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef08951800 20 add_watcher() i=7 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef08951800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a005831090 con 0x55a005819dc0 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.160+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94145775588816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00582e580 con 0x55a005819dc0 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.161+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94145775588816] v33'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fedbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 5 note: GC not initialized 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fed377fe640 20 reqs_thread_entry: start 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 20 Filter name: none 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fed357fa640 20 reqs_thread_entry: start 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.162+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0058645b0 con 0x7fef00058040 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef08951800 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef08951800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef08951800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef08951800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:21.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.163+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a00586ac60 con 0x7fef00058040 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.164+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.164+0000 7fef08951800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.164+0000 7fef08951800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.164+0000 7fef08951800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.164+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94145775838752 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55a0058662a0 con 0x55a005819dc0 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 94145775579264 notify 141733920810 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55a0055a5b30 con 0x55a005819dc0 2024-09-13T23:27:21.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fede9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920810 cookie 94145775579264 notifier 4920 bl.length()=649 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fede9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fede9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fede9ffb640 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7fedcc003ea0 con 0x55a005819dc0 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 94145775838752 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.165+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 94145775838752 notify 141733920810 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7feefc02d580 con 0x55a005819dc0 2024-09-13T23:27:21.180 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.166+0000 7fedbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.166+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94145775588816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005866a60 con 0x55a005819dc0 2024-09-13T23:27:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.167+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94145775588816] v33'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.167+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94145775567280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005866a60 con 0x55a00581e6d0 2024-09-13T23:27:21.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.168+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94145775567280] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.168+0000 7fef08951800 20 remove_watcher() i=0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.168+0000 7fef08951800 2 removed watcher, disabling cache 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.168+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94145775571424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005866a60 con 0x55a005819dc0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.169+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94145775571424] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.169+0000 7fef08951800 20 remove_watcher() i=1 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.169+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94145775573760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005866a60 con 0x55a005823200 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.170+0000 7fef06445640 1 -- 172.21.15.99:0/4191522840 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94145775573760] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef807a030 con 0x55a005823200 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.170+0000 7fef08951800 20 remove_watcher() i=2 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.170+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94145775578208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a005866a60 con 0x55a00581e6d0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.171+0000 7fef06c46640 1 -- 172.21.15.99:0/4191522840 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94145775578208] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef00032040 con 0x55a00581e6d0 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.171+0000 7fef08951800 20 remove_watcher() i=3 2024-09-13T23:27:21.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.171+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94145775579264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0058622f0 con 0x55a005819dc0 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.172+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94145775579264] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x55a005819dc0 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.172+0000 7fef08951800 20 remove_watcher() i=4 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.172+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94145775584064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0058622f0 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.173+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94145775584064] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.173+0000 7fef08951800 20 remove_watcher() i=5 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.173+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94145775580320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0058622f0 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.174+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94145775580320] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.174+0000 7fef08951800 20 remove_watcher() i=6 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.174+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94145775587696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55a0058622f0 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94145775587696] v33'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feefc029040 con 0x7fef00058040 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 20 remove_watcher() i=7 2024-09-13T23:27:21.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fef00058040 msgr2=0x7fef00040040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fef00058040 0x7fef00040040 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a005819dc0 msgr2=0x55a00581c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a005819dc0 0x55a00581c280 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a00581e6d0 msgr2=0x55a005820ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a00581e6d0 0x55a005820ac0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a005823200 msgr2=0x55a0058256c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55a005823200 0x55a0058256c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedd0036b40 msgr2=0x7fedd0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedd0036b40 0x7fedd0039000 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7feef8050020 tx=0x7feef8092000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef05c44640 1 -- 172.21.15.99:0/4191522840 reap_dead start 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 msgr2=0x55a00580e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.175+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fef0004d0f0 tx=0x7fef0004cd90 comp rx=0 tx=0).stop 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 shutdown_connections 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/4191522840 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a005806eb0 0x55a00580e320 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 >> 172.21.15.99:0/4191522840 conn(0x55a005803210 msgr2=0x55a0058012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 shutdown_connections 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/4191522840 wait complete. 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 msgr2=0x7fede00390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 0x7fede00390c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7feef8090010 tx=0x7feef808ebc0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 msgr2=0x55a0057fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x55a0057e05f0 tx=0x7fef000163e0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 shutdown_connections 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fede0036c00 0x7fede00390c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/2511071197 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0057fa160 0x55a0057fa580 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 >> 172.21.15.99:0/2511071197 conn(0x55a0057ef0f0 msgr2=0x55a0057f1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 shutdown_connections 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/2511071197 wait complete. 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 msgr2=0x55a0057e6440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 0x55a0057e6440 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 msgr2=0x55a0057eb150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 0x55a0057eb150 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 msgr2=0x7fedec039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 0x7fedec039050 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7feefc000f60 tx=0x7feefc0012b0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 msgr2=0x55a0057df3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x55a0056e6a00 tx=0x7feef8002fb0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 shutdown_connections 2024-09-13T23:27:21.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55a0057e8d60 0x55a0057eb150 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55a0056e5280 0x55a0057e6440 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fedec036b90 0x7fedec039050 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.176+0000 7fef08951800 1 --2- 172.21.15.99:0/1281566064 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55a0056e4940 0x55a0057df3d0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.177+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 >> 172.21.15.99:0/1281566064 conn(0x55a0056e0550 msgr2=0x55a0057d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.177+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 shutdown_connections 2024-09-13T23:27:21.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.177+0000 7fef08951800 1 -- 172.21.15.99:0/1281566064 wait complete. 2024-09-13T23:27:21.192 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.192 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.192 ERROR:root:0 2024-09-13T23:27:21.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:21.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T23:27:21.192 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T23:27:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:27:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.238+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.238+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.238+0000 7f0c1b82f800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55698a7ce5d0 0x55698a7ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.238+0000 7f0c1b82f800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55698a717b30 con 0x55698a7cd2f0 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.238+0000 7f0c1b82f800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55698a6f9360 con 0x55698a7ce5d0 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.239+0000 7f0c16aee640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x55698a7ce5d0 0x55698a7ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.239+0000 7f0c162ed640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x55698a7cd2f0 0x55698a860680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:55322/0 (socket says 172.21.15.99:55322) 2024-09-13T23:27:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.239+0000 7f0c162ed640 1 -- 172.21.15.99:0/1785792378 learned_addr learned my addr 172.21.15.99:0/1785792378 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:27:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.239+0000 7f0c16aee640 1 -- 172.21.15.99:0/1785792378 >> v1:172.21.15.43:6789/0 conn(0x55698a7cd2f0 legacy=0x55698a860680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.239+0000 7f0c16aee640 1 -- 172.21.15.99:0/1785792378 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a71fe00 con 0x55698a7ce5d0 2024-09-13T23:27:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c16aee640 1 --2- 172.21.15.99:0/1785792378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7ce5d0 0x55698a7ccdb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0c08005fd0 tx=0x7f0c08045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8665d594f5ee4c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c15aec640 1 -- 172.21.15.99:0/1785792378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08058530 con 0x55698a7ce5d0 2024-09-13T23:27:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c15aec640 1 -- 172.21.15.99:0/1785792378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080586d0 con 0x55698a7ce5d0 2024-09-13T23:27:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c15aec640 1 -- 172.21.15.99:0/1785792378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080589d0 con 0x55698a7ce5d0 2024-09-13T23:27:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1785792378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7ce5d0 msgr2=0x55698a7ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.241+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1785792378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7ce5d0 0x55698a7ccdb0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0c08005fd0 tx=0x7f0c08045c30 comp rx=0 tx=0).stop 2024-09-13T23:27:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.242+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1785792378 shutdown_connections 2024-09-13T23:27:21.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.242+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1785792378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7ce5d0 0x55698a7ccdb0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.242+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1785792378 >> 172.21.15.99:0/1785792378 conn(0x55698a853fe0 msgr2=0x55698a856400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.242+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1785792378 shutdown_connections 2024-09-13T23:27:21.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.242+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1785792378 wait complete. 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.255+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.255+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.255+0000 7f0c1b82f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.255+0000 7f0c1b82f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55698a7a4360 con 0x55698a7cd2f0 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0c16aee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0c16aee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57830/0 (socket says 172.21.15.99:57830) 2024-09-13T23:27:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0c16aee640 1 -- 172.21.15.99:0/473448265 learned_addr learned my addr 172.21.15.99:0/473448265 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0c16aee640 1 -- 172.21.15.99:0/473448265 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a6f1bc0 con 0x55698a7cd2f0 2024-09-13T23:27:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0c16aee640 1 --2- 172.21.15.99:0/473448265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a3f0 tx=0x7f0c08051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df901d29de9861f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0b04e09640 1 -- 172.21.15.99:0/473448265 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c080589b0 con 0x55698a7cd2f0 2024-09-13T23:27:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0b04e09640 1 -- 172.21.15.99:0/473448265 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c08068070 con 0x55698a7cd2f0 2024-09-13T23:27:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.256+0000 7f0b04e09640 1 -- 172.21.15.99:0/473448265 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08058c80 con 0x55698a7cd2f0 2024-09-13T23:27:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- 172.21.15.99:0/473448265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 msgr2=0x55698a949b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/473448265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800a3f0 tx=0x7f0c08051000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- 172.21.15.99:0/473448265 shutdown_connections 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/473448265 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a949b30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- 172.21.15.99:0/473448265 >> 172.21.15.99:0/473448265 conn(0x55698a853fe0 msgr2=0x55698a9454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- 172.21.15.99:0/473448265 shutdown_connections 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- 172.21.15.99:0/473448265 wait complete. 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.257+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c1b82f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c1b82f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55698a7cd9e0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c16aee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c16aee640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57836/0 (socket says 172.21.15.99:57836) 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c16aee640 1 -- 172.21.15.99:0/2233335463 learned_addr learned my addr 172.21.15.99:0/2233335463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c16aee640 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a705fe0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c16aee640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0c08065040 tx=0x7f0c08003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0b03606640 1 -- 172.21.15.99:0/2233335463 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08063650 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0b03606640 1 -- 172.21.15.99:0/2233335463 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c080637f0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0b03606640 1 -- 172.21.15.99:0/2233335463 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c08063af0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.258+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55698a9519a0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.259+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698a951ec0 con 0x55698a7cd2f0 2024-09-13T23:27:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.259+0000 7f0b03606640 1 -- 172.21.15.99:0/2233335463 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c08074020 con 0x55698a7cd2f0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.259+0000 7f0b03606640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 0x7f0afc039050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.259+0000 7f0b03606640 1 -- 172.21.15.99:0/2233335463 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c080908d0 con 0x55698a7cd2f0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.259+0000 7f0c162ed640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 0x7f0afc039050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 0x55698a9584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a958a10 con 0x55698a7ce5d0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c172ef640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 0x55698a9584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c162ed640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 0x7f0afc039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000f60 tx=0x7f0c0c0012b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c172ef640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 0x55698a9584d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c172ef640 1 -- 172.21.15.99:0/2233335463 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c100083e0 con 0x55698a7ce5d0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.260+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a955a80 con 0x55698a7ce5d0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c172ef640 1 -- 172.21.15.99:0/2233335463 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c100083e0 con 0x55698a7ce5d0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 0x55698a95d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a95d7c0 con 0x55698a95ace0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c16aee640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 0x55698a95d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c16aee640 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 0x55698a95d0d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c16aee640 1 -- 172.21.15.99:0/2233335463 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c0806c450 con 0x55698a95ace0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.261+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a959b80 con 0x55698a7ce5d0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c172ef640 1 -- 172.21.15.99:0/2233335463 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c100083e0 con 0x55698a7ce5d0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a95a020 con 0x55698a95ace0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c16aee640 1 -- 172.21.15.99:0/2233335463 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c0806c450 con 0x55698a95ace0 2024-09-13T23:27:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c1b82f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.262+0000 7f0c1b82f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55698a6f3580 con 0x55698a96c100 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57850/0 (socket says 172.21.15.99:57850) 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c172ef640 1 -- 172.21.15.99:0/1670850011 learned_addr learned my addr 172.21.15.99:0/1670850011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c172ef640 1 -- 172.21.15.99:0/1670850011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a96ca60 con 0x55698a96c100 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c172ef640 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55698a952510 tx=0x7f0c1000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0b00e01640 1 -- 172.21.15.99:0/1670850011 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1001c020 con 0x55698a96c100 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0b00e01640 1 -- 172.21.15.99:0/1670850011 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c10007c30 con 0x55698a96c100 2024-09-13T23:27:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55698a96ccf0 con 0x55698a96c100 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0b00e01640 1 -- 172.21.15.99:0/1670850011 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10018440 con 0x55698a96c100 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.263+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698a96f9d0 con 0x55698a96c100 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.264+0000 7f0b00e01640 1 -- 172.21.15.99:0/1670850011 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c1001f020 con 0x55698a96c100 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.264+0000 7f0b00e01640 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 0x7f0af00390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.264+0000 7f0b00e01640 1 -- 172.21.15.99:0/1670850011 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c1004e1b0 con 0x55698a96c100 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.264+0000 7f0c16aee640 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 0x7f0af00390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c16aee640 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 0x7f0af00390c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c0808ee50 tx=0x7f0c08063df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c1b82f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c1b82f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55698a94a220 con 0x55698a978d80 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57856/0 (socket says 172.21.15.99:57856) 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.265+0000 7f0c172ef640 1 -- 172.21.15.99:0/789410434 learned_addr learned my addr 172.21.15.99:0/789410434 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c172ef640 1 -- 172.21.15.99:0/789410434 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a979750 con 0x55698a978d80 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c172ef640 1 --2- 172.21.15.99:0/789410434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0c1004c600 tx=0x7f0c10016630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8635ca167620c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0afa7fc640 1 -- 172.21.15.99:0/789410434 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10045070 con 0x55698a978d80 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0afa7fc640 1 -- 172.21.15.99:0/789410434 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c100188f0 con 0x55698a978d80 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0afa7fc640 1 -- 172.21.15.99:0/789410434 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10021550 con 0x55698a978d80 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 -- 172.21.15.99:0/789410434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 msgr2=0x55698a979180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/789410434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f0c1004c600 tx=0x7f0c10016630 comp rx=0 tx=0).stop 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 -- 172.21.15.99:0/789410434 shutdown_connections 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/789410434 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a979180 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 -- 172.21.15.99:0/789410434 >> 172.21.15.99:0/789410434 conn(0x55698a9750e0 msgr2=0x55698a973230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 -- 172.21.15.99:0/789410434 shutdown_connections 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.266+0000 7f0c1b82f800 1 -- 172.21.15.99:0/789410434 wait complete. 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c1b82f800 1 Processor -- start 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c1b82f800 1 -- start start 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c1b82f800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c1b82f800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x55698a979d20 con 0x55698a978d80 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c172ef640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:57864/0 (socket says 172.21.15.99:57864) 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 learned_addr learned my addr 172.21.15.99:0/3373880844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:27:21.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698a9807b0 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.267+0000 7f0c172ef640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0c10043040 tx=0x7f0c1004c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0af8ff9640 1 -- 172.21.15.99:0/3373880844 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c10045030 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0af8ff9640 1 -- 172.21.15.99:0/3373880844 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c100296e0 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55698a980a40 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0af8ff9640 1 -- 172.21.15.99:0/3373880844 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c1003fe60 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698a9836f0 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.268+0000 7f0af8ff9640 1 -- 172.21.15.99:0/3373880844 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f0c10016040 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0af8ff9640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ae0036b40 0x7f0ae0039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0af8ff9640 1 -- 172.21.15.99:0/3373880844 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f0c10046070 con 0x55698a978d80 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c16aee640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ae0036b40 0x7f0ae0039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c16aee640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ae0036b40 0x7f0ae0039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c08045c50 tx=0x7f0c08095000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a98bcf0 0x55698a98e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a98e900 con 0x55698a98bcf0 2024-09-13T23:27:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.269+0000 7f0c162ed640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a98bcf0 0x55698a98e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c162ed640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a98bcf0 0x55698a98e1b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c009050 con 0x55698a98bcf0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 realm 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a98b140 con 0x55698a98bcf0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c009050 con 0x55698a98bcf0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a98f3f0 con 0x55698a98bcf0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c009050 con 0x55698a98bcf0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.270+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a98fcc0 con 0x55698a98bcf0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c0c009050 con 0x55698a98bcf0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a990600 0x55698a992a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a9931a0 con 0x55698a990600 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c172ef640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a990600 0x55698a992a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c172ef640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a990600 0x55698a992a10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 20 searching for the correct realm 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55698a995170 0x55698a997630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.271+0000 7f0c16aee640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55698a995170 0x55698a997630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c16aee640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55698a995170 0x55698a997630 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c172ef640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c10021020 0x7f0c1002b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:27:21.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.272+0000 7f0c162ed640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c10021020 0x7f0c1002b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c10021020 0x7f0c1002b450 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c009050 con 0x7f0c10021020 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c009050 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.273+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.274+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.275+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.276+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.277+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.278+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.279+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a995170 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x7f0c10021020 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a98bcf0 2024-09-13T23:27:21.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55698a997d00 con 0x55698a990600 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.280+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a993b60 con 0x55698a98bcf0 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a994400 con 0x55698a98bcf0 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a998180 con 0x55698a990600 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 zone default found 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 4 Realm: () 2024-09-13T23:27:21.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 zonegroup default 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.281+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a9985b0 con 0x7f0c10021020 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a99a880 con 0x55698a995170 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a99ac20 con 0x55698a995170 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 started sync module instance, tier type = 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.282+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a999d10 con 0x55698a990600 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.284+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.284+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93911785251392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a999d10 con 0x55698a990600 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.284+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99b620 con 0x55698a98bcf0 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.285+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93911785251392] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.285+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.285+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93911785255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a999d10 con 0x55698a98bcf0 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.285+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99c0b0 con 0x55698a995170 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.286+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93911785255216] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.286+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.286+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93911785248864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a999c80 con 0x55698a995170 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.286+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99cf70 con 0x55698a990600 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.287+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93911785248864] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.287+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.288+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93911785261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99d390 con 0x55698a990600 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.288+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99dd50 con 0x55698a98bcf0 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.289+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93911785261760] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.289+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.289+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93911785263296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99dd50 con 0x55698a98bcf0 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.289+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99e780 con 0x7f0c10021020 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.290+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93911785263296] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.290+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.290+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93911785267856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99dd50 con 0x7f0c10021020 2024-09-13T23:27:21.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.290+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99f1c0 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.291+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93911785267856] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.291+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.291+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93911785271024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99dd50 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.291+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99fbd0 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93911785271024] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93911785265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a99fbd0 con 0x7f0c10021020 2024-09-13T23:27:21.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=0 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=1 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=2 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=3 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=4 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=5 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.292+0000 7f0c1b82f800 20 add_watcher() i=6 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.293+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93911785265792] v33'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.293+0000 7f0c1b82f800 20 add_watcher() i=7 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.293+0000 7f0c1b82f800 2 all 8 watchers are set, enabling cache 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.293+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a9a2ef0 con 0x55698a98bcf0 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.293+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.294+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93911785273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9a0160 con 0x55698a98bcf0 2024-09-13T23:27:21.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93911785273488] v33'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x55698a98bcf0 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 5 note: GC not initialized 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0a47fff640 20 reqs_thread_entry: start 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 20 init_complete bucket index max shards: 11 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 20 Filter name: none 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0a45ffb640 20 reqs_thread_entry: start 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 20 rados->read ofs=0 len=0 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.295+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d63d0 con 0x7f0c10021020 2024-09-13T23:27:21.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c1b82f800 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c1b82f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c1b82f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c1b82f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.296+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9dcd80 con 0x7f0c10021020 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.297+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v33'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0c0c029040 con 0x7f0c10021020 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.297+0000 7f0c1b82f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.297+0000 7f0c1b82f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.297+0000 7f0c1b82f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93911785523008 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d83e0 con 0x55698a98bcf0 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== watch-notify(notify (1) cookie 93911785263296 notify 141733920811 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55698a717b30 con 0x55698a98bcf0 2024-09-13T23:27:21.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0afa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 141733920811 cookie 93911785263296 notifier 4927 bl.length()=649 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0afa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0afa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(64 notify.4 [notify cookie 93911785523008 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c0c040020 con 0x55698a98bcf0 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0afa7fc640 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x7f0adc003ea0 con 0x55698a98bcf0 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x55698a98bcf0 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.298+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== watch-notify(notify_complete (2) cookie 93911785523008 notify 141733920811 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c0c02f5a0 con 0x55698a98bcf0 2024-09-13T23:27:21.313 INFO:teuthology.orchestra.run.smithi099.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T23:27:19.285424Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T23:27:19.285413Z","tags":[],"group_ids":[]} 2024-09-13T23:27:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.299+0000 7f0acd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:27:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.299+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93911785273488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d8ba0 con 0x55698a98bcf0 2024-09-13T23:27:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.300+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93911785273488] v33'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x55698a98bcf0 2024-09-13T23:27:21.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.300+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93911785251392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d8ba0 con 0x55698a990600 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.301+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93911785251392] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.301+0000 7f0c1b82f800 20 remove_watcher() i=0 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.301+0000 7f0c1b82f800 2 removed watcher, disabling cache 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.301+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93911785255216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d8ba0 con 0x55698a98bcf0 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.302+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93911785255216] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x55698a98bcf0 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.302+0000 7f0c1b82f800 20 remove_watcher() i=1 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.302+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93911785248864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d8ba0 con 0x55698a995170 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c16aee640 1 -- 172.21.15.99:0/3373880844 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93911785248864] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c080a4040 con 0x55698a995170 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c1b82f800 20 remove_watcher() i=2 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93911785261760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d8ba0 con 0x55698a990600 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c172ef640 1 -- 172.21.15.99:0/3373880844 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93911785261760] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c10028070 con 0x55698a990600 2024-09-13T23:27:21.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c1b82f800 20 remove_watcher() i=3 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.304+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93911785263296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d4130 con 0x55698a98bcf0 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.305+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93911785263296] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x55698a98bcf0 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.305+0000 7f0c1b82f800 20 remove_watcher() i=4 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.305+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93911785267856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d4130 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.307+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93911785267856] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.307+0000 7f0c1b82f800 20 remove_watcher() i=5 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.307+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93911785271024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d4130 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.308+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93911785271024] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.308+0000 7f0c1b82f800 20 remove_watcher() i=6 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.308+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93911785265792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55698a9d4130 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93911785265792] v33'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c0c040020 con 0x7f0c10021020 2024-09-13T23:27:21.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 20 remove_watcher() i=7 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c10021020 msgr2=0x7f0c1002b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7f0c10021020 0x7f0c1002b450 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a98bcf0 msgr2=0x55698a98e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a98bcf0 0x55698a98e1b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a990600 msgr2=0x55698a992a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a990600 0x55698a992a10 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55698a995170 msgr2=0x55698a997630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x55698a995170 0x55698a997630 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ae0036b40 msgr2=0x7f0ae0039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0ae0036b40 0x7f0ae0039000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0c08045c50 tx=0x7f0c08095000 comp rx=0 tx=0).stop 2024-09-13T23:27:21.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c162ed640 1 -- 172.21.15.99:0/3373880844 reap_dead start 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 msgr2=0x55698a980270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f0c10043040 tx=0x7f0c1004c560 comp rx=0 tx=0).stop 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 shutdown_connections 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/3373880844 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a978d80 0x55698a980270 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 >> 172.21.15.99:0/3373880844 conn(0x55698a9750e0 msgr2=0x55698a9731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 shutdown_connections 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.309+0000 7f0c1b82f800 1 -- 172.21.15.99:0/3373880844 wait complete. 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 msgr2=0x7f0af00390c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 0x7f0af00390c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c0808ee50 tx=0x7f0c08063df0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 msgr2=0x55698a96c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x55698a952510 tx=0x7f0c1000beb0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 shutdown_connections 2024-09-13T23:27:21.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0af0036c00 0x7f0af00390c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/1670850011 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a96c100 0x55698a96c520 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 >> 172.21.15.99:0/1670850011 conn(0x55698a961090 msgr2=0x55698a963c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 shutdown_connections 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/1670850011 wait complete. 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 msgr2=0x55698a9584d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 0x55698a9584d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 msgr2=0x55698a95d0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 0x55698a95d0d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 msgr2=0x7f0afc039050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 0x7f0afc039050 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c000f60 tx=0x7f0c0c0012b0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 msgr2=0x55698a951460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f0c08065040 tx=0x7f0c08003330 comp rx=0 tx=0).stop 2024-09-13T23:27:21.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 shutdown_connections 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x55698a95ace0 0x55698a95d0d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x55698a7ce5d0 0x55698a9584d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f0afc036b90 0x7f0afc039050 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 --2- 172.21.15.99:0/2233335463 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x55698a7cd2f0 0x55698a951460 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 >> 172.21.15.99:0/2233335463 conn(0x55698a853fe0 msgr2=0x55698a943da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 shutdown_connections 2024-09-13T23:27:21.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:27:21.310+0000 7f0c1b82f800 1 -- 172.21.15.99:0/2233335463 wait complete. 2024-09-13T23:27:21.325 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.325 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T23:27:19.285424Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T23:27:19.285413Z', 'tags': [], 'group_ids': []} 2024-09-13T23:27:21.325 ERROR:root:0 2024-09-13T23:27:21.325 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:27:21.340 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.341 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.353 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:27:21.367 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.379 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.379 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T23:27:21.395 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T23:27:21.396 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.408 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.408 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T23:27:21.423 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.424 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.435 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.436 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T23:27:21.451 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T23:27:21.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.462 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.463 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T23:27:21.478 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T23:27:21.479 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.490 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.491 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T23:27:21.505 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.506 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.517 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.518 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T23:27:21.531 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.531 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.544 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.544 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T23:27:21.559 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.559 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.571 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.571 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.584 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:27:21.585 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:27:21.599 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:27:21.618 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T23:27:21.630 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T23:27:21.630 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:27:21.643 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:27:21.613142Z', 'creation_time': '2024-09-13T23:27:21.610640Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:27:21.643 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T23:27:21.656 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:27:21.613142Z', 'creation_time': '2024-09-13T23:27:21.610640Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T23:27:21.660 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:27:21.672 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:27:21.613142Z', 'creation_time': '2024-09-13T23:27:21.610640Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:27:21.673 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T23:27:21.685 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000d1fb2c533a4cf283-0066e4ca59-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:27:21.689 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T23:27:21.704 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.704 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T23:27:21.720 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:27:21.728 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11'} 2024-09-13T23:27:21.746 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.750 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11'} 2024-09-13T23:27:21.767 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.768 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T23:27:21.786 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.800 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T23:27:21.815 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:27:21.816 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T23:27:21.829 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '30ca56dc-5661-43d6-a109-42ef24013139', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'marker': '08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T23:27:21.763064Z', 'creation_time': '2024-09-13T23:27:21.610640Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T23:28:21.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T23:28:21.905 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T23:28:21.906 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T23:28:21.930 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T23:28:21.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:28:21.944 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T23:28:21.944 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T23:28:21.958 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T23:28:21.959 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T23:28:21.973 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T23:28:21.973 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T23:28:21.988 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T23:28:21.988 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T23:28:22.001 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T23:00:00.000000Z', 'epoch': 1726268400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T23:28:22.001 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T23:28:22.017 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:22.017 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T23:28:22.029 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T23:28:22.029 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T23:28:22.047 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:28:22.060 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T23:28:22.078 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:28:22.331 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:28:22.346 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000d4ed719a8dc8510e-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.446 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:28:22.458 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:28:22.462 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T23:28:22.474 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T23:28:22.593 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T23:28:22.639 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:22.639 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:28:22.656 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T23:28:22.657 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T23:28:22.670 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T23:28:22.681 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T23:28:22.693 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000057fb877ea50c888e-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.711 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T23:28:22.749 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:22.749 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T23:28:22.762 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000902bf922ad350ae5-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.762 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T23:28:22.775 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'd45f1493-9740-4c4f-a727-0654beec83a1'}]}} 2024-09-13T23:28:22.776 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T23:28:22.797 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T23:28:22.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:28:22.811 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:28:22.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T23:28:22.825 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000081dd75095ce9c059-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.825 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T23:28:22.837 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bb7fa90e866c1734-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.848 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:28:22.861 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:28:22.862 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T23:28:22.875 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000076dc2030801be1ae-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.876 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T23:28:22.887 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000e1c913eda95604e2-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.887 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T23:28:22.900 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T23:28:22.900 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T23:28:22.912 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000003ee703c265b4618a-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.912 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T23:28:22.924 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008630a579aebf56ce-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T23:28:22.936 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b49a1d8111a850ba-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T23:28:22.948 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000d81e8995993eb3e2-0066e4ca96-4234-default', 'HostId': '4234-default-default'} 2024-09-13T23:28:22.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T23:28:22.967 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:22.967 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T23:28:22.980 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T23:28:22.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T23:28:22.995 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:22.996 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T23:28:23.008 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T23:28:23.008 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T23:28:23.023 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T23:28:23.028 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T23:28:23.037 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T23:28:23.037 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:28:23.039 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-13T23:28:23.037+0000 7f8c67625640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35917) UID: 0 2024-09-13T23:28:23.039 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-13T23:28:23.037+0000 7f8c6ebd9880 -1 shutting down 2024-09-13T23:28:26.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-13T23:28:29.140 INFO:tasks.rgw.client.0:Stopped 2024-09-13T23:28:29.141 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T23:28:29.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T23:28:29.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T23:28:29.300 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T23:28:29.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T23:28:29.301 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T23:28:29.388 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-09-13T23:28:29.389 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T23:28:29.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe350040800 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5570292ce900 0x5570292d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe350040800 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55702918ab30 con 0x5570292ca4c0 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe350040800 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x55702916c360 con 0x5570292ce900 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe347fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x5570292ce900 0x5570292d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe34db34640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x5570292ca4c0 0x5570292ca8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.99:42452/0 (socket says 172.21.15.99:42452) 2024-09-13T23:28:29.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.388+0000 7fe34db34640 1 -- 172.21.15.99:0/3185816225 learned_addr learned my addr 172.21.15.99:0/3185816225 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-09-13T23:28:29.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.389+0000 7fe347fff640 1 -- 172.21.15.99:0/3185816225 >> v1:172.21.15.43:6789/0 conn(0x5570292ca4c0 legacy=0x5570292ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.389+0000 7fe347fff640 1 -- 172.21.15.99:0/3185816225 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029192e00 con 0x5570292ce900 2024-09-13T23:28:29.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe347fff640 1 --2- 172.21.15.99:0/3185816225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ce900 0x5570292d0cf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe33800a470 tx=0x7fe338045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3963508668eb1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe34d333640 1 -- 172.21.15.99:0/3185816225 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338053570 con 0x5570292ce900 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe34d333640 1 -- 172.21.15.99:0/3185816225 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe338058070 con 0x5570292ce900 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe34d333640 1 -- 172.21.15.99:0/3185816225 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe338053880 con 0x5570292ce900 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 -- 172.21.15.99:0/3185816225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ce900 msgr2=0x5570292d0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 --2- 172.21.15.99:0/3185816225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ce900 0x5570292d0cf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe33800a470 tx=0x7fe338045a20 comp rx=0 tx=0).stop 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 -- 172.21.15.99:0/3185816225 shutdown_connections 2024-09-13T23:28:29.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 --2- 172.21.15.99:0/3185816225 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ce900 0x5570292d0cf0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 -- 172.21.15.99:0/3185816225 >> 172.21.15.99:0/3185816225 conn(0x5570292c5df0 msgr2=0x5570292c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 -- 172.21.15.99:0/3185816225 shutdown_connections 2024-09-13T23:28:29.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.391+0000 7fe350040800 1 -- 172.21.15.99:0/3185816225 wait complete. 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.406+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe350040800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe350040800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557029217330 con 0x5570292ca4c0 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe34db34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe34db34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:41626/0 (socket says 172.21.15.99:41626) 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe34db34640 1 -- 172.21.15.99:0/263857418 learned_addr learned my addr 172.21.15.99:0/263857418 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:28:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.407+0000 7fe34db34640 1 -- 172.21.15.99:0/263857418 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029164bc0 con 0x5570292ca4c0 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe34db34640 1 --2- 172.21.15.99:0/263857418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe340001d80 tx=0x7fe340001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dacaa1c4f1f193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe23be07640 1 -- 172.21.15.99:0/263857418 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340013030 con 0x5570292ca4c0 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe23be07640 1 -- 172.21.15.99:0/263857418 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34000e470 con 0x5570292ca4c0 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe23be07640 1 -- 172.21.15.99:0/263857418 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34000e810 con 0x5570292ca4c0 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe350040800 1 -- 172.21.15.99:0/263857418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 msgr2=0x5570293b9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe350040800 1 --2- 172.21.15.99:0/263857418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe340001d80 tx=0x7fe340001e70 comp rx=0 tx=0).stop 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe350040800 1 -- 172.21.15.99:0/263857418 shutdown_connections 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe350040800 1 --2- 172.21.15.99:0/263857418 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293b9750 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.408+0000 7fe350040800 1 -- 172.21.15.99:0/263857418 >> 172.21.15.99:0/263857418 conn(0x5570292c5df0 msgr2=0x5570293b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 -- 172.21.15.99:0/263857418 shutdown_connections 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 -- 172.21.15.99:0/263857418 wait complete. 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe350040800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570292d1530 con 0x5570292ca4c0 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe34db34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe34db34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:41632/0 (socket says 172.21.15.99:41632) 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.409+0000 7fe34db34640 1 -- 172.21.15.99:0/3309254397 learned_addr learned my addr 172.21.15.99:0/3309254397 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe34db34640 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557029178fe0 con 0x5570292ca4c0 2024-09-13T23:28:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe34db34640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe340004000 tx=0x7fe340000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe23a604640 1 -- 172.21.15.99:0/3309254397 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340027070 con 0x5570292ca4c0 2024-09-13T23:28:29.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe23a604640 1 -- 172.21.15.99:0/3309254397 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe340019900 con 0x5570292ca4c0 2024-09-13T23:28:29.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570293c27a0 con 0x5570292ca4c0 2024-09-13T23:28:29.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe23a604640 1 -- 172.21.15.99:0/3309254397 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe340019c60 con 0x5570292ca4c0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.410+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570293c2cc0 con 0x5570292ca4c0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe23a604640 1 -- 172.21.15.99:0/3309254397 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe34002a070 con 0x5570292ca4c0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe23a604640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 0x7fe234039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe23a604640 1 -- 172.21.15.99:0/3309254397 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe34001f070 con 0x5570292ca4c0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe347fff640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 0x7fe234039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 0x5570293c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.411+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570293c98a0 con 0x5570292ce900 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe34e335640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 0x5570293c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe347fff640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 0x7fe234039000 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe338057000 tx=0x7fe338052000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe34e335640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 0x5570293c92d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe34e335640 1 -- 172.21.15.99:0/3309254397 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe34800a4a0 con 0x5570292ce900 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570293c6880 con 0x5570292ce900 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.412+0000 7fe34e335640 1 -- 172.21.15.99:0/3309254397 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe34800a4a0 con 0x5570292ce900 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 0x5570293cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:3 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570293ce640 con 0x5570293cbbb0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe34db34640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 0x5570293cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe34db34640 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 0x5570293cdfa0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe34db34640 1 -- 172.21.15.99:0/3309254397 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(3 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe340029030 con 0x5570293cbbb0 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.413+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570293caa50 con 0x5570292ce900 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe34e335640 1 -- 172.21.15.99:0/3309254397 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe34800a4a0 con 0x5570292ce900 2024-09-13T23:28:29.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570293caf30 con 0x5570293cbbb0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe34db34640 1 -- 172.21.15.99:0/3309254397 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(5 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe340029030 con 0x5570293cbbb0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe350040800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.414+0000 7fe350040800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x557029166580 con 0x5570293dcfd0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:41644/0 (socket says 172.21.15.99:41644) 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe34e335640 1 -- 172.21.15.99:0/3395768961 learned_addr learned my addr 172.21.15.99:0/3395768961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe34e335640 1 -- 172.21.15.99:0/3395768961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570293dd930 con 0x5570293dcfd0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe34e335640 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x5570293c9c80 tx=0x7fe3480167b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe2337fe640 1 -- 172.21.15.99:0/3395768961 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348013640 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe2337fe640 1 -- 172.21.15.99:0/3395768961 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3480137e0 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe2337fe640 1 -- 172.21.15.99:0/3395768961 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348013ae0 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570293ddbc0 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.415+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570293e08a0 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.416+0000 7fe2337fe640 1 -- 172.21.15.99:0/3395768961 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe348011040 con 0x5570293dcfd0 2024-09-13T23:28:29.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.416+0000 7fe2337fe640 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 0x7fe228039000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.416+0000 7fe2337fe640 1 -- 172.21.15.99:0/3395768961 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe34800e040 con 0x5570293dcfd0 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.416+0000 7fe34db34640 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 0x7fe228039000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe34db34640 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 0x7fe228039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5570293c67c0 tx=0x7fe34002ae80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe350040800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe350040800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570293b9f00 con 0x5570293be050 2024-09-13T23:28:29.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:41654/0 (socket says 172.21.15.99:41654) 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.417+0000 7fe34e335640 1 -- 172.21.15.99:0/1260703834 learned_addr learned my addr 172.21.15.99:0/1260703834 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe34e335640 1 -- 172.21.15.99:0/1260703834 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570293bea20 con 0x5570293be050 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe34e335640 1 --2- 172.21.15.99:0/1260703834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe34804cde0 tx=0x7fe348020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745208b29a2b9aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe2317fa640 1 -- 172.21.15.99:0/1260703834 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348014c70 con 0x5570293be050 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe2317fa640 1 -- 172.21.15.99:0/1260703834 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34801cd50 con 0x5570293be050 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe2317fa640 1 -- 172.21.15.99:0/1260703834 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34802aa60 con 0x5570293be050 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 -- 172.21.15.99:0/1260703834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 msgr2=0x5570293be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 --2- 172.21.15.99:0/1260703834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe34804cde0 tx=0x7fe348020f60 comp rx=0 tx=0).stop 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 -- 172.21.15.99:0/1260703834 shutdown_connections 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 --2- 172.21.15.99:0/1260703834 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293be450 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 -- 172.21.15.99:0/1260703834 >> 172.21.15.99:0/1260703834 conn(0x5570293e6080 msgr2=0x5570293e4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 -- 172.21.15.99:0/1260703834 shutdown_connections 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.418+0000 7fe350040800 1 -- 172.21.15.99:0/1260703834 wait complete. 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe350040800 1 Processor -- start 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe350040800 1 -- start start 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe350040800 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe350040800 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x5570293bcd80 con 0x5570293be050 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe34e335640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.99:41656/0 (socket says 172.21.15.99:41656) 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 learned_addr learned my addr 172.21.15.99:0/2418132021 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.419+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570293f3900 con 0x5570293be050 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe34e335640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe34804cce0 tx=0x7fe34804cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe21f7fe640 1 -- 172.21.15.99:0/2418132021 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348038020 con 0x5570293be050 2024-09-13T23:28:29.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe21f7fe640 1 -- 172.21.15.99:0/2418132021 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348040130 con 0x5570293be050 2024-09-13T23:28:29.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5570293f3b90 con 0x5570293be050 2024-09-13T23:28:29.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe21f7fe640 1 -- 172.21.15.99:0/2418132021 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe348040430 con 0x5570293be050 2024-09-13T23:28:29.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.420+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570293f3b90 con 0x5570293be050 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.421+0000 7fe21f7fe640 1 -- 172.21.15.99:0/2418132021 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe34803b070 con 0x5570293be050 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.421+0000 7fe21f7fe640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe218036af0 0x7fe218038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.421+0000 7fe21f7fe640 1 -- 172.21.15.99:0/2418132021 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe348035c00 con 0x5570293be050 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.421+0000 7fe34db34640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe218036af0 0x7fe218038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.421+0000 7fe34db34640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe218036af0 0x7fe218038fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe340016fd0 tx=0x7fe340038000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570293fecc0 0x557029401180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570294018d0 con 0x5570293fecc0 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe347fff640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570293fecc0 0x557029401180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe347fff640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570293fecc0 0x557029401180 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 20 realm 2024-09-13T23:28:29.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.422+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029401d00 con 0x5570293fecc0 2024-09-13T23:28:29.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570294025d0 con 0x5570293fecc0 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029402970 con 0x5570293fecc0 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570294036d0 0x557029405ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:5 5.1c 5:3ba5726a:::zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029406110 con 0x5570294036d0 2024-09-13T23:28:29.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe34e335640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570294036d0 0x557029405ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.423+0000 7fe34e335640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570294036d0 0x557029405ac0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== osd_op_reply(5 zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe350040800 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T23:28:29.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe350040800 20 searching for the correct realm 2024-09-13T23:28:29.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5570294080c0 0x55702940a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe34db34640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5570294080c0 0x55702940a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe34db34640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5570294080c0 0x55702940a580 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== osd_op_reply(6 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.424+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.425+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== osd_op_reply(7 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.425+0000 7fe34e335640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe348034070 0x7fe34804b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.425+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.425+0000 7fe347fff640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe348034070 0x7fe34804b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.425+0000 7fe347fff640 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe348034070 0x7fe34804b4d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== osd_op_reply(8 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 5 ==== osd_op_reply(9 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 6 ==== osd_op_reply(10 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 7 ==== osd_op_reply(11 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.426+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== osd_op_reply(12 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 3 ==== osd_op_reply(13 [pgnls start_epoch 33 out=107b] v33'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== osd_op_reply(14 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 8 ==== osd_op_reply(15 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.427+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 3 ==== osd_op_reply(16 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 9 ==== osd_op_reply(17 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 4 ==== osd_op_reply(18 [pgnls start_epoch 33 out=142b] v24'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 3 ==== osd_op_reply(19 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.428+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 4 ==== osd_op_reply(20 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 4 ==== osd_op_reply(21 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 5 ==== osd_op_reply(22 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 6 ==== osd_op_reply(23 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.429+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 10 ==== osd_op_reply(24 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 11 ==== osd_op_reply(25 [pgnls start_epoch 33 out=74b] v33'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 5 ==== osd_op_reply(26 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 7 ==== osd_op_reply(27 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.430+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 5 ==== osd_op_reply(28 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 12 ==== osd_op_reply(29 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 6 ==== osd_op_reply(30 [pgnls start_epoch 33 out=82b] v33'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.431+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 8 ==== osd_op_reply(31 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 7 ==== osd_op_reply(32 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 6 ==== osd_op_reply(33 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294080c0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 9 ==== osd_op_reply(34 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.432+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x7fe348034070 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 8 ==== osd_op_reply(35 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570293fecc0 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 13 ==== osd_op_reply(36 [pgnls start_epoch 33 out=115b] v33'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 33 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e33) -- 0x55702940ac50 con 0x5570294036d0 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 7 ==== osd_op_reply(37 [pgnls start_epoch 33 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got zone_info.08e5ebbf-96cb-421f-911b-a0c32cceba7e 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.433+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029406ad0 con 0x5570293fecc0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029407370 con 0x5570293fecc0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:40 5.6 5:61eef632:::zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702940b0d0 con 0x5570294036d0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 8 ==== osd_op_reply(40 zonegroup_info.30ca56dc-5661-43d6-a109-42ef24013139 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 zone default found 2024-09-13T23:28:29.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 4 Realm: () 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 4 ZoneGroup: default (30ca56dc-5661-43d6-a109-42ef24013139) 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 4 Zone: default (08e5ebbf-96cb-421f-911b-a0c32cceba7e) 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 zonegroup default 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.434+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702940b920 con 0x7fe348034070 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702940b530 con 0x5570294080c0 2024-09-13T23:28:29.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 rados->read ofs=0 len=0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702940dba0 con 0x5570294080c0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 started sync module instance, tier type = 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 20 started zone id=08e5ebbf-96cb-421f-911b-a0c32cceba7e (name=default) with tier type = 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.435+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940cfe0 con 0x5570294036d0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.436+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 9 ==== osd_op_reply(44 notify.0 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.437+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93940216812496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940cc40 con 0x5570294036d0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.437+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940ea10 con 0x5570293fecc0 2024-09-13T23:28:29.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.438+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93940216812496] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.438+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 16 ==== osd_op_reply(46 notify.1 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.438+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93940216815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940e9d0 con 0x5570293fecc0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.438+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940f420 con 0x5570294080c0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.439+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93940216815664] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.439+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 12 ==== osd_op_reply(48 notify.2 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.439+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93940216819568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702940f810 con 0x5570294080c0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.439+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029410230 con 0x5570294036d0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.440+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 11 ==== osd_op_reply(50 notify.3 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.440+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93940216823072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029410ad0 con 0x5570294036d0 2024-09-13T23:28:29.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.441+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294115b0 con 0x5570293fecc0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.441+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93940216819568] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.442+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 18 ==== osd_op_reply(52 notify.4 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.442+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93940216828096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294115b0 con 0x5570293fecc0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.442+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029412000 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.442+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93940216823072] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.443+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 10 ==== osd_op_reply(54 notify.5 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.443+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93940216825376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029411fc0 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.443+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029412a40 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.443+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93940216828096] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.444+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93940216825376] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.444+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 12 ==== osd_op_reply(56 notify.6 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.444+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93940216830736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029411f30 con 0x7fe348034070 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.444+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029412ef0 con 0x7fe348034070 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93940216830736] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 14 ==== osd_op_reply(58 notify.7 [create] v33'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93940216833424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029412e60 con 0x7fe348034070 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=0 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=1 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=2 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=3 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=4 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=5 2024-09-13T23:28:29.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.445+0000 7fe350040800 20 add_watcher() i=6 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93940216833424] v33'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe350040800 20 add_watcher() i=7 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe350040800 2 all 8 watchers are set, enabling cache 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x5570294162f0 con 0x5570293fecc0 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.447+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93940216834944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029413770 con 0x5570293fecc0 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.448+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93940216834944] v33'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.448+0000 7fe1ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.448+0000 7fe350040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.448+0000 7fe350040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.448+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941ec00 con 0x5570293fecc0 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.449+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.449+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941f2d0 con 0x7fe348034070 2024-09-13T23:28:29.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.450+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.450+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941f6f0 con 0x5570294080c0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.451+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.451+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941fc60 con 0x5570293fecc0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.452+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v33'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.452+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941fc60 con 0x5570294036d0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.453+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v33'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.453+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941fd90 con 0x5570294080c0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.454+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v33'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.454+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702941fd90 con 0x5570293fecc0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.455+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v33'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.456+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294202b0 con 0x7fe348034070 2024-09-13T23:28:29.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.457+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v33'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.457+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294202b0 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.458+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.458+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294202b0 con 0x5570294080c0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.459+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v33'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.459+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294202b0 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.460+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v33'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.460+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420340 con 0x7fe348034070 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.461+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v33'42 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.461+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420470 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.462+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.462+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420470 con 0x7fe348034070 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.463+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v33'64 uv44 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.463+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420470 con 0x5570293fecc0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.464+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v33'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.464+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420470 con 0x5570294080c0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.465+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v33'79 uv48 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.465+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420ac0 con 0x5570294036d0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.466+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v33'86 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.466+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420aa0 con 0x5570294080c0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.467+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v33'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.467+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420aa0 con 0x5570293fecc0 2024-09-13T23:28:29.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.468+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v33'40 uv30 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.468+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420aa0 con 0x5570293fecc0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.469+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v33'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.469+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420aa0 con 0x5570294080c0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.470+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v33'80 uv50 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.470+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029420aa0 con 0x5570294036d0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.471+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v33'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.471+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.472+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v33'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.472+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.473+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v33'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.473+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.474+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v33'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.474+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.475+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v33'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.475+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x7fe348034070 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.476+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v33'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.476+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.478+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v33'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.478+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x7fe348034070 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.479+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v33'57 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.479+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294080c0 2024-09-13T23:28:29.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.480+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v33'81 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.480+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x7fe348034070 2024-09-13T23:28:29.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.481+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v33'65 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.481+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294208d0 con 0x5570294036d0 2024-09-13T23:28:29.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v33'38 uv28 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe1fe7fc640 20 reqs_thread_entry: start 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe350040800 20 init_complete bucket index max shards: 11 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe350040800 20 Filter name: none 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe16ffff640 20 reqs_thread_entry: start 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T23:28:29.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.483+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:94 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.484+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 20 ==== osd_op_reply(94 gc.12 [call] v33'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.484+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:95 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 21 ==== osd_op_reply(95 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:96 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 22 ==== osd_op_reply(96 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:97 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 23 ==== osd_op_reply(97 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:98 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 24 ==== osd_op_reply(98 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.485+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:99 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.486+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 25 ==== osd_op_reply(99 gc.12 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.486+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T23:28:29.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.486+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:100 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.487+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 23 ==== osd_op_reply(100 gc.13 [call] v33'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.487+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:101 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 24 ==== osd_op_reply(101 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:102 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 25 ==== osd_op_reply(102 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:103 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 26 ==== osd_op_reply(103 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:104 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 27 ==== osd_op_reply(104 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.488+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:105 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.490+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 28 ==== osd_op_reply(105 gc.13 [call] v33'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.490+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T23:28:29.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.490+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:106 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 28 ==== osd_op_reply(106 gc.14 [call] v33'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:107 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 29 ==== osd_op_reply(107 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:108 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 30 ==== osd_op_reply(108 gc.14 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:109 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 31 ==== osd_op_reply(109 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.491+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:110 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 32 ==== osd_op_reply(110 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:111 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 33 ==== osd_op_reply(111 gc.14 [call] v33'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.492+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:112 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 26 ==== osd_op_reply(112 gc.15 [call] v33'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:113 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 27 ==== osd_op_reply(113 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:114 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 28 ==== osd_op_reply(114 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:115 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 29 ==== osd_op_reply(115 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.494+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:116 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 30 ==== osd_op_reply(116 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:117 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 31 ==== osd_op_reply(117 gc.15 [call] v33'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.495+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:118 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.496+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 26 ==== osd_op_reply(118 gc.16 [call] v33'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.496+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:119 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 27 ==== osd_op_reply(119 gc.16 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:120 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 28 ==== osd_op_reply(120 gc.16 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:121 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 29 ==== osd_op_reply(121 gc.16 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:122 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 30 ==== osd_op_reply(122 gc.16 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.497+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:123 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.498+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 31 ==== osd_op_reply(123 gc.16 [call] v33'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.498+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.498+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:124 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.499+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 32 ==== osd_op_reply(124 gc.17 [call] v33'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.499+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:125 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.499+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 33 ==== osd_op_reply(125 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.499+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.499+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:126 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 34 ==== osd_op_reply(126 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:127 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 35 ==== osd_op_reply(127 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:128 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 36 ==== osd_op_reply(128 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.500+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:129 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.501+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 37 ==== osd_op_reply(129 gc.17 [call] v33'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.501+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.501+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:130 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.502+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 34 ==== osd_op_reply(130 gc.18 [call] v33'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.502+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:131 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.502+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 35 ==== osd_op_reply(131 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.502+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.502+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:132 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 36 ==== osd_op_reply(132 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:133 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 37 ==== osd_op_reply(133 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:134 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 38 ==== osd_op_reply(134 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.503+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:135 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.504+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 39 ==== osd_op_reply(135 gc.18 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.504+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.504+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:136 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.505+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 40 ==== osd_op_reply(136 gc.19 [call] v33'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.505+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:137 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.505+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 41 ==== osd_op_reply(137 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.505+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.505+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:138 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 42 ==== osd_op_reply(138 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:139 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 43 ==== osd_op_reply(139 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:140 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 44 ==== osd_op_reply(140 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.506+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:141 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.507+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 45 ==== osd_op_reply(141 gc.19 [call] v33'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.507+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.507+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:142 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 38 ==== osd_op_reply(142 gc.20 [call] v33'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:143 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 39 ==== osd_op_reply(143 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:144 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 40 ==== osd_op_reply(144 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.508+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:145 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 41 ==== osd_op_reply(145 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:146 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 42 ==== osd_op_reply(146 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.509+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:147 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.510+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 43 ==== osd_op_reply(147 gc.20 [call] v33'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.510+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.510+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:148 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 32 ==== osd_op_reply(148 gc.21 [call] v33'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:149 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 33 ==== osd_op_reply(149 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:150 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 34 ==== osd_op_reply(150 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.511+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:151 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 35 ==== osd_op_reply(151 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:152 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 36 ==== osd_op_reply(152 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.512+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:153 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.513+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 37 ==== osd_op_reply(153 gc.21 [call] v33'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.513+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.513+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:154 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 44 ==== osd_op_reply(154 gc.22 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:155 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 45 ==== osd_op_reply(155 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:156 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 46 ==== osd_op_reply(156 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:157 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 47 ==== osd_op_reply(157 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.514+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:158 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 48 ==== osd_op_reply(158 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:159 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 49 ==== osd_op_reply(159 gc.22 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.515+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:160 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.516+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 50 ==== osd_op_reply(160 gc.23 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.516+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:161 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 51 ==== osd_op_reply(161 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:162 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 52 ==== osd_op_reply(162 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 53 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 54 ==== osd_op_reply(164 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.517+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.518+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 55 ==== osd_op_reply(165 gc.23 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.518+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.518+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 56 ==== osd_op_reply(166 gc.24 [call] v33'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 57 ==== osd_op_reply(167 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.519+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 58 ==== osd_op_reply(168 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:169 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 59 ==== osd_op_reply(169 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:170 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 60 ==== osd_op_reply(170 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.520+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:171 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.521+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 61 ==== osd_op_reply(171 gc.24 [call] v33'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.521+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.521+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:172 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 62 ==== osd_op_reply(172 gc.25 [call] v33'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:173 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 63 ==== osd_op_reply(173 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:174 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 64 ==== osd_op_reply(174 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.522+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:175 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 65 ==== osd_op_reply(175 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:176 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 66 ==== osd_op_reply(176 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.523+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:177 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.524+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 67 ==== osd_op_reply(177 gc.25 [call] v33'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.524+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T23:28:29.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.524+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:178 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 29 ==== osd_op_reply(178 gc.26 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:179 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 30 ==== osd_op_reply(179 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:180 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 31 ==== osd_op_reply(180 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.525+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:181 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 32 ==== osd_op_reply(181 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:182 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 33 ==== osd_op_reply(182 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.526+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:183 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.527+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 34 ==== osd_op_reply(183 gc.26 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.527+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.527+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:184 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 68 ==== osd_op_reply(184 gc.27 [call] v33'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:185 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 69 ==== osd_op_reply(185 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:186 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 70 ==== osd_op_reply(186 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.528+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:187 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 71 ==== osd_op_reply(187 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:188 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 72 ==== osd_op_reply(188 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.529+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:189 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.530+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 73 ==== osd_op_reply(189 gc.27 [call] v33'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.530+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.530+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:190 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 35 ==== osd_op_reply(190 gc.28 [call] v33'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:191 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 36 ==== osd_op_reply(191 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:192 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 37 ==== osd_op_reply(192 gc.28 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.531+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:193 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.532+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 38 ==== osd_op_reply(193 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.532+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.532+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:194 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.533+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 39 ==== osd_op_reply(194 gc.28 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.533+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.533+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:195 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.534+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 40 ==== osd_op_reply(195 gc.28 [call] v33'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.534+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.534+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:196 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.535+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 74 ==== osd_op_reply(196 gc.29 [call] v33'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.535+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:197 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 75 ==== osd_op_reply(197 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:198 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 76 ==== osd_op_reply(198 gc.29 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:199 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 77 ==== osd_op_reply(199 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.536+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:200 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.537+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 78 ==== osd_op_reply(200 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.537+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.537+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:201 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.538+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 79 ==== osd_op_reply(201 gc.29 [call] v33'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.538+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.538+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:202 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 41 ==== osd_op_reply(202 gc.30 [call] v33'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:203 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 42 ==== osd_op_reply(203 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:204 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 43 ==== osd_op_reply(204 gc.30 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.539+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:205 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 44 ==== osd_op_reply(205 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:206 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 45 ==== osd_op_reply(206 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.540+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:207 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.541+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 46 ==== osd_op_reply(207 gc.30 [call] v33'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.541+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.541+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:208 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 38 ==== osd_op_reply(208 gc.31 [call] v33'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:209 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 39 ==== osd_op_reply(209 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:210 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 40 ==== osd_op_reply(210 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.542+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:211 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 41 ==== osd_op_reply(211 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:212 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 42 ==== osd_op_reply(212 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.543+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:213 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.544+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 43 ==== osd_op_reply(213 gc.31 [call] v33'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.544+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.544+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:214 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 46 ==== osd_op_reply(214 gc.0 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:215 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 47 ==== osd_op_reply(215 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:216 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 48 ==== osd_op_reply(216 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.545+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:217 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 49 ==== osd_op_reply(217 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:218 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 50 ==== osd_op_reply(218 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.546+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:219 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.547+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 51 ==== osd_op_reply(219 gc.0 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.547+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.547+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:220 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.548+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 47 ==== osd_op_reply(220 gc.1 [call] v33'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.548+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:221 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 48 ==== osd_op_reply(221 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:222 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 49 ==== osd_op_reply(222 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:223 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 50 ==== osd_op_reply(223 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:224 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 51 ==== osd_op_reply(224 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.549+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:225 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.550+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 52 ==== osd_op_reply(225 gc.1 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.550+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.550+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:226 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.551+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 80 ==== osd_op_reply(226 gc.2 [call] v33'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.551+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:227 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 81 ==== osd_op_reply(227 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:228 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 82 ==== osd_op_reply(228 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:229 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 83 ==== osd_op_reply(229 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:230 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 84 ==== osd_op_reply(230 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.552+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:231 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.553+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 85 ==== osd_op_reply(231 gc.2 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.553+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.553+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:232 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 52 ==== osd_op_reply(232 gc.3 [call] v33'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:233 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 53 ==== osd_op_reply(233 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:234 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 54 ==== osd_op_reply(234 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.554+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:235 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 55 ==== osd_op_reply(235 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:236 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 56 ==== osd_op_reply(236 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.555+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:237 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.556+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 57 ==== osd_op_reply(237 gc.3 [call] v33'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.556+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T23:28:29.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.556+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:238 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 44 ==== osd_op_reply(238 gc.4 [call] v33'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:239 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 45 ==== osd_op_reply(239 gc.4 [call out=15b] v0'0 uv89 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:240 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 46 ==== osd_op_reply(240 gc.4 [call out=24b] v0'0 uv89 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:241 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 47 ==== osd_op_reply(241 gc.4 [call out=15b] v0'0 uv89 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.557+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:242 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.558+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 48 ==== osd_op_reply(242 gc.4 [call out=15b] v0'0 uv89 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.558+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.558+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:243 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.558+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 49 ==== osd_op_reply(243 gc.4 [call] v33'90 uv90 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.558+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T23:28:29.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.559+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:244 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.559+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 86 ==== osd_op_reply(244 gc.5 [call] v33'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.559+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:245 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 87 ==== osd_op_reply(245 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:246 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 88 ==== osd_op_reply(246 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:247 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 89 ==== osd_op_reply(247 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:248 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 90 ==== osd_op_reply(248 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.560+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:249 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570294080c0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.561+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 91 ==== osd_op_reply(249 gc.5 [call] v33'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.561+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.561+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:250 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.562+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 58 ==== osd_op_reply(250 gc.6 [call] v33'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.562+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:251 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 59 ==== osd_op_reply(251 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:252 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 60 ==== osd_op_reply(252 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:253 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 61 ==== osd_op_reply(253 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:254 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 62 ==== osd_op_reply(254 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.563+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:255 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.564+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 63 ==== osd_op_reply(255 gc.6 [call] v33'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.564+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.564+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:256 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.565+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 53 ==== osd_op_reply(256 gc.7 [call] v33'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.565+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:257 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 54 ==== osd_op_reply(257 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:258 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944b6d0 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 55 ==== osd_op_reply(258 gc.7 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:259 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 56 ==== osd_op_reply(259 gc.7 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.566+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:260 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55702944c6e0 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 57 ==== osd_op_reply(260 gc.7 [call out=1715b] v0'0 uv60 ondisk = 0) ==== 148+0+1715 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 20 garbage collection: RGWGC::process iterating over entry tag='08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.2411424109850532738', time=2024-09-13T23:28:37.330173+0000, chain.objs.size()=7 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_1 2024-09-13T23:28:29.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:261 3.d 3:b167f7fd:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944a9d0 con 0x5570294080c0 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_2 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:262 3.e 3:70a6a7ac:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702944fac0 con 0x5570294036d0 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_3 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:263 3.31 3:8f4f839a:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294523f0 con 0x7fe348034070 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_4 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:264 3.1 3:80c98968:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_5 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:265 3.3e 3:7d856fc1:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x5570294523f0 con 0x7fe348034070 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_6 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:266 3.2c 3:34398781:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_7 2024-09-13T23:28:29.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.567+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:267 3.19 3:9a52c6b4:::08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55702945c210 con 0x5570293fecc0 2024-09-13T23:28:29.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.569+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 58 ==== osd_op_reply(264 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_4 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.569+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 64 ==== osd_op_reply(267 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_7 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.570+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 59 ==== osd_op_reply(265 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_5 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.570+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 50 ==== osd_op_reply(262 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_2 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.571+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 60 ==== osd_op_reply(263 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_3 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.571+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 92 ==== osd_op_reply(261 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_1 [call] v33'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.574+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 93 ==== osd_op_reply(266 08e5ebbf-96cb-421f-911b-a0c32cceba7e.4234.11__shadow_.UrB6aLEKJzlZvfw2WNv-zfSpf3ME31B_6 [call] v33'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.574+0000 7fe350040800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.574+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:268 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.575+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 61 ==== osd_op_reply(268 gc.7 [call] v33'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.575+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:269 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.576+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 62 ==== osd_op_reply(269 gc.7 [call] v33'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.576+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T23:28:29.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.576+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:270 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 51 ==== osd_op_reply(270 gc.8 [call] v33'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:271 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 52 ==== osd_op_reply(271 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:272 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 53 ==== osd_op_reply(272 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.577+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:273 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 54 ==== osd_op_reply(273 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:274 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 55 ==== osd_op_reply(274 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.578+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:275 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.579+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 56 ==== osd_op_reply(275 gc.8 [call] v33'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.579+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T23:28:29.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.579+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:276 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 94 ==== osd_op_reply(276 gc.9 [call] v33'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:277 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 95 ==== osd_op_reply(277 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:278 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 96 ==== osd_op_reply(278 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.580+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:279 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 97 ==== osd_op_reply(279 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:280 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 98 ==== osd_op_reply(280 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.581+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:281 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.582+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 99 ==== osd_op_reply(281 gc.9 [call] v33'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.582+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T23:28:29.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.582+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:282 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 57 ==== osd_op_reply(282 gc.10 [call] v33'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:283 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 58 ==== osd_op_reply(283 gc.10 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:284 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 59 ==== osd_op_reply(284 gc.10 [call out=24b] v0'0 uv91 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:285 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 60 ==== osd_op_reply(285 gc.10 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.583+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:286 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.584+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 61 ==== osd_op_reply(286 gc.10 [call out=15b] v0'0 uv91 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.584+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.584+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:287 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.585+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 62 ==== osd_op_reply(287 gc.10 [call] v33'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.585+0000 7fe350040800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T23:28:29.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.585+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:288 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 63 ==== osd_op_reply(288 gc.11 [call] v33'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:289 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 64 ==== osd_op_reply(289 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:290 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 65 ==== osd_op_reply(290 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:291 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 66 ==== osd_op_reply(291 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.586+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:292 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.587+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 67 ==== osd_op_reply(292 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.587+0000 7fe350040800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.587+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:293 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.588+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 68 ==== osd_op_reply(293 gc.11 [call] v33'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.589+0000 7fe1ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T23:28:29.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.589+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93940216834944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570293fecc0 2024-09-13T23:28:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.590+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93940216834944] v33'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.590+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93940216812496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.591+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93940216812496] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.591+0000 7fe350040800 20 remove_watcher() i=0 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.591+0000 7fe350040800 2 removed watcher, disabling cache 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.591+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93940216815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570293fecc0 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.592+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93940216815664] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.592+0000 7fe350040800 20 remove_watcher() i=1 2024-09-13T23:28:29.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.592+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93940216819568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294080c0 2024-09-13T23:28:29.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.593+0000 7fe34db34640 1 -- 172.21.15.99:0/2418132021 <== osd.3 v2:172.21.15.99:6816/1212313328 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93940216819568] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe340029030 con 0x5570294080c0 2024-09-13T23:28:29.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.593+0000 7fe350040800 20 remove_watcher() i=2 2024-09-13T23:28:29.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.593+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93940216823072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570294036d0 2024-09-13T23:28:29.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.594+0000 7fe34e335640 1 -- 172.21.15.99:0/2418132021 <== osd.2 v2:172.21.15.99:6800/2157953423 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93940216823072] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34803a030 con 0x5570294036d0 2024-09-13T23:28:29.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.594+0000 7fe350040800 20 remove_watcher() i=3 2024-09-13T23:28:29.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.594+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93940216828096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x5570293fecc0 2024-09-13T23:28:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.595+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.1 v2:172.21.15.99:6801/642925376 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93940216828096] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x5570293fecc0 2024-09-13T23:28:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.595+0000 7fe350040800 20 remove_watcher() i=4 2024-09-13T23:28:29.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.595+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93940216825376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.597+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93940216825376] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.597+0000 7fe350040800 20 remove_watcher() i=5 2024-09-13T23:28:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.597+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93940216830736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.598+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93940216830736] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.598+0000 7fe350040800 20 remove_watcher() i=6 2024-09-13T23:28:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.598+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93940216833424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x557029454de0 con 0x7fe348034070 2024-09-13T23:28:29.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 <== osd.0 v2:172.21.15.43:6800/3849931173 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93940216833424] v33'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe338051070 con 0x7fe348034070 2024-09-13T23:28:29.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 20 remove_watcher() i=7 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe348034070 msgr2=0x7fe34804b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe348034070 0x7fe34804b4d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570293fecc0 msgr2=0x557029401180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570293fecc0 0x557029401180 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570294036d0 msgr2=0x557029405ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570294036d0 0x557029405ac0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5570294080c0 msgr2=0x55702940a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x5570294080c0 0x55702940a580 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe218036af0 msgr2=0x7fe218038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe218036af0 0x7fe218038fb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe340016fd0 tx=0x7fe340038000 comp rx=0 tx=0).stop 2024-09-13T23:28:29.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 msgr2=0x5570293f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe347fff640 1 -- 172.21.15.99:0/2418132021 reap_dead start 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe34804cce0 tx=0x7fe34804cd40 comp rx=0 tx=0).stop 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 shutdown_connections 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 --2- 172.21.15.99:0/2418132021 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293be050 0x5570293f33c0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 >> 172.21.15.99:0/2418132021 conn(0x5570293e6080 msgr2=0x5570293e4150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 shutdown_connections 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.599+0000 7fe350040800 1 -- 172.21.15.99:0/2418132021 wait complete. 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 msgr2=0x7fe228039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 0x7fe228039000 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5570293c67c0 tx=0x7fe34002ae80 comp rx=0 tx=0).stop 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 msgr2=0x5570293dd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x5570293c9c80 tx=0x7fe3480167b0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 shutdown_connections 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe228036b40 0x7fe228039000 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3395768961 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570293dcfd0 0x5570293dd3f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 >> 172.21.15.99:0/3395768961 conn(0x5570293d1f60 msgr2=0x5570293d4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 shutdown_connections 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3395768961 wait complete. 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 msgr2=0x5570293c92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 0x5570293c92d0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 msgr2=0x5570293cdfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 0x5570293cdfa0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 msgr2=0x7fe234039000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 0x7fe234039000 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe338057000 tx=0x7fe338052000 comp rx=0 tx=0).stop 2024-09-13T23:28:29.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 msgr2=0x5570293c2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe340004000 tx=0x7fe340000bc0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 shutdown_connections 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x5570293cbbb0 0x5570293cdfa0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x5570292ce900 0x5570293c92d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe234036b40 0x7fe234039000 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 --2- 172.21.15.99:0/3309254397 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x5570292ca4c0 0x5570293c2260 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 >> 172.21.15.99:0/3309254397 conn(0x5570292c5df0 msgr2=0x5570293b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 shutdown_connections 2024-09-13T23:28:29.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-13T23:28:29.600+0000 7fe350040800 1 -- 172.21.15.99:0/3309254397 wait complete. 2024-09-13T23:28:29.611 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T23:28:29.622 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T23:28:29.623 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75fcf91640 1 Processor -- start 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75fcf91640 1 -- start start 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75fcf91640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75f812e940 0x7f75f8130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75fcf91640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f806eba0 con 0x7f75f806eda0 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75fcf91640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f75f806d2f0 con 0x7f75f812e940 2024-09-13T23:28:29.730 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75edd9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f75f812e940 0x7f75f8130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75f659c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f75f806eda0 0x7f75f806f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40846/0 (socket says 172.21.15.43:40846) 2024-09-13T23:28:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.728+0000 7f75f659c640 1 -- 172.21.15.43:0/1504453041 learned_addr learned my addr 172.21.15.43:0/1504453041 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.729+0000 7f75edd9b640 1 -- 172.21.15.43:0/1504453041 >> v1:172.21.15.43:6789/0 conn(0x7f75f806eda0 legacy=0x7f75f806f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.731 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.729+0000 7f75edd9b640 1 -- 172.21.15.43:0/1504453041 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f8070d50 con 0x7f75f812e940 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.729+0000 7f75edd9b640 1 --2- 172.21.15.43:0/1504453041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f812e940 0x7f75f8130d30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009720 tx=0x7f75e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fff42309edf9a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75f5d9b640 1 -- 172.21.15.43:0/1504453041 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e0037070 con 0x7f75f812e940 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75f5d9b640 1 -- 172.21.15.43:0/1504453041 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e002ae20 con 0x7f75f812e940 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75f5d9b640 1 -- 172.21.15.43:0/1504453041 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e0032590 con 0x7f75f812e940 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 -- 172.21.15.43:0/1504453041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f812e940 msgr2=0x7f75f8130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1504453041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f812e940 0x7f75f8130d30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f75e0009720 tx=0x7f75e002a1a0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 -- 172.21.15.43:0/1504453041 shutdown_connections 2024-09-13T23:28:29.735 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1504453041 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f812e940 0x7f75f8130d30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 -- 172.21.15.43:0/1504453041 >> 172.21.15.43:0/1504453041 conn(0x7f75f809a890 msgr2=0x7f75f809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 -- 172.21.15.43:0/1504453041 shutdown_connections 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.730+0000 7f75fcf91640 1 -- 172.21.15.43:0/1504453041 wait complete. 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.731+0000 7f75fcf91640 1 Processor -- start 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.731+0000 7f75fcf91640 1 -- start start 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75fcf91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75fcf91640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f75f806fcd0 con 0x7f75f806eda0 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75f659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75f659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34626/0 (socket says 172.21.15.43:34626) 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75f659c640 1 -- 172.21.15.43:0/1036945304 learned_addr learned my addr 172.21.15.43:0/1036945304 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:29.736 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75f659c640 1 -- 172.21.15.43:0/1036945304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f8125820 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75f659c640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c380 tx=0x7f75e800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8005c10 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e8005db0 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f8124c90 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75e8004930 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.732+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f8127a10 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.733+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f75e801a020 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.733+0000 7f75ef7fe640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 0x7f75d803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.733+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f75e804b480 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.733+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f806f180 con 0x7f75f806eda0 2024-09-13T23:28:29.737 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.734+0000 7f75edd9b640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 0x7f75d803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:29.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.734+0000 7f75edd9b640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 0x7f75d803a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f75e0034000 tx=0x7f75e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:29.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.738+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75e80127f0 con 0x7f75f806eda0 2024-09-13T23:28:29.910 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.909+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75f8128940 con 0x7f75d80382a0 2024-09-13T23:28:29.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.925+0000 7f75ef7fe640 1 -- 172.21.15.43:0/1036945304 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665575 (secure 0 0 0) 0x7f75f8128940 con 0x7f75d80382a0 2024-09-13T23:28:29.936 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:29.942 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:28:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 msgr2=0x7f75d803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 0x7f75d803a760 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f75e0034000 tx=0x7f75e002e000 comp rx=0 tx=0).stop 2024-09-13T23:28:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 msgr2=0x7f75f8125d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f75e800c380 tx=0x7f75e800c840 comp rx=0 tx=0).stop 2024-09-13T23:28:29.946 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 shutdown_connections 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f75d80382a0 0x7f75d803a760 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 --2- 172.21.15.43:0/1036945304 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f75f806eda0 0x7f75f8125d80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 >> 172.21.15.43:0/1036945304 conn(0x7f75f809a890 msgr2=0x7f75f812b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 shutdown_connections 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:29.930+0000 7f75fcf91640 1 -- 172.21.15.43:0/1036945304 wait complete. 2024-09-13T23:28:29.947 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-13T23:28:29.355677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4861,"num_read_kb":4442,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190480,"kb_used_data":53264,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296880,"statfs":{"total":386547056640,"available":386352005120,"internally_reserved":0,"allocated":54542336,"data_stored":53352252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004485"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.326609+0000","last_change":"2024-09-13T23:25:13.287107+0000","last_active":"2024-09-13T23:28:22.326609+0000","last_peered":"2024-09-13T23:28:22.326609+0000","last_clean":"2024-09-13T23:28:22.326609+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:28:22.326609+0000","last_undegraded":"2024-09-13T23:28:22.326609+0000","last_fullsized":"2024-09-13T23:28:22.326609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697306+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.697306+0000","last_peered":"2024-09-13T23:28:22.697306+0000","last_clean":"2024-09-13T23:28:22.697306+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.697306+0000","last_undegraded":"2024-09-13T23:28:22.697306+0000","last_fullsized":"2024-09-13T23:28:22.697306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327060+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:27:21.327060+0000","last_peered":"2024-09-13T23:27:21.327060+0000","last_clean":"2024-09-13T23:27:21.327060+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:27:21.327060+0000","last_undegraded":"2024-09-13T23:27:21.327060+0000","last_fullsized":"2024-09-13T23:27:21.327060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:02.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.715133+0000","last_change":"2024-09-13T23:25:15.283513+0000","last_active":"2024-09-13T23:26:37.715133+0000","last_peered":"2024-09-13T23:26:37.715133+0000","last_clean":"2024-09-13T23:26:37.715133+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:26:37.715133+0000","last_undegraded":"2024-09-13T23:26:37.715133+0000","last_fullsized":"2024-09-13T23:26:37.715133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:19.716730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383611+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:25:52.383611+0000","last_peered":"2024-09-13T23:25:52.383611+0000","last_clean":"2024-09-13T23:25:52.383611+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:25:52.383611+0000","last_undegraded":"2024-09-13T23:25:52.383611+0000","last_fullsized":"2024-09-13T23:25:52.383611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:53.486874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697586+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.697586+0000","last_peered":"2024-09-13T23:28:22.697586+0000","last_clean":"2024-09-13T23:28:22.697586+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.697586+0000","last_undegraded":"2024-09-13T23:28:22.697586+0000","last_fullsized":"2024-09-13T23:28:22.697586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:44.489685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373408+0000","last_change":"2024-09-13T23:25:13.275095+0000","last_active":"2024-09-13T23:25:52.373408+0000","last_peered":"2024-09-13T23:25:52.373408+0000","last_clean":"2024-09-13T23:25:52.373408+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:25:52.373408+0000","last_undegraded":"2024-09-13T23:25:52.373408+0000","last_fullsized":"2024-09-13T23:25:52.373408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717114+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:26:37.717114+0000","last_peered":"2024-09-13T23:26:37.717114+0000","last_clean":"2024-09-13T23:26:37.717114+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:26:37.717114+0000","last_undegraded":"2024-09-13T23:26:37.717114+0000","last_fullsized":"2024-09-13T23:26:37.717114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:35.198533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376609+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:25:52.376609+0000","last_peered":"2024-09-13T23:25:52.376609+0000","last_clean":"2024-09-13T23:25:52.376609+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:25:52.376609+0000","last_undegraded":"2024-09-13T23:25:52.376609+0000","last_fullsized":"2024-09-13T23:25:52.376609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.491515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.917848+0000","last_change":"2024-09-13T23:25:15.285777+0000","last_active":"2024-09-13T23:25:55.917848+0000","last_peered":"2024-09-13T23:25:55.917848+0000","last_clean":"2024-09-13T23:25:55.917848+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:25:55.917848+0000","last_undegraded":"2024-09-13T23:25:55.917848+0000","last_fullsized":"2024-09-13T23:25:55.917848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372573+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:25:52.372573+0000","last_peered":"2024-09-13T23:25:52.372573+0000","last_clean":"2024-09-13T23:25:52.372573+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:25:52.372573+0000","last_undegraded":"2024-09-13T23:25:52.372573+0000","last_fullsized":"2024-09-13T23:25:52.372573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697189+0000","last_change":"2024-09-13T23:25:15.290172+0000","last_active":"2024-09-13T23:28:22.697189+0000","last_peered":"2024-09-13T23:28:22.697189+0000","last_clean":"2024-09-13T23:28:22.697189+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:22.697189+0000","last_undegraded":"2024-09-13T23:28:22.697189+0000","last_fullsized":"2024-09-13T23:28:22.697189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:16.423529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377367+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:25:52.377367+0000","last_peered":"2024-09-13T23:25:52.377367+0000","last_clean":"2024-09-13T23:25:52.377367+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:25:52.377367+0000","last_undegraded":"2024-09-13T23:25:52.377367+0000","last_fullsized":"2024-09-13T23:25:52.377367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374311+0000","last_change":"2024-09-13T23:25:15.288159+0000","last_active":"2024-09-13T23:28:22.374311+0000","last_peered":"2024-09-13T23:28:22.374311+0000","last_clean":"2024-09-13T23:28:22.374311+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:28:22.374311+0000","last_undegraded":"2024-09-13T23:28:22.374311+0000","last_fullsized":"2024-09-13T23:28:22.374311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.728590+0000","last_change":"2024-09-13T23:25:13.285351+0000","last_active":"2024-09-13T23:27:21.728590+0000","last_peered":"2024-09-13T23:27:21.728590+0000","last_clean":"2024-09-13T23:27:21.728590+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:27:21.728590+0000","last_undegraded":"2024-09-13T23:27:21.728590+0000","last_fullsized":"2024-09-13T23:27:21.728590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.816721+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:25:54.816721+0000","last_peered":"2024-09-13T23:25:54.816721+0000","last_clean":"2024-09-13T23:25:54.816721+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:25:54.816721+0000","last_undegraded":"2024-09-13T23:25:54.816721+0000","last_fullsized":"2024-09-13T23:25:54.816721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626345+0000","last_change":"2024-09-13T23:25:15.287032+0000","last_active":"2024-09-13T23:28:22.626345+0000","last_peered":"2024-09-13T23:28:22.626345+0000","last_clean":"2024-09-13T23:28:22.626345+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:28:22.626345+0000","last_undegraded":"2024-09-13T23:28:22.626345+0000","last_fullsized":"2024-09-13T23:28:22.626345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:16.113359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380456+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:25:52.380456+0000","last_peered":"2024-09-13T23:25:52.380456+0000","last_clean":"2024-09-13T23:25:52.380456+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:25:52.380456+0000","last_undegraded":"2024-09-13T23:25:52.380456+0000","last_fullsized":"2024-09-13T23:25:52.380456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871681+0000","last_change":"2024-09-13T23:25:15.287488+0000","last_active":"2024-09-13T23:27:21.871681+0000","last_peered":"2024-09-13T23:27:21.871681+0000","last_clean":"2024-09-13T23:27:21.871681+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:27:21.871681+0000","last_undegraded":"2024-09-13T23:27:21.871681+0000","last_fullsized":"2024-09-13T23:27:21.871681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376849+0000","last_change":"2024-09-13T23:25:13.286390+0000","last_active":"2024-09-13T23:25:52.376849+0000","last_peered":"2024-09-13T23:25:52.376849+0000","last_clean":"2024-09-13T23:25:52.376849+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:25:52.376849+0000","last_undegraded":"2024-09-13T23:25:52.376849+0000","last_fullsized":"2024-09-13T23:25:52.376849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625998+0000","last_change":"2024-09-13T23:25:15.284340+0000","last_active":"2024-09-13T23:28:22.625998+0000","last_peered":"2024-09-13T23:28:22.625998+0000","last_clean":"2024-09-13T23:28:22.625998+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:28:22.625998+0000","last_undegraded":"2024-09-13T23:28:22.625998+0000","last_fullsized":"2024-09-13T23:28:22.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:01.252262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.792366+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:25:54.792366+0000","last_peered":"2024-09-13T23:25:54.792366+0000","last_clean":"2024-09-13T23:25:54.792366+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:25:54.792366+0000","last_undegraded":"2024-09-13T23:25:54.792366+0000","last_fullsized":"2024-09-13T23:25:54.792366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:24.391365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.166890+0000","last_change":"2024-09-13T23:25:15.279035+0000","last_active":"2024-09-13T23:25:55.166890+0000","last_peered":"2024-09-13T23:25:55.166890+0000","last_clean":"2024-09-13T23:25:55.166890+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:25:55.166890+0000","last_undegraded":"2024-09-13T23:25:55.166890+0000","last_fullsized":"2024-09-13T23:25:55.166890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380325+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:25:52.380325+0000","last_peered":"2024-09-13T23:25:52.380325+0000","last_clean":"2024-09-13T23:25:52.380325+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:25:52.380325+0000","last_undegraded":"2024-09-13T23:25:52.380325+0000","last_fullsized":"2024-09-13T23:25:52.380325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373942+0000","last_change":"2024-09-13T23:25:15.280560+0000","last_active":"2024-09-13T23:25:52.373942+0000","last_peered":"2024-09-13T23:25:52.373942+0000","last_clean":"2024-09-13T23:25:52.373942+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:25:52.373942+0000","last_undegraded":"2024-09-13T23:25:52.373942+0000","last_fullsized":"2024-09-13T23:25:52.373942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375633+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:25:52.375633+0000","last_peered":"2024-09-13T23:25:52.375633+0000","last_clean":"2024-09-13T23:25:52.375633+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:25:52.375633+0000","last_undegraded":"2024-09-13T23:25:52.375633+0000","last_fullsized":"2024-09-13T23:25:52.375633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733254+0000","last_change":"2024-09-13T23:25:15.284594+0000","last_active":"2024-09-13T23:28:22.733254+0000","last_peered":"2024-09-13T23:28:22.733254+0000","last_clean":"2024-09-13T23:28:22.733254+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:28:22.733254+0000","last_undegraded":"2024-09-13T23:28:22.733254+0000","last_fullsized":"2024-09-13T23:28:22.733254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374584+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:25:52.374584+0000","last_peered":"2024-09-13T23:25:52.374584+0000","last_clean":"2024-09-13T23:25:52.374584+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:25:52.374584+0000","last_undegraded":"2024-09-13T23:25:52.374584+0000","last_fullsized":"2024-09-13T23:25:52.374584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:50.268744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.669461+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.669461+0000","last_peered":"2024-09-13T23:28:22.669461+0000","last_clean":"2024-09-13T23:28:22.669461+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.669461+0000","last_undegraded":"2024-09-13T23:28:22.669461+0000","last_fullsized":"2024-09-13T23:28:22.669461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:09.425167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374612+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.374612+0000","last_peered":"2024-09-13T23:28:22.374612+0000","last_clean":"2024-09-13T23:28:22.374612+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.374612+0000","last_undegraded":"2024-09-13T23:28:22.374612+0000","last_fullsized":"2024-09-13T23:28:22.374612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376199+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:25:52.376199+0000","last_peered":"2024-09-13T23:25:52.376199+0000","last_clean":"2024-09-13T23:25:52.376199+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:25:52.376199+0000","last_undegraded":"2024-09-13T23:25:52.376199+0000","last_fullsized":"2024-09-13T23:25:52.376199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:28.575656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381408+0000","last_change":"2024-09-13T23:25:17.289713+0000","last_active":"2024-09-13T23:25:52.381408+0000","last_peered":"2024-09-13T23:25:52.381408+0000","last_clean":"2024-09-13T23:25:52.381408+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:25:52.381408+0000","last_undegraded":"2024-09-13T23:25:52.381408+0000","last_fullsized":"2024-09-13T23:25:52.381408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:05.506988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.169401+0000","last_change":"2024-09-13T23:25:19.296863+0000","last_active":"2024-09-13T23:27:20.169401+0000","last_peered":"2024-09-13T23:27:20.169401+0000","last_clean":"2024-09-13T23:27:20.169401+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:27:20.169401+0000","last_undegraded":"2024-09-13T23:27:20.169401+0000","last_fullsized":"2024-09-13T23:27:20.169401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:01.662692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379495+0000","last_change":"2024-09-13T23:25:21.306129+0000","last_active":"2024-09-13T23:25:52.379495+0000","last_peered":"2024-09-13T23:25:52.379495+0000","last_clean":"2024-09-13T23:25:52.379495+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:25:52.379495+0000","last_undegraded":"2024-09-13T23:25:52.379495+0000","last_fullsized":"2024-09-13T23:25:52.379495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.723062+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:26:37.723062+0000","last_peered":"2024-09-13T23:26:37.723062+0000","last_clean":"2024-09-13T23:26:37.723062+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:26:37.723062+0000","last_undegraded":"2024-09-13T23:26:37.723062+0000","last_fullsized":"2024-09-13T23:26:37.723062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:42.589333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332392+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:27:43.332392+0000","last_peered":"2024-09-13T23:27:43.332392+0000","last_clean":"2024-09-13T23:27:43.332392+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:27:43.332392+0000","last_undegraded":"2024-09-13T23:27:43.332392+0000","last_fullsized":"2024-09-13T23:27:43.332392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:44.441287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372736+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:25:52.372736+0000","last_peered":"2024-09-13T23:25:52.372736+0000","last_clean":"2024-09-13T23:25:52.372736+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:25:52.372736+0000","last_undegraded":"2024-09-13T23:25:52.372736+0000","last_fullsized":"2024-09-13T23:25:52.372736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:53.316546+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:25:53.316546+0000","last_peered":"2024-09-13T23:25:53.316546+0000","last_clean":"2024-09-13T23:25:53.316546+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:25:53.316546+0000","last_undegraded":"2024-09-13T23:25:53.316546+0000","last_fullsized":"2024-09-13T23:25:53.316546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:09.831944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379403+0000","last_change":"2024-09-13T23:25:19.296507+0000","last_active":"2024-09-13T23:25:52.379403+0000","last_peered":"2024-09-13T23:25:52.379403+0000","last_clean":"2024-09-13T23:25:52.379403+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:25:52.379403+0000","last_undegraded":"2024-09-13T23:25:52.379403+0000","last_fullsized":"2024-09-13T23:25:52.379403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:51.134434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379082+0000","last_change":"2024-09-13T23:25:21.301362+0000","last_active":"2024-09-13T23:25:52.379082+0000","last_peered":"2024-09-13T23:25:52.379082+0000","last_clean":"2024-09-13T23:25:52.379082+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:25:52.379082+0000","last_undegraded":"2024-09-13T23:25:52.379082+0000","last_fullsized":"2024-09-13T23:25:52.379082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.481142+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.481142+0000","last_peered":"2024-09-13T23:28:22.481142+0000","last_clean":"2024-09-13T23:28:22.481142+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.481142+0000","last_undegraded":"2024-09-13T23:28:22.481142+0000","last_fullsized":"2024-09-13T23:28:22.481142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871746+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:21.871746+0000","last_peered":"2024-09-13T23:27:21.871746+0000","last_clean":"2024-09-13T23:27:21.871746+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:21.871746+0000","last_undegraded":"2024-09-13T23:27:21.871746+0000","last_fullsized":"2024-09-13T23:27:21.871746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:21.355304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379644+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:25:52.379644+0000","last_peered":"2024-09-13T23:25:52.379644+0000","last_clean":"2024-09-13T23:25:52.379644+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:25:52.379644+0000","last_undegraded":"2024-09-13T23:25:52.379644+0000","last_fullsized":"2024-09-13T23:25:52.379644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376883+0000","last_change":"2024-09-13T23:25:17.287013+0000","last_active":"2024-09-13T23:25:52.376883+0000","last_peered":"2024-09-13T23:25:52.376883+0000","last_clean":"2024-09-13T23:25:52.376883+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:25:52.376883+0000","last_undegraded":"2024-09-13T23:25:52.376883+0000","last_fullsized":"2024-09-13T23:25:52.376883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374464+0000","last_change":"2024-09-13T23:25:19.289864+0000","last_active":"2024-09-13T23:25:52.374464+0000","last_peered":"2024-09-13T23:25:52.374464+0000","last_clean":"2024-09-13T23:25:52.374464+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:25:52.374464+0000","last_undegraded":"2024-09-13T23:25:52.374464+0000","last_fullsized":"2024-09-13T23:25:52.374464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:38.226160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364768+0000","last_change":"2024-09-13T23:25:21.304299+0000","last_active":"2024-09-13T23:28:22.364768+0000","last_peered":"2024-09-13T23:28:22.364768+0000","last_clean":"2024-09-13T23:28:22.364768+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:22.364768+0000","last_undegraded":"2024-09-13T23:28:22.364768+0000","last_fullsized":"2024-09-13T23:28:22.364768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.160237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.172427+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:25:55.172427+0000","last_peered":"2024-09-13T23:25:55.172427+0000","last_clean":"2024-09-13T23:25:55.172427+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:25:55.172427+0000","last_undegraded":"2024-09-13T23:25:55.172427+0000","last_fullsized":"2024-09-13T23:25:55.172427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:34.976156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733291+0000","last_change":"2024-09-13T23:25:15.285324+0000","last_active":"2024-09-13T23:28:22.733291+0000","last_peered":"2024-09-13T23:28:22.733291+0000","last_clean":"2024-09-13T23:28:22.733291+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:22.733291+0000","last_undegraded":"2024-09-13T23:28:22.733291+0000","last_fullsized":"2024-09-13T23:28:22.733291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376181+0000","last_change":"2024-09-13T23:25:13.288918+0000","last_active":"2024-09-13T23:25:52.376181+0000","last_peered":"2024-09-13T23:25:52.376181+0000","last_clean":"2024-09-13T23:25:52.376181+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:25:52.376181+0000","last_undegraded":"2024-09-13T23:25:52.376181+0000","last_fullsized":"2024-09-13T23:25:52.376181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377072+0000","last_change":"2024-09-13T23:25:17.287813+0000","last_active":"2024-09-13T23:25:52.377072+0000","last_peered":"2024-09-13T23:25:52.377072+0000","last_clean":"2024-09-13T23:25:52.377072+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:25:52.377072+0000","last_undegraded":"2024-09-13T23:25:52.377072+0000","last_fullsized":"2024-09-13T23:25:52.377072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:01.764699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.164218+0000","last_change":"2024-09-13T23:25:19.291393+0000","last_active":"2024-09-13T23:27:20.164218+0000","last_peered":"2024-09-13T23:27:20.164218+0000","last_clean":"2024-09-13T23:27:20.164218+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:27:20.164218+0000","last_undegraded":"2024-09-13T23:27:20.164218+0000","last_fullsized":"2024-09-13T23:27:20.164218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:41.211829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.735967+0000","last_change":"2024-09-13T23:25:21.303172+0000","last_active":"2024-09-13T23:28:22.735967+0000","last_peered":"2024-09-13T23:28:22.735967+0000","last_clean":"2024-09-13T23:28:22.735967+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:22.735967+0000","last_undegraded":"2024-09-13T23:28:22.735967+0000","last_fullsized":"2024-09-13T23:28:22.735967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739506+0000","last_change":"2024-09-13T23:25:15.291664+0000","last_active":"2024-09-13T23:28:22.739506+0000","last_peered":"2024-09-13T23:28:22.739506+0000","last_clean":"2024-09-13T23:28:22.739506+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:22.739506+0000","last_undegraded":"2024-09-13T23:28:22.739506+0000","last_fullsized":"2024-09-13T23:28:22.739506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:54.160656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375841+0000","last_change":"2024-09-13T23:25:13.289874+0000","last_active":"2024-09-13T23:25:52.375841+0000","last_peered":"2024-09-13T23:25:52.375841+0000","last_clean":"2024-09-13T23:25:52.375841+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:25:52.375841+0000","last_undegraded":"2024-09-13T23:25:52.375841+0000","last_fullsized":"2024-09-13T23:25:52.375841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376161+0000","last_change":"2024-09-13T23:25:17.289113+0000","last_active":"2024-09-13T23:25:52.376161+0000","last_peered":"2024-09-13T23:25:52.376161+0000","last_clean":"2024-09-13T23:25:52.376161+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:25:52.376161+0000","last_undegraded":"2024-09-13T23:25:52.376161+0000","last_fullsized":"2024-09-13T23:25:52.376161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'40","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.173883+0000","last_change":"2024-09-13T23:25:19.297925+0000","last_active":"2024-09-13T23:27:20.173883+0000","last_peered":"2024-09-13T23:27:20.173883+0000","last_clean":"2024-09-13T23:27:20.173883+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:27:20.173883+0000","last_undegraded":"2024-09-13T23:27:20.173883+0000","last_fullsized":"2024-09-13T23:27:20.173883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374678+0000","last_change":"2024-09-13T23:25:21.301483+0000","last_active":"2024-09-13T23:25:52.374678+0000","last_peered":"2024-09-13T23:25:52.374678+0000","last_clean":"2024-09-13T23:25:52.374678+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:25:52.374678+0000","last_undegraded":"2024-09-13T23:25:52.374678+0000","last_fullsized":"2024-09-13T23:25:52.374678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:11.275595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.677351+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.677351+0000","last_peered":"2024-09-13T23:28:22.677351+0000","last_clean":"2024-09-13T23:28:22.677351+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.677351+0000","last_undegraded":"2024-09-13T23:28:22.677351+0000","last_fullsized":"2024-09-13T23:28:22.677351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:47.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871541+0000","last_change":"2024-09-13T23:25:15.285081+0000","last_active":"2024-09-13T23:27:21.871541+0000","last_peered":"2024-09-13T23:27:21.871541+0000","last_clean":"2024-09-13T23:27:21.871541+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:27:21.871541+0000","last_undegraded":"2024-09-13T23:27:21.871541+0000","last_fullsized":"2024-09-13T23:27:21.871541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329270+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:27:28.329270+0000","last_peered":"2024-09-13T23:27:28.329270+0000","last_clean":"2024-09-13T23:27:28.329270+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:27:28.329270+0000","last_undegraded":"2024-09-13T23:27:28.329270+0000","last_fullsized":"2024-09-13T23:27:28.329270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374895+0000","last_change":"2024-09-13T23:25:17.291228+0000","last_active":"2024-09-13T23:25:52.374895+0000","last_peered":"2024-09-13T23:25:52.374895+0000","last_clean":"2024-09-13T23:25:52.374895+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:25:52.374895+0000","last_undegraded":"2024-09-13T23:25:52.374895+0000","last_fullsized":"2024-09-13T23:25:52.374895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:35.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.153630+0000","last_change":"2024-09-13T23:25:19.294956+0000","last_active":"2024-09-13T23:27:20.153630+0000","last_peered":"2024-09-13T23:27:20.153630+0000","last_clean":"2024-09-13T23:27:20.153630+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:27:20.153630+0000","last_undegraded":"2024-09-13T23:27:20.153630+0000","last_fullsized":"2024-09-13T23:27:20.153630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:35.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374433+0000","last_change":"2024-09-13T23:25:21.308307+0000","last_active":"2024-09-13T23:25:52.374433+0000","last_peered":"2024-09-13T23:25:52.374433+0000","last_clean":"2024-09-13T23:25:52.374433+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:25:52.374433+0000","last_undegraded":"2024-09-13T23:25:52.374433+0000","last_fullsized":"2024-09-13T23:25:52.374433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:32.166331+0000","last_change":"2024-09-13T23:25:23.307544+0000","last_active":"2024-09-13T23:26:32.166331+0000","last_peered":"2024-09-13T23:26:32.166331+0000","last_clean":"2024-09-13T23:26:32.166331+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:26:32.166331+0000","last_undegraded":"2024-09-13T23:26:32.166331+0000","last_fullsized":"2024-09-13T23:26:32.166331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:10.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479224+0000","last_change":"2024-09-13T23:25:15.287305+0000","last_active":"2024-09-13T23:28:22.479224+0000","last_peered":"2024-09-13T23:28:22.479224+0000","last_clean":"2024-09-13T23:28:22.479224+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:28:22.479224+0000","last_undegraded":"2024-09-13T23:28:22.479224+0000","last_fullsized":"2024-09-13T23:28:22.479224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329978+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:27:28.329978+0000","last_peered":"2024-09-13T23:27:28.329978+0000","last_clean":"2024-09-13T23:27:28.329978+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:27:28.329978+0000","last_undegraded":"2024-09-13T23:27:28.329978+0000","last_fullsized":"2024-09-13T23:27:28.329978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:37.817951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:17.285971+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:54.021576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.175918+0000","last_change":"2024-09-13T23:25:19.299653+0000","last_active":"2024-09-13T23:27:20.175918+0000","last_peered":"2024-09-13T23:27:20.175918+0000","last_clean":"2024-09-13T23:27:20.175918+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:27:20.175918+0000","last_undegraded":"2024-09-13T23:27:20.175918+0000","last_fullsized":"2024-09-13T23:27:20.175918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:09.850559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":348,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:23.022818+0000","last_change":"2024-09-13T23:25:21.308757+0000","last_active":"2024-09-13T23:28:23.022818+0000","last_peered":"2024-09-13T23:28:23.022818+0000","last_clean":"2024-09-13T23:28:23.022818+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:23.022818+0000","last_undegraded":"2024-09-13T23:28:23.022818+0000","last_fullsized":"2024-09-13T23:28:23.022818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375463+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:25:52.375463+0000","last_peered":"2024-09-13T23:25:52.375463+0000","last_clean":"2024-09-13T23:25:52.375463+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:25:52.375463+0000","last_undegraded":"2024-09-13T23:25:52.375463+0000","last_fullsized":"2024-09-13T23:25:52.375463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.604079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.696828+0000","last_change":"2024-09-13T23:25:15.283264+0000","last_active":"2024-09-13T23:28:22.696828+0000","last_peered":"2024-09-13T23:28:22.696828+0000","last_clean":"2024-09-13T23:28:22.696828+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:22.696828+0000","last_undegraded":"2024-09-13T23:28:22.696828+0000","last_fullsized":"2024-09-13T23:28:22.696828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.390295+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:18.390295+0000","last_peered":"2024-09-13T23:27:18.390295+0000","last_clean":"2024-09-13T23:27:18.390295+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:18.390295+0000","last_undegraded":"2024-09-13T23:27:18.390295+0000","last_fullsized":"2024-09-13T23:27:18.390295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:32.413205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:17.286788+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:39.422715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.875706+0000","last_change":"2024-09-13T23:25:19.299651+0000","last_active":"2024-09-13T23:27:21.875706+0000","last_peered":"2024-09-13T23:27:21.875706+0000","last_clean":"2024-09-13T23:27:21.875706+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:27:21.875706+0000","last_undegraded":"2024-09-13T23:27:21.875706+0000","last_fullsized":"2024-09-13T23:27:21.875706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.439065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374591+0000","last_change":"2024-09-13T23:25:21.301614+0000","last_active":"2024-09-13T23:25:52.374591+0000","last_peered":"2024-09-13T23:25:52.374591+0000","last_clean":"2024-09-13T23:25:52.374591+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:25:52.374591+0000","last_undegraded":"2024-09-13T23:25:52.374591+0000","last_fullsized":"2024-09-13T23:25:52.374591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.962416+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.962416+0000","last_peered":"2024-09-13T23:28:22.962416+0000","last_clean":"2024-09-13T23:28:22.962416+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.962416+0000","last_undegraded":"2024-09-13T23:28:22.962416+0000","last_fullsized":"2024-09-13T23:28:22.962416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:22.720145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733331+0000","last_change":"2024-09-13T23:25:15.296722+0000","last_active":"2024-09-13T23:28:22.733331+0000","last_peered":"2024-09-13T23:28:22.733331+0000","last_clean":"2024-09-13T23:28:22.733331+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:22.733331+0000","last_undegraded":"2024-09-13T23:28:22.733331+0000","last_fullsized":"2024-09-13T23:28:22.733331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:38.000462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.414481+0000","last_change":"2024-09-13T23:25:13.283881+0000","last_active":"2024-09-13T23:25:55.414481+0000","last_peered":"2024-09-13T23:25:55.414481+0000","last_clean":"2024-09-13T23:25:55.414481+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:25:55.414481+0000","last_undegraded":"2024-09-13T23:25:55.414481+0000","last_fullsized":"2024-09-13T23:25:55.414481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:06.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374030+0000","last_change":"2024-09-13T23:25:17.285259+0000","last_active":"2024-09-13T23:25:52.374030+0000","last_peered":"2024-09-13T23:25:52.374030+0000","last_clean":"2024-09-13T23:25:52.374030+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:25:52.374030+0000","last_undegraded":"2024-09-13T23:25:52.374030+0000","last_fullsized":"2024-09-13T23:25:52.374030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:00.997313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.157664+0000","last_change":"2024-09-13T23:25:19.292957+0000","last_active":"2024-09-13T23:27:20.157664+0000","last_peered":"2024-09-13T23:27:20.157664+0000","last_clean":"2024-09-13T23:27:20.157664+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:27:20.157664+0000","last_undegraded":"2024-09-13T23:27:20.157664+0000","last_fullsized":"2024-09-13T23:27:20.157664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:36.621593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380477+0000","last_change":"2024-09-13T23:25:21.307942+0000","last_active":"2024-09-13T23:25:52.380477+0000","last_peered":"2024-09-13T23:25:52.380477+0000","last_clean":"2024-09-13T23:25:52.380477+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:25:52.380477+0000","last_undegraded":"2024-09-13T23:25:52.380477+0000","last_fullsized":"2024-09-13T23:25:52.380477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:57.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329045+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:27:23.329045+0000","last_peered":"2024-09-13T23:27:23.329045+0000","last_clean":"2024-09-13T23:27:23.329045+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:27:23.329045+0000","last_undegraded":"2024-09-13T23:27:23.329045+0000","last_fullsized":"2024-09-13T23:27:23.329045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:16.049837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697480+0000","last_change":"2024-09-13T23:25:15.290226+0000","last_active":"2024-09-13T23:28:22.697480+0000","last_peered":"2024-09-13T23:28:22.697480+0000","last_clean":"2024-09-13T23:28:22.697480+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:22.697480+0000","last_undegraded":"2024-09-13T23:28:22.697480+0000","last_fullsized":"2024-09-13T23:28:22.697480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:58.471027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376787+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:25:52.376787+0000","last_peered":"2024-09-13T23:25:52.376787+0000","last_clean":"2024-09-13T23:25:52.376787+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:25:52.376787+0000","last_undegraded":"2024-09-13T23:25:52.376787+0000","last_fullsized":"2024-09-13T23:25:52.376787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:34.681115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376818+0000","last_change":"2024-09-13T23:25:17.287240+0000","last_active":"2024-09-13T23:25:52.376818+0000","last_peered":"2024-09-13T23:25:52.376818+0000","last_clean":"2024-09-13T23:25:52.376818+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:25:52.376818+0000","last_undegraded":"2024-09-13T23:25:52.376818+0000","last_fullsized":"2024-09-13T23:25:52.376818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.184924+0000","last_change":"2024-09-13T23:25:19.289083+0000","last_active":"2024-09-13T23:27:20.184924+0000","last_peered":"2024-09-13T23:27:20.184924+0000","last_clean":"2024-09-13T23:27:20.184924+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:27:20.184924+0000","last_undegraded":"2024-09-13T23:27:20.184924+0000","last_fullsized":"2024-09-13T23:27:20.184924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:42.816869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":431,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966627+0000","last_change":"2024-09-13T23:25:21.302618+0000","last_active":"2024-09-13T23:28:22.966627+0000","last_peered":"2024-09-13T23:28:22.966627+0000","last_clean":"2024-09-13T23:28:22.966627+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:22.966627+0000","last_undegraded":"2024-09-13T23:28:22.966627+0000","last_fullsized":"2024-09-13T23:28:22.966627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:56.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328632+0000","last_change":"2024-09-13T23:25:23.302781+0000","last_active":"2024-09-13T23:27:31.328632+0000","last_peered":"2024-09-13T23:27:31.328632+0000","last_clean":"2024-09-13T23:27:31.328632+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:27:31.328632+0000","last_undegraded":"2024-09-13T23:27:31.328632+0000","last_fullsized":"2024-09-13T23:27:31.328632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:54.025813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.437139+0000","last_change":"2024-09-13T23:25:15.290988+0000","last_active":"2024-09-13T23:25:55.437139+0000","last_peered":"2024-09-13T23:25:55.437139+0000","last_clean":"2024-09-13T23:25:55.437139+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:25:55.437139+0000","last_undegraded":"2024-09-13T23:25:55.437139+0000","last_fullsized":"2024-09-13T23:25:55.437139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374910+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:25:52.374910+0000","last_peered":"2024-09-13T23:25:52.374910+0000","last_clean":"2024-09-13T23:25:52.374910+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:25:52.374910+0000","last_undegraded":"2024-09-13T23:25:52.374910+0000","last_fullsized":"2024-09-13T23:25:52.374910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:32.148141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282446+0000","last_change":"2024-09-13T23:25:17.288588+0000","last_active":"2024-09-13T23:27:21.282446+0000","last_peered":"2024-09-13T23:27:21.282446+0000","last_clean":"2024-09-13T23:27:21.282446+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:27:21.282446+0000","last_undegraded":"2024-09-13T23:27:21.282446+0000","last_fullsized":"2024-09-13T23:27:21.282446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:15.817722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330751+0000","last_change":"2024-09-13T23:25:19.298296+0000","last_active":"2024-09-13T23:27:33.330751+0000","last_peered":"2024-09-13T23:27:33.330751+0000","last_clean":"2024-09-13T23:27:33.330751+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:27:33.330751+0000","last_undegraded":"2024-09-13T23:27:33.330751+0000","last_fullsized":"2024-09-13T23:27:33.330751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:39.743432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":468,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.846586+0000","last_change":"2024-09-13T23:25:21.299515+0000","last_active":"2024-09-13T23:28:22.846586+0000","last_peered":"2024-09-13T23:28:22.846586+0000","last_clean":"2024-09-13T23:28:22.846586+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:22.846586+0000","last_undegraded":"2024-09-13T23:28:22.846586+0000","last_fullsized":"2024-09-13T23:28:22.846586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.844255+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.844255+0000","last_peered":"2024-09-13T23:28:22.844255+0000","last_clean":"2024-09-13T23:28:22.844255+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.844255+0000","last_undegraded":"2024-09-13T23:28:22.844255+0000","last_fullsized":"2024-09-13T23:28:22.844255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:46.511629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901641+0000","last_change":"2024-09-13T23:25:15.295321+0000","last_active":"2024-09-13T23:26:37.901641+0000","last_peered":"2024-09-13T23:26:37.901641+0000","last_clean":"2024-09-13T23:26:37.901641+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:26:37.901641+0000","last_undegraded":"2024-09-13T23:26:37.901641+0000","last_fullsized":"2024-09-13T23:26:37.901641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:07.615477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373680+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:25:52.373680+0000","last_peered":"2024-09-13T23:25:52.373680+0000","last_clean":"2024-09-13T23:25:52.373680+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:25:52.373680+0000","last_undegraded":"2024-09-13T23:25:52.373680+0000","last_fullsized":"2024-09-13T23:25:52.373680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:19.192252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376682+0000","last_change":"2024-09-13T23:25:17.288064+0000","last_active":"2024-09-13T23:25:52.376682+0000","last_peered":"2024-09-13T23:25:52.376682+0000","last_clean":"2024-09-13T23:25:52.376682+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:25:52.376682+0000","last_undegraded":"2024-09-13T23:25:52.376682+0000","last_fullsized":"2024-09-13T23:25:52.376682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:40.830361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.170472+0000","last_change":"2024-09-13T23:25:19.292186+0000","last_active":"2024-09-13T23:27:20.170472+0000","last_peered":"2024-09-13T23:27:20.170472+0000","last_clean":"2024-09-13T23:27:20.170472+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:27:20.170472+0000","last_undegraded":"2024-09-13T23:27:20.170472+0000","last_fullsized":"2024-09-13T23:27:20.170472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:33.111945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373673+0000","last_change":"2024-09-13T23:25:21.307481+0000","last_active":"2024-09-13T23:25:52.373673+0000","last_peered":"2024-09-13T23:25:52.373673+0000","last_clean":"2024-09-13T23:25:52.373673+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:25:52.373673+0000","last_undegraded":"2024-09-13T23:25:52.373673+0000","last_fullsized":"2024-09-13T23:25:52.373673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.794734+0000","last_change":"2024-09-13T23:25:23.303608+0000","last_active":"2024-09-13T23:28:22.794734+0000","last_peered":"2024-09-13T23:28:22.794734+0000","last_clean":"2024-09-13T23:28:22.794734+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:22.794734+0000","last_undegraded":"2024-09-13T23:28:22.794734+0000","last_fullsized":"2024-09-13T23:28:22.794734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.083983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901628+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:26:37.901628+0000","last_peered":"2024-09-13T23:26:37.901628+0000","last_clean":"2024-09-13T23:26:37.901628+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:26:37.901628+0000","last_undegraded":"2024-09-13T23:26:37.901628+0000","last_fullsized":"2024-09-13T23:26:37.901628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:01.400783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375969+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:25:52.375969+0000","last_peered":"2024-09-13T23:25:52.375969+0000","last_clean":"2024-09-13T23:25:52.375969+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:25:52.375969+0000","last_undegraded":"2024-09-13T23:25:52.375969+0000","last_fullsized":"2024-09-13T23:25:52.375969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:42.131218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376079+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:52.376079+0000","last_peered":"2024-09-13T23:25:52.376079+0000","last_clean":"2024-09-13T23:25:52.376079+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:52.376079+0000","last_undegraded":"2024-09-13T23:25:52.376079+0000","last_fullsized":"2024-09-13T23:25:52.376079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374353+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:25:52.374353+0000","last_peered":"2024-09-13T23:25:52.374353+0000","last_clean":"2024-09-13T23:25:52.374353+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:25:52.374353+0000","last_undegraded":"2024-09-13T23:25:52.374353+0000","last_fullsized":"2024-09-13T23:25:52.374353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:49.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378955+0000","last_change":"2024-09-13T23:25:17.286100+0000","last_active":"2024-09-13T23:25:52.378955+0000","last_peered":"2024-09-13T23:25:52.378955+0000","last_clean":"2024-09-13T23:25:52.378955+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:25:52.378955+0000","last_undegraded":"2024-09-13T23:25:52.378955+0000","last_fullsized":"2024-09-13T23:25:52.378955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:55.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'78","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.182700+0000","last_change":"2024-09-13T23:25:19.298079+0000","last_active":"2024-09-13T23:27:20.182700+0000","last_peered":"2024-09-13T23:27:20.182700+0000","last_clean":"2024-09-13T23:27:20.182700+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:27:20.182700+0000","last_undegraded":"2024-09-13T23:27:20.182700+0000","last_fullsized":"2024-09-13T23:27:20.182700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:28.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376686+0000","last_change":"2024-09-13T23:25:21.308687+0000","last_active":"2024-09-13T23:25:52.376686+0000","last_peered":"2024-09-13T23:25:52.376686+0000","last_clean":"2024-09-13T23:25:52.376686+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:25:52.376686+0000","last_undegraded":"2024-09-13T23:25:52.376686+0000","last_fullsized":"2024-09-13T23:25:52.376686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:09.375352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.742526+0000","last_change":"2024-09-13T23:25:23.304383+0000","last_active":"2024-09-13T23:28:22.742526+0000","last_peered":"2024-09-13T23:28:22.742526+0000","last_clean":"2024-09-13T23:28:22.742526+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:22.742526+0000","last_undegraded":"2024-09-13T23:28:22.742526+0000","last_fullsized":"2024-09-13T23:28:22.742526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:15.420600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382727+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.382727+0000","last_peered":"2024-09-13T23:28:22.382727+0000","last_clean":"2024-09-13T23:28:22.382727+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.382727+0000","last_undegraded":"2024-09-13T23:28:22.382727+0000","last_fullsized":"2024-09-13T23:28:22.382727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:49.591312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373570+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:52.373570+0000","last_peered":"2024-09-13T23:25:52.373570+0000","last_clean":"2024-09-13T23:25:52.373570+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:52.373570+0000","last_undegraded":"2024-09-13T23:25:52.373570+0000","last_fullsized":"2024-09-13T23:25:52.373570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326956+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:27:21.326956+0000","last_peered":"2024-09-13T23:27:21.326956+0000","last_clean":"2024-09-13T23:27:21.326956+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:27:21.326956+0000","last_undegraded":"2024-09-13T23:27:21.326956+0000","last_fullsized":"2024-09-13T23:27:21.326956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381102+0000","last_change":"2024-09-13T23:25:17.287907+0000","last_active":"2024-09-13T23:25:52.381102+0000","last_peered":"2024-09-13T23:25:52.381102+0000","last_clean":"2024-09-13T23:25:52.381102+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:25:52.381102+0000","last_undegraded":"2024-09-13T23:25:52.381102+0000","last_fullsized":"2024-09-13T23:25:52.381102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:39:37.373797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'273","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364547+0000","last_change":"2024-09-13T23:25:19.299249+0000","last_active":"2024-09-13T23:28:22.364547+0000","last_peered":"2024-09-13T23:28:22.364547+0000","last_clean":"2024-09-13T23:28:22.364547+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:22.364547+0000","last_undegraded":"2024-09-13T23:28:22.364547+0000","last_fullsized":"2024-09-13T23:28:22.364547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:54.251861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380330+0000","last_change":"2024-09-13T23:25:21.304037+0000","last_active":"2024-09-13T23:25:52.380330+0000","last_peered":"2024-09-13T23:25:52.380330+0000","last_clean":"2024-09-13T23:25:52.380330+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:25:52.380330+0000","last_undegraded":"2024-09-13T23:25:52.380330+0000","last_fullsized":"2024-09-13T23:25:52.380330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:34.562617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.721511+0000","last_change":"2024-09-13T23:25:23.308546+0000","last_active":"2024-09-13T23:26:37.721511+0000","last_peered":"2024-09-13T23:26:37.721511+0000","last_clean":"2024-09-13T23:26:37.721511+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:26:37.721511+0000","last_undegraded":"2024-09-13T23:26:37.721511+0000","last_fullsized":"2024-09-13T23:26:37.721511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:15.331780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374990+0000","last_change":"2024-09-13T23:25:15.285194+0000","last_active":"2024-09-13T23:28:22.374990+0000","last_peered":"2024-09-13T23:28:22.374990+0000","last_clean":"2024-09-13T23:28:22.374990+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:28:22.374990+0000","last_undegraded":"2024-09-13T23:28:22.374990+0000","last_fullsized":"2024-09-13T23:28:22.374990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372184+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:52.372184+0000","last_peered":"2024-09-13T23:25:52.372184+0000","last_clean":"2024-09-13T23:25:52.372184+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:52.372184+0000","last_undegraded":"2024-09-13T23:25:52.372184+0000","last_fullsized":"2024-09-13T23:25:52.372184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.889372+0000","last_change":"2024-09-13T23:25:13.287909+0000","last_active":"2024-09-13T23:26:37.889372+0000","last_peered":"2024-09-13T23:26:37.889372+0000","last_clean":"2024-09-13T23:26:37.889372+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:26:37.889372+0000","last_undegraded":"2024-09-13T23:26:37.889372+0000","last_fullsized":"2024-09-13T23:26:37.889372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282894+0000","last_change":"2024-09-13T23:25:17.283490+0000","last_active":"2024-09-13T23:27:21.282894+0000","last_peered":"2024-09-13T23:27:21.282894+0000","last_clean":"2024-09-13T23:27:21.282894+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:27:21.282894+0000","last_undegraded":"2024-09-13T23:27:21.282894+0000","last_fullsized":"2024-09-13T23:27:21.282894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364589+0000","last_change":"2024-09-13T23:25:19.293483+0000","last_active":"2024-09-13T23:28:22.364589+0000","last_peered":"2024-09-13T23:28:22.364589+0000","last_clean":"2024-09-13T23:28:22.364589+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:22.364589+0000","last_undegraded":"2024-09-13T23:28:22.364589+0000","last_fullsized":"2024-09-13T23:28:22.364589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:37.400352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375104+0000","last_change":"2024-09-13T23:25:21.302444+0000","last_active":"2024-09-13T23:25:52.375104+0000","last_peered":"2024-09-13T23:25:52.375104+0000","last_clean":"2024-09-13T23:25:52.375104+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:25:52.375104+0000","last_undegraded":"2024-09-13T23:25:52.375104+0000","last_fullsized":"2024-09-13T23:25:52.375104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:59.000917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.075118+0000","last_change":"2024-09-13T23:25:23.311768+0000","last_active":"2024-09-13T23:28:22.075118+0000","last_peered":"2024-09-13T23:28:22.075118+0000","last_clean":"2024-09-13T23:28:22.075118+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:28:22.075118+0000","last_undegraded":"2024-09-13T23:28:22.075118+0000","last_fullsized":"2024-09-13T23:28:22.075118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:53.775798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327023+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:27:21.327023+0000","last_peered":"2024-09-13T23:27:21.327023+0000","last_clean":"2024-09-13T23:27:21.327023+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:27:21.327023+0000","last_undegraded":"2024-09-13T23:27:21.327023+0000","last_fullsized":"2024-09-13T23:27:21.327023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374265+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:52.374265+0000","last_peered":"2024-09-13T23:25:52.374265+0000","last_clean":"2024-09-13T23:25:52.374265+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:52.374265+0000","last_undegraded":"2024-09-13T23:25:52.374265+0000","last_fullsized":"2024-09-13T23:25:52.374265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621755+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.621755+0000","last_peered":"2024-09-13T23:28:22.621755+0000","last_clean":"2024-09-13T23:28:22.621755+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.621755+0000","last_undegraded":"2024-09-13T23:28:22.621755+0000","last_fullsized":"2024-09-13T23:28:22.621755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376731+0000","last_change":"2024-09-13T23:25:17.285610+0000","last_active":"2024-09-13T23:25:52.376731+0000","last_peered":"2024-09-13T23:25:52.376731+0000","last_clean":"2024-09-13T23:25:52.376731+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:25:52.376731+0000","last_undegraded":"2024-09-13T23:25:52.376731+0000","last_fullsized":"2024-09-13T23:25:52.376731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:40.895440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.895417+0000","last_change":"2024-09-13T23:25:19.294517+0000","last_active":"2024-09-13T23:28:21.895417+0000","last_peered":"2024-09-13T23:28:21.895417+0000","last_clean":"2024-09-13T23:28:21.895417+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:21.895417+0000","last_undegraded":"2024-09-13T23:28:21.895417+0000","last_fullsized":"2024-09-13T23:28:21.895417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:57.792215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380367+0000","last_change":"2024-09-13T23:25:21.307983+0000","last_active":"2024-09-13T23:25:52.380367+0000","last_peered":"2024-09-13T23:25:52.380367+0000","last_clean":"2024-09-13T23:25:52.380367+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:25:52.380367+0000","last_undegraded":"2024-09-13T23:25:52.380367+0000","last_fullsized":"2024-09-13T23:25:52.380367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:49.287014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.505152+0000","last_change":"2024-09-13T23:25:23.314405+0000","last_active":"2024-09-13T23:27:21.505152+0000","last_peered":"2024-09-13T23:27:21.505152+0000","last_clean":"2024-09-13T23:27:21.505152+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:27:21.505152+0000","last_undegraded":"2024-09-13T23:27:21.505152+0000","last_fullsized":"2024-09-13T23:27:21.505152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:35.679328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871200+0000","last_change":"2024-09-13T23:25:15.295101+0000","last_active":"2024-09-13T23:27:21.871200+0000","last_peered":"2024-09-13T23:27:21.871200+0000","last_clean":"2024-09-13T23:27:21.871200+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:27:21.871200+0000","last_undegraded":"2024-09-13T23:27:21.871200+0000","last_fullsized":"2024-09-13T23:27:21.871200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374467+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:25:52.374467+0000","last_peered":"2024-09-13T23:25:52.374467+0000","last_clean":"2024-09-13T23:25:52.374467+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:25:52.374467+0000","last_undegraded":"2024-09-13T23:25:52.374467+0000","last_fullsized":"2024-09-13T23:25:52.374467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374857+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:52.374857+0000","last_peered":"2024-09-13T23:25:52.374857+0000","last_clean":"2024-09-13T23:25:52.374857+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:52.374857+0000","last_undegraded":"2024-09-13T23:25:52.374857+0000","last_fullsized":"2024-09-13T23:25:52.374857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326988+0000","last_change":"2024-09-13T23:25:17.285296+0000","last_active":"2024-09-13T23:27:21.326988+0000","last_peered":"2024-09-13T23:27:21.326988+0000","last_clean":"2024-09-13T23:27:21.326988+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:27:21.326988+0000","last_undegraded":"2024-09-13T23:27:21.326988+0000","last_fullsized":"2024-09-13T23:27:21.326988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:16.469594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'63","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326920+0000","last_change":"2024-09-13T23:25:19.298514+0000","last_active":"2024-09-13T23:27:21.326920+0000","last_peered":"2024-09-13T23:27:21.326920+0000","last_clean":"2024-09-13T23:27:21.326920+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:27:21.326920+0000","last_undegraded":"2024-09-13T23:27:21.326920+0000","last_fullsized":"2024-09-13T23:27:21.326920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:01.195077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372567+0000","last_change":"2024-09-13T23:25:21.301624+0000","last_active":"2024-09-13T23:25:52.372567+0000","last_peered":"2024-09-13T23:25:52.372567+0000","last_clean":"2024-09-13T23:25:52.372567+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:25:52.372567+0000","last_undegraded":"2024-09-13T23:25:52.372567+0000","last_fullsized":"2024-09-13T23:25:52.372567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:48.130925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.785277+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:21.785277+0000","last_peered":"2024-09-13T23:27:21.785277+0000","last_clean":"2024-09-13T23:27:21.785277+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:21.785277+0000","last_undegraded":"2024-09-13T23:27:21.785277+0000","last_fullsized":"2024-09-13T23:27:21.785277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:58.134248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899466+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:26:37.899466+0000","last_peered":"2024-09-13T23:26:37.899466+0000","last_clean":"2024-09-13T23:26:37.899466+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:26:37.899466+0000","last_undegraded":"2024-09-13T23:26:37.899466+0000","last_fullsized":"2024-09-13T23:26:37.899466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:00.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375170+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:25:52.375170+0000","last_peered":"2024-09-13T23:25:52.375170+0000","last_clean":"2024-09-13T23:25:52.375170+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:25:52.375170+0000","last_undegraded":"2024-09-13T23:25:52.375170+0000","last_fullsized":"2024-09-13T23:25:52.375170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382386+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:52.382386+0000","last_peered":"2024-09-13T23:25:52.382386+0000","last_clean":"2024-09-13T23:25:52.382386+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:52.382386+0000","last_undegraded":"2024-09-13T23:25:52.382386+0000","last_fullsized":"2024-09-13T23:25:52.382386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374660+0000","last_change":"2024-09-13T23:25:17.287023+0000","last_active":"2024-09-13T23:25:52.374660+0000","last_peered":"2024-09-13T23:25:52.374660+0000","last_clean":"2024-09-13T23:25:52.374660+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:25:52.374660+0000","last_undegraded":"2024-09-13T23:25:52.374660+0000","last_fullsized":"2024-09-13T23:25:52.374660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:07.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376436+0000","last_change":"2024-09-13T23:25:19.294335+0000","last_active":"2024-09-13T23:25:52.376436+0000","last_peered":"2024-09-13T23:25:52.376436+0000","last_clean":"2024-09-13T23:25:52.376436+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:25:52.376436+0000","last_undegraded":"2024-09-13T23:25:52.376436+0000","last_fullsized":"2024-09-13T23:25:52.376436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364508+0000","last_change":"2024-09-13T23:25:21.300733+0000","last_active":"2024-09-13T23:28:22.364508+0000","last_peered":"2024-09-13T23:28:22.364508+0000","last_clean":"2024-09-13T23:28:22.364508+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:22.364508+0000","last_undegraded":"2024-09-13T23:28:22.364508+0000","last_fullsized":"2024-09-13T23:28:22.364508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:13.414196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380261+0000","last_change":"2024-09-13T23:25:23.311239+0000","last_active":"2024-09-13T23:25:52.380261+0000","last_peered":"2024-09-13T23:25:52.380261+0000","last_clean":"2024-09-13T23:25:52.380261+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:25:52.380261+0000","last_undegraded":"2024-09-13T23:25:52.380261+0000","last_fullsized":"2024-09-13T23:25:52.380261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:01.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.634716+0000","last_change":"2024-09-13T23:25:15.291433+0000","last_active":"2024-09-13T23:28:22.634716+0000","last_peered":"2024-09-13T23:28:22.634716+0000","last_clean":"2024-09-13T23:28:22.634716+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:22.634716+0000","last_undegraded":"2024-09-13T23:28:22.634716+0000","last_fullsized":"2024-09-13T23:28:22.634716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:25.985146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.424804+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:25:55.424804+0000","last_peered":"2024-09-13T23:25:55.424804+0000","last_clean":"2024-09-13T23:25:55.424804+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:25:55.424804+0000","last_undegraded":"2024-09-13T23:25:55.424804+0000","last_fullsized":"2024-09-13T23:25:55.424804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:04.927068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375533+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:52.375533+0000","last_peered":"2024-09-13T23:25:52.375533+0000","last_clean":"2024-09-13T23:25:52.375533+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:52.375533+0000","last_undegraded":"2024-09-13T23:25:52.375533+0000","last_fullsized":"2024-09-13T23:25:52.375533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388035+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:25:52.388035+0000","last_peered":"2024-09-13T23:25:52.388035+0000","last_clean":"2024-09-13T23:25:52.388035+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:25:52.388035+0000","last_undegraded":"2024-09-13T23:25:52.388035+0000","last_fullsized":"2024-09-13T23:25:52.388035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:07.872328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329205+0000","last_change":"2024-09-13T23:25:19.295671+0000","last_active":"2024-09-13T23:27:23.329205+0000","last_peered":"2024-09-13T23:27:23.329205+0000","last_clean":"2024-09-13T23:27:23.329205+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:27:23.329205+0000","last_undegraded":"2024-09-13T23:27:23.329205+0000","last_fullsized":"2024-09-13T23:27:23.329205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.597972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":399,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.995385+0000","last_change":"2024-09-13T23:25:21.300629+0000","last_active":"2024-09-13T23:28:22.995385+0000","last_peered":"2024-09-13T23:28:22.995385+0000","last_clean":"2024-09-13T23:28:22.995385+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:22.995385+0000","last_undegraded":"2024-09-13T23:28:22.995385+0000","last_fullsized":"2024-09-13T23:28:22.995385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:24.498793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.431442+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:25:55.431442+0000","last_peered":"2024-09-13T23:25:55.431442+0000","last_clean":"2024-09-13T23:25:55.431442+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:25:55.431442+0000","last_undegraded":"2024-09-13T23:25:55.431442+0000","last_fullsized":"2024-09-13T23:25:55.431442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:10.438084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899058+0000","last_change":"2024-09-13T23:25:15.289794+0000","last_active":"2024-09-13T23:26:37.899058+0000","last_peered":"2024-09-13T23:26:37.899058+0000","last_clean":"2024-09-13T23:26:37.899058+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:26:37.899058+0000","last_undegraded":"2024-09-13T23:26:37.899058+0000","last_fullsized":"2024-09-13T23:26:37.899058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:15.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.619082+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.619082+0000","last_peered":"2024-09-13T23:28:22.619082+0000","last_clean":"2024-09-13T23:28:22.619082+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.619082+0000","last_undegraded":"2024-09-13T23:28:22.619082+0000","last_fullsized":"2024-09-13T23:28:22.619082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:09.098791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380490+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:52.380490+0000","last_peered":"2024-09-13T23:25:52.380490+0000","last_clean":"2024-09-13T23:25:52.380490+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:52.380490+0000","last_undegraded":"2024-09-13T23:25:52.380490+0000","last_fullsized":"2024-09-13T23:25:52.380490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388053+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:25:52.388053+0000","last_peered":"2024-09-13T23:25:52.388053+0000","last_clean":"2024-09-13T23:25:52.388053+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:25:52.388053+0000","last_undegraded":"2024-09-13T23:25:52.388053+0000","last_fullsized":"2024-09-13T23:25:52.388053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:53.886096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'83","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328394+0000","last_change":"2024-09-13T23:25:19.291785+0000","last_active":"2024-09-13T23:27:23.328394+0000","last_peered":"2024-09-13T23:27:23.328394+0000","last_clean":"2024-09-13T23:27:23.328394+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:27:23.328394+0000","last_undegraded":"2024-09-13T23:27:23.328394+0000","last_fullsized":"2024-09-13T23:27:23.328394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:19.764533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374724+0000","last_change":"2024-09-13T23:25:21.301723+0000","last_active":"2024-09-13T23:25:52.374724+0000","last_peered":"2024-09-13T23:25:52.374724+0000","last_clean":"2024-09-13T23:25:52.374724+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:25:52.374724+0000","last_undegraded":"2024-09-13T23:25:52.374724+0000","last_fullsized":"2024-09-13T23:25:52.374724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:00.977979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373401+0000","last_change":"2024-09-13T23:25:23.305632+0000","last_active":"2024-09-13T23:25:52.373401+0000","last_peered":"2024-09-13T23:25:52.373401+0000","last_clean":"2024-09-13T23:25:52.373401+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:25:52.373401+0000","last_undegraded":"2024-09-13T23:25:52.373401+0000","last_fullsized":"2024-09-13T23:25:52.373401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.047663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375073+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:25:52.375073+0000","last_peered":"2024-09-13T23:25:52.375073+0000","last_clean":"2024-09-13T23:25:52.375073+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:25:52.375073+0000","last_undegraded":"2024-09-13T23:25:52.375073+0000","last_fullsized":"2024-09-13T23:25:52.375073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:36.465581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479975+0000","last_change":"2024-09-13T23:25:15.289596+0000","last_active":"2024-09-13T23:28:22.479975+0000","last_peered":"2024-09-13T23:28:22.479975+0000","last_clean":"2024-09-13T23:28:22.479975+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:28:22.479975+0000","last_undegraded":"2024-09-13T23:28:22.479975+0000","last_fullsized":"2024-09-13T23:28:22.479975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.021512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375986+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:52.375986+0000","last_peered":"2024-09-13T23:25:52.375986+0000","last_clean":"2024-09-13T23:25:52.375986+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:25:52.375986+0000","last_undegraded":"2024-09-13T23:25:52.375986+0000","last_fullsized":"2024-09-13T23:25:52.375986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:40.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379392+0000","last_change":"2024-09-13T23:25:17.286995+0000","last_active":"2024-09-13T23:25:52.379392+0000","last_peered":"2024-09-13T23:25:52.379392+0000","last_clean":"2024-09-13T23:25:52.379392+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:25:52.379392+0000","last_undegraded":"2024-09-13T23:25:52.379392+0000","last_fullsized":"2024-09-13T23:25:52.379392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:28.543035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.174996+0000","last_change":"2024-09-13T23:25:19.299340+0000","last_active":"2024-09-13T23:27:20.174996+0000","last_peered":"2024-09-13T23:27:20.174996+0000","last_clean":"2024-09-13T23:27:20.174996+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:27:20.174996+0000","last_undegraded":"2024-09-13T23:27:20.174996+0000","last_fullsized":"2024-09-13T23:27:20.174996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:19.887611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374367+0000","last_change":"2024-09-13T23:25:21.306435+0000","last_active":"2024-09-13T23:25:52.374367+0000","last_peered":"2024-09-13T23:25:52.374367+0000","last_clean":"2024-09-13T23:25:52.374367+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:25:52.374367+0000","last_undegraded":"2024-09-13T23:25:52.374367+0000","last_fullsized":"2024-09-13T23:25:52.374367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.772839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:19.870950+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:19.870950+0000","last_peered":"2024-09-13T23:27:19.870950+0000","last_clean":"2024-09-13T23:27:19.870950+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:19.870950+0000","last_undegraded":"2024-09-13T23:27:19.870950+0000","last_fullsized":"2024-09-13T23:27:19.870950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:47.394971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739917+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.739917+0000","last_peered":"2024-09-13T23:28:22.739917+0000","last_clean":"2024-09-13T23:28:22.739917+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.739917+0000","last_undegraded":"2024-09-13T23:28:22.739917+0000","last_fullsized":"2024-09-13T23:28:22.739917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.848834+0000","last_change":"2024-09-13T23:25:13.287807+0000","last_active":"2024-09-13T23:27:21.848834+0000","last_peered":"2024-09-13T23:27:21.848834+0000","last_clean":"2024-09-13T23:27:21.848834+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:27:21.848834+0000","last_undegraded":"2024-09-13T23:27:21.848834+0000","last_fullsized":"2024-09-13T23:27:21.848834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379956+0000","last_change":"2024-09-13T23:25:17.287358+0000","last_active":"2024-09-13T23:25:52.379956+0000","last_peered":"2024-09-13T23:25:52.379956+0000","last_clean":"2024-09-13T23:25:52.379956+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:25:52.379956+0000","last_undegraded":"2024-09-13T23:25:52.379956+0000","last_fullsized":"2024-09-13T23:25:52.379956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:52.433067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900136+0000","last_change":"2024-09-13T23:25:19.290459+0000","last_active":"2024-09-13T23:28:21.900136+0000","last_peered":"2024-09-13T23:28:21.900136+0000","last_clean":"2024-09-13T23:28:21.900136+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:21.900136+0000","last_undegraded":"2024-09-13T23:28:21.900136+0000","last_fullsized":"2024-09-13T23:28:21.900136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:49.482704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372343+0000","last_change":"2024-09-13T23:25:21.308722+0000","last_active":"2024-09-13T23:25:52.372343+0000","last_peered":"2024-09-13T23:25:52.372343+0000","last_clean":"2024-09-13T23:25:52.372343+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:25:52.372343+0000","last_undegraded":"2024-09-13T23:25:52.372343+0000","last_fullsized":"2024-09-13T23:25:52.372343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:25.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.812141+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:25:54.812141+0000","last_peered":"2024-09-13T23:25:54.812141+0000","last_clean":"2024-09-13T23:25:54.812141+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:25:54.812141+0000","last_undegraded":"2024-09-13T23:25:54.812141+0000","last_fullsized":"2024-09-13T23:25:54.812141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:51.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478456+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.478456+0000","last_peered":"2024-09-13T23:28:22.478456+0000","last_clean":"2024-09-13T23:28:22.478456+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.478456+0000","last_undegraded":"2024-09-13T23:28:22.478456+0000","last_fullsized":"2024-09-13T23:28:22.478456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.815605+0000","last_change":"2024-09-13T23:25:13.286024+0000","last_active":"2024-09-13T23:27:21.815605+0000","last_peered":"2024-09-13T23:27:21.815605+0000","last_clean":"2024-09-13T23:27:21.815605+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:27:21.815605+0000","last_undegraded":"2024-09-13T23:27:21.815605+0000","last_fullsized":"2024-09-13T23:27:21.815605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.371452+0000","last_change":"2024-09-13T23:25:17.286907+0000","last_active":"2024-09-13T23:25:52.371452+0000","last_peered":"2024-09-13T23:25:52.371452+0000","last_clean":"2024-09-13T23:25:52.371452+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:25:52.371452+0000","last_undegraded":"2024-09-13T23:25:52.371452+0000","last_fullsized":"2024-09-13T23:25:52.371452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:40.004624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.028937+0000","last_change":"2024-09-13T23:25:19.293305+0000","last_active":"2024-09-13T23:28:22.028937+0000","last_peered":"2024-09-13T23:28:22.028937+0000","last_clean":"2024-09-13T23:28:22.028937+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:22.028937+0000","last_undegraded":"2024-09-13T23:28:22.028937+0000","last_fullsized":"2024-09-13T23:28:22.028937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:19.534065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375591+0000","last_change":"2024-09-13T23:25:21.299732+0000","last_active":"2024-09-13T23:25:52.375591+0000","last_peered":"2024-09-13T23:25:52.375591+0000","last_clean":"2024-09-13T23:25:52.375591+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:25:52.375591+0000","last_undegraded":"2024-09-13T23:25:52.375591+0000","last_fullsized":"2024-09-13T23:25:52.375591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:43.808950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625968+0000","last_change":"2024-09-13T23:25:15.291739+0000","last_active":"2024-09-13T23:28:22.625968+0000","last_peered":"2024-09-13T23:28:22.625968+0000","last_clean":"2024-09-13T23:28:22.625968+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:22.625968+0000","last_undegraded":"2024-09-13T23:28:22.625968+0000","last_fullsized":"2024-09-13T23:28:22.625968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:57.989606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380093+0000","last_change":"2024-09-13T23:25:13.288670+0000","last_active":"2024-09-13T23:25:52.380093+0000","last_peered":"2024-09-13T23:25:52.380093+0000","last_clean":"2024-09-13T23:25:52.380093+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:25:52.380093+0000","last_undegraded":"2024-09-13T23:25:52.380093+0000","last_fullsized":"2024-09-13T23:25:52.380093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379765+0000","last_change":"2024-09-13T23:25:17.289029+0000","last_active":"2024-09-13T23:25:52.379765+0000","last_peered":"2024-09-13T23:25:52.379765+0000","last_clean":"2024-09-13T23:25:52.379765+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:25:52.379765+0000","last_undegraded":"2024-09-13T23:25:52.379765+0000","last_fullsized":"2024-09-13T23:25:52.379765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.980532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.159963+0000","last_change":"2024-09-13T23:25:19.288912+0000","last_active":"2024-09-13T23:27:20.159963+0000","last_peered":"2024-09-13T23:27:20.159963+0000","last_clean":"2024-09-13T23:27:20.159963+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:27:20.159963+0000","last_undegraded":"2024-09-13T23:27:20.159963+0000","last_fullsized":"2024-09-13T23:27:20.159963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:42.902191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373575+0000","last_change":"2024-09-13T23:25:21.298721+0000","last_active":"2024-09-13T23:25:52.373575+0000","last_peered":"2024-09-13T23:25:52.373575+0000","last_clean":"2024-09-13T23:25:52.373575+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:25:52.373575+0000","last_undegraded":"2024-09-13T23:25:52.373575+0000","last_fullsized":"2024-09-13T23:25:52.373575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:35.119012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739696+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.739696+0000","last_peered":"2024-09-13T23:28:22.739696+0000","last_clean":"2024-09-13T23:28:22.739696+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.739696+0000","last_undegraded":"2024-09-13T23:28:22.739696+0000","last_fullsized":"2024-09-13T23:28:22.739696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:13.221204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373681+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:25:52.373681+0000","last_peered":"2024-09-13T23:25:52.373681+0000","last_clean":"2024-09-13T23:25:52.373681+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:25:52.373681+0000","last_undegraded":"2024-09-13T23:25:52.373681+0000","last_fullsized":"2024-09-13T23:25:52.373681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:04.176141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376297+0000","last_change":"2024-09-13T23:25:17.285736+0000","last_active":"2024-09-13T23:25:52.376297+0000","last_peered":"2024-09-13T23:25:52.376297+0000","last_clean":"2024-09-13T23:25:52.376297+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:25:52.376297+0000","last_undegraded":"2024-09-13T23:25:52.376297+0000","last_fullsized":"2024-09-13T23:25:52.376297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:51.331504+0000","last_change":"2024-09-13T23:25:19.290018+0000","last_active":"2024-09-13T23:27:51.331504+0000","last_peered":"2024-09-13T23:27:51.331504+0000","last_clean":"2024-09-13T23:27:51.331504+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:27:51.331504+0000","last_undegraded":"2024-09-13T23:27:51.331504+0000","last_fullsized":"2024-09-13T23:27:51.331504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.123858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374548+0000","last_change":"2024-09-13T23:25:21.300887+0000","last_active":"2024-09-13T23:25:52.374548+0000","last_peered":"2024-09-13T23:25:52.374548+0000","last_clean":"2024-09-13T23:25:52.374548+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:25:52.374548+0000","last_undegraded":"2024-09-13T23:25:52.374548+0000","last_fullsized":"2024-09-13T23:25:52.374548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:45.277378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.869223+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:21.869223+0000","last_peered":"2024-09-13T23:27:21.869223+0000","last_clean":"2024-09-13T23:27:21.869223+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:21.869223+0000","last_undegraded":"2024-09-13T23:27:21.869223+0000","last_fullsized":"2024-09-13T23:27:21.869223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:52.742462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.864009+0000","last_change":"2024-09-13T23:25:15.281867+0000","last_active":"2024-09-13T23:27:21.864009+0000","last_peered":"2024-09-13T23:27:21.864009+0000","last_clean":"2024-09-13T23:27:21.864009+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:27:21.864009+0000","last_undegraded":"2024-09-13T23:27:21.864009+0000","last_fullsized":"2024-09-13T23:27:21.864009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330940+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:27:38.330940+0000","last_peered":"2024-09-13T23:27:38.330940+0000","last_clean":"2024-09-13T23:27:38.330940+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:27:38.330940+0000","last_undegraded":"2024-09-13T23:27:38.330940+0000","last_fullsized":"2024-09-13T23:27:38.330940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:32.466032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375392+0000","last_change":"2024-09-13T23:25:17.282822+0000","last_active":"2024-09-13T23:25:52.375392+0000","last_peered":"2024-09-13T23:25:52.375392+0000","last_clean":"2024-09-13T23:25:52.375392+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:25:52.375392+0000","last_undegraded":"2024-09-13T23:25:52.375392+0000","last_fullsized":"2024-09-13T23:25:52.375392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:34.290866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.160935+0000","last_change":"2024-09-13T23:25:19.290348+0000","last_active":"2024-09-13T23:27:20.160935+0000","last_peered":"2024-09-13T23:27:20.160935+0000","last_clean":"2024-09-13T23:27:20.160935+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:27:20.160935+0000","last_undegraded":"2024-09-13T23:27:20.160935+0000","last_fullsized":"2024-09-13T23:27:20.160935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:41.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381331+0000","last_change":"2024-09-13T23:25:21.305428+0000","last_active":"2024-09-13T23:25:52.381331+0000","last_peered":"2024-09-13T23:25:52.381331+0000","last_clean":"2024-09-13T23:25:52.381331+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:25:52.381331+0000","last_undegraded":"2024-09-13T23:25:52.381331+0000","last_fullsized":"2024-09-13T23:25:52.381331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373824+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:25:52.373824+0000","last_peered":"2024-09-13T23:25:52.373824+0000","last_clean":"2024-09-13T23:25:52.373824+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:25:52.373824+0000","last_undegraded":"2024-09-13T23:25:52.373824+0000","last_fullsized":"2024-09-13T23:25:52.373824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:45.821221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717093+0000","last_change":"2024-09-13T23:25:15.290421+0000","last_active":"2024-09-13T23:26:37.717093+0000","last_peered":"2024-09-13T23:26:37.717093+0000","last_clean":"2024-09-13T23:26:37.717093+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:26:37.717093+0000","last_undegraded":"2024-09-13T23:26:37.717093+0000","last_fullsized":"2024-09-13T23:26:37.717093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:22.137388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.272409+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:25:54.272409+0000","last_peered":"2024-09-13T23:25:54.272409+0000","last_clean":"2024-09-13T23:25:54.272409+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:25:54.272409+0000","last_undegraded":"2024-09-13T23:25:54.272409+0000","last_fullsized":"2024-09-13T23:25:54.272409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.272703+0000","last_change":"2024-09-13T23:25:17.282523+0000","last_active":"2024-09-13T23:27:21.272703+0000","last_peered":"2024-09-13T23:27:21.272703+0000","last_clean":"2024-09-13T23:27:21.272703+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:27:21.272703+0000","last_undegraded":"2024-09-13T23:27:21.272703+0000","last_fullsized":"2024-09-13T23:27:21.272703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:09.619639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.178897+0000","last_change":"2024-09-13T23:25:19.295026+0000","last_active":"2024-09-13T23:27:20.178897+0000","last_peered":"2024-09-13T23:27:20.178897+0000","last_clean":"2024-09-13T23:27:20.178897+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:27:20.178897+0000","last_undegraded":"2024-09-13T23:27:20.178897+0000","last_fullsized":"2024-09-13T23:27:20.178897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375400+0000","last_change":"2024-09-13T23:25:21.301455+0000","last_active":"2024-09-13T23:25:52.375400+0000","last_peered":"2024-09-13T23:25:52.375400+0000","last_clean":"2024-09-13T23:25:52.375400+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:25:52.375400+0000","last_undegraded":"2024-09-13T23:25:52.375400+0000","last_fullsized":"2024-09-13T23:25:52.375400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:40.147072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.394588+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.394588+0000","last_peered":"2024-09-13T23:28:22.394588+0000","last_clean":"2024-09-13T23:28:22.394588+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.394588+0000","last_undegraded":"2024-09-13T23:28:22.394588+0000","last_fullsized":"2024-09-13T23:28:22.394588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.414979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.376519+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.376519+0000","last_peered":"2024-09-13T23:28:22.376519+0000","last_clean":"2024-09-13T23:28:22.376519+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.376519+0000","last_undegraded":"2024-09-13T23:28:22.376519+0000","last_fullsized":"2024-09-13T23:28:22.376519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613616+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.613616+0000","last_peered":"2024-09-13T23:28:22.613616+0000","last_clean":"2024-09-13T23:28:22.613616+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.613616+0000","last_undegraded":"2024-09-13T23:28:22.613616+0000","last_fullsized":"2024-09-13T23:28:22.613616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:20.499420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380719+0000","last_change":"2024-09-13T23:25:17.285551+0000","last_active":"2024-09-13T23:25:52.380719+0000","last_peered":"2024-09-13T23:25:52.380719+0000","last_clean":"2024-09-13T23:25:52.380719+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:25:52.380719+0000","last_undegraded":"2024-09-13T23:25:52.380719+0000","last_fullsized":"2024-09-13T23:25:52.380719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.219409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.818061+0000","last_change":"2024-09-13T23:25:19.294499+0000","last_active":"2024-09-13T23:25:54.818061+0000","last_peered":"2024-09-13T23:25:54.818061+0000","last_clean":"2024-09-13T23:25:54.818061+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:25:54.818061+0000","last_undegraded":"2024-09-13T23:25:54.818061+0000","last_fullsized":"2024-09-13T23:25:54.818061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:06.976502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364507+0000","last_change":"2024-09-13T23:25:21.304914+0000","last_active":"2024-09-13T23:28:22.364507+0000","last_peered":"2024-09-13T23:28:22.364507+0000","last_clean":"2024-09-13T23:28:22.364507+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:22.364507+0000","last_undegraded":"2024-09-13T23:28:22.364507+0000","last_fullsized":"2024-09-13T23:28:22.364507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:11.529972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373312+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:25:52.373312+0000","last_peered":"2024-09-13T23:25:52.373312+0000","last_clean":"2024-09-13T23:25:52.373312+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:25:52.373312+0000","last_undegraded":"2024-09-13T23:25:52.373312+0000","last_fullsized":"2024-09-13T23:25:52.373312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:54.970107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626042+0000","last_change":"2024-09-13T23:25:15.286332+0000","last_active":"2024-09-13T23:28:22.626042+0000","last_peered":"2024-09-13T23:28:22.626042+0000","last_clean":"2024-09-13T23:28:22.626042+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:22.626042+0000","last_undegraded":"2024-09-13T23:28:22.626042+0000","last_fullsized":"2024-09-13T23:28:22.626042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:34:15.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380462+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:25:52.380462+0000","last_peered":"2024-09-13T23:25:52.380462+0000","last_clean":"2024-09-13T23:25:52.380462+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:25:52.380462+0000","last_undegraded":"2024-09-13T23:25:52.380462+0000","last_fullsized":"2024-09-13T23:25:52.380462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379838+0000","last_change":"2024-09-13T23:25:17.286289+0000","last_active":"2024-09-13T23:25:52.379838+0000","last_peered":"2024-09-13T23:25:52.379838+0000","last_clean":"2024-09-13T23:25:52.379838+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:25:52.379838+0000","last_undegraded":"2024-09-13T23:25:52.379838+0000","last_fullsized":"2024-09-13T23:25:52.379838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.151515+0000","last_change":"2024-09-13T23:25:19.296410+0000","last_active":"2024-09-13T23:27:20.151515+0000","last_peered":"2024-09-13T23:27:20.151515+0000","last_clean":"2024-09-13T23:27:20.151515+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:27:20.151515+0000","last_undegraded":"2024-09-13T23:27:20.151515+0000","last_fullsized":"2024-09-13T23:27:20.151515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:43.270311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373670+0000","last_change":"2024-09-13T23:25:21.307423+0000","last_active":"2024-09-13T23:25:52.373670+0000","last_peered":"2024-09-13T23:25:52.373670+0000","last_clean":"2024-09-13T23:25:52.373670+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:25:52.373670+0000","last_undegraded":"2024-09-13T23:25:52.373670+0000","last_fullsized":"2024-09-13T23:25:52.373670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379286+0000","last_change":"2024-09-13T23:25:23.309558+0000","last_active":"2024-09-13T23:25:52.379286+0000","last_peered":"2024-09-13T23:25:52.379286+0000","last_clean":"2024-09-13T23:25:52.379286+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:25:52.379286+0000","last_undegraded":"2024-09-13T23:25:52.379286+0000","last_fullsized":"2024-09-13T23:25:52.379286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372351+0000","last_change":"2024-09-13T23:25:15.279688+0000","last_active":"2024-09-13T23:25:52.372351+0000","last_peered":"2024-09-13T23:25:52.372351+0000","last_clean":"2024-09-13T23:25:52.372351+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:25:52.372351+0000","last_undegraded":"2024-09-13T23:25:52.372351+0000","last_fullsized":"2024-09-13T23:25:52.372351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382669+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:25:52.382669+0000","last_peered":"2024-09-13T23:25:52.382669+0000","last_clean":"2024-09-13T23:25:52.382669+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:25:52.382669+0000","last_undegraded":"2024-09-13T23:25:52.382669+0000","last_fullsized":"2024-09-13T23:25:52.382669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:10.620559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373525+0000","last_change":"2024-09-13T23:25:17.285313+0000","last_active":"2024-09-13T23:25:52.373525+0000","last_peered":"2024-09-13T23:25:52.373525+0000","last_clean":"2024-09-13T23:25:52.373525+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:25:52.373525+0000","last_undegraded":"2024-09-13T23:25:52.373525+0000","last_fullsized":"2024-09-13T23:25:52.373525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:03.256424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.152651+0000","last_change":"2024-09-13T23:25:19.298312+0000","last_active":"2024-09-13T23:27:20.152651+0000","last_peered":"2024-09-13T23:27:20.152651+0000","last_clean":"2024-09-13T23:27:20.152651+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:27:20.152651+0000","last_undegraded":"2024-09-13T23:27:20.152651+0000","last_fullsized":"2024-09-13T23:27:20.152651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:23.503939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374897+0000","last_change":"2024-09-13T23:25:21.306963+0000","last_active":"2024-09-13T23:25:52.374897+0000","last_peered":"2024-09-13T23:25:52.374897+0000","last_clean":"2024-09-13T23:25:52.374897+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:25:52.374897+0000","last_undegraded":"2024-09-13T23:25:52.374897+0000","last_fullsized":"2024-09-13T23:25:52.374897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.701389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.896491+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:26:37.896491+0000","last_peered":"2024-09-13T23:26:37.896491+0000","last_clean":"2024-09-13T23:26:37.896491+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:26:37.896491+0000","last_undegraded":"2024-09-13T23:26:37.896491+0000","last_fullsized":"2024-09-13T23:26:37.896491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.998081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697384+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.697384+0000","last_peered":"2024-09-13T23:28:22.697384+0000","last_clean":"2024-09-13T23:28:22.697384+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.697384+0000","last_undegraded":"2024-09-13T23:28:22.697384+0000","last_fullsized":"2024-09-13T23:28:22.697384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:03.357373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616400+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.616400+0000","last_peered":"2024-09-13T23:28:22.616400+0000","last_clean":"2024-09-13T23:28:22.616400+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.616400+0000","last_undegraded":"2024-09-13T23:28:22.616400+0000","last_fullsized":"2024-09-13T23:28:22.616400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:10.971868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378929+0000","last_change":"2024-09-13T23:25:17.289277+0000","last_active":"2024-09-13T23:25:52.378929+0000","last_peered":"2024-09-13T23:25:52.378929+0000","last_clean":"2024-09-13T23:25:52.378929+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:25:52.378929+0000","last_undegraded":"2024-09-13T23:25:52.378929+0000","last_fullsized":"2024-09-13T23:25:52.378929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:40.810119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'26","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.176935+0000","last_change":"2024-09-13T23:25:19.294964+0000","last_active":"2024-09-13T23:27:20.176935+0000","last_peered":"2024-09-13T23:27:20.176935+0000","last_clean":"2024-09-13T23:27:20.176935+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:27:20.176935+0000","last_undegraded":"2024-09-13T23:27:20.176935+0000","last_fullsized":"2024-09-13T23:27:20.176935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:15.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374493+0000","last_change":"2024-09-13T23:25:21.305087+0000","last_active":"2024-09-13T23:25:52.374493+0000","last_peered":"2024-09-13T23:25:52.374493+0000","last_clean":"2024-09-13T23:25:52.374493+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:25:52.374493+0000","last_undegraded":"2024-09-13T23:25:52.374493+0000","last_fullsized":"2024-09-13T23:25:52.374493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:44.058731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.187340+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:20.187340+0000","last_peered":"2024-09-13T23:27:20.187340+0000","last_clean":"2024-09-13T23:27:20.187340+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:20.187340+0000","last_undegraded":"2024-09-13T23:27:20.187340+0000","last_fullsized":"2024-09-13T23:27:20.187340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:43.115277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632608+0000","last_change":"2024-09-13T23:25:15.286878+0000","last_active":"2024-09-13T23:28:22.632608+0000","last_peered":"2024-09-13T23:28:22.632608+0000","last_clean":"2024-09-13T23:28:22.632608+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:22.632608+0000","last_undegraded":"2024-09-13T23:28:22.632608+0000","last_fullsized":"2024-09-13T23:28:22.632608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:37.878923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381505+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:25:52.381505+0000","last_peered":"2024-09-13T23:25:52.381505+0000","last_clean":"2024-09-13T23:25:52.381505+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:25:52.381505+0000","last_undegraded":"2024-09-13T23:25:52.381505+0000","last_fullsized":"2024-09-13T23:25:52.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.774635+0000","last_change":"2024-09-13T23:25:17.290217+0000","last_active":"2024-09-13T23:27:18.774635+0000","last_peered":"2024-09-13T23:27:18.774635+0000","last_clean":"2024-09-13T23:27:18.774635+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:27:18.774635+0000","last_undegraded":"2024-09-13T23:27:18.774635+0000","last_fullsized":"2024-09-13T23:27:18.774635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900968+0000","last_change":"2024-09-13T23:25:19.294973+0000","last_active":"2024-09-13T23:28:21.900968+0000","last_peered":"2024-09-13T23:28:21.900968+0000","last_clean":"2024-09-13T23:28:21.900968+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:21.900968+0000","last_undegraded":"2024-09-13T23:28:21.900968+0000","last_fullsized":"2024-09-13T23:28:21.900968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:49.482309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374666+0000","last_change":"2024-09-13T23:25:21.307475+0000","last_active":"2024-09-13T23:25:52.374666+0000","last_peered":"2024-09-13T23:25:52.374666+0000","last_clean":"2024-09-13T23:25:52.374666+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:25:52.374666+0000","last_undegraded":"2024-09-13T23:25:52.374666+0000","last_fullsized":"2024-09-13T23:25:52.374666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:24.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.699992+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.699992+0000","last_peered":"2024-09-13T23:28:22.699992+0000","last_clean":"2024-09-13T23:28:22.699992+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.699992+0000","last_undegraded":"2024-09-13T23:28:22.699992+0000","last_fullsized":"2024-09-13T23:28:22.699992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:57.777775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626210+0000","last_change":"2024-09-13T23:25:15.296960+0000","last_active":"2024-09-13T23:28:22.626210+0000","last_peered":"2024-09-13T23:28:22.626210+0000","last_clean":"2024-09-13T23:28:22.626210+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:22.626210+0000","last_undegraded":"2024-09-13T23:28:22.626210+0000","last_fullsized":"2024-09-13T23:28:22.626210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:32.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.610521+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.610521+0000","last_peered":"2024-09-13T23:28:22.610521+0000","last_clean":"2024-09-13T23:28:22.610521+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.610521+0000","last_undegraded":"2024-09-13T23:28:22.610521+0000","last_fullsized":"2024-09-13T23:28:22.610521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733334+0000","last_change":"2024-09-13T23:25:15.285164+0000","last_active":"2024-09-13T23:28:22.733334+0000","last_peered":"2024-09-13T23:28:22.733334+0000","last_clean":"2024-09-13T23:28:22.733334+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:28:22.733334+0000","last_undegraded":"2024-09-13T23:28:22.733334+0000","last_fullsized":"2024-09-13T23:28:22.733334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374101+0000","last_change":"2024-09-13T23:25:13.281843+0000","last_active":"2024-09-13T23:25:52.374101+0000","last_peered":"2024-09-13T23:25:52.374101+0000","last_clean":"2024-09-13T23:25:52.374101+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:25:52.374101+0000","last_undegraded":"2024-09-13T23:25:52.374101+0000","last_fullsized":"2024-09-13T23:25:52.374101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626100+0000","last_change":"2024-09-13T23:25:15.280336+0000","last_active":"2024-09-13T23:28:22.626100+0000","last_peered":"2024-09-13T23:28:22.626100+0000","last_clean":"2024-09-13T23:28:22.626100+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:28:22.626100+0000","last_undegraded":"2024-09-13T23:28:22.626100+0000","last_fullsized":"2024-09-13T23:28:22.626100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:33.711819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374801+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:25:52.374801+0000","last_peered":"2024-09-13T23:25:52.374801+0000","last_clean":"2024-09-13T23:25:52.374801+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:25:52.374801+0000","last_undegraded":"2024-09-13T23:25:52.374801+0000","last_fullsized":"2024-09-13T23:25:52.374801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733197+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.733197+0000","last_peered":"2024-09-13T23:28:22.733197+0000","last_clean":"2024-09-13T23:28:22.733197+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.733197+0000","last_undegraded":"2024-09-13T23:28:22.733197+0000","last_fullsized":"2024-09-13T23:28:22.733197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375346+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:25:52.375346+0000","last_peered":"2024-09-13T23:25:52.375346+0000","last_clean":"2024-09-13T23:25:52.375346+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:25:52.375346+0000","last_undegraded":"2024-09-13T23:25:52.375346+0000","last_fullsized":"2024-09-13T23:25:52.375346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.400507+0000","last_change":"2024-09-13T23:25:15.278977+0000","last_active":"2024-09-13T23:27:18.400507+0000","last_peered":"2024-09-13T23:27:18.400507+0000","last_clean":"2024-09-13T23:27:18.400507+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:27:18.400507+0000","last_undegraded":"2024-09-13T23:27:18.400507+0000","last_fullsized":"2024-09-13T23:27:18.400507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375434+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:25:52.375434+0000","last_peered":"2024-09-13T23:25:52.375434+0000","last_clean":"2024-09-13T23:25:52.375434+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:25:52.375434+0000","last_undegraded":"2024-09-13T23:25:52.375434+0000","last_fullsized":"2024-09-13T23:25:52.375434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871609+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:21.871609+0000","last_peered":"2024-09-13T23:27:21.871609+0000","last_clean":"2024-09-13T23:27:21.871609+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:21.871609+0000","last_undegraded":"2024-09-13T23:27:21.871609+0000","last_fullsized":"2024-09-13T23:27:21.871609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:04.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.273183+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:25:54.273183+0000","last_peered":"2024-09-13T23:25:54.273183+0000","last_clean":"2024-09-13T23:25:54.273183+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:25:54.273183+0000","last_undegraded":"2024-09-13T23:25:54.273183+0000","last_fullsized":"2024-09-13T23:25:54.273183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697112+0000","last_change":"2024-09-13T23:25:15.286489+0000","last_active":"2024-09-13T23:28:22.697112+0000","last_peered":"2024-09-13T23:28:22.697112+0000","last_clean":"2024-09-13T23:28:22.697112+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:22.697112+0000","last_undegraded":"2024-09-13T23:28:22.697112+0000","last_fullsized":"2024-09-13T23:28:22.697112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.384574+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:25:52.384574+0000","last_peered":"2024-09-13T23:25:52.384574+0000","last_clean":"2024-09-13T23:25:52.384574+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:25:52.384574+0000","last_undegraded":"2024-09-13T23:25:52.384574+0000","last_fullsized":"2024-09-13T23:25:52.384574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:08.828451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697025+0000","last_change":"2024-09-13T23:25:15.287524+0000","last_active":"2024-09-13T23:28:22.697025+0000","last_peered":"2024-09-13T23:28:22.697025+0000","last_clean":"2024-09-13T23:28:22.697025+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:28:22.697025+0000","last_undegraded":"2024-09-13T23:28:22.697025+0000","last_fullsized":"2024-09-13T23:28:22.697025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.417154+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:55.417154+0000","last_peered":"2024-09-13T23:25:55.417154+0000","last_clean":"2024-09-13T23:25:55.417154+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:25:55.417154+0000","last_undegraded":"2024-09-13T23:25:55.417154+0000","last_fullsized":"2024-09-13T23:25:55.417154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:41.876893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381077+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:25:52.381077+0000","last_peered":"2024-09-13T23:25:52.381077+0000","last_clean":"2024-09-13T23:25:52.381077+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:25:52.381077+0000","last_undegraded":"2024-09-13T23:25:52.381077+0000","last_fullsized":"2024-09-13T23:25:52.381077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.721411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373889+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:25:52.373889+0000","last_peered":"2024-09-13T23:25:52.373889+0000","last_clean":"2024-09-13T23:25:52.373889+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:25:52.373889+0000","last_undegraded":"2024-09-13T23:25:52.373889+0000","last_fullsized":"2024-09-13T23:25:52.373889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:51.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733239+0000","last_change":"2024-09-13T23:25:15.285028+0000","last_active":"2024-09-13T23:28:22.733239+0000","last_peered":"2024-09-13T23:28:22.733239+0000","last_clean":"2024-09-13T23:28:22.733239+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:28:22.733239+0000","last_undegraded":"2024-09-13T23:28:22.733239+0000","last_fullsized":"2024-09-13T23:28:22.733239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:16.065036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.705635+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:26:37.705635+0000","last_peered":"2024-09-13T23:26:37.705635+0000","last_clean":"2024-09-13T23:26:37.705635+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:26:37.705635+0000","last_undegraded":"2024-09-13T23:26:37.705635+0000","last_fullsized":"2024-09-13T23:26:37.705635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376137+0000","last_change":"2024-09-13T23:25:15.278986+0000","last_active":"2024-09-13T23:25:52.376137+0000","last_peered":"2024-09-13T23:25:52.376137+0000","last_clean":"2024-09-13T23:25:52.376137+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:25:52.376137+0000","last_undegraded":"2024-09-13T23:25:52.376137+0000","last_fullsized":"2024-09-13T23:25:52.376137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.729113+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.729113+0000","last_peered":"2024-09-13T23:28:22.729113+0000","last_clean":"2024-09-13T23:28:22.729113+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.729113+0000","last_undegraded":"2024-09-13T23:28:22.729113+0000","last_fullsized":"2024-09-13T23:28:22.729113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478144+0000","last_change":"2024-09-13T23:25:15.285560+0000","last_active":"2024-09-13T23:28:22.478144+0000","last_peered":"2024-09-13T23:28:22.478144+0000","last_clean":"2024-09-13T23:28:22.478144+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:28:22.478144+0000","last_undegraded":"2024-09-13T23:28:22.478144+0000","last_fullsized":"2024-09-13T23:28:22.478144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.422238+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:25:55.422238+0000","last_peered":"2024-09-13T23:25:55.422238+0000","last_clean":"2024-09-13T23:25:55.422238+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:25:55.422238+0000","last_undegraded":"2024-09-13T23:25:55.422238+0000","last_fullsized":"2024-09-13T23:25:55.422238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377262+0000","last_change":"2024-09-13T23:25:15.295677+0000","last_active":"2024-09-13T23:25:52.377262+0000","last_peered":"2024-09-13T23:25:52.377262+0000","last_clean":"2024-09-13T23:25:52.377262+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:25:52.377262+0000","last_undegraded":"2024-09-13T23:25:52.377262+0000","last_fullsized":"2024-09-13T23:25:52.377262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329947+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:27:28.329947+0000","last_peered":"2024-09-13T23:27:28.329947+0000","last_clean":"2024-09-13T23:27:28.329947+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:27:28.329947+0000","last_undegraded":"2024-09-13T23:27:28.329947+0000","last_fullsized":"2024-09-13T23:27:28.329947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:36.892250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379651+0000","last_change":"2024-09-13T23:25:15.287972+0000","last_active":"2024-09-13T23:25:52.379651+0000","last_peered":"2024-09-13T23:25:52.379651+0000","last_clean":"2024-09-13T23:25:52.379651+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:25:52.379651+0000","last_undegraded":"2024-09-13T23:25:52.379651+0000","last_fullsized":"2024-09-13T23:25:52.379651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383517+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:25:52.383517+0000","last_peered":"2024-09-13T23:25:52.383517+0000","last_clean":"2024-09-13T23:25:52.383517+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:25:52.383517+0000","last_undegraded":"2024-09-13T23:25:52.383517+0000","last_fullsized":"2024-09-13T23:25:52.383517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:21.475245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.399802+0000","last_change":"2024-09-13T23:25:15.289747+0000","last_active":"2024-09-13T23:27:18.399802+0000","last_peered":"2024-09-13T23:27:18.399802+0000","last_clean":"2024-09-13T23:27:18.399802+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:27:18.399802+0000","last_undegraded":"2024-09-13T23:27:18.399802+0000","last_fullsized":"2024-09-13T23:27:18.399802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:46.131004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:13.286270+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842922+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.842922+0000","last_peered":"2024-09-13T23:28:22.842922+0000","last_clean":"2024-09-13T23:28:22.842922+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.842922+0000","last_undegraded":"2024-09-13T23:28:22.842922+0000","last_fullsized":"2024-09-13T23:28:22.842922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380588+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:25:52.380588+0000","last_peered":"2024-09-13T23:25:52.380588+0000","last_clean":"2024-09-13T23:25:52.380588+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:25:52.380588+0000","last_undegraded":"2024-09-13T23:25:52.380588+0000","last_fullsized":"2024-09-13T23:25:52.380588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:43.556989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374102+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:25:52.374102+0000","last_peered":"2024-09-13T23:25:52.374102+0000","last_clean":"2024-09-13T23:25:52.374102+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:25:52.374102+0000","last_undegraded":"2024-09-13T23:25:52.374102+0000","last_fullsized":"2024-09-13T23:25:52.374102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:18.737876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733301+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.733301+0000","last_peered":"2024-09-13T23:28:22.733301+0000","last_clean":"2024-09-13T23:28:22.733301+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.733301+0000","last_undegraded":"2024-09-13T23:28:22.733301+0000","last_fullsized":"2024-09-13T23:28:22.733301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:36.329312+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:27:36.329312+0000","last_peered":"2024-09-13T23:27:36.329312+0000","last_clean":"2024-09-13T23:27:36.329312+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:27:36.329312+0000","last_undegraded":"2024-09-13T23:27:36.329312+0000","last_fullsized":"2024-09-13T23:27:36.329312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704225+0000","last_change":"2024-09-13T23:25:15.295660+0000","last_active":"2024-09-13T23:28:22.704225+0000","last_peered":"2024-09-13T23:28:22.704225+0000","last_clean":"2024-09-13T23:28:22.704225+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:28:22.704225+0000","last_undegraded":"2024-09-13T23:28:22.704225+0000","last_fullsized":"2024-09-13T23:28:22.704225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44616,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327224,"statfs":{"total":96636764160,"available":96591077376,"internally_reserved":0,"allocated":9494528,"data_stored":9168045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52708,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319132,"statfs":{"total":96636764160,"available":96582791168,"internally_reserved":0,"allocated":17780736,"data_stored":17508411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49248,"kb_used_data":13904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322592,"statfs":{"total":96636764160,"available":96586334208,"internally_reserved":0,"allocated":14237696,"data_stored":13950771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43908,"kb_used_data":12724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327932,"statfs":{"total":96636764160,"available":96591802368,"internally_reserved":0,"allocated":13029376,"data_stored":12725025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:28:29.960 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:28:30.086 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.084+0000 7fc1418ed640 1 Processor -- start 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.084+0000 7fc1418ed640 1 -- start start 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc1418ed640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc13c09a100 0x7fc13c133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc1418ed640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc13c09d3b0 con 0x7fc13c09bd50 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc1418ed640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc13c09c840 con 0x7fc13c09a100 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc13a7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc13c09a100 0x7fc13c133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc13affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc13c09bd50 0x7fc13c09c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40862/0 (socket says 172.21.15.43:40862) 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc13affd640 1 -- 172.21.15.43:0/1241592672 learned_addr learned my addr 172.21.15.43:0/1241592672 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc13a7fc640 1 -- 172.21.15.43:0/1241592672 >> v1:172.21.15.43:6789/0 conn(0x7fc13c09bd50 legacy=0x7fc13c09c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.087 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.085+0000 7fc13a7fc640 1 -- 172.21.15.43:0/1241592672 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c098230 con 0x7fc13c09a100 2024-09-13T23:28:30.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc13a7fc640 1 --2- 172.21.15.43:0/1241592672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c133da0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc130009720 tx=0x7fc13002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dcba712f3662d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc139ffb640 1 -- 172.21.15.43:0/1241592672 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc130037070 con 0x7fc13c09a100 2024-09-13T23:28:30.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc139ffb640 1 -- 172.21.15.43:0/1241592672 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc13002ad90 con 0x7fc13c09a100 2024-09-13T23:28:30.090 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc139ffb640 1 -- 172.21.15.43:0/1241592672 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc130032590 con 0x7fc13c09a100 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc1418ed640 1 -- 172.21.15.43:0/1241592672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 msgr2=0x7fc13c133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc1418ed640 1 --2- 172.21.15.43:0/1241592672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c133da0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc130009720 tx=0x7fc13002a110 comp rx=0 tx=0).stop 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc1418ed640 1 -- 172.21.15.43:0/1241592672 shutdown_connections 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.086+0000 7fc1418ed640 1 --2- 172.21.15.43:0/1241592672 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c133da0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.087+0000 7fc1418ed640 1 -- 172.21.15.43:0/1241592672 >> 172.21.15.43:0/1241592672 conn(0x7fc13c06d4a0 msgr2=0x7fc13c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.087+0000 7fc1418ed640 1 -- 172.21.15.43:0/1241592672 shutdown_connections 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.087+0000 7fc1418ed640 1 -- 172.21.15.43:0/1241592672 wait complete. 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.087+0000 7fc1418ed640 1 Processor -- start 2024-09-13T23:28:30.091 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc1418ed640 1 -- start start 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc1418ed640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc1418ed640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c134670 con 0x7fc13c09a100 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc13affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc13affd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34646/0 (socket says 172.21.15.43:34646) 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc13affd640 1 -- 172.21.15.43:0/3494970322 learned_addr learned my addr 172.21.15.43:0/3494970322 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:30.092 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc13affd640 1 -- 172.21.15.43:0/3494970322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c095540 con 0x7fc13c09a100 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc13affd640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c4a0 tx=0x7fc12c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.088+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c017070 con 0x7fc13c09a100 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.089+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c005c10 con 0x7fc13c09a100 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.089+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c0950a0 con 0x7fc13c09a100 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.089+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c007070 con 0x7fc13c09a100 2024-09-13T23:28:30.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.089+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c0963b0 con 0x7fc13c09a100 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.090+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc12c01a070 con 0x7fc13c09a100 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.090+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13c0008d0 con 0x7fc13c09a100 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.090+0000 7fc123fff640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 0x7fc12803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.090+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fc12c04aeb0 con 0x7fc13c09a100 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.090+0000 7fc13a7fc640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 0x7fc12803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.091+0000 7fc13a7fc640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 0x7fc12803a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc130034000 tx=0x7fc13002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.095 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.095+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc13c0963b0 con 0x7fc13c09a100 2024-09-13T23:28:30.269 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.268+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc13c074970 con 0x7fc1280382a0 2024-09-13T23:28:30.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.283+0000 7fc123fff640 1 -- 172.21.15.43:0/3494970322 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665575 (secure 0 0 0) 0x7fc13c074970 con 0x7fc1280382a0 2024-09-13T23:28:30.294 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:30.299 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 msgr2=0x7fc12803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 0x7fc12803a760 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc130034000 tx=0x7fc13002e000 comp rx=0 tx=0).stop 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 msgr2=0x7fc13c132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00c4a0 tx=0x7fc12c00c960 comp rx=0 tx=0).stop 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 shutdown_connections 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1280382a0 0x7fc12803a760 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 --2- 172.21.15.43:0/3494970322 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc13c09a100 0x7fc13c132880 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 >> 172.21.15.43:0/3494970322 conn(0x7fc13c06d4a0 msgr2=0x7fc13c096a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 shutdown_connections 2024-09-13T23:28:30.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.288+0000 7fc1418ed640 1 -- 172.21.15.43:0/3494970322 wait complete. 2024-09-13T23:28:30.303 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-13T23:28:29.355677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4861,"num_read_kb":4442,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190480,"kb_used_data":53264,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296880,"statfs":{"total":386547056640,"available":386352005120,"internally_reserved":0,"allocated":54542336,"data_stored":53352252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004485"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.326609+0000","last_change":"2024-09-13T23:25:13.287107+0000","last_active":"2024-09-13T23:28:22.326609+0000","last_peered":"2024-09-13T23:28:22.326609+0000","last_clean":"2024-09-13T23:28:22.326609+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:28:22.326609+0000","last_undegraded":"2024-09-13T23:28:22.326609+0000","last_fullsized":"2024-09-13T23:28:22.326609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697306+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.697306+0000","last_peered":"2024-09-13T23:28:22.697306+0000","last_clean":"2024-09-13T23:28:22.697306+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.697306+0000","last_undegraded":"2024-09-13T23:28:22.697306+0000","last_fullsized":"2024-09-13T23:28:22.697306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327060+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:27:21.327060+0000","last_peered":"2024-09-13T23:27:21.327060+0000","last_clean":"2024-09-13T23:27:21.327060+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:27:21.327060+0000","last_undegraded":"2024-09-13T23:27:21.327060+0000","last_fullsized":"2024-09-13T23:27:21.327060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:02.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.715133+0000","last_change":"2024-09-13T23:25:15.283513+0000","last_active":"2024-09-13T23:26:37.715133+0000","last_peered":"2024-09-13T23:26:37.715133+0000","last_clean":"2024-09-13T23:26:37.715133+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:26:37.715133+0000","last_undegraded":"2024-09-13T23:26:37.715133+0000","last_fullsized":"2024-09-13T23:26:37.715133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:19.716730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383611+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:25:52.383611+0000","last_peered":"2024-09-13T23:25:52.383611+0000","last_clean":"2024-09-13T23:25:52.383611+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:25:52.383611+0000","last_undegraded":"2024-09-13T23:25:52.383611+0000","last_fullsized":"2024-09-13T23:25:52.383611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:53.486874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697586+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.697586+0000","last_peered":"2024-09-13T23:28:22.697586+0000","last_clean":"2024-09-13T23:28:22.697586+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.697586+0000","last_undegraded":"2024-09-13T23:28:22.697586+0000","last_fullsized":"2024-09-13T23:28:22.697586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:44.489685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373408+0000","last_change":"2024-09-13T23:25:13.275095+0000","last_active":"2024-09-13T23:25:52.373408+0000","last_peered":"2024-09-13T23:25:52.373408+0000","last_clean":"2024-09-13T23:25:52.373408+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:25:52.373408+0000","last_undegraded":"2024-09-13T23:25:52.373408+0000","last_fullsized":"2024-09-13T23:25:52.373408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717114+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:26:37.717114+0000","last_peered":"2024-09-13T23:26:37.717114+0000","last_clean":"2024-09-13T23:26:37.717114+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:26:37.717114+0000","last_undegraded":"2024-09-13T23:26:37.717114+0000","last_fullsized":"2024-09-13T23:26:37.717114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:35.198533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376609+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:25:52.376609+0000","last_peered":"2024-09-13T23:25:52.376609+0000","last_clean":"2024-09-13T23:25:52.376609+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:25:52.376609+0000","last_undegraded":"2024-09-13T23:25:52.376609+0000","last_fullsized":"2024-09-13T23:25:52.376609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.491515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.917848+0000","last_change":"2024-09-13T23:25:15.285777+0000","last_active":"2024-09-13T23:25:55.917848+0000","last_peered":"2024-09-13T23:25:55.917848+0000","last_clean":"2024-09-13T23:25:55.917848+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:25:55.917848+0000","last_undegraded":"2024-09-13T23:25:55.917848+0000","last_fullsized":"2024-09-13T23:25:55.917848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372573+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:25:52.372573+0000","last_peered":"2024-09-13T23:25:52.372573+0000","last_clean":"2024-09-13T23:25:52.372573+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:25:52.372573+0000","last_undegraded":"2024-09-13T23:25:52.372573+0000","last_fullsized":"2024-09-13T23:25:52.372573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697189+0000","last_change":"2024-09-13T23:25:15.290172+0000","last_active":"2024-09-13T23:28:22.697189+0000","last_peered":"2024-09-13T23:28:22.697189+0000","last_clean":"2024-09-13T23:28:22.697189+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:22.697189+0000","last_undegraded":"2024-09-13T23:28:22.697189+0000","last_fullsized":"2024-09-13T23:28:22.697189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:16.423529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377367+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:25:52.377367+0000","last_peered":"2024-09-13T23:25:52.377367+0000","last_clean":"2024-09-13T23:25:52.377367+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:25:52.377367+0000","last_undegraded":"2024-09-13T23:25:52.377367+0000","last_fullsized":"2024-09-13T23:25:52.377367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374311+0000","last_change":"2024-09-13T23:25:15.288159+0000","last_active":"2024-09-13T23:28:22.374311+0000","last_peered":"2024-09-13T23:28:22.374311+0000","last_clean":"2024-09-13T23:28:22.374311+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:28:22.374311+0000","last_undegraded":"2024-09-13T23:28:22.374311+0000","last_fullsized":"2024-09-13T23:28:22.374311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.728590+0000","last_change":"2024-09-13T23:25:13.285351+0000","last_active":"2024-09-13T23:27:21.728590+0000","last_peered":"2024-09-13T23:27:21.728590+0000","last_clean":"2024-09-13T23:27:21.728590+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:27:21.728590+0000","last_undegraded":"2024-09-13T23:27:21.728590+0000","last_fullsized":"2024-09-13T23:27:21.728590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.816721+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:25:54.816721+0000","last_peered":"2024-09-13T23:25:54.816721+0000","last_clean":"2024-09-13T23:25:54.816721+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:25:54.816721+0000","last_undegraded":"2024-09-13T23:25:54.816721+0000","last_fullsized":"2024-09-13T23:25:54.816721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626345+0000","last_change":"2024-09-13T23:25:15.287032+0000","last_active":"2024-09-13T23:28:22.626345+0000","last_peered":"2024-09-13T23:28:22.626345+0000","last_clean":"2024-09-13T23:28:22.626345+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:28:22.626345+0000","last_undegraded":"2024-09-13T23:28:22.626345+0000","last_fullsized":"2024-09-13T23:28:22.626345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:16.113359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380456+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:25:52.380456+0000","last_peered":"2024-09-13T23:25:52.380456+0000","last_clean":"2024-09-13T23:25:52.380456+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:25:52.380456+0000","last_undegraded":"2024-09-13T23:25:52.380456+0000","last_fullsized":"2024-09-13T23:25:52.380456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871681+0000","last_change":"2024-09-13T23:25:15.287488+0000","last_active":"2024-09-13T23:27:21.871681+0000","last_peered":"2024-09-13T23:27:21.871681+0000","last_clean":"2024-09-13T23:27:21.871681+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:27:21.871681+0000","last_undegraded":"2024-09-13T23:27:21.871681+0000","last_fullsized":"2024-09-13T23:27:21.871681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376849+0000","last_change":"2024-09-13T23:25:13.286390+0000","last_active":"2024-09-13T23:25:52.376849+0000","last_peered":"2024-09-13T23:25:52.376849+0000","last_clean":"2024-09-13T23:25:52.376849+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:25:52.376849+0000","last_undegraded":"2024-09-13T23:25:52.376849+0000","last_fullsized":"2024-09-13T23:25:52.376849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625998+0000","last_change":"2024-09-13T23:25:15.284340+0000","last_active":"2024-09-13T23:28:22.625998+0000","last_peered":"2024-09-13T23:28:22.625998+0000","last_clean":"2024-09-13T23:28:22.625998+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:28:22.625998+0000","last_undegraded":"2024-09-13T23:28:22.625998+0000","last_fullsized":"2024-09-13T23:28:22.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:01.252262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.792366+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:25:54.792366+0000","last_peered":"2024-09-13T23:25:54.792366+0000","last_clean":"2024-09-13T23:25:54.792366+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:25:54.792366+0000","last_undegraded":"2024-09-13T23:25:54.792366+0000","last_fullsized":"2024-09-13T23:25:54.792366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:24.391365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.166890+0000","last_change":"2024-09-13T23:25:15.279035+0000","last_active":"2024-09-13T23:25:55.166890+0000","last_peered":"2024-09-13T23:25:55.166890+0000","last_clean":"2024-09-13T23:25:55.166890+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:25:55.166890+0000","last_undegraded":"2024-09-13T23:25:55.166890+0000","last_fullsized":"2024-09-13T23:25:55.166890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380325+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:25:52.380325+0000","last_peered":"2024-09-13T23:25:52.380325+0000","last_clean":"2024-09-13T23:25:52.380325+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:25:52.380325+0000","last_undegraded":"2024-09-13T23:25:52.380325+0000","last_fullsized":"2024-09-13T23:25:52.380325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373942+0000","last_change":"2024-09-13T23:25:15.280560+0000","last_active":"2024-09-13T23:25:52.373942+0000","last_peered":"2024-09-13T23:25:52.373942+0000","last_clean":"2024-09-13T23:25:52.373942+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:25:52.373942+0000","last_undegraded":"2024-09-13T23:25:52.373942+0000","last_fullsized":"2024-09-13T23:25:52.373942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375633+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:25:52.375633+0000","last_peered":"2024-09-13T23:25:52.375633+0000","last_clean":"2024-09-13T23:25:52.375633+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:25:52.375633+0000","last_undegraded":"2024-09-13T23:25:52.375633+0000","last_fullsized":"2024-09-13T23:25:52.375633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733254+0000","last_change":"2024-09-13T23:25:15.284594+0000","last_active":"2024-09-13T23:28:22.733254+0000","last_peered":"2024-09-13T23:28:22.733254+0000","last_clean":"2024-09-13T23:28:22.733254+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:28:22.733254+0000","last_undegraded":"2024-09-13T23:28:22.733254+0000","last_fullsized":"2024-09-13T23:28:22.733254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374584+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:25:52.374584+0000","last_peered":"2024-09-13T23:25:52.374584+0000","last_clean":"2024-09-13T23:25:52.374584+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:25:52.374584+0000","last_undegraded":"2024-09-13T23:25:52.374584+0000","last_fullsized":"2024-09-13T23:25:52.374584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:50.268744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.669461+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.669461+0000","last_peered":"2024-09-13T23:28:22.669461+0000","last_clean":"2024-09-13T23:28:22.669461+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.669461+0000","last_undegraded":"2024-09-13T23:28:22.669461+0000","last_fullsized":"2024-09-13T23:28:22.669461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:09.425167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374612+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.374612+0000","last_peered":"2024-09-13T23:28:22.374612+0000","last_clean":"2024-09-13T23:28:22.374612+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.374612+0000","last_undegraded":"2024-09-13T23:28:22.374612+0000","last_fullsized":"2024-09-13T23:28:22.374612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376199+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:25:52.376199+0000","last_peered":"2024-09-13T23:25:52.376199+0000","last_clean":"2024-09-13T23:25:52.376199+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:25:52.376199+0000","last_undegraded":"2024-09-13T23:25:52.376199+0000","last_fullsized":"2024-09-13T23:25:52.376199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:28.575656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381408+0000","last_change":"2024-09-13T23:25:17.289713+0000","last_active":"2024-09-13T23:25:52.381408+0000","last_peered":"2024-09-13T23:25:52.381408+0000","last_clean":"2024-09-13T23:25:52.381408+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:25:52.381408+0000","last_undegraded":"2024-09-13T23:25:52.381408+0000","last_fullsized":"2024-09-13T23:25:52.381408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:05.506988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.169401+0000","last_change":"2024-09-13T23:25:19.296863+0000","last_active":"2024-09-13T23:27:20.169401+0000","last_peered":"2024-09-13T23:27:20.169401+0000","last_clean":"2024-09-13T23:27:20.169401+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:27:20.169401+0000","last_undegraded":"2024-09-13T23:27:20.169401+0000","last_fullsized":"2024-09-13T23:27:20.169401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:01.662692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379495+0000","last_change":"2024-09-13T23:25:21.306129+0000","last_active":"2024-09-13T23:25:52.379495+0000","last_peered":"2024-09-13T23:25:52.379495+0000","last_clean":"2024-09-13T23:25:52.379495+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:25:52.379495+0000","last_undegraded":"2024-09-13T23:25:52.379495+0000","last_fullsized":"2024-09-13T23:25:52.379495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.723062+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:26:37.723062+0000","last_peered":"2024-09-13T23:26:37.723062+0000","last_clean":"2024-09-13T23:26:37.723062+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:26:37.723062+0000","last_undegraded":"2024-09-13T23:26:37.723062+0000","last_fullsized":"2024-09-13T23:26:37.723062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:42.589333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332392+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:27:43.332392+0000","last_peered":"2024-09-13T23:27:43.332392+0000","last_clean":"2024-09-13T23:27:43.332392+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:27:43.332392+0000","last_undegraded":"2024-09-13T23:27:43.332392+0000","last_fullsized":"2024-09-13T23:27:43.332392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:44.441287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372736+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:25:52.372736+0000","last_peered":"2024-09-13T23:25:52.372736+0000","last_clean":"2024-09-13T23:25:52.372736+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:25:52.372736+0000","last_undegraded":"2024-09-13T23:25:52.372736+0000","last_fullsized":"2024-09-13T23:25:52.372736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:53.316546+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:25:53.316546+0000","last_peered":"2024-09-13T23:25:53.316546+0000","last_clean":"2024-09-13T23:25:53.316546+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:25:53.316546+0000","last_undegraded":"2024-09-13T23:25:53.316546+0000","last_fullsized":"2024-09-13T23:25:53.316546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:09.831944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379403+0000","last_change":"2024-09-13T23:25:19.296507+0000","last_active":"2024-09-13T23:25:52.379403+0000","last_peered":"2024-09-13T23:25:52.379403+0000","last_clean":"2024-09-13T23:25:52.379403+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:25:52.379403+0000","last_undegraded":"2024-09-13T23:25:52.379403+0000","last_fullsized":"2024-09-13T23:25:52.379403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:51.134434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379082+0000","last_change":"2024-09-13T23:25:21.301362+0000","last_active":"2024-09-13T23:25:52.379082+0000","last_peered":"2024-09-13T23:25:52.379082+0000","last_clean":"2024-09-13T23:25:52.379082+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:25:52.379082+0000","last_undegraded":"2024-09-13T23:25:52.379082+0000","last_fullsized":"2024-09-13T23:25:52.379082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.481142+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.481142+0000","last_peered":"2024-09-13T23:28:22.481142+0000","last_clean":"2024-09-13T23:28:22.481142+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.481142+0000","last_undegraded":"2024-09-13T23:28:22.481142+0000","last_fullsized":"2024-09-13T23:28:22.481142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871746+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:21.871746+0000","last_peered":"2024-09-13T23:27:21.871746+0000","last_clean":"2024-09-13T23:27:21.871746+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:21.871746+0000","last_undegraded":"2024-09-13T23:27:21.871746+0000","last_fullsized":"2024-09-13T23:27:21.871746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:21.355304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379644+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:25:52.379644+0000","last_peered":"2024-09-13T23:25:52.379644+0000","last_clean":"2024-09-13T23:25:52.379644+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:25:52.379644+0000","last_undegraded":"2024-09-13T23:25:52.379644+0000","last_fullsized":"2024-09-13T23:25:52.379644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376883+0000","last_change":"2024-09-13T23:25:17.287013+0000","last_active":"2024-09-13T23:25:52.376883+0000","last_peered":"2024-09-13T23:25:52.376883+0000","last_clean":"2024-09-13T23:25:52.376883+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:25:52.376883+0000","last_undegraded":"2024-09-13T23:25:52.376883+0000","last_fullsized":"2024-09-13T23:25:52.376883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374464+0000","last_change":"2024-09-13T23:25:19.289864+0000","last_active":"2024-09-13T23:25:52.374464+0000","last_peered":"2024-09-13T23:25:52.374464+0000","last_clean":"2024-09-13T23:25:52.374464+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:25:52.374464+0000","last_undegraded":"2024-09-13T23:25:52.374464+0000","last_fullsized":"2024-09-13T23:25:52.374464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:38.226160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364768+0000","last_change":"2024-09-13T23:25:21.304299+0000","last_active":"2024-09-13T23:28:22.364768+0000","last_peered":"2024-09-13T23:28:22.364768+0000","last_clean":"2024-09-13T23:28:22.364768+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:22.364768+0000","last_undegraded":"2024-09-13T23:28:22.364768+0000","last_fullsized":"2024-09-13T23:28:22.364768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.160237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.172427+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:25:55.172427+0000","last_peered":"2024-09-13T23:25:55.172427+0000","last_clean":"2024-09-13T23:25:55.172427+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:25:55.172427+0000","last_undegraded":"2024-09-13T23:25:55.172427+0000","last_fullsized":"2024-09-13T23:25:55.172427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:34.976156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733291+0000","last_change":"2024-09-13T23:25:15.285324+0000","last_active":"2024-09-13T23:28:22.733291+0000","last_peered":"2024-09-13T23:28:22.733291+0000","last_clean":"2024-09-13T23:28:22.733291+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:22.733291+0000","last_undegraded":"2024-09-13T23:28:22.733291+0000","last_fullsized":"2024-09-13T23:28:22.733291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376181+0000","last_change":"2024-09-13T23:25:13.288918+0000","last_active":"2024-09-13T23:25:52.376181+0000","last_peered":"2024-09-13T23:25:52.376181+0000","last_clean":"2024-09-13T23:25:52.376181+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:25:52.376181+0000","last_undegraded":"2024-09-13T23:25:52.376181+0000","last_fullsized":"2024-09-13T23:25:52.376181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377072+0000","last_change":"2024-09-13T23:25:17.287813+0000","last_active":"2024-09-13T23:25:52.377072+0000","last_peered":"2024-09-13T23:25:52.377072+0000","last_clean":"2024-09-13T23:25:52.377072+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:25:52.377072+0000","last_undegraded":"2024-09-13T23:25:52.377072+0000","last_fullsized":"2024-09-13T23:25:52.377072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:01.764699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.164218+0000","last_change":"2024-09-13T23:25:19.291393+0000","last_active":"2024-09-13T23:27:20.164218+0000","last_peered":"2024-09-13T23:27:20.164218+0000","last_clean":"2024-09-13T23:27:20.164218+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:27:20.164218+0000","last_undegraded":"2024-09-13T23:27:20.164218+0000","last_fullsized":"2024-09-13T23:27:20.164218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:41.211829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.735967+0000","last_change":"2024-09-13T23:25:21.303172+0000","last_active":"2024-09-13T23:28:22.735967+0000","last_peered":"2024-09-13T23:28:22.735967+0000","last_clean":"2024-09-13T23:28:22.735967+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:22.735967+0000","last_undegraded":"2024-09-13T23:28:22.735967+0000","last_fullsized":"2024-09-13T23:28:22.735967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739506+0000","last_change":"2024-09-13T23:25:15.291664+0000","last_active":"2024-09-13T23:28:22.739506+0000","last_peered":"2024-09-13T23:28:22.739506+0000","last_clean":"2024-09-13T23:28:22.739506+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:22.739506+0000","last_undegraded":"2024-09-13T23:28:22.739506+0000","last_fullsized":"2024-09-13T23:28:22.739506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:54.160656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375841+0000","last_change":"2024-09-13T23:25:13.289874+0000","last_active":"2024-09-13T23:25:52.375841+0000","last_peered":"2024-09-13T23:25:52.375841+0000","last_clean":"2024-09-13T23:25:52.375841+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:25:52.375841+0000","last_undegraded":"2024-09-13T23:25:52.375841+0000","last_fullsized":"2024-09-13T23:25:52.375841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376161+0000","last_change":"2024-09-13T23:25:17.289113+0000","last_active":"2024-09-13T23:25:52.376161+0000","last_peered":"2024-09-13T23:25:52.376161+0000","last_clean":"2024-09-13T23:25:52.376161+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:25:52.376161+0000","last_undegraded":"2024-09-13T23:25:52.376161+0000","last_fullsized":"2024-09-13T23:25:52.376161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'40","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.173883+0000","last_change":"2024-09-13T23:25:19.297925+0000","last_active":"2024-09-13T23:27:20.173883+0000","last_peered":"2024-09-13T23:27:20.173883+0000","last_clean":"2024-09-13T23:27:20.173883+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:27:20.173883+0000","last_undegraded":"2024-09-13T23:27:20.173883+0000","last_fullsized":"2024-09-13T23:27:20.173883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374678+0000","last_change":"2024-09-13T23:25:21.301483+0000","last_active":"2024-09-13T23:25:52.374678+0000","last_peered":"2024-09-13T23:25:52.374678+0000","last_clean":"2024-09-13T23:25:52.374678+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:25:52.374678+0000","last_undegraded":"2024-09-13T23:25:52.374678+0000","last_fullsized":"2024-09-13T23:25:52.374678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:11.275595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.677351+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.677351+0000","last_peered":"2024-09-13T23:28:22.677351+0000","last_clean":"2024-09-13T23:28:22.677351+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.677351+0000","last_undegraded":"2024-09-13T23:28:22.677351+0000","last_fullsized":"2024-09-13T23:28:22.677351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:47.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871541+0000","last_change":"2024-09-13T23:25:15.285081+0000","last_active":"2024-09-13T23:27:21.871541+0000","last_peered":"2024-09-13T23:27:21.871541+0000","last_clean":"2024-09-13T23:27:21.871541+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:27:21.871541+0000","last_undegraded":"2024-09-13T23:27:21.871541+0000","last_fullsized":"2024-09-13T23:27:21.871541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329270+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:27:28.329270+0000","last_peered":"2024-09-13T23:27:28.329270+0000","last_clean":"2024-09-13T23:27:28.329270+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:27:28.329270+0000","last_undegraded":"2024-09-13T23:27:28.329270+0000","last_fullsized":"2024-09-13T23:27:28.329270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374895+0000","last_change":"2024-09-13T23:25:17.291228+0000","last_active":"2024-09-13T23:25:52.374895+0000","last_peered":"2024-09-13T23:25:52.374895+0000","last_clean":"2024-09-13T23:25:52.374895+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:25:52.374895+0000","last_undegraded":"2024-09-13T23:25:52.374895+0000","last_fullsized":"2024-09-13T23:25:52.374895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:35.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.153630+0000","last_change":"2024-09-13T23:25:19.294956+0000","last_active":"2024-09-13T23:27:20.153630+0000","last_peered":"2024-09-13T23:27:20.153630+0000","last_clean":"2024-09-13T23:27:20.153630+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:27:20.153630+0000","last_undegraded":"2024-09-13T23:27:20.153630+0000","last_fullsized":"2024-09-13T23:27:20.153630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:35.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374433+0000","last_change":"2024-09-13T23:25:21.308307+0000","last_active":"2024-09-13T23:25:52.374433+0000","last_peered":"2024-09-13T23:25:52.374433+0000","last_clean":"2024-09-13T23:25:52.374433+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:25:52.374433+0000","last_undegraded":"2024-09-13T23:25:52.374433+0000","last_fullsized":"2024-09-13T23:25:52.374433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:32.166331+0000","last_change":"2024-09-13T23:25:23.307544+0000","last_active":"2024-09-13T23:26:32.166331+0000","last_peered":"2024-09-13T23:26:32.166331+0000","last_clean":"2024-09-13T23:26:32.166331+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:26:32.166331+0000","last_undegraded":"2024-09-13T23:26:32.166331+0000","last_fullsized":"2024-09-13T23:26:32.166331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:10.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479224+0000","last_change":"2024-09-13T23:25:15.287305+0000","last_active":"2024-09-13T23:28:22.479224+0000","last_peered":"2024-09-13T23:28:22.479224+0000","last_clean":"2024-09-13T23:28:22.479224+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:28:22.479224+0000","last_undegraded":"2024-09-13T23:28:22.479224+0000","last_fullsized":"2024-09-13T23:28:22.479224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329978+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:27:28.329978+0000","last_peered":"2024-09-13T23:27:28.329978+0000","last_clean":"2024-09-13T23:27:28.329978+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:27:28.329978+0000","last_undegraded":"2024-09-13T23:27:28.329978+0000","last_fullsized":"2024-09-13T23:27:28.329978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:37.817951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:17.285971+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:54.021576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.175918+0000","last_change":"2024-09-13T23:25:19.299653+0000","last_active":"2024-09-13T23:27:20.175918+0000","last_peered":"2024-09-13T23:27:20.175918+0000","last_clean":"2024-09-13T23:27:20.175918+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:27:20.175918+0000","last_undegraded":"2024-09-13T23:27:20.175918+0000","last_fullsized":"2024-09-13T23:27:20.175918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:09.850559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":348,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:23.022818+0000","last_change":"2024-09-13T23:25:21.308757+0000","last_active":"2024-09-13T23:28:23.022818+0000","last_peered":"2024-09-13T23:28:23.022818+0000","last_clean":"2024-09-13T23:28:23.022818+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:23.022818+0000","last_undegraded":"2024-09-13T23:28:23.022818+0000","last_fullsized":"2024-09-13T23:28:23.022818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375463+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:25:52.375463+0000","last_peered":"2024-09-13T23:25:52.375463+0000","last_clean":"2024-09-13T23:25:52.375463+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:25:52.375463+0000","last_undegraded":"2024-09-13T23:25:52.375463+0000","last_fullsized":"2024-09-13T23:25:52.375463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.604079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.696828+0000","last_change":"2024-09-13T23:25:15.283264+0000","last_active":"2024-09-13T23:28:22.696828+0000","last_peered":"2024-09-13T23:28:22.696828+0000","last_clean":"2024-09-13T23:28:22.696828+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:22.696828+0000","last_undegraded":"2024-09-13T23:28:22.696828+0000","last_fullsized":"2024-09-13T23:28:22.696828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.390295+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:18.390295+0000","last_peered":"2024-09-13T23:27:18.390295+0000","last_clean":"2024-09-13T23:27:18.390295+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:18.390295+0000","last_undegraded":"2024-09-13T23:27:18.390295+0000","last_fullsized":"2024-09-13T23:27:18.390295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:32.413205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:17.286788+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:39.422715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.875706+0000","last_change":"2024-09-13T23:25:19.299651+0000","last_active":"2024-09-13T23:27:21.875706+0000","last_peered":"2024-09-13T23:27:21.875706+0000","last_clean":"2024-09-13T23:27:21.875706+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:27:21.875706+0000","last_undegraded":"2024-09-13T23:27:21.875706+0000","last_fullsized":"2024-09-13T23:27:21.875706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.439065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374591+0000","last_change":"2024-09-13T23:25:21.301614+0000","last_active":"2024-09-13T23:25:52.374591+0000","last_peered":"2024-09-13T23:25:52.374591+0000","last_clean":"2024-09-13T23:25:52.374591+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:25:52.374591+0000","last_undegraded":"2024-09-13T23:25:52.374591+0000","last_fullsized":"2024-09-13T23:25:52.374591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.962416+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.962416+0000","last_peered":"2024-09-13T23:28:22.962416+0000","last_clean":"2024-09-13T23:28:22.962416+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.962416+0000","last_undegraded":"2024-09-13T23:28:22.962416+0000","last_fullsized":"2024-09-13T23:28:22.962416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:22.720145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733331+0000","last_change":"2024-09-13T23:25:15.296722+0000","last_active":"2024-09-13T23:28:22.733331+0000","last_peered":"2024-09-13T23:28:22.733331+0000","last_clean":"2024-09-13T23:28:22.733331+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:22.733331+0000","last_undegraded":"2024-09-13T23:28:22.733331+0000","last_fullsized":"2024-09-13T23:28:22.733331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:38.000462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.414481+0000","last_change":"2024-09-13T23:25:13.283881+0000","last_active":"2024-09-13T23:25:55.414481+0000","last_peered":"2024-09-13T23:25:55.414481+0000","last_clean":"2024-09-13T23:25:55.414481+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:25:55.414481+0000","last_undegraded":"2024-09-13T23:25:55.414481+0000","last_fullsized":"2024-09-13T23:25:55.414481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:06.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374030+0000","last_change":"2024-09-13T23:25:17.285259+0000","last_active":"2024-09-13T23:25:52.374030+0000","last_peered":"2024-09-13T23:25:52.374030+0000","last_clean":"2024-09-13T23:25:52.374030+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:25:52.374030+0000","last_undegraded":"2024-09-13T23:25:52.374030+0000","last_fullsized":"2024-09-13T23:25:52.374030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:00.997313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.157664+0000","last_change":"2024-09-13T23:25:19.292957+0000","last_active":"2024-09-13T23:27:20.157664+0000","last_peered":"2024-09-13T23:27:20.157664+0000","last_clean":"2024-09-13T23:27:20.157664+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:27:20.157664+0000","last_undegraded":"2024-09-13T23:27:20.157664+0000","last_fullsized":"2024-09-13T23:27:20.157664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:36.621593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380477+0000","last_change":"2024-09-13T23:25:21.307942+0000","last_active":"2024-09-13T23:25:52.380477+0000","last_peered":"2024-09-13T23:25:52.380477+0000","last_clean":"2024-09-13T23:25:52.380477+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:25:52.380477+0000","last_undegraded":"2024-09-13T23:25:52.380477+0000","last_fullsized":"2024-09-13T23:25:52.380477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:57.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329045+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:27:23.329045+0000","last_peered":"2024-09-13T23:27:23.329045+0000","last_clean":"2024-09-13T23:27:23.329045+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:27:23.329045+0000","last_undegraded":"2024-09-13T23:27:23.329045+0000","last_fullsized":"2024-09-13T23:27:23.329045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:16.049837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697480+0000","last_change":"2024-09-13T23:25:15.290226+0000","last_active":"2024-09-13T23:28:22.697480+0000","last_peered":"2024-09-13T23:28:22.697480+0000","last_clean":"2024-09-13T23:28:22.697480+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:22.697480+0000","last_undegraded":"2024-09-13T23:28:22.697480+0000","last_fullsized":"2024-09-13T23:28:22.697480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:58.471027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376787+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:25:52.376787+0000","last_peered":"2024-09-13T23:25:52.376787+0000","last_clean":"2024-09-13T23:25:52.376787+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:25:52.376787+0000","last_undegraded":"2024-09-13T23:25:52.376787+0000","last_fullsized":"2024-09-13T23:25:52.376787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:34.681115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376818+0000","last_change":"2024-09-13T23:25:17.287240+0000","last_active":"2024-09-13T23:25:52.376818+0000","last_peered":"2024-09-13T23:25:52.376818+0000","last_clean":"2024-09-13T23:25:52.376818+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:25:52.376818+0000","last_undegraded":"2024-09-13T23:25:52.376818+0000","last_fullsized":"2024-09-13T23:25:52.376818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.184924+0000","last_change":"2024-09-13T23:25:19.289083+0000","last_active":"2024-09-13T23:27:20.184924+0000","last_peered":"2024-09-13T23:27:20.184924+0000","last_clean":"2024-09-13T23:27:20.184924+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:27:20.184924+0000","last_undegraded":"2024-09-13T23:27:20.184924+0000","last_fullsized":"2024-09-13T23:27:20.184924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:42.816869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":431,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966627+0000","last_change":"2024-09-13T23:25:21.302618+0000","last_active":"2024-09-13T23:28:22.966627+0000","last_peered":"2024-09-13T23:28:22.966627+0000","last_clean":"2024-09-13T23:28:22.966627+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:22.966627+0000","last_undegraded":"2024-09-13T23:28:22.966627+0000","last_fullsized":"2024-09-13T23:28:22.966627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:56.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328632+0000","last_change":"2024-09-13T23:25:23.302781+0000","last_active":"2024-09-13T23:27:31.328632+0000","last_peered":"2024-09-13T23:27:31.328632+0000","last_clean":"2024-09-13T23:27:31.328632+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:27:31.328632+0000","last_undegraded":"2024-09-13T23:27:31.328632+0000","last_fullsized":"2024-09-13T23:27:31.328632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:54.025813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.437139+0000","last_change":"2024-09-13T23:25:15.290988+0000","last_active":"2024-09-13T23:25:55.437139+0000","last_peered":"2024-09-13T23:25:55.437139+0000","last_clean":"2024-09-13T23:25:55.437139+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:25:55.437139+0000","last_undegraded":"2024-09-13T23:25:55.437139+0000","last_fullsized":"2024-09-13T23:25:55.437139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374910+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:25:52.374910+0000","last_peered":"2024-09-13T23:25:52.374910+0000","last_clean":"2024-09-13T23:25:52.374910+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:25:52.374910+0000","last_undegraded":"2024-09-13T23:25:52.374910+0000","last_fullsized":"2024-09-13T23:25:52.374910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:32.148141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282446+0000","last_change":"2024-09-13T23:25:17.288588+0000","last_active":"2024-09-13T23:27:21.282446+0000","last_peered":"2024-09-13T23:27:21.282446+0000","last_clean":"2024-09-13T23:27:21.282446+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:27:21.282446+0000","last_undegraded":"2024-09-13T23:27:21.282446+0000","last_fullsized":"2024-09-13T23:27:21.282446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:15.817722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330751+0000","last_change":"2024-09-13T23:25:19.298296+0000","last_active":"2024-09-13T23:27:33.330751+0000","last_peered":"2024-09-13T23:27:33.330751+0000","last_clean":"2024-09-13T23:27:33.330751+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:27:33.330751+0000","last_undegraded":"2024-09-13T23:27:33.330751+0000","last_fullsized":"2024-09-13T23:27:33.330751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:39.743432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":468,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.846586+0000","last_change":"2024-09-13T23:25:21.299515+0000","last_active":"2024-09-13T23:28:22.846586+0000","last_peered":"2024-09-13T23:28:22.846586+0000","last_clean":"2024-09-13T23:28:22.846586+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:22.846586+0000","last_undegraded":"2024-09-13T23:28:22.846586+0000","last_fullsized":"2024-09-13T23:28:22.846586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.844255+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.844255+0000","last_peered":"2024-09-13T23:28:22.844255+0000","last_clean":"2024-09-13T23:28:22.844255+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.844255+0000","last_undegraded":"2024-09-13T23:28:22.844255+0000","last_fullsized":"2024-09-13T23:28:22.844255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:46.511629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901641+0000","last_change":"2024-09-13T23:25:15.295321+0000","last_active":"2024-09-13T23:26:37.901641+0000","last_peered":"2024-09-13T23:26:37.901641+0000","last_clean":"2024-09-13T23:26:37.901641+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:26:37.901641+0000","last_undegraded":"2024-09-13T23:26:37.901641+0000","last_fullsized":"2024-09-13T23:26:37.901641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:07.615477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373680+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:25:52.373680+0000","last_peered":"2024-09-13T23:25:52.373680+0000","last_clean":"2024-09-13T23:25:52.373680+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:25:52.373680+0000","last_undegraded":"2024-09-13T23:25:52.373680+0000","last_fullsized":"2024-09-13T23:25:52.373680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:19.192252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376682+0000","last_change":"2024-09-13T23:25:17.288064+0000","last_active":"2024-09-13T23:25:52.376682+0000","last_peered":"2024-09-13T23:25:52.376682+0000","last_clean":"2024-09-13T23:25:52.376682+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:25:52.376682+0000","last_undegraded":"2024-09-13T23:25:52.376682+0000","last_fullsized":"2024-09-13T23:25:52.376682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:40.830361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.170472+0000","last_change":"2024-09-13T23:25:19.292186+0000","last_active":"2024-09-13T23:27:20.170472+0000","last_peered":"2024-09-13T23:27:20.170472+0000","last_clean":"2024-09-13T23:27:20.170472+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:27:20.170472+0000","last_undegraded":"2024-09-13T23:27:20.170472+0000","last_fullsized":"2024-09-13T23:27:20.170472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:33.111945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373673+0000","last_change":"2024-09-13T23:25:21.307481+0000","last_active":"2024-09-13T23:25:52.373673+0000","last_peered":"2024-09-13T23:25:52.373673+0000","last_clean":"2024-09-13T23:25:52.373673+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:25:52.373673+0000","last_undegraded":"2024-09-13T23:25:52.373673+0000","last_fullsized":"2024-09-13T23:25:52.373673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.794734+0000","last_change":"2024-09-13T23:25:23.303608+0000","last_active":"2024-09-13T23:28:22.794734+0000","last_peered":"2024-09-13T23:28:22.794734+0000","last_clean":"2024-09-13T23:28:22.794734+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:22.794734+0000","last_undegraded":"2024-09-13T23:28:22.794734+0000","last_fullsized":"2024-09-13T23:28:22.794734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.083983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901628+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:26:37.901628+0000","last_peered":"2024-09-13T23:26:37.901628+0000","last_clean":"2024-09-13T23:26:37.901628+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:26:37.901628+0000","last_undegraded":"2024-09-13T23:26:37.901628+0000","last_fullsized":"2024-09-13T23:26:37.901628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:01.400783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375969+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:25:52.375969+0000","last_peered":"2024-09-13T23:25:52.375969+0000","last_clean":"2024-09-13T23:25:52.375969+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:25:52.375969+0000","last_undegraded":"2024-09-13T23:25:52.375969+0000","last_fullsized":"2024-09-13T23:25:52.375969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:42.131218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376079+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:52.376079+0000","last_peered":"2024-09-13T23:25:52.376079+0000","last_clean":"2024-09-13T23:25:52.376079+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:52.376079+0000","last_undegraded":"2024-09-13T23:25:52.376079+0000","last_fullsized":"2024-09-13T23:25:52.376079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374353+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:25:52.374353+0000","last_peered":"2024-09-13T23:25:52.374353+0000","last_clean":"2024-09-13T23:25:52.374353+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:25:52.374353+0000","last_undegraded":"2024-09-13T23:25:52.374353+0000","last_fullsized":"2024-09-13T23:25:52.374353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:49.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378955+0000","last_change":"2024-09-13T23:25:17.286100+0000","last_active":"2024-09-13T23:25:52.378955+0000","last_peered":"2024-09-13T23:25:52.378955+0000","last_clean":"2024-09-13T23:25:52.378955+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:25:52.378955+0000","last_undegraded":"2024-09-13T23:25:52.378955+0000","last_fullsized":"2024-09-13T23:25:52.378955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:55.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'78","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.182700+0000","last_change":"2024-09-13T23:25:19.298079+0000","last_active":"2024-09-13T23:27:20.182700+0000","last_peered":"2024-09-13T23:27:20.182700+0000","last_clean":"2024-09-13T23:27:20.182700+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:27:20.182700+0000","last_undegraded":"2024-09-13T23:27:20.182700+0000","last_fullsized":"2024-09-13T23:27:20.182700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:28.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376686+0000","last_change":"2024-09-13T23:25:21.308687+0000","last_active":"2024-09-13T23:25:52.376686+0000","last_peered":"2024-09-13T23:25:52.376686+0000","last_clean":"2024-09-13T23:25:52.376686+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:25:52.376686+0000","last_undegraded":"2024-09-13T23:25:52.376686+0000","last_fullsized":"2024-09-13T23:25:52.376686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:09.375352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.742526+0000","last_change":"2024-09-13T23:25:23.304383+0000","last_active":"2024-09-13T23:28:22.742526+0000","last_peered":"2024-09-13T23:28:22.742526+0000","last_clean":"2024-09-13T23:28:22.742526+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:22.742526+0000","last_undegraded":"2024-09-13T23:28:22.742526+0000","last_fullsized":"2024-09-13T23:28:22.742526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:15.420600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382727+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.382727+0000","last_peered":"2024-09-13T23:28:22.382727+0000","last_clean":"2024-09-13T23:28:22.382727+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.382727+0000","last_undegraded":"2024-09-13T23:28:22.382727+0000","last_fullsized":"2024-09-13T23:28:22.382727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:49.591312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373570+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:52.373570+0000","last_peered":"2024-09-13T23:25:52.373570+0000","last_clean":"2024-09-13T23:25:52.373570+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:52.373570+0000","last_undegraded":"2024-09-13T23:25:52.373570+0000","last_fullsized":"2024-09-13T23:25:52.373570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326956+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:27:21.326956+0000","last_peered":"2024-09-13T23:27:21.326956+0000","last_clean":"2024-09-13T23:27:21.326956+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:27:21.326956+0000","last_undegraded":"2024-09-13T23:27:21.326956+0000","last_fullsized":"2024-09-13T23:27:21.326956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381102+0000","last_change":"2024-09-13T23:25:17.287907+0000","last_active":"2024-09-13T23:25:52.381102+0000","last_peered":"2024-09-13T23:25:52.381102+0000","last_clean":"2024-09-13T23:25:52.381102+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:25:52.381102+0000","last_undegraded":"2024-09-13T23:25:52.381102+0000","last_fullsized":"2024-09-13T23:25:52.381102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:39:37.373797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'273","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364547+0000","last_change":"2024-09-13T23:25:19.299249+0000","last_active":"2024-09-13T23:28:22.364547+0000","last_peered":"2024-09-13T23:28:22.364547+0000","last_clean":"2024-09-13T23:28:22.364547+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:22.364547+0000","last_undegraded":"2024-09-13T23:28:22.364547+0000","last_fullsized":"2024-09-13T23:28:22.364547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:54.251861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380330+0000","last_change":"2024-09-13T23:25:21.304037+0000","last_active":"2024-09-13T23:25:52.380330+0000","last_peered":"2024-09-13T23:25:52.380330+0000","last_clean":"2024-09-13T23:25:52.380330+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:25:52.380330+0000","last_undegraded":"2024-09-13T23:25:52.380330+0000","last_fullsized":"2024-09-13T23:25:52.380330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:34.562617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.721511+0000","last_change":"2024-09-13T23:25:23.308546+0000","last_active":"2024-09-13T23:26:37.721511+0000","last_peered":"2024-09-13T23:26:37.721511+0000","last_clean":"2024-09-13T23:26:37.721511+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:26:37.721511+0000","last_undegraded":"2024-09-13T23:26:37.721511+0000","last_fullsized":"2024-09-13T23:26:37.721511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:15.331780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374990+0000","last_change":"2024-09-13T23:25:15.285194+0000","last_active":"2024-09-13T23:28:22.374990+0000","last_peered":"2024-09-13T23:28:22.374990+0000","last_clean":"2024-09-13T23:28:22.374990+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:28:22.374990+0000","last_undegraded":"2024-09-13T23:28:22.374990+0000","last_fullsized":"2024-09-13T23:28:22.374990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372184+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:52.372184+0000","last_peered":"2024-09-13T23:25:52.372184+0000","last_clean":"2024-09-13T23:25:52.372184+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:52.372184+0000","last_undegraded":"2024-09-13T23:25:52.372184+0000","last_fullsized":"2024-09-13T23:25:52.372184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.889372+0000","last_change":"2024-09-13T23:25:13.287909+0000","last_active":"2024-09-13T23:26:37.889372+0000","last_peered":"2024-09-13T23:26:37.889372+0000","last_clean":"2024-09-13T23:26:37.889372+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:26:37.889372+0000","last_undegraded":"2024-09-13T23:26:37.889372+0000","last_fullsized":"2024-09-13T23:26:37.889372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282894+0000","last_change":"2024-09-13T23:25:17.283490+0000","last_active":"2024-09-13T23:27:21.282894+0000","last_peered":"2024-09-13T23:27:21.282894+0000","last_clean":"2024-09-13T23:27:21.282894+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:27:21.282894+0000","last_undegraded":"2024-09-13T23:27:21.282894+0000","last_fullsized":"2024-09-13T23:27:21.282894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364589+0000","last_change":"2024-09-13T23:25:19.293483+0000","last_active":"2024-09-13T23:28:22.364589+0000","last_peered":"2024-09-13T23:28:22.364589+0000","last_clean":"2024-09-13T23:28:22.364589+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:22.364589+0000","last_undegraded":"2024-09-13T23:28:22.364589+0000","last_fullsized":"2024-09-13T23:28:22.364589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:37.400352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375104+0000","last_change":"2024-09-13T23:25:21.302444+0000","last_active":"2024-09-13T23:25:52.375104+0000","last_peered":"2024-09-13T23:25:52.375104+0000","last_clean":"2024-09-13T23:25:52.375104+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:25:52.375104+0000","last_undegraded":"2024-09-13T23:25:52.375104+0000","last_fullsized":"2024-09-13T23:25:52.375104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:59.000917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.075118+0000","last_change":"2024-09-13T23:25:23.311768+0000","last_active":"2024-09-13T23:28:22.075118+0000","last_peered":"2024-09-13T23:28:22.075118+0000","last_clean":"2024-09-13T23:28:22.075118+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:28:22.075118+0000","last_undegraded":"2024-09-13T23:28:22.075118+0000","last_fullsized":"2024-09-13T23:28:22.075118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:53.775798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327023+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:27:21.327023+0000","last_peered":"2024-09-13T23:27:21.327023+0000","last_clean":"2024-09-13T23:27:21.327023+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:27:21.327023+0000","last_undegraded":"2024-09-13T23:27:21.327023+0000","last_fullsized":"2024-09-13T23:27:21.327023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374265+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:52.374265+0000","last_peered":"2024-09-13T23:25:52.374265+0000","last_clean":"2024-09-13T23:25:52.374265+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:52.374265+0000","last_undegraded":"2024-09-13T23:25:52.374265+0000","last_fullsized":"2024-09-13T23:25:52.374265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621755+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.621755+0000","last_peered":"2024-09-13T23:28:22.621755+0000","last_clean":"2024-09-13T23:28:22.621755+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.621755+0000","last_undegraded":"2024-09-13T23:28:22.621755+0000","last_fullsized":"2024-09-13T23:28:22.621755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376731+0000","last_change":"2024-09-13T23:25:17.285610+0000","last_active":"2024-09-13T23:25:52.376731+0000","last_peered":"2024-09-13T23:25:52.376731+0000","last_clean":"2024-09-13T23:25:52.376731+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:25:52.376731+0000","last_undegraded":"2024-09-13T23:25:52.376731+0000","last_fullsized":"2024-09-13T23:25:52.376731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:40.895440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.895417+0000","last_change":"2024-09-13T23:25:19.294517+0000","last_active":"2024-09-13T23:28:21.895417+0000","last_peered":"2024-09-13T23:28:21.895417+0000","last_clean":"2024-09-13T23:28:21.895417+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:21.895417+0000","last_undegraded":"2024-09-13T23:28:21.895417+0000","last_fullsized":"2024-09-13T23:28:21.895417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:57.792215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380367+0000","last_change":"2024-09-13T23:25:21.307983+0000","last_active":"2024-09-13T23:25:52.380367+0000","last_peered":"2024-09-13T23:25:52.380367+0000","last_clean":"2024-09-13T23:25:52.380367+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:25:52.380367+0000","last_undegraded":"2024-09-13T23:25:52.380367+0000","last_fullsized":"2024-09-13T23:25:52.380367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:49.287014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.505152+0000","last_change":"2024-09-13T23:25:23.314405+0000","last_active":"2024-09-13T23:27:21.505152+0000","last_peered":"2024-09-13T23:27:21.505152+0000","last_clean":"2024-09-13T23:27:21.505152+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:27:21.505152+0000","last_undegraded":"2024-09-13T23:27:21.505152+0000","last_fullsized":"2024-09-13T23:27:21.505152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:35.679328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871200+0000","last_change":"2024-09-13T23:25:15.295101+0000","last_active":"2024-09-13T23:27:21.871200+0000","last_peered":"2024-09-13T23:27:21.871200+0000","last_clean":"2024-09-13T23:27:21.871200+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:27:21.871200+0000","last_undegraded":"2024-09-13T23:27:21.871200+0000","last_fullsized":"2024-09-13T23:27:21.871200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374467+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:25:52.374467+0000","last_peered":"2024-09-13T23:25:52.374467+0000","last_clean":"2024-09-13T23:25:52.374467+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:25:52.374467+0000","last_undegraded":"2024-09-13T23:25:52.374467+0000","last_fullsized":"2024-09-13T23:25:52.374467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374857+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:52.374857+0000","last_peered":"2024-09-13T23:25:52.374857+0000","last_clean":"2024-09-13T23:25:52.374857+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:52.374857+0000","last_undegraded":"2024-09-13T23:25:52.374857+0000","last_fullsized":"2024-09-13T23:25:52.374857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326988+0000","last_change":"2024-09-13T23:25:17.285296+0000","last_active":"2024-09-13T23:27:21.326988+0000","last_peered":"2024-09-13T23:27:21.326988+0000","last_clean":"2024-09-13T23:27:21.326988+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:27:21.326988+0000","last_undegraded":"2024-09-13T23:27:21.326988+0000","last_fullsized":"2024-09-13T23:27:21.326988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:16.469594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'63","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326920+0000","last_change":"2024-09-13T23:25:19.298514+0000","last_active":"2024-09-13T23:27:21.326920+0000","last_peered":"2024-09-13T23:27:21.326920+0000","last_clean":"2024-09-13T23:27:21.326920+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:27:21.326920+0000","last_undegraded":"2024-09-13T23:27:21.326920+0000","last_fullsized":"2024-09-13T23:27:21.326920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:01.195077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372567+0000","last_change":"2024-09-13T23:25:21.301624+0000","last_active":"2024-09-13T23:25:52.372567+0000","last_peered":"2024-09-13T23:25:52.372567+0000","last_clean":"2024-09-13T23:25:52.372567+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:25:52.372567+0000","last_undegraded":"2024-09-13T23:25:52.372567+0000","last_fullsized":"2024-09-13T23:25:52.372567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:48.130925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.785277+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:21.785277+0000","last_peered":"2024-09-13T23:27:21.785277+0000","last_clean":"2024-09-13T23:27:21.785277+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:21.785277+0000","last_undegraded":"2024-09-13T23:27:21.785277+0000","last_fullsized":"2024-09-13T23:27:21.785277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:58.134248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899466+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:26:37.899466+0000","last_peered":"2024-09-13T23:26:37.899466+0000","last_clean":"2024-09-13T23:26:37.899466+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:26:37.899466+0000","last_undegraded":"2024-09-13T23:26:37.899466+0000","last_fullsized":"2024-09-13T23:26:37.899466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:00.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375170+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:25:52.375170+0000","last_peered":"2024-09-13T23:25:52.375170+0000","last_clean":"2024-09-13T23:25:52.375170+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:25:52.375170+0000","last_undegraded":"2024-09-13T23:25:52.375170+0000","last_fullsized":"2024-09-13T23:25:52.375170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382386+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:52.382386+0000","last_peered":"2024-09-13T23:25:52.382386+0000","last_clean":"2024-09-13T23:25:52.382386+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:52.382386+0000","last_undegraded":"2024-09-13T23:25:52.382386+0000","last_fullsized":"2024-09-13T23:25:52.382386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374660+0000","last_change":"2024-09-13T23:25:17.287023+0000","last_active":"2024-09-13T23:25:52.374660+0000","last_peered":"2024-09-13T23:25:52.374660+0000","last_clean":"2024-09-13T23:25:52.374660+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:25:52.374660+0000","last_undegraded":"2024-09-13T23:25:52.374660+0000","last_fullsized":"2024-09-13T23:25:52.374660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:07.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376436+0000","last_change":"2024-09-13T23:25:19.294335+0000","last_active":"2024-09-13T23:25:52.376436+0000","last_peered":"2024-09-13T23:25:52.376436+0000","last_clean":"2024-09-13T23:25:52.376436+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:25:52.376436+0000","last_undegraded":"2024-09-13T23:25:52.376436+0000","last_fullsized":"2024-09-13T23:25:52.376436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364508+0000","last_change":"2024-09-13T23:25:21.300733+0000","last_active":"2024-09-13T23:28:22.364508+0000","last_peered":"2024-09-13T23:28:22.364508+0000","last_clean":"2024-09-13T23:28:22.364508+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:22.364508+0000","last_undegraded":"2024-09-13T23:28:22.364508+0000","last_fullsized":"2024-09-13T23:28:22.364508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:13.414196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380261+0000","last_change":"2024-09-13T23:25:23.311239+0000","last_active":"2024-09-13T23:25:52.380261+0000","last_peered":"2024-09-13T23:25:52.380261+0000","last_clean":"2024-09-13T23:25:52.380261+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:25:52.380261+0000","last_undegraded":"2024-09-13T23:25:52.380261+0000","last_fullsized":"2024-09-13T23:25:52.380261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:01.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.634716+0000","last_change":"2024-09-13T23:25:15.291433+0000","last_active":"2024-09-13T23:28:22.634716+0000","last_peered":"2024-09-13T23:28:22.634716+0000","last_clean":"2024-09-13T23:28:22.634716+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:22.634716+0000","last_undegraded":"2024-09-13T23:28:22.634716+0000","last_fullsized":"2024-09-13T23:28:22.634716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:25.985146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.424804+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:25:55.424804+0000","last_peered":"2024-09-13T23:25:55.424804+0000","last_clean":"2024-09-13T23:25:55.424804+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:25:55.424804+0000","last_undegraded":"2024-09-13T23:25:55.424804+0000","last_fullsized":"2024-09-13T23:25:55.424804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:04.927068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375533+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:52.375533+0000","last_peered":"2024-09-13T23:25:52.375533+0000","last_clean":"2024-09-13T23:25:52.375533+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:52.375533+0000","last_undegraded":"2024-09-13T23:25:52.375533+0000","last_fullsized":"2024-09-13T23:25:52.375533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388035+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:25:52.388035+0000","last_peered":"2024-09-13T23:25:52.388035+0000","last_clean":"2024-09-13T23:25:52.388035+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:25:52.388035+0000","last_undegraded":"2024-09-13T23:25:52.388035+0000","last_fullsized":"2024-09-13T23:25:52.388035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:07.872328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329205+0000","last_change":"2024-09-13T23:25:19.295671+0000","last_active":"2024-09-13T23:27:23.329205+0000","last_peered":"2024-09-13T23:27:23.329205+0000","last_clean":"2024-09-13T23:27:23.329205+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:27:23.329205+0000","last_undegraded":"2024-09-13T23:27:23.329205+0000","last_fullsized":"2024-09-13T23:27:23.329205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.597972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":399,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.995385+0000","last_change":"2024-09-13T23:25:21.300629+0000","last_active":"2024-09-13T23:28:22.995385+0000","last_peered":"2024-09-13T23:28:22.995385+0000","last_clean":"2024-09-13T23:28:22.995385+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:22.995385+0000","last_undegraded":"2024-09-13T23:28:22.995385+0000","last_fullsized":"2024-09-13T23:28:22.995385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:24.498793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.431442+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:25:55.431442+0000","last_peered":"2024-09-13T23:25:55.431442+0000","last_clean":"2024-09-13T23:25:55.431442+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:25:55.431442+0000","last_undegraded":"2024-09-13T23:25:55.431442+0000","last_fullsized":"2024-09-13T23:25:55.431442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:10.438084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899058+0000","last_change":"2024-09-13T23:25:15.289794+0000","last_active":"2024-09-13T23:26:37.899058+0000","last_peered":"2024-09-13T23:26:37.899058+0000","last_clean":"2024-09-13T23:26:37.899058+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:26:37.899058+0000","last_undegraded":"2024-09-13T23:26:37.899058+0000","last_fullsized":"2024-09-13T23:26:37.899058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:15.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.619082+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.619082+0000","last_peered":"2024-09-13T23:28:22.619082+0000","last_clean":"2024-09-13T23:28:22.619082+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.619082+0000","last_undegraded":"2024-09-13T23:28:22.619082+0000","last_fullsized":"2024-09-13T23:28:22.619082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:09.098791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380490+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:52.380490+0000","last_peered":"2024-09-13T23:25:52.380490+0000","last_clean":"2024-09-13T23:25:52.380490+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:52.380490+0000","last_undegraded":"2024-09-13T23:25:52.380490+0000","last_fullsized":"2024-09-13T23:25:52.380490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388053+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:25:52.388053+0000","last_peered":"2024-09-13T23:25:52.388053+0000","last_clean":"2024-09-13T23:25:52.388053+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:25:52.388053+0000","last_undegraded":"2024-09-13T23:25:52.388053+0000","last_fullsized":"2024-09-13T23:25:52.388053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:53.886096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'83","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328394+0000","last_change":"2024-09-13T23:25:19.291785+0000","last_active":"2024-09-13T23:27:23.328394+0000","last_peered":"2024-09-13T23:27:23.328394+0000","last_clean":"2024-09-13T23:27:23.328394+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:27:23.328394+0000","last_undegraded":"2024-09-13T23:27:23.328394+0000","last_fullsized":"2024-09-13T23:27:23.328394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:19.764533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374724+0000","last_change":"2024-09-13T23:25:21.301723+0000","last_active":"2024-09-13T23:25:52.374724+0000","last_peered":"2024-09-13T23:25:52.374724+0000","last_clean":"2024-09-13T23:25:52.374724+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:25:52.374724+0000","last_undegraded":"2024-09-13T23:25:52.374724+0000","last_fullsized":"2024-09-13T23:25:52.374724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:00.977979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373401+0000","last_change":"2024-09-13T23:25:23.305632+0000","last_active":"2024-09-13T23:25:52.373401+0000","last_peered":"2024-09-13T23:25:52.373401+0000","last_clean":"2024-09-13T23:25:52.373401+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:25:52.373401+0000","last_undegraded":"2024-09-13T23:25:52.373401+0000","last_fullsized":"2024-09-13T23:25:52.373401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.047663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375073+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:25:52.375073+0000","last_peered":"2024-09-13T23:25:52.375073+0000","last_clean":"2024-09-13T23:25:52.375073+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:25:52.375073+0000","last_undegraded":"2024-09-13T23:25:52.375073+0000","last_fullsized":"2024-09-13T23:25:52.375073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:36.465581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479975+0000","last_change":"2024-09-13T23:25:15.289596+0000","last_active":"2024-09-13T23:28:22.479975+0000","last_peered":"2024-09-13T23:28:22.479975+0000","last_clean":"2024-09-13T23:28:22.479975+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:28:22.479975+0000","last_undegraded":"2024-09-13T23:28:22.479975+0000","last_fullsized":"2024-09-13T23:28:22.479975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.021512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375986+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:52.375986+0000","last_peered":"2024-09-13T23:25:52.375986+0000","last_clean":"2024-09-13T23:25:52.375986+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:25:52.375986+0000","last_undegraded":"2024-09-13T23:25:52.375986+0000","last_fullsized":"2024-09-13T23:25:52.375986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:40.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379392+0000","last_change":"2024-09-13T23:25:17.286995+0000","last_active":"2024-09-13T23:25:52.379392+0000","last_peered":"2024-09-13T23:25:52.379392+0000","last_clean":"2024-09-13T23:25:52.379392+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:25:52.379392+0000","last_undegraded":"2024-09-13T23:25:52.379392+0000","last_fullsized":"2024-09-13T23:25:52.379392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:28.543035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.174996+0000","last_change":"2024-09-13T23:25:19.299340+0000","last_active":"2024-09-13T23:27:20.174996+0000","last_peered":"2024-09-13T23:27:20.174996+0000","last_clean":"2024-09-13T23:27:20.174996+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:27:20.174996+0000","last_undegraded":"2024-09-13T23:27:20.174996+0000","last_fullsized":"2024-09-13T23:27:20.174996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:19.887611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374367+0000","last_change":"2024-09-13T23:25:21.306435+0000","last_active":"2024-09-13T23:25:52.374367+0000","last_peered":"2024-09-13T23:25:52.374367+0000","last_clean":"2024-09-13T23:25:52.374367+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:25:52.374367+0000","last_undegraded":"2024-09-13T23:25:52.374367+0000","last_fullsized":"2024-09-13T23:25:52.374367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.772839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:19.870950+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:19.870950+0000","last_peered":"2024-09-13T23:27:19.870950+0000","last_clean":"2024-09-13T23:27:19.870950+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:19.870950+0000","last_undegraded":"2024-09-13T23:27:19.870950+0000","last_fullsized":"2024-09-13T23:27:19.870950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:47.394971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739917+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.739917+0000","last_peered":"2024-09-13T23:28:22.739917+0000","last_clean":"2024-09-13T23:28:22.739917+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.739917+0000","last_undegraded":"2024-09-13T23:28:22.739917+0000","last_fullsized":"2024-09-13T23:28:22.739917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.848834+0000","last_change":"2024-09-13T23:25:13.287807+0000","last_active":"2024-09-13T23:27:21.848834+0000","last_peered":"2024-09-13T23:27:21.848834+0000","last_clean":"2024-09-13T23:27:21.848834+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:27:21.848834+0000","last_undegraded":"2024-09-13T23:27:21.848834+0000","last_fullsized":"2024-09-13T23:27:21.848834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379956+0000","last_change":"2024-09-13T23:25:17.287358+0000","last_active":"2024-09-13T23:25:52.379956+0000","last_peered":"2024-09-13T23:25:52.379956+0000","last_clean":"2024-09-13T23:25:52.379956+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:25:52.379956+0000","last_undegraded":"2024-09-13T23:25:52.379956+0000","last_fullsized":"2024-09-13T23:25:52.379956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:52.433067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900136+0000","last_change":"2024-09-13T23:25:19.290459+0000","last_active":"2024-09-13T23:28:21.900136+0000","last_peered":"2024-09-13T23:28:21.900136+0000","last_clean":"2024-09-13T23:28:21.900136+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:21.900136+0000","last_undegraded":"2024-09-13T23:28:21.900136+0000","last_fullsized":"2024-09-13T23:28:21.900136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:49.482704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372343+0000","last_change":"2024-09-13T23:25:21.308722+0000","last_active":"2024-09-13T23:25:52.372343+0000","last_peered":"2024-09-13T23:25:52.372343+0000","last_clean":"2024-09-13T23:25:52.372343+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:25:52.372343+0000","last_undegraded":"2024-09-13T23:25:52.372343+0000","last_fullsized":"2024-09-13T23:25:52.372343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:25.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.812141+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:25:54.812141+0000","last_peered":"2024-09-13T23:25:54.812141+0000","last_clean":"2024-09-13T23:25:54.812141+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:25:54.812141+0000","last_undegraded":"2024-09-13T23:25:54.812141+0000","last_fullsized":"2024-09-13T23:25:54.812141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:51.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478456+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.478456+0000","last_peered":"2024-09-13T23:28:22.478456+0000","last_clean":"2024-09-13T23:28:22.478456+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.478456+0000","last_undegraded":"2024-09-13T23:28:22.478456+0000","last_fullsized":"2024-09-13T23:28:22.478456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.815605+0000","last_change":"2024-09-13T23:25:13.286024+0000","last_active":"2024-09-13T23:27:21.815605+0000","last_peered":"2024-09-13T23:27:21.815605+0000","last_clean":"2024-09-13T23:27:21.815605+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:27:21.815605+0000","last_undegraded":"2024-09-13T23:27:21.815605+0000","last_fullsized":"2024-09-13T23:27:21.815605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.371452+0000","last_change":"2024-09-13T23:25:17.286907+0000","last_active":"2024-09-13T23:25:52.371452+0000","last_peered":"2024-09-13T23:25:52.371452+0000","last_clean":"2024-09-13T23:25:52.371452+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:25:52.371452+0000","last_undegraded":"2024-09-13T23:25:52.371452+0000","last_fullsized":"2024-09-13T23:25:52.371452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:40.004624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.028937+0000","last_change":"2024-09-13T23:25:19.293305+0000","last_active":"2024-09-13T23:28:22.028937+0000","last_peered":"2024-09-13T23:28:22.028937+0000","last_clean":"2024-09-13T23:28:22.028937+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:22.028937+0000","last_undegraded":"2024-09-13T23:28:22.028937+0000","last_fullsized":"2024-09-13T23:28:22.028937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:19.534065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375591+0000","last_change":"2024-09-13T23:25:21.299732+0000","last_active":"2024-09-13T23:25:52.375591+0000","last_peered":"2024-09-13T23:25:52.375591+0000","last_clean":"2024-09-13T23:25:52.375591+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:25:52.375591+0000","last_undegraded":"2024-09-13T23:25:52.375591+0000","last_fullsized":"2024-09-13T23:25:52.375591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:43.808950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625968+0000","last_change":"2024-09-13T23:25:15.291739+0000","last_active":"2024-09-13T23:28:22.625968+0000","last_peered":"2024-09-13T23:28:22.625968+0000","last_clean":"2024-09-13T23:28:22.625968+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:22.625968+0000","last_undegraded":"2024-09-13T23:28:22.625968+0000","last_fullsized":"2024-09-13T23:28:22.625968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:57.989606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380093+0000","last_change":"2024-09-13T23:25:13.288670+0000","last_active":"2024-09-13T23:25:52.380093+0000","last_peered":"2024-09-13T23:25:52.380093+0000","last_clean":"2024-09-13T23:25:52.380093+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:25:52.380093+0000","last_undegraded":"2024-09-13T23:25:52.380093+0000","last_fullsized":"2024-09-13T23:25:52.380093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379765+0000","last_change":"2024-09-13T23:25:17.289029+0000","last_active":"2024-09-13T23:25:52.379765+0000","last_peered":"2024-09-13T23:25:52.379765+0000","last_clean":"2024-09-13T23:25:52.379765+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:25:52.379765+0000","last_undegraded":"2024-09-13T23:25:52.379765+0000","last_fullsized":"2024-09-13T23:25:52.379765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.980532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.159963+0000","last_change":"2024-09-13T23:25:19.288912+0000","last_active":"2024-09-13T23:27:20.159963+0000","last_peered":"2024-09-13T23:27:20.159963+0000","last_clean":"2024-09-13T23:27:20.159963+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:27:20.159963+0000","last_undegraded":"2024-09-13T23:27:20.159963+0000","last_fullsized":"2024-09-13T23:27:20.159963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:42.902191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373575+0000","last_change":"2024-09-13T23:25:21.298721+0000","last_active":"2024-09-13T23:25:52.373575+0000","last_peered":"2024-09-13T23:25:52.373575+0000","last_clean":"2024-09-13T23:25:52.373575+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:25:52.373575+0000","last_undegraded":"2024-09-13T23:25:52.373575+0000","last_fullsized":"2024-09-13T23:25:52.373575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:35.119012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739696+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.739696+0000","last_peered":"2024-09-13T23:28:22.739696+0000","last_clean":"2024-09-13T23:28:22.739696+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.739696+0000","last_undegraded":"2024-09-13T23:28:22.739696+0000","last_fullsized":"2024-09-13T23:28:22.739696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:13.221204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373681+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:25:52.373681+0000","last_peered":"2024-09-13T23:25:52.373681+0000","last_clean":"2024-09-13T23:25:52.373681+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:25:52.373681+0000","last_undegraded":"2024-09-13T23:25:52.373681+0000","last_fullsized":"2024-09-13T23:25:52.373681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:04.176141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376297+0000","last_change":"2024-09-13T23:25:17.285736+0000","last_active":"2024-09-13T23:25:52.376297+0000","last_peered":"2024-09-13T23:25:52.376297+0000","last_clean":"2024-09-13T23:25:52.376297+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:25:52.376297+0000","last_undegraded":"2024-09-13T23:25:52.376297+0000","last_fullsized":"2024-09-13T23:25:52.376297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:51.331504+0000","last_change":"2024-09-13T23:25:19.290018+0000","last_active":"2024-09-13T23:27:51.331504+0000","last_peered":"2024-09-13T23:27:51.331504+0000","last_clean":"2024-09-13T23:27:51.331504+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:27:51.331504+0000","last_undegraded":"2024-09-13T23:27:51.331504+0000","last_fullsized":"2024-09-13T23:27:51.331504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.123858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374548+0000","last_change":"2024-09-13T23:25:21.300887+0000","last_active":"2024-09-13T23:25:52.374548+0000","last_peered":"2024-09-13T23:25:52.374548+0000","last_clean":"2024-09-13T23:25:52.374548+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:25:52.374548+0000","last_undegraded":"2024-09-13T23:25:52.374548+0000","last_fullsized":"2024-09-13T23:25:52.374548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:45.277378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.869223+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:21.869223+0000","last_peered":"2024-09-13T23:27:21.869223+0000","last_clean":"2024-09-13T23:27:21.869223+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:21.869223+0000","last_undegraded":"2024-09-13T23:27:21.869223+0000","last_fullsized":"2024-09-13T23:27:21.869223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:52.742462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.864009+0000","last_change":"2024-09-13T23:25:15.281867+0000","last_active":"2024-09-13T23:27:21.864009+0000","last_peered":"2024-09-13T23:27:21.864009+0000","last_clean":"2024-09-13T23:27:21.864009+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:27:21.864009+0000","last_undegraded":"2024-09-13T23:27:21.864009+0000","last_fullsized":"2024-09-13T23:27:21.864009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330940+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:27:38.330940+0000","last_peered":"2024-09-13T23:27:38.330940+0000","last_clean":"2024-09-13T23:27:38.330940+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:27:38.330940+0000","last_undegraded":"2024-09-13T23:27:38.330940+0000","last_fullsized":"2024-09-13T23:27:38.330940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:32.466032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375392+0000","last_change":"2024-09-13T23:25:17.282822+0000","last_active":"2024-09-13T23:25:52.375392+0000","last_peered":"2024-09-13T23:25:52.375392+0000","last_clean":"2024-09-13T23:25:52.375392+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:25:52.375392+0000","last_undegraded":"2024-09-13T23:25:52.375392+0000","last_fullsized":"2024-09-13T23:25:52.375392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:34.290866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.160935+0000","last_change":"2024-09-13T23:25:19.290348+0000","last_active":"2024-09-13T23:27:20.160935+0000","last_peered":"2024-09-13T23:27:20.160935+0000","last_clean":"2024-09-13T23:27:20.160935+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:27:20.160935+0000","last_undegraded":"2024-09-13T23:27:20.160935+0000","last_fullsized":"2024-09-13T23:27:20.160935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:41.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381331+0000","last_change":"2024-09-13T23:25:21.305428+0000","last_active":"2024-09-13T23:25:52.381331+0000","last_peered":"2024-09-13T23:25:52.381331+0000","last_clean":"2024-09-13T23:25:52.381331+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:25:52.381331+0000","last_undegraded":"2024-09-13T23:25:52.381331+0000","last_fullsized":"2024-09-13T23:25:52.381331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373824+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:25:52.373824+0000","last_peered":"2024-09-13T23:25:52.373824+0000","last_clean":"2024-09-13T23:25:52.373824+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:25:52.373824+0000","last_undegraded":"2024-09-13T23:25:52.373824+0000","last_fullsized":"2024-09-13T23:25:52.373824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:45.821221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717093+0000","last_change":"2024-09-13T23:25:15.290421+0000","last_active":"2024-09-13T23:26:37.717093+0000","last_peered":"2024-09-13T23:26:37.717093+0000","last_clean":"2024-09-13T23:26:37.717093+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:26:37.717093+0000","last_undegraded":"2024-09-13T23:26:37.717093+0000","last_fullsized":"2024-09-13T23:26:37.717093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:22.137388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.272409+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:25:54.272409+0000","last_peered":"2024-09-13T23:25:54.272409+0000","last_clean":"2024-09-13T23:25:54.272409+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:25:54.272409+0000","last_undegraded":"2024-09-13T23:25:54.272409+0000","last_fullsized":"2024-09-13T23:25:54.272409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.272703+0000","last_change":"2024-09-13T23:25:17.282523+0000","last_active":"2024-09-13T23:27:21.272703+0000","last_peered":"2024-09-13T23:27:21.272703+0000","last_clean":"2024-09-13T23:27:21.272703+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:27:21.272703+0000","last_undegraded":"2024-09-13T23:27:21.272703+0000","last_fullsized":"2024-09-13T23:27:21.272703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:09.619639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.178897+0000","last_change":"2024-09-13T23:25:19.295026+0000","last_active":"2024-09-13T23:27:20.178897+0000","last_peered":"2024-09-13T23:27:20.178897+0000","last_clean":"2024-09-13T23:27:20.178897+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:27:20.178897+0000","last_undegraded":"2024-09-13T23:27:20.178897+0000","last_fullsized":"2024-09-13T23:27:20.178897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375400+0000","last_change":"2024-09-13T23:25:21.301455+0000","last_active":"2024-09-13T23:25:52.375400+0000","last_peered":"2024-09-13T23:25:52.375400+0000","last_clean":"2024-09-13T23:25:52.375400+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:25:52.375400+0000","last_undegraded":"2024-09-13T23:25:52.375400+0000","last_fullsized":"2024-09-13T23:25:52.375400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:40.147072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.394588+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.394588+0000","last_peered":"2024-09-13T23:28:22.394588+0000","last_clean":"2024-09-13T23:28:22.394588+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.394588+0000","last_undegraded":"2024-09-13T23:28:22.394588+0000","last_fullsized":"2024-09-13T23:28:22.394588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.414979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.376519+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.376519+0000","last_peered":"2024-09-13T23:28:22.376519+0000","last_clean":"2024-09-13T23:28:22.376519+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.376519+0000","last_undegraded":"2024-09-13T23:28:22.376519+0000","last_fullsized":"2024-09-13T23:28:22.376519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613616+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.613616+0000","last_peered":"2024-09-13T23:28:22.613616+0000","last_clean":"2024-09-13T23:28:22.613616+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.613616+0000","last_undegraded":"2024-09-13T23:28:22.613616+0000","last_fullsized":"2024-09-13T23:28:22.613616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:20.499420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380719+0000","last_change":"2024-09-13T23:25:17.285551+0000","last_active":"2024-09-13T23:25:52.380719+0000","last_peered":"2024-09-13T23:25:52.380719+0000","last_clean":"2024-09-13T23:25:52.380719+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:25:52.380719+0000","last_undegraded":"2024-09-13T23:25:52.380719+0000","last_fullsized":"2024-09-13T23:25:52.380719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.219409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.818061+0000","last_change":"2024-09-13T23:25:19.294499+0000","last_active":"2024-09-13T23:25:54.818061+0000","last_peered":"2024-09-13T23:25:54.818061+0000","last_clean":"2024-09-13T23:25:54.818061+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:25:54.818061+0000","last_undegraded":"2024-09-13T23:25:54.818061+0000","last_fullsized":"2024-09-13T23:25:54.818061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:06.976502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364507+0000","last_change":"2024-09-13T23:25:21.304914+0000","last_active":"2024-09-13T23:28:22.364507+0000","last_peered":"2024-09-13T23:28:22.364507+0000","last_clean":"2024-09-13T23:28:22.364507+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:22.364507+0000","last_undegraded":"2024-09-13T23:28:22.364507+0000","last_fullsized":"2024-09-13T23:28:22.364507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:11.529972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373312+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:25:52.373312+0000","last_peered":"2024-09-13T23:25:52.373312+0000","last_clean":"2024-09-13T23:25:52.373312+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:25:52.373312+0000","last_undegraded":"2024-09-13T23:25:52.373312+0000","last_fullsized":"2024-09-13T23:25:52.373312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:54.970107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626042+0000","last_change":"2024-09-13T23:25:15.286332+0000","last_active":"2024-09-13T23:28:22.626042+0000","last_peered":"2024-09-13T23:28:22.626042+0000","last_clean":"2024-09-13T23:28:22.626042+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:22.626042+0000","last_undegraded":"2024-09-13T23:28:22.626042+0000","last_fullsized":"2024-09-13T23:28:22.626042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:34:15.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380462+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:25:52.380462+0000","last_peered":"2024-09-13T23:25:52.380462+0000","last_clean":"2024-09-13T23:25:52.380462+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:25:52.380462+0000","last_undegraded":"2024-09-13T23:25:52.380462+0000","last_fullsized":"2024-09-13T23:25:52.380462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379838+0000","last_change":"2024-09-13T23:25:17.286289+0000","last_active":"2024-09-13T23:25:52.379838+0000","last_peered":"2024-09-13T23:25:52.379838+0000","last_clean":"2024-09-13T23:25:52.379838+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:25:52.379838+0000","last_undegraded":"2024-09-13T23:25:52.379838+0000","last_fullsized":"2024-09-13T23:25:52.379838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.151515+0000","last_change":"2024-09-13T23:25:19.296410+0000","last_active":"2024-09-13T23:27:20.151515+0000","last_peered":"2024-09-13T23:27:20.151515+0000","last_clean":"2024-09-13T23:27:20.151515+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:27:20.151515+0000","last_undegraded":"2024-09-13T23:27:20.151515+0000","last_fullsized":"2024-09-13T23:27:20.151515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:43.270311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373670+0000","last_change":"2024-09-13T23:25:21.307423+0000","last_active":"2024-09-13T23:25:52.373670+0000","last_peered":"2024-09-13T23:25:52.373670+0000","last_clean":"2024-09-13T23:25:52.373670+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:25:52.373670+0000","last_undegraded":"2024-09-13T23:25:52.373670+0000","last_fullsized":"2024-09-13T23:25:52.373670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379286+0000","last_change":"2024-09-13T23:25:23.309558+0000","last_active":"2024-09-13T23:25:52.379286+0000","last_peered":"2024-09-13T23:25:52.379286+0000","last_clean":"2024-09-13T23:25:52.379286+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:25:52.379286+0000","last_undegraded":"2024-09-13T23:25:52.379286+0000","last_fullsized":"2024-09-13T23:25:52.379286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372351+0000","last_change":"2024-09-13T23:25:15.279688+0000","last_active":"2024-09-13T23:25:52.372351+0000","last_peered":"2024-09-13T23:25:52.372351+0000","last_clean":"2024-09-13T23:25:52.372351+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:25:52.372351+0000","last_undegraded":"2024-09-13T23:25:52.372351+0000","last_fullsized":"2024-09-13T23:25:52.372351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382669+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:25:52.382669+0000","last_peered":"2024-09-13T23:25:52.382669+0000","last_clean":"2024-09-13T23:25:52.382669+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:25:52.382669+0000","last_undegraded":"2024-09-13T23:25:52.382669+0000","last_fullsized":"2024-09-13T23:25:52.382669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:10.620559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373525+0000","last_change":"2024-09-13T23:25:17.285313+0000","last_active":"2024-09-13T23:25:52.373525+0000","last_peered":"2024-09-13T23:25:52.373525+0000","last_clean":"2024-09-13T23:25:52.373525+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:25:52.373525+0000","last_undegraded":"2024-09-13T23:25:52.373525+0000","last_fullsized":"2024-09-13T23:25:52.373525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:03.256424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.152651+0000","last_change":"2024-09-13T23:25:19.298312+0000","last_active":"2024-09-13T23:27:20.152651+0000","last_peered":"2024-09-13T23:27:20.152651+0000","last_clean":"2024-09-13T23:27:20.152651+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:27:20.152651+0000","last_undegraded":"2024-09-13T23:27:20.152651+0000","last_fullsized":"2024-09-13T23:27:20.152651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:23.503939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374897+0000","last_change":"2024-09-13T23:25:21.306963+0000","last_active":"2024-09-13T23:25:52.374897+0000","last_peered":"2024-09-13T23:25:52.374897+0000","last_clean":"2024-09-13T23:25:52.374897+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:25:52.374897+0000","last_undegraded":"2024-09-13T23:25:52.374897+0000","last_fullsized":"2024-09-13T23:25:52.374897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.701389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.896491+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:26:37.896491+0000","last_peered":"2024-09-13T23:26:37.896491+0000","last_clean":"2024-09-13T23:26:37.896491+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:26:37.896491+0000","last_undegraded":"2024-09-13T23:26:37.896491+0000","last_fullsized":"2024-09-13T23:26:37.896491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.998081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697384+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.697384+0000","last_peered":"2024-09-13T23:28:22.697384+0000","last_clean":"2024-09-13T23:28:22.697384+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.697384+0000","last_undegraded":"2024-09-13T23:28:22.697384+0000","last_fullsized":"2024-09-13T23:28:22.697384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:03.357373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616400+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.616400+0000","last_peered":"2024-09-13T23:28:22.616400+0000","last_clean":"2024-09-13T23:28:22.616400+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.616400+0000","last_undegraded":"2024-09-13T23:28:22.616400+0000","last_fullsized":"2024-09-13T23:28:22.616400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:10.971868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378929+0000","last_change":"2024-09-13T23:25:17.289277+0000","last_active":"2024-09-13T23:25:52.378929+0000","last_peered":"2024-09-13T23:25:52.378929+0000","last_clean":"2024-09-13T23:25:52.378929+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:25:52.378929+0000","last_undegraded":"2024-09-13T23:25:52.378929+0000","last_fullsized":"2024-09-13T23:25:52.378929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:40.810119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'26","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.176935+0000","last_change":"2024-09-13T23:25:19.294964+0000","last_active":"2024-09-13T23:27:20.176935+0000","last_peered":"2024-09-13T23:27:20.176935+0000","last_clean":"2024-09-13T23:27:20.176935+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:27:20.176935+0000","last_undegraded":"2024-09-13T23:27:20.176935+0000","last_fullsized":"2024-09-13T23:27:20.176935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:15.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374493+0000","last_change":"2024-09-13T23:25:21.305087+0000","last_active":"2024-09-13T23:25:52.374493+0000","last_peered":"2024-09-13T23:25:52.374493+0000","last_clean":"2024-09-13T23:25:52.374493+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:25:52.374493+0000","last_undegraded":"2024-09-13T23:25:52.374493+0000","last_fullsized":"2024-09-13T23:25:52.374493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:44.058731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.187340+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:20.187340+0000","last_peered":"2024-09-13T23:27:20.187340+0000","last_clean":"2024-09-13T23:27:20.187340+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:20.187340+0000","last_undegraded":"2024-09-13T23:27:20.187340+0000","last_fullsized":"2024-09-13T23:27:20.187340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:43.115277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632608+0000","last_change":"2024-09-13T23:25:15.286878+0000","last_active":"2024-09-13T23:28:22.632608+0000","last_peered":"2024-09-13T23:28:22.632608+0000","last_clean":"2024-09-13T23:28:22.632608+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:22.632608+0000","last_undegraded":"2024-09-13T23:28:22.632608+0000","last_fullsized":"2024-09-13T23:28:22.632608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:37.878923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381505+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:25:52.381505+0000","last_peered":"2024-09-13T23:25:52.381505+0000","last_clean":"2024-09-13T23:25:52.381505+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:25:52.381505+0000","last_undegraded":"2024-09-13T23:25:52.381505+0000","last_fullsized":"2024-09-13T23:25:52.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.774635+0000","last_change":"2024-09-13T23:25:17.290217+0000","last_active":"2024-09-13T23:27:18.774635+0000","last_peered":"2024-09-13T23:27:18.774635+0000","last_clean":"2024-09-13T23:27:18.774635+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:27:18.774635+0000","last_undegraded":"2024-09-13T23:27:18.774635+0000","last_fullsized":"2024-09-13T23:27:18.774635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900968+0000","last_change":"2024-09-13T23:25:19.294973+0000","last_active":"2024-09-13T23:28:21.900968+0000","last_peered":"2024-09-13T23:28:21.900968+0000","last_clean":"2024-09-13T23:28:21.900968+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:21.900968+0000","last_undegraded":"2024-09-13T23:28:21.900968+0000","last_fullsized":"2024-09-13T23:28:21.900968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:49.482309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374666+0000","last_change":"2024-09-13T23:25:21.307475+0000","last_active":"2024-09-13T23:25:52.374666+0000","last_peered":"2024-09-13T23:25:52.374666+0000","last_clean":"2024-09-13T23:25:52.374666+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:25:52.374666+0000","last_undegraded":"2024-09-13T23:25:52.374666+0000","last_fullsized":"2024-09-13T23:25:52.374666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:24.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.699992+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.699992+0000","last_peered":"2024-09-13T23:28:22.699992+0000","last_clean":"2024-09-13T23:28:22.699992+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.699992+0000","last_undegraded":"2024-09-13T23:28:22.699992+0000","last_fullsized":"2024-09-13T23:28:22.699992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:57.777775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626210+0000","last_change":"2024-09-13T23:25:15.296960+0000","last_active":"2024-09-13T23:28:22.626210+0000","last_peered":"2024-09-13T23:28:22.626210+0000","last_clean":"2024-09-13T23:28:22.626210+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:22.626210+0000","last_undegraded":"2024-09-13T23:28:22.626210+0000","last_fullsized":"2024-09-13T23:28:22.626210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:32.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.610521+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.610521+0000","last_peered":"2024-09-13T23:28:22.610521+0000","last_clean":"2024-09-13T23:28:22.610521+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.610521+0000","last_undegraded":"2024-09-13T23:28:22.610521+0000","last_fullsized":"2024-09-13T23:28:22.610521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733334+0000","last_change":"2024-09-13T23:25:15.285164+0000","last_active":"2024-09-13T23:28:22.733334+0000","last_peered":"2024-09-13T23:28:22.733334+0000","last_clean":"2024-09-13T23:28:22.733334+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:28:22.733334+0000","last_undegraded":"2024-09-13T23:28:22.733334+0000","last_fullsized":"2024-09-13T23:28:22.733334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374101+0000","last_change":"2024-09-13T23:25:13.281843+0000","last_active":"2024-09-13T23:25:52.374101+0000","last_peered":"2024-09-13T23:25:52.374101+0000","last_clean":"2024-09-13T23:25:52.374101+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:25:52.374101+0000","last_undegraded":"2024-09-13T23:25:52.374101+0000","last_fullsized":"2024-09-13T23:25:52.374101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626100+0000","last_change":"2024-09-13T23:25:15.280336+0000","last_active":"2024-09-13T23:28:22.626100+0000","last_peered":"2024-09-13T23:28:22.626100+0000","last_clean":"2024-09-13T23:28:22.626100+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:28:22.626100+0000","last_undegraded":"2024-09-13T23:28:22.626100+0000","last_fullsized":"2024-09-13T23:28:22.626100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:33.711819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374801+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:25:52.374801+0000","last_peered":"2024-09-13T23:25:52.374801+0000","last_clean":"2024-09-13T23:25:52.374801+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:25:52.374801+0000","last_undegraded":"2024-09-13T23:25:52.374801+0000","last_fullsized":"2024-09-13T23:25:52.374801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733197+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.733197+0000","last_peered":"2024-09-13T23:28:22.733197+0000","last_clean":"2024-09-13T23:28:22.733197+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.733197+0000","last_undegraded":"2024-09-13T23:28:22.733197+0000","last_fullsized":"2024-09-13T23:28:22.733197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375346+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:25:52.375346+0000","last_peered":"2024-09-13T23:25:52.375346+0000","last_clean":"2024-09-13T23:25:52.375346+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:25:52.375346+0000","last_undegraded":"2024-09-13T23:25:52.375346+0000","last_fullsized":"2024-09-13T23:25:52.375346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.400507+0000","last_change":"2024-09-13T23:25:15.278977+0000","last_active":"2024-09-13T23:27:18.400507+0000","last_peered":"2024-09-13T23:27:18.400507+0000","last_clean":"2024-09-13T23:27:18.400507+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:27:18.400507+0000","last_undegraded":"2024-09-13T23:27:18.400507+0000","last_fullsized":"2024-09-13T23:27:18.400507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375434+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:25:52.375434+0000","last_peered":"2024-09-13T23:25:52.375434+0000","last_clean":"2024-09-13T23:25:52.375434+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:25:52.375434+0000","last_undegraded":"2024-09-13T23:25:52.375434+0000","last_fullsized":"2024-09-13T23:25:52.375434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871609+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:21.871609+0000","last_peered":"2024-09-13T23:27:21.871609+0000","last_clean":"2024-09-13T23:27:21.871609+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:21.871609+0000","last_undegraded":"2024-09-13T23:27:21.871609+0000","last_fullsized":"2024-09-13T23:27:21.871609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:04.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.273183+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:25:54.273183+0000","last_peered":"2024-09-13T23:25:54.273183+0000","last_clean":"2024-09-13T23:25:54.273183+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:25:54.273183+0000","last_undegraded":"2024-09-13T23:25:54.273183+0000","last_fullsized":"2024-09-13T23:25:54.273183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697112+0000","last_change":"2024-09-13T23:25:15.286489+0000","last_active":"2024-09-13T23:28:22.697112+0000","last_peered":"2024-09-13T23:28:22.697112+0000","last_clean":"2024-09-13T23:28:22.697112+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:22.697112+0000","last_undegraded":"2024-09-13T23:28:22.697112+0000","last_fullsized":"2024-09-13T23:28:22.697112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.384574+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:25:52.384574+0000","last_peered":"2024-09-13T23:25:52.384574+0000","last_clean":"2024-09-13T23:25:52.384574+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:25:52.384574+0000","last_undegraded":"2024-09-13T23:25:52.384574+0000","last_fullsized":"2024-09-13T23:25:52.384574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:08.828451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697025+0000","last_change":"2024-09-13T23:25:15.287524+0000","last_active":"2024-09-13T23:28:22.697025+0000","last_peered":"2024-09-13T23:28:22.697025+0000","last_clean":"2024-09-13T23:28:22.697025+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:28:22.697025+0000","last_undegraded":"2024-09-13T23:28:22.697025+0000","last_fullsized":"2024-09-13T23:28:22.697025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.417154+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:55.417154+0000","last_peered":"2024-09-13T23:25:55.417154+0000","last_clean":"2024-09-13T23:25:55.417154+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:25:55.417154+0000","last_undegraded":"2024-09-13T23:25:55.417154+0000","last_fullsized":"2024-09-13T23:25:55.417154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:41.876893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381077+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:25:52.381077+0000","last_peered":"2024-09-13T23:25:52.381077+0000","last_clean":"2024-09-13T23:25:52.381077+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:25:52.381077+0000","last_undegraded":"2024-09-13T23:25:52.381077+0000","last_fullsized":"2024-09-13T23:25:52.381077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.721411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373889+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:25:52.373889+0000","last_peered":"2024-09-13T23:25:52.373889+0000","last_clean":"2024-09-13T23:25:52.373889+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:25:52.373889+0000","last_undegraded":"2024-09-13T23:25:52.373889+0000","last_fullsized":"2024-09-13T23:25:52.373889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:51.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733239+0000","last_change":"2024-09-13T23:25:15.285028+0000","last_active":"2024-09-13T23:28:22.733239+0000","last_peered":"2024-09-13T23:28:22.733239+0000","last_clean":"2024-09-13T23:28:22.733239+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:28:22.733239+0000","last_undegraded":"2024-09-13T23:28:22.733239+0000","last_fullsized":"2024-09-13T23:28:22.733239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:16.065036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.705635+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:26:37.705635+0000","last_peered":"2024-09-13T23:26:37.705635+0000","last_clean":"2024-09-13T23:26:37.705635+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:26:37.705635+0000","last_undegraded":"2024-09-13T23:26:37.705635+0000","last_fullsized":"2024-09-13T23:26:37.705635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376137+0000","last_change":"2024-09-13T23:25:15.278986+0000","last_active":"2024-09-13T23:25:52.376137+0000","last_peered":"2024-09-13T23:25:52.376137+0000","last_clean":"2024-09-13T23:25:52.376137+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:25:52.376137+0000","last_undegraded":"2024-09-13T23:25:52.376137+0000","last_fullsized":"2024-09-13T23:25:52.376137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.729113+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.729113+0000","last_peered":"2024-09-13T23:28:22.729113+0000","last_clean":"2024-09-13T23:28:22.729113+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.729113+0000","last_undegraded":"2024-09-13T23:28:22.729113+0000","last_fullsized":"2024-09-13T23:28:22.729113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478144+0000","last_change":"2024-09-13T23:25:15.285560+0000","last_active":"2024-09-13T23:28:22.478144+0000","last_peered":"2024-09-13T23:28:22.478144+0000","last_clean":"2024-09-13T23:28:22.478144+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:28:22.478144+0000","last_undegraded":"2024-09-13T23:28:22.478144+0000","last_fullsized":"2024-09-13T23:28:22.478144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.422238+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:25:55.422238+0000","last_peered":"2024-09-13T23:25:55.422238+0000","last_clean":"2024-09-13T23:25:55.422238+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:25:55.422238+0000","last_undegraded":"2024-09-13T23:25:55.422238+0000","last_fullsized":"2024-09-13T23:25:55.422238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377262+0000","last_change":"2024-09-13T23:25:15.295677+0000","last_active":"2024-09-13T23:25:52.377262+0000","last_peered":"2024-09-13T23:25:52.377262+0000","last_clean":"2024-09-13T23:25:52.377262+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:25:52.377262+0000","last_undegraded":"2024-09-13T23:25:52.377262+0000","last_fullsized":"2024-09-13T23:25:52.377262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329947+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:27:28.329947+0000","last_peered":"2024-09-13T23:27:28.329947+0000","last_clean":"2024-09-13T23:27:28.329947+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:27:28.329947+0000","last_undegraded":"2024-09-13T23:27:28.329947+0000","last_fullsized":"2024-09-13T23:27:28.329947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:36.892250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379651+0000","last_change":"2024-09-13T23:25:15.287972+0000","last_active":"2024-09-13T23:25:52.379651+0000","last_peered":"2024-09-13T23:25:52.379651+0000","last_clean":"2024-09-13T23:25:52.379651+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:25:52.379651+0000","last_undegraded":"2024-09-13T23:25:52.379651+0000","last_fullsized":"2024-09-13T23:25:52.379651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383517+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:25:52.383517+0000","last_peered":"2024-09-13T23:25:52.383517+0000","last_clean":"2024-09-13T23:25:52.383517+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:25:52.383517+0000","last_undegraded":"2024-09-13T23:25:52.383517+0000","last_fullsized":"2024-09-13T23:25:52.383517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:21.475245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.399802+0000","last_change":"2024-09-13T23:25:15.289747+0000","last_active":"2024-09-13T23:27:18.399802+0000","last_peered":"2024-09-13T23:27:18.399802+0000","last_clean":"2024-09-13T23:27:18.399802+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:27:18.399802+0000","last_undegraded":"2024-09-13T23:27:18.399802+0000","last_fullsized":"2024-09-13T23:27:18.399802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:46.131004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:13.286270+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842922+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.842922+0000","last_peered":"2024-09-13T23:28:22.842922+0000","last_clean":"2024-09-13T23:28:22.842922+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.842922+0000","last_undegraded":"2024-09-13T23:28:22.842922+0000","last_fullsized":"2024-09-13T23:28:22.842922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380588+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:25:52.380588+0000","last_peered":"2024-09-13T23:25:52.380588+0000","last_clean":"2024-09-13T23:25:52.380588+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:25:52.380588+0000","last_undegraded":"2024-09-13T23:25:52.380588+0000","last_fullsized":"2024-09-13T23:25:52.380588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:43.556989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374102+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:25:52.374102+0000","last_peered":"2024-09-13T23:25:52.374102+0000","last_clean":"2024-09-13T23:25:52.374102+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:25:52.374102+0000","last_undegraded":"2024-09-13T23:25:52.374102+0000","last_fullsized":"2024-09-13T23:25:52.374102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:18.737876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733301+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.733301+0000","last_peered":"2024-09-13T23:28:22.733301+0000","last_clean":"2024-09-13T23:28:22.733301+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.733301+0000","last_undegraded":"2024-09-13T23:28:22.733301+0000","last_fullsized":"2024-09-13T23:28:22.733301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:36.329312+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:27:36.329312+0000","last_peered":"2024-09-13T23:27:36.329312+0000","last_clean":"2024-09-13T23:27:36.329312+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:27:36.329312+0000","last_undegraded":"2024-09-13T23:27:36.329312+0000","last_fullsized":"2024-09-13T23:27:36.329312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704225+0000","last_change":"2024-09-13T23:25:15.295660+0000","last_active":"2024-09-13T23:28:22.704225+0000","last_peered":"2024-09-13T23:28:22.704225+0000","last_clean":"2024-09-13T23:28:22.704225+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:28:22.704225+0000","last_undegraded":"2024-09-13T23:28:22.704225+0000","last_fullsized":"2024-09-13T23:28:22.704225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44616,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327224,"statfs":{"total":96636764160,"available":96591077376,"internally_reserved":0,"allocated":9494528,"data_stored":9168045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52708,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319132,"statfs":{"total":96636764160,"available":96582791168,"internally_reserved":0,"allocated":17780736,"data_stored":17508411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49248,"kb_used_data":13904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322592,"statfs":{"total":96636764160,"available":96586334208,"internally_reserved":0,"allocated":14237696,"data_stored":13950771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43908,"kb_used_data":12724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327932,"statfs":{"total":96636764160,"available":96591802368,"internally_reserved":0,"allocated":13029376,"data_stored":12725025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:28:30.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T23:28:30.313 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:28:30.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f717454b640 1 Processor -- start 2024-09-13T23:28:30.442 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f717454b640 1 -- start start 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f717454b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f716c12f9d0 0x7f716c131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f717454b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f716c071f70 con 0x7f716c12cca0 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f717454b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f716c06e350 con 0x7f716c12f9d0 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.441+0000 7f7171ae6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f716c12f9d0 0x7f716c131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f7171ae6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f716c12f9d0 0x7f716c131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34652/0 (socket says 172.21.15.43:34652) 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f7171ae6640 1 -- 172.21.15.43:0/1392090165 learned_addr learned my addr 172.21.15.43:0/1392090165 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:30.447 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f71722e7640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f716c12cca0 0x7f716c12d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40864/0 (socket says 172.21.15.43:40864) 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f7171ae6640 1 -- 172.21.15.43:0/1392090165 >> v1:172.21.15.43:6789/0 conn(0x7f716c12cca0 legacy=0x7f716c12d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f7171ae6640 1 -- 172.21.15.43:0/1392090165 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c0715c0 con 0x7f716c12f9d0 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.442+0000 7f7171ae6640 1 --2- 172.21.15.43:0/1392090165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12f9d0 0x7f716c131dc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097f0 tx=0x7f715c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e078b12ea729fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f71712e5640 1 -- 172.21.15.43:0/1392090165 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c037070 con 0x7f716c12f9d0 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f71712e5640 1 -- 172.21.15.43:0/1392090165 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c032440 con 0x7f716c12f9d0 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f71712e5640 1 -- 172.21.15.43:0/1392090165 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f715c02ae60 con 0x7f716c12f9d0 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 -- 172.21.15.43:0/1392090165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12f9d0 msgr2=0x7f716c131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 --2- 172.21.15.43:0/1392090165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12f9d0 0x7f716c131dc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097f0 tx=0x7f715c02a1e0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 -- 172.21.15.43:0/1392090165 shutdown_connections 2024-09-13T23:28:30.448 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 --2- 172.21.15.43:0/1392090165 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12f9d0 0x7f716c131dc0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 -- 172.21.15.43:0/1392090165 >> 172.21.15.43:0/1392090165 conn(0x7f716c09a890 msgr2=0x7f716c09aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 -- 172.21.15.43:0/1392090165 shutdown_connections 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.443+0000 7f717454b640 1 -- 172.21.15.43:0/1392090165 wait complete. 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.444+0000 7f717454b640 1 Processor -- start 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.444+0000 7f717454b640 1 -- start start 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.444+0000 7f717454b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.444+0000 7f717454b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f716c12ca50 con 0x7f716c12cca0 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.444+0000 7f71722e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f71722e7640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34662/0 (socket says 172.21.15.43:34662) 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f71722e7640 1 -- 172.21.15.43:0/773361936 learned_addr learned my addr 172.21.15.43:0/773361936 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:30.449 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f71722e7640 1 -- 172.21.15.43:0/773361936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c129b80 con 0x7f716c12cca0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f71722e7640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f716800c340 tx=0x7f716800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71680074d0 con 0x7f716c12cca0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7168007670 con 0x7f716c12cca0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c124f50 con 0x7f716c12cca0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7168004950 con 0x7f716c12cca0 2024-09-13T23:28:30.450 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.445+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c1246f0 con 0x7f716c12cca0 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.446+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f716801a020 con 0x7f716c12cca0 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.446+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c12d080 con 0x7f716c12cca0 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.446+0000 7f7162ffd640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 0x7f715003a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.446+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f716804b420 con 0x7f716c12cca0 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.447+0000 7f7171ae6640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 0x7f715003a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.451 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.447+0000 7f7171ae6640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 0x7f715003a710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097f0 tx=0x7f715c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.452 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.451+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7168019d60 con 0x7f716c12cca0 2024-09-13T23:28:30.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.622+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f716c0008d0 con 0x7f7150038250 2024-09-13T23:28:30.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.637+0000 7f7162ffd640 1 -- 172.21.15.43:0/773361936 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665575 (secure 0 0 0) 0x7f716c0008d0 con 0x7f7150038250 2024-09-13T23:28:30.647 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:30.653 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:28:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.641+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 msgr2=0x7f715003a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.641+0000 7f717454b640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 0x7f715003a710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097f0 tx=0x7f715c02e000 comp rx=0 tx=0).stop 2024-09-13T23:28:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 msgr2=0x7f716c1c1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.655 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f716800c340 tx=0x7f716800c800 comp rx=0 tx=0).stop 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 shutdown_connections 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f7150038250 0x7f715003a710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 --2- 172.21.15.43:0/773361936 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f716c12cca0 0x7f716c1c1310 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 >> 172.21.15.43:0/773361936 conn(0x7f716c09a890 msgr2=0x7f716c097d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 shutdown_connections 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.642+0000 7f717454b640 1 -- 172.21.15.43:0/773361936 wait complete. 2024-09-13T23:28:30.656 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-13T23:28:29.355677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4861,"num_read_kb":4442,"num_write":2106,"num_write_kb":61374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4479,"ondisk_log_size":4479,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190480,"kb_used_data":53264,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377296880,"statfs":{"total":386547056640,"available":386352005120,"internally_reserved":0,"allocated":54542336,"data_stored":53352252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25811687,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004485"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.326609+0000","last_change":"2024-09-13T23:25:13.287107+0000","last_active":"2024-09-13T23:28:22.326609+0000","last_peered":"2024-09-13T23:28:22.326609+0000","last_clean":"2024-09-13T23:28:22.326609+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:28:22.326609+0000","last_undegraded":"2024-09-13T23:28:22.326609+0000","last_fullsized":"2024-09-13T23:28:22.326609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697306+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.697306+0000","last_peered":"2024-09-13T23:28:22.697306+0000","last_clean":"2024-09-13T23:28:22.697306+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.697306+0000","last_undegraded":"2024-09-13T23:28:22.697306+0000","last_fullsized":"2024-09-13T23:28:22.697306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327060+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:27:21.327060+0000","last_peered":"2024-09-13T23:27:21.327060+0000","last_clean":"2024-09-13T23:27:21.327060+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:27:21.327060+0000","last_undegraded":"2024-09-13T23:27:21.327060+0000","last_fullsized":"2024-09-13T23:27:21.327060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:02.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.715133+0000","last_change":"2024-09-13T23:25:15.283513+0000","last_active":"2024-09-13T23:26:37.715133+0000","last_peered":"2024-09-13T23:26:37.715133+0000","last_clean":"2024-09-13T23:26:37.715133+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:26:37.715133+0000","last_undegraded":"2024-09-13T23:26:37.715133+0000","last_fullsized":"2024-09-13T23:26:37.715133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:19.716730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383611+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:25:52.383611+0000","last_peered":"2024-09-13T23:25:52.383611+0000","last_clean":"2024-09-13T23:25:52.383611+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:25:52.383611+0000","last_undegraded":"2024-09-13T23:25:52.383611+0000","last_fullsized":"2024-09-13T23:25:52.383611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:53.486874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697586+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.697586+0000","last_peered":"2024-09-13T23:28:22.697586+0000","last_clean":"2024-09-13T23:28:22.697586+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.697586+0000","last_undegraded":"2024-09-13T23:28:22.697586+0000","last_fullsized":"2024-09-13T23:28:22.697586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:44.489685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373408+0000","last_change":"2024-09-13T23:25:13.275095+0000","last_active":"2024-09-13T23:25:52.373408+0000","last_peered":"2024-09-13T23:25:52.373408+0000","last_clean":"2024-09-13T23:25:52.373408+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:25:52.373408+0000","last_undegraded":"2024-09-13T23:25:52.373408+0000","last_fullsized":"2024-09-13T23:25:52.373408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717114+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:26:37.717114+0000","last_peered":"2024-09-13T23:26:37.717114+0000","last_clean":"2024-09-13T23:26:37.717114+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:26:37.717114+0000","last_undegraded":"2024-09-13T23:26:37.717114+0000","last_fullsized":"2024-09-13T23:26:37.717114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:35.198533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376609+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:25:52.376609+0000","last_peered":"2024-09-13T23:25:52.376609+0000","last_clean":"2024-09-13T23:25:52.376609+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:25:52.376609+0000","last_undegraded":"2024-09-13T23:25:52.376609+0000","last_fullsized":"2024-09-13T23:25:52.376609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.491515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.917848+0000","last_change":"2024-09-13T23:25:15.285777+0000","last_active":"2024-09-13T23:25:55.917848+0000","last_peered":"2024-09-13T23:25:55.917848+0000","last_clean":"2024-09-13T23:25:55.917848+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:25:55.917848+0000","last_undegraded":"2024-09-13T23:25:55.917848+0000","last_fullsized":"2024-09-13T23:25:55.917848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372573+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:25:52.372573+0000","last_peered":"2024-09-13T23:25:52.372573+0000","last_clean":"2024-09-13T23:25:52.372573+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:25:52.372573+0000","last_undegraded":"2024-09-13T23:25:52.372573+0000","last_fullsized":"2024-09-13T23:25:52.372573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697189+0000","last_change":"2024-09-13T23:25:15.290172+0000","last_active":"2024-09-13T23:28:22.697189+0000","last_peered":"2024-09-13T23:28:22.697189+0000","last_clean":"2024-09-13T23:28:22.697189+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:22.697189+0000","last_undegraded":"2024-09-13T23:28:22.697189+0000","last_fullsized":"2024-09-13T23:28:22.697189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:16.423529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377367+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:25:52.377367+0000","last_peered":"2024-09-13T23:25:52.377367+0000","last_clean":"2024-09-13T23:25:52.377367+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:25:52.377367+0000","last_undegraded":"2024-09-13T23:25:52.377367+0000","last_fullsized":"2024-09-13T23:25:52.377367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374311+0000","last_change":"2024-09-13T23:25:15.288159+0000","last_active":"2024-09-13T23:28:22.374311+0000","last_peered":"2024-09-13T23:28:22.374311+0000","last_clean":"2024-09-13T23:28:22.374311+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:28:22.374311+0000","last_undegraded":"2024-09-13T23:28:22.374311+0000","last_fullsized":"2024-09-13T23:28:22.374311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.728590+0000","last_change":"2024-09-13T23:25:13.285351+0000","last_active":"2024-09-13T23:27:21.728590+0000","last_peered":"2024-09-13T23:27:21.728590+0000","last_clean":"2024-09-13T23:27:21.728590+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:27:21.728590+0000","last_undegraded":"2024-09-13T23:27:21.728590+0000","last_fullsized":"2024-09-13T23:27:21.728590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.816721+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:25:54.816721+0000","last_peered":"2024-09-13T23:25:54.816721+0000","last_clean":"2024-09-13T23:25:54.816721+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:25:54.816721+0000","last_undegraded":"2024-09-13T23:25:54.816721+0000","last_fullsized":"2024-09-13T23:25:54.816721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626345+0000","last_change":"2024-09-13T23:25:15.287032+0000","last_active":"2024-09-13T23:28:22.626345+0000","last_peered":"2024-09-13T23:28:22.626345+0000","last_clean":"2024-09-13T23:28:22.626345+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:28:22.626345+0000","last_undegraded":"2024-09-13T23:28:22.626345+0000","last_fullsized":"2024-09-13T23:28:22.626345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:16.113359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380456+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:25:52.380456+0000","last_peered":"2024-09-13T23:25:52.380456+0000","last_clean":"2024-09-13T23:25:52.380456+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:25:52.380456+0000","last_undegraded":"2024-09-13T23:25:52.380456+0000","last_fullsized":"2024-09-13T23:25:52.380456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871681+0000","last_change":"2024-09-13T23:25:15.287488+0000","last_active":"2024-09-13T23:27:21.871681+0000","last_peered":"2024-09-13T23:27:21.871681+0000","last_clean":"2024-09-13T23:27:21.871681+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:27:21.871681+0000","last_undegraded":"2024-09-13T23:27:21.871681+0000","last_fullsized":"2024-09-13T23:27:21.871681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376849+0000","last_change":"2024-09-13T23:25:13.286390+0000","last_active":"2024-09-13T23:25:52.376849+0000","last_peered":"2024-09-13T23:25:52.376849+0000","last_clean":"2024-09-13T23:25:52.376849+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:25:52.376849+0000","last_undegraded":"2024-09-13T23:25:52.376849+0000","last_fullsized":"2024-09-13T23:25:52.376849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625998+0000","last_change":"2024-09-13T23:25:15.284340+0000","last_active":"2024-09-13T23:28:22.625998+0000","last_peered":"2024-09-13T23:28:22.625998+0000","last_clean":"2024-09-13T23:28:22.625998+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:28:22.625998+0000","last_undegraded":"2024-09-13T23:28:22.625998+0000","last_fullsized":"2024-09-13T23:28:22.625998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:01.252262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.792366+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:25:54.792366+0000","last_peered":"2024-09-13T23:25:54.792366+0000","last_clean":"2024-09-13T23:25:54.792366+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:25:54.792366+0000","last_undegraded":"2024-09-13T23:25:54.792366+0000","last_fullsized":"2024-09-13T23:25:54.792366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:24.391365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.166890+0000","last_change":"2024-09-13T23:25:15.279035+0000","last_active":"2024-09-13T23:25:55.166890+0000","last_peered":"2024-09-13T23:25:55.166890+0000","last_clean":"2024-09-13T23:25:55.166890+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:25:55.166890+0000","last_undegraded":"2024-09-13T23:25:55.166890+0000","last_fullsized":"2024-09-13T23:25:55.166890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380325+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:25:52.380325+0000","last_peered":"2024-09-13T23:25:52.380325+0000","last_clean":"2024-09-13T23:25:52.380325+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:25:52.380325+0000","last_undegraded":"2024-09-13T23:25:52.380325+0000","last_fullsized":"2024-09-13T23:25:52.380325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373942+0000","last_change":"2024-09-13T23:25:15.280560+0000","last_active":"2024-09-13T23:25:52.373942+0000","last_peered":"2024-09-13T23:25:52.373942+0000","last_clean":"2024-09-13T23:25:52.373942+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:25:52.373942+0000","last_undegraded":"2024-09-13T23:25:52.373942+0000","last_fullsized":"2024-09-13T23:25:52.373942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375633+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:25:52.375633+0000","last_peered":"2024-09-13T23:25:52.375633+0000","last_clean":"2024-09-13T23:25:52.375633+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:25:52.375633+0000","last_undegraded":"2024-09-13T23:25:52.375633+0000","last_fullsized":"2024-09-13T23:25:52.375633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733254+0000","last_change":"2024-09-13T23:25:15.284594+0000","last_active":"2024-09-13T23:28:22.733254+0000","last_peered":"2024-09-13T23:28:22.733254+0000","last_clean":"2024-09-13T23:28:22.733254+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:28:22.733254+0000","last_undegraded":"2024-09-13T23:28:22.733254+0000","last_fullsized":"2024-09-13T23:28:22.733254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374584+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:25:52.374584+0000","last_peered":"2024-09-13T23:25:52.374584+0000","last_clean":"2024-09-13T23:25:52.374584+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:25:52.374584+0000","last_undegraded":"2024-09-13T23:25:52.374584+0000","last_fullsized":"2024-09-13T23:25:52.374584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:50.268744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":99,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.669461+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.669461+0000","last_peered":"2024-09-13T23:28:22.669461+0000","last_clean":"2024-09-13T23:28:22.669461+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.669461+0000","last_undegraded":"2024-09-13T23:28:22.669461+0000","last_fullsized":"2024-09-13T23:28:22.669461+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:09.425167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374612+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.374612+0000","last_peered":"2024-09-13T23:28:22.374612+0000","last_clean":"2024-09-13T23:28:22.374612+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.374612+0000","last_undegraded":"2024-09-13T23:28:22.374612+0000","last_fullsized":"2024-09-13T23:28:22.374612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376199+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:25:52.376199+0000","last_peered":"2024-09-13T23:25:52.376199+0000","last_clean":"2024-09-13T23:25:52.376199+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:25:52.376199+0000","last_undegraded":"2024-09-13T23:25:52.376199+0000","last_fullsized":"2024-09-13T23:25:52.376199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:28.575656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381408+0000","last_change":"2024-09-13T23:25:17.289713+0000","last_active":"2024-09-13T23:25:52.381408+0000","last_peered":"2024-09-13T23:25:52.381408+0000","last_clean":"2024-09-13T23:25:52.381408+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:25:52.381408+0000","last_undegraded":"2024-09-13T23:25:52.381408+0000","last_fullsized":"2024-09-13T23:25:52.381408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:05.506988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.169401+0000","last_change":"2024-09-13T23:25:19.296863+0000","last_active":"2024-09-13T23:27:20.169401+0000","last_peered":"2024-09-13T23:27:20.169401+0000","last_clean":"2024-09-13T23:27:20.169401+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:27:20.169401+0000","last_undegraded":"2024-09-13T23:27:20.169401+0000","last_fullsized":"2024-09-13T23:27:20.169401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:01.662692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379495+0000","last_change":"2024-09-13T23:25:21.306129+0000","last_active":"2024-09-13T23:25:52.379495+0000","last_peered":"2024-09-13T23:25:52.379495+0000","last_clean":"2024-09-13T23:25:52.379495+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:25:52.379495+0000","last_undegraded":"2024-09-13T23:25:52.379495+0000","last_fullsized":"2024-09-13T23:25:52.379495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.723062+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:26:37.723062+0000","last_peered":"2024-09-13T23:26:37.723062+0000","last_clean":"2024-09-13T23:26:37.723062+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:26:37.723062+0000","last_undegraded":"2024-09-13T23:26:37.723062+0000","last_fullsized":"2024-09-13T23:26:37.723062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:42.589333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332392+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:27:43.332392+0000","last_peered":"2024-09-13T23:27:43.332392+0000","last_clean":"2024-09-13T23:27:43.332392+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:27:43.332392+0000","last_undegraded":"2024-09-13T23:27:43.332392+0000","last_fullsized":"2024-09-13T23:27:43.332392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:44.441287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372736+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:25:52.372736+0000","last_peered":"2024-09-13T23:25:52.372736+0000","last_clean":"2024-09-13T23:25:52.372736+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:25:52.372736+0000","last_undegraded":"2024-09-13T23:25:52.372736+0000","last_fullsized":"2024-09-13T23:25:52.372736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:53.316546+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:25:53.316546+0000","last_peered":"2024-09-13T23:25:53.316546+0000","last_clean":"2024-09-13T23:25:53.316546+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:25:53.316546+0000","last_undegraded":"2024-09-13T23:25:53.316546+0000","last_fullsized":"2024-09-13T23:25:53.316546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:33:09.831944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379403+0000","last_change":"2024-09-13T23:25:19.296507+0000","last_active":"2024-09-13T23:25:52.379403+0000","last_peered":"2024-09-13T23:25:52.379403+0000","last_clean":"2024-09-13T23:25:52.379403+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:25:52.379403+0000","last_undegraded":"2024-09-13T23:25:52.379403+0000","last_fullsized":"2024-09-13T23:25:52.379403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:51.134434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379082+0000","last_change":"2024-09-13T23:25:21.301362+0000","last_active":"2024-09-13T23:25:52.379082+0000","last_peered":"2024-09-13T23:25:52.379082+0000","last_clean":"2024-09-13T23:25:52.379082+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:25:52.379082+0000","last_undegraded":"2024-09-13T23:25:52.379082+0000","last_fullsized":"2024-09-13T23:25:52.379082+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.481142+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.481142+0000","last_peered":"2024-09-13T23:28:22.481142+0000","last_clean":"2024-09-13T23:28:22.481142+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.481142+0000","last_undegraded":"2024-09-13T23:28:22.481142+0000","last_fullsized":"2024-09-13T23:28:22.481142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871746+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:21.871746+0000","last_peered":"2024-09-13T23:27:21.871746+0000","last_clean":"2024-09-13T23:27:21.871746+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:21.871746+0000","last_undegraded":"2024-09-13T23:27:21.871746+0000","last_fullsized":"2024-09-13T23:27:21.871746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:21.355304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379644+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:25:52.379644+0000","last_peered":"2024-09-13T23:25:52.379644+0000","last_clean":"2024-09-13T23:25:52.379644+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:25:52.379644+0000","last_undegraded":"2024-09-13T23:25:52.379644+0000","last_fullsized":"2024-09-13T23:25:52.379644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376883+0000","last_change":"2024-09-13T23:25:17.287013+0000","last_active":"2024-09-13T23:25:52.376883+0000","last_peered":"2024-09-13T23:25:52.376883+0000","last_clean":"2024-09-13T23:25:52.376883+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:25:52.376883+0000","last_undegraded":"2024-09-13T23:25:52.376883+0000","last_fullsized":"2024-09-13T23:25:52.376883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374464+0000","last_change":"2024-09-13T23:25:19.289864+0000","last_active":"2024-09-13T23:25:52.374464+0000","last_peered":"2024-09-13T23:25:52.374464+0000","last_clean":"2024-09-13T23:25:52.374464+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:25:52.374464+0000","last_undegraded":"2024-09-13T23:25:52.374464+0000","last_fullsized":"2024-09-13T23:25:52.374464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:38.226160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'282","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364768+0000","last_change":"2024-09-13T23:25:21.304299+0000","last_active":"2024-09-13T23:28:22.364768+0000","last_peered":"2024-09-13T23:28:22.364768+0000","last_clean":"2024-09-13T23:28:22.364768+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:22.364768+0000","last_undegraded":"2024-09-13T23:28:22.364768+0000","last_fullsized":"2024-09-13T23:28:22.364768+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.160237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.172427+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:25:55.172427+0000","last_peered":"2024-09-13T23:25:55.172427+0000","last_clean":"2024-09-13T23:25:55.172427+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:25:55.172427+0000","last_undegraded":"2024-09-13T23:25:55.172427+0000","last_fullsized":"2024-09-13T23:25:55.172427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:34.976156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733291+0000","last_change":"2024-09-13T23:25:15.285324+0000","last_active":"2024-09-13T23:28:22.733291+0000","last_peered":"2024-09-13T23:28:22.733291+0000","last_clean":"2024-09-13T23:28:22.733291+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:22.733291+0000","last_undegraded":"2024-09-13T23:28:22.733291+0000","last_fullsized":"2024-09-13T23:28:22.733291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376181+0000","last_change":"2024-09-13T23:25:13.288918+0000","last_active":"2024-09-13T23:25:52.376181+0000","last_peered":"2024-09-13T23:25:52.376181+0000","last_clean":"2024-09-13T23:25:52.376181+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:25:52.376181+0000","last_undegraded":"2024-09-13T23:25:52.376181+0000","last_fullsized":"2024-09-13T23:25:52.376181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377072+0000","last_change":"2024-09-13T23:25:17.287813+0000","last_active":"2024-09-13T23:25:52.377072+0000","last_peered":"2024-09-13T23:25:52.377072+0000","last_clean":"2024-09-13T23:25:52.377072+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:25:52.377072+0000","last_undegraded":"2024-09-13T23:25:52.377072+0000","last_fullsized":"2024-09-13T23:25:52.377072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:01.764699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.164218+0000","last_change":"2024-09-13T23:25:19.291393+0000","last_active":"2024-09-13T23:27:20.164218+0000","last_peered":"2024-09-13T23:27:20.164218+0000","last_clean":"2024-09-13T23:27:20.164218+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:27:20.164218+0000","last_undegraded":"2024-09-13T23:27:20.164218+0000","last_fullsized":"2024-09-13T23:27:20.164218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:41.211829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'282","reported_seq":441,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.735967+0000","last_change":"2024-09-13T23:25:21.303172+0000","last_active":"2024-09-13T23:28:22.735967+0000","last_peered":"2024-09-13T23:28:22.735967+0000","last_clean":"2024-09-13T23:28:22.735967+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:22.735967+0000","last_undegraded":"2024-09-13T23:28:22.735967+0000","last_fullsized":"2024-09-13T23:28:22.735967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739506+0000","last_change":"2024-09-13T23:25:15.291664+0000","last_active":"2024-09-13T23:28:22.739506+0000","last_peered":"2024-09-13T23:28:22.739506+0000","last_clean":"2024-09-13T23:28:22.739506+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:22.739506+0000","last_undegraded":"2024-09-13T23:28:22.739506+0000","last_fullsized":"2024-09-13T23:28:22.739506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:54.160656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375841+0000","last_change":"2024-09-13T23:25:13.289874+0000","last_active":"2024-09-13T23:25:52.375841+0000","last_peered":"2024-09-13T23:25:52.375841+0000","last_clean":"2024-09-13T23:25:52.375841+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:25:52.375841+0000","last_undegraded":"2024-09-13T23:25:52.375841+0000","last_fullsized":"2024-09-13T23:25:52.375841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376161+0000","last_change":"2024-09-13T23:25:17.289113+0000","last_active":"2024-09-13T23:25:52.376161+0000","last_peered":"2024-09-13T23:25:52.376161+0000","last_clean":"2024-09-13T23:25:52.376161+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:25:52.376161+0000","last_undegraded":"2024-09-13T23:25:52.376161+0000","last_fullsized":"2024-09-13T23:25:52.376161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'40","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.173883+0000","last_change":"2024-09-13T23:25:19.297925+0000","last_active":"2024-09-13T23:27:20.173883+0000","last_peered":"2024-09-13T23:27:20.173883+0000","last_clean":"2024-09-13T23:27:20.173883+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:27:20.173883+0000","last_undegraded":"2024-09-13T23:27:20.173883+0000","last_fullsized":"2024-09-13T23:27:20.173883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374678+0000","last_change":"2024-09-13T23:25:21.301483+0000","last_active":"2024-09-13T23:25:52.374678+0000","last_peered":"2024-09-13T23:25:52.374678+0000","last_clean":"2024-09-13T23:25:52.374678+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:25:52.374678+0000","last_undegraded":"2024-09-13T23:25:52.374678+0000","last_fullsized":"2024-09-13T23:25:52.374678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:11.275595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.677351+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.677351+0000","last_peered":"2024-09-13T23:28:22.677351+0000","last_clean":"2024-09-13T23:28:22.677351+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.677351+0000","last_undegraded":"2024-09-13T23:28:22.677351+0000","last_fullsized":"2024-09-13T23:28:22.677351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:47.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871541+0000","last_change":"2024-09-13T23:25:15.285081+0000","last_active":"2024-09-13T23:27:21.871541+0000","last_peered":"2024-09-13T23:27:21.871541+0000","last_clean":"2024-09-13T23:27:21.871541+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:27:21.871541+0000","last_undegraded":"2024-09-13T23:27:21.871541+0000","last_fullsized":"2024-09-13T23:27:21.871541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329270+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:27:28.329270+0000","last_peered":"2024-09-13T23:27:28.329270+0000","last_clean":"2024-09-13T23:27:28.329270+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:27:28.329270+0000","last_undegraded":"2024-09-13T23:27:28.329270+0000","last_fullsized":"2024-09-13T23:27:28.329270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374895+0000","last_change":"2024-09-13T23:25:17.291228+0000","last_active":"2024-09-13T23:25:52.374895+0000","last_peered":"2024-09-13T23:25:52.374895+0000","last_clean":"2024-09-13T23:25:52.374895+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:25:52.374895+0000","last_undegraded":"2024-09-13T23:25:52.374895+0000","last_fullsized":"2024-09-13T23:25:52.374895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:35.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.153630+0000","last_change":"2024-09-13T23:25:19.294956+0000","last_active":"2024-09-13T23:27:20.153630+0000","last_peered":"2024-09-13T23:27:20.153630+0000","last_clean":"2024-09-13T23:27:20.153630+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:27:20.153630+0000","last_undegraded":"2024-09-13T23:27:20.153630+0000","last_fullsized":"2024-09-13T23:27:20.153630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:35.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374433+0000","last_change":"2024-09-13T23:25:21.308307+0000","last_active":"2024-09-13T23:25:52.374433+0000","last_peered":"2024-09-13T23:25:52.374433+0000","last_clean":"2024-09-13T23:25:52.374433+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:25:52.374433+0000","last_undegraded":"2024-09-13T23:25:52.374433+0000","last_fullsized":"2024-09-13T23:25:52.374433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:32.166331+0000","last_change":"2024-09-13T23:25:23.307544+0000","last_active":"2024-09-13T23:26:32.166331+0000","last_peered":"2024-09-13T23:26:32.166331+0000","last_clean":"2024-09-13T23:26:32.166331+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:26:32.166331+0000","last_undegraded":"2024-09-13T23:26:32.166331+0000","last_fullsized":"2024-09-13T23:26:32.166331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:10.684124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479224+0000","last_change":"2024-09-13T23:25:15.287305+0000","last_active":"2024-09-13T23:28:22.479224+0000","last_peered":"2024-09-13T23:28:22.479224+0000","last_clean":"2024-09-13T23:28:22.479224+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:28:22.479224+0000","last_undegraded":"2024-09-13T23:28:22.479224+0000","last_fullsized":"2024-09-13T23:28:22.479224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329978+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:27:28.329978+0000","last_peered":"2024-09-13T23:27:28.329978+0000","last_clean":"2024-09-13T23:27:28.329978+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:27:28.329978+0000","last_undegraded":"2024-09-13T23:27:28.329978+0000","last_fullsized":"2024-09-13T23:27:28.329978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:37.817951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:17.285971+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:54.021576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.175918+0000","last_change":"2024-09-13T23:25:19.299653+0000","last_active":"2024-09-13T23:27:20.175918+0000","last_peered":"2024-09-13T23:27:20.175918+0000","last_clean":"2024-09-13T23:27:20.175918+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:27:20.175918+0000","last_undegraded":"2024-09-13T23:27:20.175918+0000","last_fullsized":"2024-09-13T23:27:20.175918+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:09.850559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'282","reported_seq":348,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:23.022818+0000","last_change":"2024-09-13T23:25:21.308757+0000","last_active":"2024-09-13T23:28:23.022818+0000","last_peered":"2024-09-13T23:28:23.022818+0000","last_clean":"2024-09-13T23:28:23.022818+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:23.022818+0000","last_undegraded":"2024-09-13T23:28:23.022818+0000","last_fullsized":"2024-09-13T23:28:23.022818+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375463+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:25:52.375463+0000","last_peered":"2024-09-13T23:25:52.375463+0000","last_clean":"2024-09-13T23:25:52.375463+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:25:52.375463+0000","last_undegraded":"2024-09-13T23:25:52.375463+0000","last_fullsized":"2024-09-13T23:25:52.375463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.604079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.696828+0000","last_change":"2024-09-13T23:25:15.283264+0000","last_active":"2024-09-13T23:28:22.696828+0000","last_peered":"2024-09-13T23:28:22.696828+0000","last_clean":"2024-09-13T23:28:22.696828+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:22.696828+0000","last_undegraded":"2024-09-13T23:28:22.696828+0000","last_fullsized":"2024-09-13T23:28:22.696828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.390295+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:18.390295+0000","last_peered":"2024-09-13T23:27:18.390295+0000","last_clean":"2024-09-13T23:27:18.390295+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:18.390295+0000","last_undegraded":"2024-09-13T23:27:18.390295+0000","last_fullsized":"2024-09-13T23:27:18.390295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:32.413205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:17.286788+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:39.422715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.875706+0000","last_change":"2024-09-13T23:25:19.299651+0000","last_active":"2024-09-13T23:27:21.875706+0000","last_peered":"2024-09-13T23:27:21.875706+0000","last_clean":"2024-09-13T23:27:21.875706+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:27:21.875706+0000","last_undegraded":"2024-09-13T23:27:21.875706+0000","last_fullsized":"2024-09-13T23:27:21.875706+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.439065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374591+0000","last_change":"2024-09-13T23:25:21.301614+0000","last_active":"2024-09-13T23:25:52.374591+0000","last_peered":"2024-09-13T23:25:52.374591+0000","last_clean":"2024-09-13T23:25:52.374591+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:25:52.374591+0000","last_undegraded":"2024-09-13T23:25:52.374591+0000","last_fullsized":"2024-09-13T23:25:52.374591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.962416+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.962416+0000","last_peered":"2024-09-13T23:28:22.962416+0000","last_clean":"2024-09-13T23:28:22.962416+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.962416+0000","last_undegraded":"2024-09-13T23:28:22.962416+0000","last_fullsized":"2024-09-13T23:28:22.962416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:22.720145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733331+0000","last_change":"2024-09-13T23:25:15.296722+0000","last_active":"2024-09-13T23:28:22.733331+0000","last_peered":"2024-09-13T23:28:22.733331+0000","last_clean":"2024-09-13T23:28:22.733331+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:22.733331+0000","last_undegraded":"2024-09-13T23:28:22.733331+0000","last_fullsized":"2024-09-13T23:28:22.733331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:38.000462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.414481+0000","last_change":"2024-09-13T23:25:13.283881+0000","last_active":"2024-09-13T23:25:55.414481+0000","last_peered":"2024-09-13T23:25:55.414481+0000","last_clean":"2024-09-13T23:25:55.414481+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:25:55.414481+0000","last_undegraded":"2024-09-13T23:25:55.414481+0000","last_fullsized":"2024-09-13T23:25:55.414481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:06.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374030+0000","last_change":"2024-09-13T23:25:17.285259+0000","last_active":"2024-09-13T23:25:52.374030+0000","last_peered":"2024-09-13T23:25:52.374030+0000","last_clean":"2024-09-13T23:25:52.374030+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:25:52.374030+0000","last_undegraded":"2024-09-13T23:25:52.374030+0000","last_fullsized":"2024-09-13T23:25:52.374030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:00.997313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.157664+0000","last_change":"2024-09-13T23:25:19.292957+0000","last_active":"2024-09-13T23:27:20.157664+0000","last_peered":"2024-09-13T23:27:20.157664+0000","last_clean":"2024-09-13T23:27:20.157664+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:27:20.157664+0000","last_undegraded":"2024-09-13T23:27:20.157664+0000","last_fullsized":"2024-09-13T23:27:20.157664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:36.621593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380477+0000","last_change":"2024-09-13T23:25:21.307942+0000","last_active":"2024-09-13T23:25:52.380477+0000","last_peered":"2024-09-13T23:25:52.380477+0000","last_clean":"2024-09-13T23:25:52.380477+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:25:52.380477+0000","last_undegraded":"2024-09-13T23:25:52.380477+0000","last_fullsized":"2024-09-13T23:25:52.380477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:57.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329045+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:27:23.329045+0000","last_peered":"2024-09-13T23:27:23.329045+0000","last_clean":"2024-09-13T23:27:23.329045+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:27:23.329045+0000","last_undegraded":"2024-09-13T23:27:23.329045+0000","last_fullsized":"2024-09-13T23:27:23.329045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:16.049837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697480+0000","last_change":"2024-09-13T23:25:15.290226+0000","last_active":"2024-09-13T23:28:22.697480+0000","last_peered":"2024-09-13T23:28:22.697480+0000","last_clean":"2024-09-13T23:28:22.697480+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:22.697480+0000","last_undegraded":"2024-09-13T23:28:22.697480+0000","last_fullsized":"2024-09-13T23:28:22.697480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:58.471027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376787+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:25:52.376787+0000","last_peered":"2024-09-13T23:25:52.376787+0000","last_clean":"2024-09-13T23:25:52.376787+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:25:52.376787+0000","last_undegraded":"2024-09-13T23:25:52.376787+0000","last_fullsized":"2024-09-13T23:25:52.376787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:34.681115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376818+0000","last_change":"2024-09-13T23:25:17.287240+0000","last_active":"2024-09-13T23:25:52.376818+0000","last_peered":"2024-09-13T23:25:52.376818+0000","last_clean":"2024-09-13T23:25:52.376818+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:25:52.376818+0000","last_undegraded":"2024-09-13T23:25:52.376818+0000","last_fullsized":"2024-09-13T23:25:52.376818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'37","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.184924+0000","last_change":"2024-09-13T23:25:19.289083+0000","last_active":"2024-09-13T23:27:20.184924+0000","last_peered":"2024-09-13T23:27:20.184924+0000","last_clean":"2024-09-13T23:27:20.184924+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:27:20.184924+0000","last_undegraded":"2024-09-13T23:27:20.184924+0000","last_fullsized":"2024-09-13T23:27:20.184924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:42.816869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'282","reported_seq":431,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966627+0000","last_change":"2024-09-13T23:25:21.302618+0000","last_active":"2024-09-13T23:28:22.966627+0000","last_peered":"2024-09-13T23:28:22.966627+0000","last_clean":"2024-09-13T23:28:22.966627+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:22.966627+0000","last_undegraded":"2024-09-13T23:28:22.966627+0000","last_fullsized":"2024-09-13T23:28:22.966627+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:56.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328632+0000","last_change":"2024-09-13T23:25:23.302781+0000","last_active":"2024-09-13T23:27:31.328632+0000","last_peered":"2024-09-13T23:27:31.328632+0000","last_clean":"2024-09-13T23:27:31.328632+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:27:31.328632+0000","last_undegraded":"2024-09-13T23:27:31.328632+0000","last_fullsized":"2024-09-13T23:27:31.328632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:54.025813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.437139+0000","last_change":"2024-09-13T23:25:15.290988+0000","last_active":"2024-09-13T23:25:55.437139+0000","last_peered":"2024-09-13T23:25:55.437139+0000","last_clean":"2024-09-13T23:25:55.437139+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:25:55.437139+0000","last_undegraded":"2024-09-13T23:25:55.437139+0000","last_fullsized":"2024-09-13T23:25:55.437139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374910+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:25:52.374910+0000","last_peered":"2024-09-13T23:25:52.374910+0000","last_clean":"2024-09-13T23:25:52.374910+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:25:52.374910+0000","last_undegraded":"2024-09-13T23:25:52.374910+0000","last_fullsized":"2024-09-13T23:25:52.374910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:32.148141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":413,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282446+0000","last_change":"2024-09-13T23:25:17.288588+0000","last_active":"2024-09-13T23:27:21.282446+0000","last_peered":"2024-09-13T23:27:21.282446+0000","last_clean":"2024-09-13T23:27:21.282446+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:27:21.282446+0000","last_undegraded":"2024-09-13T23:27:21.282446+0000","last_fullsized":"2024-09-13T23:27:21.282446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:53:15.817722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330751+0000","last_change":"2024-09-13T23:25:19.298296+0000","last_active":"2024-09-13T23:27:33.330751+0000","last_peered":"2024-09-13T23:27:33.330751+0000","last_clean":"2024-09-13T23:27:33.330751+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:27:33.330751+0000","last_undegraded":"2024-09-13T23:27:33.330751+0000","last_fullsized":"2024-09-13T23:27:33.330751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:39.743432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'282","reported_seq":468,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.846586+0000","last_change":"2024-09-13T23:25:21.299515+0000","last_active":"2024-09-13T23:28:22.846586+0000","last_peered":"2024-09-13T23:28:22.846586+0000","last_clean":"2024-09-13T23:28:22.846586+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:22.846586+0000","last_undegraded":"2024-09-13T23:28:22.846586+0000","last_fullsized":"2024-09-13T23:28:22.846586+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.844255+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.844255+0000","last_peered":"2024-09-13T23:28:22.844255+0000","last_clean":"2024-09-13T23:28:22.844255+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.844255+0000","last_undegraded":"2024-09-13T23:28:22.844255+0000","last_fullsized":"2024-09-13T23:28:22.844255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:46.511629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901641+0000","last_change":"2024-09-13T23:25:15.295321+0000","last_active":"2024-09-13T23:26:37.901641+0000","last_peered":"2024-09-13T23:26:37.901641+0000","last_clean":"2024-09-13T23:26:37.901641+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:26:37.901641+0000","last_undegraded":"2024-09-13T23:26:37.901641+0000","last_fullsized":"2024-09-13T23:26:37.901641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:07.615477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373680+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:25:52.373680+0000","last_peered":"2024-09-13T23:25:52.373680+0000","last_clean":"2024-09-13T23:25:52.373680+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:25:52.373680+0000","last_undegraded":"2024-09-13T23:25:52.373680+0000","last_fullsized":"2024-09-13T23:25:52.373680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:19.192252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376682+0000","last_change":"2024-09-13T23:25:17.288064+0000","last_active":"2024-09-13T23:25:52.376682+0000","last_peered":"2024-09-13T23:25:52.376682+0000","last_clean":"2024-09-13T23:25:52.376682+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:25:52.376682+0000","last_undegraded":"2024-09-13T23:25:52.376682+0000","last_fullsized":"2024-09-13T23:25:52.376682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:40.830361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'39","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.170472+0000","last_change":"2024-09-13T23:25:19.292186+0000","last_active":"2024-09-13T23:27:20.170472+0000","last_peered":"2024-09-13T23:27:20.170472+0000","last_clean":"2024-09-13T23:27:20.170472+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:27:20.170472+0000","last_undegraded":"2024-09-13T23:27:20.170472+0000","last_fullsized":"2024-09-13T23:27:20.170472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:33.111945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373673+0000","last_change":"2024-09-13T23:25:21.307481+0000","last_active":"2024-09-13T23:25:52.373673+0000","last_peered":"2024-09-13T23:25:52.373673+0000","last_clean":"2024-09-13T23:25:52.373673+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:25:52.373673+0000","last_undegraded":"2024-09-13T23:25:52.373673+0000","last_fullsized":"2024-09-13T23:25:52.373673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.794734+0000","last_change":"2024-09-13T23:25:23.303608+0000","last_active":"2024-09-13T23:28:22.794734+0000","last_peered":"2024-09-13T23:28:22.794734+0000","last_clean":"2024-09-13T23:28:22.794734+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:22.794734+0000","last_undegraded":"2024-09-13T23:28:22.794734+0000","last_fullsized":"2024-09-13T23:28:22.794734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:24.083983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901628+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:26:37.901628+0000","last_peered":"2024-09-13T23:26:37.901628+0000","last_clean":"2024-09-13T23:26:37.901628+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:26:37.901628+0000","last_undegraded":"2024-09-13T23:26:37.901628+0000","last_fullsized":"2024-09-13T23:26:37.901628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:01.400783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375969+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:25:52.375969+0000","last_peered":"2024-09-13T23:25:52.375969+0000","last_clean":"2024-09-13T23:25:52.375969+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:25:52.375969+0000","last_undegraded":"2024-09-13T23:25:52.375969+0000","last_fullsized":"2024-09-13T23:25:52.375969+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:42.131218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376079+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:52.376079+0000","last_peered":"2024-09-13T23:25:52.376079+0000","last_clean":"2024-09-13T23:25:52.376079+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:52.376079+0000","last_undegraded":"2024-09-13T23:25:52.376079+0000","last_fullsized":"2024-09-13T23:25:52.376079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374353+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:25:52.374353+0000","last_peered":"2024-09-13T23:25:52.374353+0000","last_clean":"2024-09-13T23:25:52.374353+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:25:52.374353+0000","last_undegraded":"2024-09-13T23:25:52.374353+0000","last_fullsized":"2024-09-13T23:25:52.374353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:49.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378955+0000","last_change":"2024-09-13T23:25:17.286100+0000","last_active":"2024-09-13T23:25:52.378955+0000","last_peered":"2024-09-13T23:25:52.378955+0000","last_clean":"2024-09-13T23:25:52.378955+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:25:52.378955+0000","last_undegraded":"2024-09-13T23:25:52.378955+0000","last_fullsized":"2024-09-13T23:25:52.378955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:55.437449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'78","reported_seq":147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.182700+0000","last_change":"2024-09-13T23:25:19.298079+0000","last_active":"2024-09-13T23:27:20.182700+0000","last_peered":"2024-09-13T23:27:20.182700+0000","last_clean":"2024-09-13T23:27:20.182700+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:27:20.182700+0000","last_undegraded":"2024-09-13T23:27:20.182700+0000","last_fullsized":"2024-09-13T23:27:20.182700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:28.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376686+0000","last_change":"2024-09-13T23:25:21.308687+0000","last_active":"2024-09-13T23:25:52.376686+0000","last_peered":"2024-09-13T23:25:52.376686+0000","last_clean":"2024-09-13T23:25:52.376686+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:25:52.376686+0000","last_undegraded":"2024-09-13T23:25:52.376686+0000","last_fullsized":"2024-09-13T23:25:52.376686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:09.375352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.742526+0000","last_change":"2024-09-13T23:25:23.304383+0000","last_active":"2024-09-13T23:28:22.742526+0000","last_peered":"2024-09-13T23:28:22.742526+0000","last_clean":"2024-09-13T23:28:22.742526+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:22.742526+0000","last_undegraded":"2024-09-13T23:28:22.742526+0000","last_fullsized":"2024-09-13T23:28:22.742526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:15.420600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382727+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.382727+0000","last_peered":"2024-09-13T23:28:22.382727+0000","last_clean":"2024-09-13T23:28:22.382727+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.382727+0000","last_undegraded":"2024-09-13T23:28:22.382727+0000","last_fullsized":"2024-09-13T23:28:22.382727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:49.591312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373570+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:52.373570+0000","last_peered":"2024-09-13T23:25:52.373570+0000","last_clean":"2024-09-13T23:25:52.373570+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:52.373570+0000","last_undegraded":"2024-09-13T23:25:52.373570+0000","last_fullsized":"2024-09-13T23:25:52.373570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326956+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:27:21.326956+0000","last_peered":"2024-09-13T23:27:21.326956+0000","last_clean":"2024-09-13T23:27:21.326956+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:27:21.326956+0000","last_undegraded":"2024-09-13T23:27:21.326956+0000","last_fullsized":"2024-09-13T23:27:21.326956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381102+0000","last_change":"2024-09-13T23:25:17.287907+0000","last_active":"2024-09-13T23:25:52.381102+0000","last_peered":"2024-09-13T23:25:52.381102+0000","last_clean":"2024-09-13T23:25:52.381102+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:25:52.381102+0000","last_undegraded":"2024-09-13T23:25:52.381102+0000","last_fullsized":"2024-09-13T23:25:52.381102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:39:37.373797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'273","reported_seq":476,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364547+0000","last_change":"2024-09-13T23:25:19.299249+0000","last_active":"2024-09-13T23:28:22.364547+0000","last_peered":"2024-09-13T23:28:22.364547+0000","last_clean":"2024-09-13T23:28:22.364547+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:22.364547+0000","last_undegraded":"2024-09-13T23:28:22.364547+0000","last_fullsized":"2024-09-13T23:28:22.364547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:54.251861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380330+0000","last_change":"2024-09-13T23:25:21.304037+0000","last_active":"2024-09-13T23:25:52.380330+0000","last_peered":"2024-09-13T23:25:52.380330+0000","last_clean":"2024-09-13T23:25:52.380330+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:25:52.380330+0000","last_undegraded":"2024-09-13T23:25:52.380330+0000","last_fullsized":"2024-09-13T23:25:52.380330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:34.562617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.721511+0000","last_change":"2024-09-13T23:25:23.308546+0000","last_active":"2024-09-13T23:26:37.721511+0000","last_peered":"2024-09-13T23:26:37.721511+0000","last_clean":"2024-09-13T23:26:37.721511+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:26:37.721511+0000","last_undegraded":"2024-09-13T23:26:37.721511+0000","last_fullsized":"2024-09-13T23:26:37.721511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:15.331780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374990+0000","last_change":"2024-09-13T23:25:15.285194+0000","last_active":"2024-09-13T23:28:22.374990+0000","last_peered":"2024-09-13T23:28:22.374990+0000","last_clean":"2024-09-13T23:28:22.374990+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:28:22.374990+0000","last_undegraded":"2024-09-13T23:28:22.374990+0000","last_fullsized":"2024-09-13T23:28:22.374990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372184+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:52.372184+0000","last_peered":"2024-09-13T23:25:52.372184+0000","last_clean":"2024-09-13T23:25:52.372184+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:52.372184+0000","last_undegraded":"2024-09-13T23:25:52.372184+0000","last_fullsized":"2024-09-13T23:25:52.372184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.889372+0000","last_change":"2024-09-13T23:25:13.287909+0000","last_active":"2024-09-13T23:26:37.889372+0000","last_peered":"2024-09-13T23:26:37.889372+0000","last_clean":"2024-09-13T23:26:37.889372+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:26:37.889372+0000","last_undegraded":"2024-09-13T23:26:37.889372+0000","last_fullsized":"2024-09-13T23:26:37.889372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":219,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.282894+0000","last_change":"2024-09-13T23:25:17.283490+0000","last_active":"2024-09-13T23:27:21.282894+0000","last_peered":"2024-09-13T23:27:21.282894+0000","last_clean":"2024-09-13T23:27:21.282894+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:27:21.282894+0000","last_undegraded":"2024-09-13T23:27:21.282894+0000","last_fullsized":"2024-09-13T23:27:21.282894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364589+0000","last_change":"2024-09-13T23:25:19.293483+0000","last_active":"2024-09-13T23:28:22.364589+0000","last_peered":"2024-09-13T23:28:22.364589+0000","last_clean":"2024-09-13T23:28:22.364589+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:22.364589+0000","last_undegraded":"2024-09-13T23:28:22.364589+0000","last_fullsized":"2024-09-13T23:28:22.364589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:37.400352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375104+0000","last_change":"2024-09-13T23:25:21.302444+0000","last_active":"2024-09-13T23:25:52.375104+0000","last_peered":"2024-09-13T23:25:52.375104+0000","last_clean":"2024-09-13T23:25:52.375104+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:25:52.375104+0000","last_undegraded":"2024-09-13T23:25:52.375104+0000","last_fullsized":"2024-09-13T23:25:52.375104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:59.000917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.075118+0000","last_change":"2024-09-13T23:25:23.311768+0000","last_active":"2024-09-13T23:28:22.075118+0000","last_peered":"2024-09-13T23:28:22.075118+0000","last_clean":"2024-09-13T23:28:22.075118+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:28:22.075118+0000","last_undegraded":"2024-09-13T23:28:22.075118+0000","last_fullsized":"2024-09-13T23:28:22.075118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:53.775798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327023+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:27:21.327023+0000","last_peered":"2024-09-13T23:27:21.327023+0000","last_clean":"2024-09-13T23:27:21.327023+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:27:21.327023+0000","last_undegraded":"2024-09-13T23:27:21.327023+0000","last_fullsized":"2024-09-13T23:27:21.327023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374265+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:52.374265+0000","last_peered":"2024-09-13T23:25:52.374265+0000","last_clean":"2024-09-13T23:25:52.374265+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:52.374265+0000","last_undegraded":"2024-09-13T23:25:52.374265+0000","last_fullsized":"2024-09-13T23:25:52.374265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621755+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.621755+0000","last_peered":"2024-09-13T23:28:22.621755+0000","last_clean":"2024-09-13T23:28:22.621755+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.621755+0000","last_undegraded":"2024-09-13T23:28:22.621755+0000","last_fullsized":"2024-09-13T23:28:22.621755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376731+0000","last_change":"2024-09-13T23:25:17.285610+0000","last_active":"2024-09-13T23:25:52.376731+0000","last_peered":"2024-09-13T23:25:52.376731+0000","last_clean":"2024-09-13T23:25:52.376731+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:25:52.376731+0000","last_undegraded":"2024-09-13T23:25:52.376731+0000","last_fullsized":"2024-09-13T23:25:52.376731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:40.895440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.895417+0000","last_change":"2024-09-13T23:25:19.294517+0000","last_active":"2024-09-13T23:28:21.895417+0000","last_peered":"2024-09-13T23:28:21.895417+0000","last_clean":"2024-09-13T23:28:21.895417+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:21.895417+0000","last_undegraded":"2024-09-13T23:28:21.895417+0000","last_fullsized":"2024-09-13T23:28:21.895417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:57.792215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380367+0000","last_change":"2024-09-13T23:25:21.307983+0000","last_active":"2024-09-13T23:25:52.380367+0000","last_peered":"2024-09-13T23:25:52.380367+0000","last_clean":"2024-09-13T23:25:52.380367+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:25:52.380367+0000","last_undegraded":"2024-09-13T23:25:52.380367+0000","last_fullsized":"2024-09-13T23:25:52.380367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:49.287014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.505152+0000","last_change":"2024-09-13T23:25:23.314405+0000","last_active":"2024-09-13T23:27:21.505152+0000","last_peered":"2024-09-13T23:27:21.505152+0000","last_clean":"2024-09-13T23:27:21.505152+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:27:21.505152+0000","last_undegraded":"2024-09-13T23:27:21.505152+0000","last_fullsized":"2024-09-13T23:27:21.505152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:35.679328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871200+0000","last_change":"2024-09-13T23:25:15.295101+0000","last_active":"2024-09-13T23:27:21.871200+0000","last_peered":"2024-09-13T23:27:21.871200+0000","last_clean":"2024-09-13T23:27:21.871200+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:27:21.871200+0000","last_undegraded":"2024-09-13T23:27:21.871200+0000","last_fullsized":"2024-09-13T23:27:21.871200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374467+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:25:52.374467+0000","last_peered":"2024-09-13T23:25:52.374467+0000","last_clean":"2024-09-13T23:25:52.374467+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:25:52.374467+0000","last_undegraded":"2024-09-13T23:25:52.374467+0000","last_fullsized":"2024-09-13T23:25:52.374467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374857+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:52.374857+0000","last_peered":"2024-09-13T23:25:52.374857+0000","last_clean":"2024-09-13T23:25:52.374857+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:52.374857+0000","last_undegraded":"2024-09-13T23:25:52.374857+0000","last_fullsized":"2024-09-13T23:25:52.374857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326988+0000","last_change":"2024-09-13T23:25:17.285296+0000","last_active":"2024-09-13T23:27:21.326988+0000","last_peered":"2024-09-13T23:27:21.326988+0000","last_clean":"2024-09-13T23:27:21.326988+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:27:21.326988+0000","last_undegraded":"2024-09-13T23:27:21.326988+0000","last_fullsized":"2024-09-13T23:27:21.326988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:16.469594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'63","reported_seq":122,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326920+0000","last_change":"2024-09-13T23:25:19.298514+0000","last_active":"2024-09-13T23:27:21.326920+0000","last_peered":"2024-09-13T23:27:21.326920+0000","last_clean":"2024-09-13T23:27:21.326920+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:27:21.326920+0000","last_undegraded":"2024-09-13T23:27:21.326920+0000","last_fullsized":"2024-09-13T23:27:21.326920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:01.195077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":65,"num_read_kb":68,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372567+0000","last_change":"2024-09-13T23:25:21.301624+0000","last_active":"2024-09-13T23:25:52.372567+0000","last_peered":"2024-09-13T23:25:52.372567+0000","last_clean":"2024-09-13T23:25:52.372567+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:25:52.372567+0000","last_undegraded":"2024-09-13T23:25:52.372567+0000","last_fullsized":"2024-09-13T23:25:52.372567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:48.130925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.785277+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:21.785277+0000","last_peered":"2024-09-13T23:27:21.785277+0000","last_clean":"2024-09-13T23:27:21.785277+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:21.785277+0000","last_undegraded":"2024-09-13T23:27:21.785277+0000","last_fullsized":"2024-09-13T23:27:21.785277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:58.134248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899466+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:26:37.899466+0000","last_peered":"2024-09-13T23:26:37.899466+0000","last_clean":"2024-09-13T23:26:37.899466+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:26:37.899466+0000","last_undegraded":"2024-09-13T23:26:37.899466+0000","last_fullsized":"2024-09-13T23:26:37.899466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:00.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375170+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:25:52.375170+0000","last_peered":"2024-09-13T23:25:52.375170+0000","last_clean":"2024-09-13T23:25:52.375170+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:25:52.375170+0000","last_undegraded":"2024-09-13T23:25:52.375170+0000","last_fullsized":"2024-09-13T23:25:52.375170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382386+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:52.382386+0000","last_peered":"2024-09-13T23:25:52.382386+0000","last_clean":"2024-09-13T23:25:52.382386+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:52.382386+0000","last_undegraded":"2024-09-13T23:25:52.382386+0000","last_fullsized":"2024-09-13T23:25:52.382386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374660+0000","last_change":"2024-09-13T23:25:17.287023+0000","last_active":"2024-09-13T23:25:52.374660+0000","last_peered":"2024-09-13T23:25:52.374660+0000","last_clean":"2024-09-13T23:25:52.374660+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:25:52.374660+0000","last_undegraded":"2024-09-13T23:25:52.374660+0000","last_fullsized":"2024-09-13T23:25:52.374660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:07.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376436+0000","last_change":"2024-09-13T23:25:19.294335+0000","last_active":"2024-09-13T23:25:52.376436+0000","last_peered":"2024-09-13T23:25:52.376436+0000","last_clean":"2024-09-13T23:25:52.376436+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:25:52.376436+0000","last_undegraded":"2024-09-13T23:25:52.376436+0000","last_fullsized":"2024-09-13T23:25:52.376436+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'282","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364508+0000","last_change":"2024-09-13T23:25:21.300733+0000","last_active":"2024-09-13T23:28:22.364508+0000","last_peered":"2024-09-13T23:28:22.364508+0000","last_clean":"2024-09-13T23:28:22.364508+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:22.364508+0000","last_undegraded":"2024-09-13T23:28:22.364508+0000","last_fullsized":"2024-09-13T23:28:22.364508+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:13.414196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380261+0000","last_change":"2024-09-13T23:25:23.311239+0000","last_active":"2024-09-13T23:25:52.380261+0000","last_peered":"2024-09-13T23:25:52.380261+0000","last_clean":"2024-09-13T23:25:52.380261+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:25:52.380261+0000","last_undegraded":"2024-09-13T23:25:52.380261+0000","last_fullsized":"2024-09-13T23:25:52.380261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:01.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.634716+0000","last_change":"2024-09-13T23:25:15.291433+0000","last_active":"2024-09-13T23:28:22.634716+0000","last_peered":"2024-09-13T23:28:22.634716+0000","last_clean":"2024-09-13T23:28:22.634716+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:22.634716+0000","last_undegraded":"2024-09-13T23:28:22.634716+0000","last_fullsized":"2024-09-13T23:28:22.634716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:25.985146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.424804+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:25:55.424804+0000","last_peered":"2024-09-13T23:25:55.424804+0000","last_clean":"2024-09-13T23:25:55.424804+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:25:55.424804+0000","last_undegraded":"2024-09-13T23:25:55.424804+0000","last_fullsized":"2024-09-13T23:25:55.424804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:04.927068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375533+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:52.375533+0000","last_peered":"2024-09-13T23:25:52.375533+0000","last_clean":"2024-09-13T23:25:52.375533+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:52.375533+0000","last_undegraded":"2024-09-13T23:25:52.375533+0000","last_fullsized":"2024-09-13T23:25:52.375533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388035+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:25:52.388035+0000","last_peered":"2024-09-13T23:25:52.388035+0000","last_clean":"2024-09-13T23:25:52.388035+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:25:52.388035+0000","last_undegraded":"2024-09-13T23:25:52.388035+0000","last_fullsized":"2024-09-13T23:25:52.388035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:07.872328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329205+0000","last_change":"2024-09-13T23:25:19.295671+0000","last_active":"2024-09-13T23:27:23.329205+0000","last_peered":"2024-09-13T23:27:23.329205+0000","last_clean":"2024-09-13T23:27:23.329205+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:27:23.329205+0000","last_undegraded":"2024-09-13T23:27:23.329205+0000","last_fullsized":"2024-09-13T23:27:23.329205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.597972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'282","reported_seq":399,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.995385+0000","last_change":"2024-09-13T23:25:21.300629+0000","last_active":"2024-09-13T23:28:22.995385+0000","last_peered":"2024-09-13T23:28:22.995385+0000","last_clean":"2024-09-13T23:28:22.995385+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:22.995385+0000","last_undegraded":"2024-09-13T23:28:22.995385+0000","last_fullsized":"2024-09-13T23:28:22.995385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:24.498793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.431442+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:25:55.431442+0000","last_peered":"2024-09-13T23:25:55.431442+0000","last_clean":"2024-09-13T23:25:55.431442+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:25:55.431442+0000","last_undegraded":"2024-09-13T23:25:55.431442+0000","last_fullsized":"2024-09-13T23:25:55.431442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:10.438084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899058+0000","last_change":"2024-09-13T23:25:15.289794+0000","last_active":"2024-09-13T23:26:37.899058+0000","last_peered":"2024-09-13T23:26:37.899058+0000","last_clean":"2024-09-13T23:26:37.899058+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:26:37.899058+0000","last_undegraded":"2024-09-13T23:26:37.899058+0000","last_fullsized":"2024-09-13T23:26:37.899058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:15.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.619082+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.619082+0000","last_peered":"2024-09-13T23:28:22.619082+0000","last_clean":"2024-09-13T23:28:22.619082+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.619082+0000","last_undegraded":"2024-09-13T23:28:22.619082+0000","last_fullsized":"2024-09-13T23:28:22.619082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:09.098791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380490+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:52.380490+0000","last_peered":"2024-09-13T23:25:52.380490+0000","last_clean":"2024-09-13T23:25:52.380490+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:52.380490+0000","last_undegraded":"2024-09-13T23:25:52.380490+0000","last_fullsized":"2024-09-13T23:25:52.380490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388053+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:25:52.388053+0000","last_peered":"2024-09-13T23:25:52.388053+0000","last_clean":"2024-09-13T23:25:52.388053+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:25:52.388053+0000","last_undegraded":"2024-09-13T23:25:52.388053+0000","last_fullsized":"2024-09-13T23:25:52.388053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:53.886096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'83","reported_seq":155,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328394+0000","last_change":"2024-09-13T23:25:19.291785+0000","last_active":"2024-09-13T23:27:23.328394+0000","last_peered":"2024-09-13T23:27:23.328394+0000","last_clean":"2024-09-13T23:27:23.328394+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:27:23.328394+0000","last_undegraded":"2024-09-13T23:27:23.328394+0000","last_fullsized":"2024-09-13T23:27:23.328394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:19.764533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374724+0000","last_change":"2024-09-13T23:25:21.301723+0000","last_active":"2024-09-13T23:25:52.374724+0000","last_peered":"2024-09-13T23:25:52.374724+0000","last_clean":"2024-09-13T23:25:52.374724+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:25:52.374724+0000","last_undegraded":"2024-09-13T23:25:52.374724+0000","last_fullsized":"2024-09-13T23:25:52.374724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:00.977979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373401+0000","last_change":"2024-09-13T23:25:23.305632+0000","last_active":"2024-09-13T23:25:52.373401+0000","last_peered":"2024-09-13T23:25:52.373401+0000","last_clean":"2024-09-13T23:25:52.373401+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:25:52.373401+0000","last_undegraded":"2024-09-13T23:25:52.373401+0000","last_fullsized":"2024-09-13T23:25:52.373401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.047663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375073+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:25:52.375073+0000","last_peered":"2024-09-13T23:25:52.375073+0000","last_clean":"2024-09-13T23:25:52.375073+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:25:52.375073+0000","last_undegraded":"2024-09-13T23:25:52.375073+0000","last_fullsized":"2024-09-13T23:25:52.375073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:36.465581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479975+0000","last_change":"2024-09-13T23:25:15.289596+0000","last_active":"2024-09-13T23:28:22.479975+0000","last_peered":"2024-09-13T23:28:22.479975+0000","last_clean":"2024-09-13T23:28:22.479975+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:28:22.479975+0000","last_undegraded":"2024-09-13T23:28:22.479975+0000","last_fullsized":"2024-09-13T23:28:22.479975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.021512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375986+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:52.375986+0000","last_peered":"2024-09-13T23:25:52.375986+0000","last_clean":"2024-09-13T23:25:52.375986+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:25:52.375986+0000","last_undegraded":"2024-09-13T23:25:52.375986+0000","last_fullsized":"2024-09-13T23:25:52.375986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:40.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379392+0000","last_change":"2024-09-13T23:25:17.286995+0000","last_active":"2024-09-13T23:25:52.379392+0000","last_peered":"2024-09-13T23:25:52.379392+0000","last_clean":"2024-09-13T23:25:52.379392+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:25:52.379392+0000","last_undegraded":"2024-09-13T23:25:52.379392+0000","last_fullsized":"2024-09-13T23:25:52.379392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:28.543035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.174996+0000","last_change":"2024-09-13T23:25:19.299340+0000","last_active":"2024-09-13T23:27:20.174996+0000","last_peered":"2024-09-13T23:27:20.174996+0000","last_clean":"2024-09-13T23:27:20.174996+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:27:20.174996+0000","last_undegraded":"2024-09-13T23:27:20.174996+0000","last_fullsized":"2024-09-13T23:27:20.174996+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:19.887611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374367+0000","last_change":"2024-09-13T23:25:21.306435+0000","last_active":"2024-09-13T23:25:52.374367+0000","last_peered":"2024-09-13T23:25:52.374367+0000","last_clean":"2024-09-13T23:25:52.374367+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:25:52.374367+0000","last_undegraded":"2024-09-13T23:25:52.374367+0000","last_fullsized":"2024-09-13T23:25:52.374367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.772839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:19.870950+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:19.870950+0000","last_peered":"2024-09-13T23:27:19.870950+0000","last_clean":"2024-09-13T23:27:19.870950+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:19.870950+0000","last_undegraded":"2024-09-13T23:27:19.870950+0000","last_fullsized":"2024-09-13T23:27:19.870950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:47.394971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739917+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.739917+0000","last_peered":"2024-09-13T23:28:22.739917+0000","last_clean":"2024-09-13T23:28:22.739917+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.739917+0000","last_undegraded":"2024-09-13T23:28:22.739917+0000","last_fullsized":"2024-09-13T23:28:22.739917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.848834+0000","last_change":"2024-09-13T23:25:13.287807+0000","last_active":"2024-09-13T23:27:21.848834+0000","last_peered":"2024-09-13T23:27:21.848834+0000","last_clean":"2024-09-13T23:27:21.848834+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:27:21.848834+0000","last_undegraded":"2024-09-13T23:27:21.848834+0000","last_fullsized":"2024-09-13T23:27:21.848834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379956+0000","last_change":"2024-09-13T23:25:17.287358+0000","last_active":"2024-09-13T23:25:52.379956+0000","last_peered":"2024-09-13T23:25:52.379956+0000","last_clean":"2024-09-13T23:25:52.379956+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:25:52.379956+0000","last_undegraded":"2024-09-13T23:25:52.379956+0000","last_fullsized":"2024-09-13T23:25:52.379956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:52.433067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900136+0000","last_change":"2024-09-13T23:25:19.290459+0000","last_active":"2024-09-13T23:28:21.900136+0000","last_peered":"2024-09-13T23:28:21.900136+0000","last_clean":"2024-09-13T23:28:21.900136+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:21.900136+0000","last_undegraded":"2024-09-13T23:28:21.900136+0000","last_fullsized":"2024-09-13T23:28:21.900136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:49.482704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372343+0000","last_change":"2024-09-13T23:25:21.308722+0000","last_active":"2024-09-13T23:25:52.372343+0000","last_peered":"2024-09-13T23:25:52.372343+0000","last_clean":"2024-09-13T23:25:52.372343+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:25:52.372343+0000","last_undegraded":"2024-09-13T23:25:52.372343+0000","last_fullsized":"2024-09-13T23:25:52.372343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:25.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.812141+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:25:54.812141+0000","last_peered":"2024-09-13T23:25:54.812141+0000","last_clean":"2024-09-13T23:25:54.812141+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:25:54.812141+0000","last_undegraded":"2024-09-13T23:25:54.812141+0000","last_fullsized":"2024-09-13T23:25:54.812141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:51.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478456+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.478456+0000","last_peered":"2024-09-13T23:28:22.478456+0000","last_clean":"2024-09-13T23:28:22.478456+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.478456+0000","last_undegraded":"2024-09-13T23:28:22.478456+0000","last_fullsized":"2024-09-13T23:28:22.478456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.815605+0000","last_change":"2024-09-13T23:25:13.286024+0000","last_active":"2024-09-13T23:27:21.815605+0000","last_peered":"2024-09-13T23:27:21.815605+0000","last_clean":"2024-09-13T23:27:21.815605+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:27:21.815605+0000","last_undegraded":"2024-09-13T23:27:21.815605+0000","last_fullsized":"2024-09-13T23:27:21.815605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.371452+0000","last_change":"2024-09-13T23:25:17.286907+0000","last_active":"2024-09-13T23:25:52.371452+0000","last_peered":"2024-09-13T23:25:52.371452+0000","last_clean":"2024-09-13T23:25:52.371452+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:25:52.371452+0000","last_undegraded":"2024-09-13T23:25:52.371452+0000","last_fullsized":"2024-09-13T23:25:52.371452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:40.004624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'41","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.028937+0000","last_change":"2024-09-13T23:25:19.293305+0000","last_active":"2024-09-13T23:28:22.028937+0000","last_peered":"2024-09-13T23:28:22.028937+0000","last_clean":"2024-09-13T23:28:22.028937+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:22.028937+0000","last_undegraded":"2024-09-13T23:28:22.028937+0000","last_fullsized":"2024-09-13T23:28:22.028937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:19.534065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375591+0000","last_change":"2024-09-13T23:25:21.299732+0000","last_active":"2024-09-13T23:25:52.375591+0000","last_peered":"2024-09-13T23:25:52.375591+0000","last_clean":"2024-09-13T23:25:52.375591+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:25:52.375591+0000","last_undegraded":"2024-09-13T23:25:52.375591+0000","last_fullsized":"2024-09-13T23:25:52.375591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:43.808950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625968+0000","last_change":"2024-09-13T23:25:15.291739+0000","last_active":"2024-09-13T23:28:22.625968+0000","last_peered":"2024-09-13T23:28:22.625968+0000","last_clean":"2024-09-13T23:28:22.625968+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:22.625968+0000","last_undegraded":"2024-09-13T23:28:22.625968+0000","last_fullsized":"2024-09-13T23:28:22.625968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:57.989606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380093+0000","last_change":"2024-09-13T23:25:13.288670+0000","last_active":"2024-09-13T23:25:52.380093+0000","last_peered":"2024-09-13T23:25:52.380093+0000","last_clean":"2024-09-13T23:25:52.380093+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:25:52.380093+0000","last_undegraded":"2024-09-13T23:25:52.380093+0000","last_fullsized":"2024-09-13T23:25:52.380093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379765+0000","last_change":"2024-09-13T23:25:17.289029+0000","last_active":"2024-09-13T23:25:52.379765+0000","last_peered":"2024-09-13T23:25:52.379765+0000","last_clean":"2024-09-13T23:25:52.379765+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:25:52.379765+0000","last_undegraded":"2024-09-13T23:25:52.379765+0000","last_fullsized":"2024-09-13T23:25:52.379765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.980532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.159963+0000","last_change":"2024-09-13T23:25:19.288912+0000","last_active":"2024-09-13T23:27:20.159963+0000","last_peered":"2024-09-13T23:27:20.159963+0000","last_clean":"2024-09-13T23:27:20.159963+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:27:20.159963+0000","last_undegraded":"2024-09-13T23:27:20.159963+0000","last_fullsized":"2024-09-13T23:27:20.159963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:42.902191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373575+0000","last_change":"2024-09-13T23:25:21.298721+0000","last_active":"2024-09-13T23:25:52.373575+0000","last_peered":"2024-09-13T23:25:52.373575+0000","last_clean":"2024-09-13T23:25:52.373575+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:25:52.373575+0000","last_undegraded":"2024-09-13T23:25:52.373575+0000","last_fullsized":"2024-09-13T23:25:52.373575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:35.119012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739696+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.739696+0000","last_peered":"2024-09-13T23:28:22.739696+0000","last_clean":"2024-09-13T23:28:22.739696+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.739696+0000","last_undegraded":"2024-09-13T23:28:22.739696+0000","last_fullsized":"2024-09-13T23:28:22.739696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:13.221204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373681+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:25:52.373681+0000","last_peered":"2024-09-13T23:25:52.373681+0000","last_clean":"2024-09-13T23:25:52.373681+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:25:52.373681+0000","last_undegraded":"2024-09-13T23:25:52.373681+0000","last_fullsized":"2024-09-13T23:25:52.373681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:04.176141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376297+0000","last_change":"2024-09-13T23:25:17.285736+0000","last_active":"2024-09-13T23:25:52.376297+0000","last_peered":"2024-09-13T23:25:52.376297+0000","last_clean":"2024-09-13T23:25:52.376297+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:25:52.376297+0000","last_undegraded":"2024-09-13T23:25:52.376297+0000","last_fullsized":"2024-09-13T23:25:52.376297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'55","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:51.331504+0000","last_change":"2024-09-13T23:25:19.290018+0000","last_active":"2024-09-13T23:27:51.331504+0000","last_peered":"2024-09-13T23:27:51.331504+0000","last_clean":"2024-09-13T23:27:51.331504+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:27:51.331504+0000","last_undegraded":"2024-09-13T23:27:51.331504+0000","last_fullsized":"2024-09-13T23:27:51.331504+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.123858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5916,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":42,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374548+0000","last_change":"2024-09-13T23:25:21.300887+0000","last_active":"2024-09-13T23:25:52.374548+0000","last_peered":"2024-09-13T23:25:52.374548+0000","last_clean":"2024-09-13T23:25:52.374548+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:25:52.374548+0000","last_undegraded":"2024-09-13T23:25:52.374548+0000","last_fullsized":"2024-09-13T23:25:52.374548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:45.277378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.869223+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:21.869223+0000","last_peered":"2024-09-13T23:27:21.869223+0000","last_clean":"2024-09-13T23:27:21.869223+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:21.869223+0000","last_undegraded":"2024-09-13T23:27:21.869223+0000","last_fullsized":"2024-09-13T23:27:21.869223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:52.742462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.864009+0000","last_change":"2024-09-13T23:25:15.281867+0000","last_active":"2024-09-13T23:27:21.864009+0000","last_peered":"2024-09-13T23:27:21.864009+0000","last_clean":"2024-09-13T23:27:21.864009+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:27:21.864009+0000","last_undegraded":"2024-09-13T23:27:21.864009+0000","last_fullsized":"2024-09-13T23:27:21.864009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330940+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:27:38.330940+0000","last_peered":"2024-09-13T23:27:38.330940+0000","last_clean":"2024-09-13T23:27:38.330940+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:27:38.330940+0000","last_undegraded":"2024-09-13T23:27:38.330940+0000","last_fullsized":"2024-09-13T23:27:38.330940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:32.466032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375392+0000","last_change":"2024-09-13T23:25:17.282822+0000","last_active":"2024-09-13T23:25:52.375392+0000","last_peered":"2024-09-13T23:25:52.375392+0000","last_clean":"2024-09-13T23:25:52.375392+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:25:52.375392+0000","last_undegraded":"2024-09-13T23:25:52.375392+0000","last_fullsized":"2024-09-13T23:25:52.375392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:34.290866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.160935+0000","last_change":"2024-09-13T23:25:19.290348+0000","last_active":"2024-09-13T23:27:20.160935+0000","last_peered":"2024-09-13T23:27:20.160935+0000","last_clean":"2024-09-13T23:27:20.160935+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:27:20.160935+0000","last_undegraded":"2024-09-13T23:27:20.160935+0000","last_fullsized":"2024-09-13T23:27:20.160935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:41.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381331+0000","last_change":"2024-09-13T23:25:21.305428+0000","last_active":"2024-09-13T23:25:52.381331+0000","last_peered":"2024-09-13T23:25:52.381331+0000","last_clean":"2024-09-13T23:25:52.381331+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:25:52.381331+0000","last_undegraded":"2024-09-13T23:25:52.381331+0000","last_fullsized":"2024-09-13T23:25:52.381331+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373824+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:25:52.373824+0000","last_peered":"2024-09-13T23:25:52.373824+0000","last_clean":"2024-09-13T23:25:52.373824+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:25:52.373824+0000","last_undegraded":"2024-09-13T23:25:52.373824+0000","last_fullsized":"2024-09-13T23:25:52.373824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:45.821221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717093+0000","last_change":"2024-09-13T23:25:15.290421+0000","last_active":"2024-09-13T23:26:37.717093+0000","last_peered":"2024-09-13T23:26:37.717093+0000","last_clean":"2024-09-13T23:26:37.717093+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:26:37.717093+0000","last_undegraded":"2024-09-13T23:26:37.717093+0000","last_fullsized":"2024-09-13T23:26:37.717093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:22.137388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.272409+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:25:54.272409+0000","last_peered":"2024-09-13T23:25:54.272409+0000","last_clean":"2024-09-13T23:25:54.272409+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:25:54.272409+0000","last_undegraded":"2024-09-13T23:25:54.272409+0000","last_fullsized":"2024-09-13T23:25:54.272409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'4","reported_seq":226,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.272703+0000","last_change":"2024-09-13T23:25:17.282523+0000","last_active":"2024-09-13T23:27:21.272703+0000","last_peered":"2024-09-13T23:27:21.272703+0000","last_clean":"2024-09-13T23:27:21.272703+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:27:21.272703+0000","last_undegraded":"2024-09-13T23:27:21.272703+0000","last_fullsized":"2024-09-13T23:27:21.272703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:09.619639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'32","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.178897+0000","last_change":"2024-09-13T23:25:19.295026+0000","last_active":"2024-09-13T23:27:20.178897+0000","last_peered":"2024-09-13T23:27:20.178897+0000","last_clean":"2024-09-13T23:27:20.178897+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:27:20.178897+0000","last_undegraded":"2024-09-13T23:27:20.178897+0000","last_fullsized":"2024-09-13T23:27:20.178897+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375400+0000","last_change":"2024-09-13T23:25:21.301455+0000","last_active":"2024-09-13T23:25:52.375400+0000","last_peered":"2024-09-13T23:25:52.375400+0000","last_clean":"2024-09-13T23:25:52.375400+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:25:52.375400+0000","last_undegraded":"2024-09-13T23:25:52.375400+0000","last_fullsized":"2024-09-13T23:25:52.375400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:40.147072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.394588+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.394588+0000","last_peered":"2024-09-13T23:28:22.394588+0000","last_clean":"2024-09-13T23:28:22.394588+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.394588+0000","last_undegraded":"2024-09-13T23:28:22.394588+0000","last_fullsized":"2024-09-13T23:28:22.394588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.414979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.376519+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.376519+0000","last_peered":"2024-09-13T23:28:22.376519+0000","last_clean":"2024-09-13T23:28:22.376519+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.376519+0000","last_undegraded":"2024-09-13T23:28:22.376519+0000","last_fullsized":"2024-09-13T23:28:22.376519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613616+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.613616+0000","last_peered":"2024-09-13T23:28:22.613616+0000","last_clean":"2024-09-13T23:28:22.613616+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.613616+0000","last_undegraded":"2024-09-13T23:28:22.613616+0000","last_fullsized":"2024-09-13T23:28:22.613616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:20.499420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380719+0000","last_change":"2024-09-13T23:25:17.285551+0000","last_active":"2024-09-13T23:25:52.380719+0000","last_peered":"2024-09-13T23:25:52.380719+0000","last_clean":"2024-09-13T23:25:52.380719+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:25:52.380719+0000","last_undegraded":"2024-09-13T23:25:52.380719+0000","last_fullsized":"2024-09-13T23:25:52.380719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:36.219409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.818061+0000","last_change":"2024-09-13T23:25:19.294499+0000","last_active":"2024-09-13T23:25:54.818061+0000","last_peered":"2024-09-13T23:25:54.818061+0000","last_clean":"2024-09-13T23:25:54.818061+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:25:54.818061+0000","last_undegraded":"2024-09-13T23:25:54.818061+0000","last_fullsized":"2024-09-13T23:25:54.818061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:06.976502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'282","reported_seq":366,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364507+0000","last_change":"2024-09-13T23:25:21.304914+0000","last_active":"2024-09-13T23:28:22.364507+0000","last_peered":"2024-09-13T23:28:22.364507+0000","last_clean":"2024-09-13T23:28:22.364507+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:22.364507+0000","last_undegraded":"2024-09-13T23:28:22.364507+0000","last_fullsized":"2024-09-13T23:28:22.364507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:11.529972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373312+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:25:52.373312+0000","last_peered":"2024-09-13T23:25:52.373312+0000","last_clean":"2024-09-13T23:25:52.373312+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:25:52.373312+0000","last_undegraded":"2024-09-13T23:25:52.373312+0000","last_fullsized":"2024-09-13T23:25:52.373312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:54.970107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626042+0000","last_change":"2024-09-13T23:25:15.286332+0000","last_active":"2024-09-13T23:28:22.626042+0000","last_peered":"2024-09-13T23:28:22.626042+0000","last_clean":"2024-09-13T23:28:22.626042+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:22.626042+0000","last_undegraded":"2024-09-13T23:28:22.626042+0000","last_fullsized":"2024-09-13T23:28:22.626042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:34:15.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380462+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:25:52.380462+0000","last_peered":"2024-09-13T23:25:52.380462+0000","last_clean":"2024-09-13T23:25:52.380462+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:25:52.380462+0000","last_undegraded":"2024-09-13T23:25:52.380462+0000","last_fullsized":"2024-09-13T23:25:52.380462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379838+0000","last_change":"2024-09-13T23:25:17.286289+0000","last_active":"2024-09-13T23:25:52.379838+0000","last_peered":"2024-09-13T23:25:52.379838+0000","last_clean":"2024-09-13T23:25:52.379838+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:25:52.379838+0000","last_undegraded":"2024-09-13T23:25:52.379838+0000","last_fullsized":"2024-09-13T23:25:52.379838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'36","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.151515+0000","last_change":"2024-09-13T23:25:19.296410+0000","last_active":"2024-09-13T23:27:20.151515+0000","last_peered":"2024-09-13T23:27:20.151515+0000","last_clean":"2024-09-13T23:27:20.151515+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:27:20.151515+0000","last_undegraded":"2024-09-13T23:27:20.151515+0000","last_fullsized":"2024-09-13T23:27:20.151515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:43.270311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373670+0000","last_change":"2024-09-13T23:25:21.307423+0000","last_active":"2024-09-13T23:25:52.373670+0000","last_peered":"2024-09-13T23:25:52.373670+0000","last_clean":"2024-09-13T23:25:52.373670+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:25:52.373670+0000","last_undegraded":"2024-09-13T23:25:52.373670+0000","last_fullsized":"2024-09-13T23:25:52.373670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379286+0000","last_change":"2024-09-13T23:25:23.309558+0000","last_active":"2024-09-13T23:25:52.379286+0000","last_peered":"2024-09-13T23:25:52.379286+0000","last_clean":"2024-09-13T23:25:52.379286+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:25:52.379286+0000","last_undegraded":"2024-09-13T23:25:52.379286+0000","last_fullsized":"2024-09-13T23:25:52.379286+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372351+0000","last_change":"2024-09-13T23:25:15.279688+0000","last_active":"2024-09-13T23:25:52.372351+0000","last_peered":"2024-09-13T23:25:52.372351+0000","last_clean":"2024-09-13T23:25:52.372351+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:25:52.372351+0000","last_undegraded":"2024-09-13T23:25:52.372351+0000","last_fullsized":"2024-09-13T23:25:52.372351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382669+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:25:52.382669+0000","last_peered":"2024-09-13T23:25:52.382669+0000","last_clean":"2024-09-13T23:25:52.382669+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:25:52.382669+0000","last_undegraded":"2024-09-13T23:25:52.382669+0000","last_fullsized":"2024-09-13T23:25:52.382669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:10.620559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373525+0000","last_change":"2024-09-13T23:25:17.285313+0000","last_active":"2024-09-13T23:25:52.373525+0000","last_peered":"2024-09-13T23:25:52.373525+0000","last_clean":"2024-09-13T23:25:52.373525+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:25:52.373525+0000","last_undegraded":"2024-09-13T23:25:52.373525+0000","last_fullsized":"2024-09-13T23:25:52.373525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:03.256424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.152651+0000","last_change":"2024-09-13T23:25:19.298312+0000","last_active":"2024-09-13T23:27:20.152651+0000","last_peered":"2024-09-13T23:27:20.152651+0000","last_clean":"2024-09-13T23:27:20.152651+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:27:20.152651+0000","last_undegraded":"2024-09-13T23:27:20.152651+0000","last_fullsized":"2024-09-13T23:27:20.152651+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:23.503939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374897+0000","last_change":"2024-09-13T23:25:21.306963+0000","last_active":"2024-09-13T23:25:52.374897+0000","last_peered":"2024-09-13T23:25:52.374897+0000","last_clean":"2024-09-13T23:25:52.374897+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:25:52.374897+0000","last_undegraded":"2024-09-13T23:25:52.374897+0000","last_fullsized":"2024-09-13T23:25:52.374897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.701389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.896491+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:26:37.896491+0000","last_peered":"2024-09-13T23:26:37.896491+0000","last_clean":"2024-09-13T23:26:37.896491+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:26:37.896491+0000","last_undegraded":"2024-09-13T23:26:37.896491+0000","last_fullsized":"2024-09-13T23:26:37.896491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.998081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697384+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.697384+0000","last_peered":"2024-09-13T23:28:22.697384+0000","last_clean":"2024-09-13T23:28:22.697384+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.697384+0000","last_undegraded":"2024-09-13T23:28:22.697384+0000","last_fullsized":"2024-09-13T23:28:22.697384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:03.357373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616400+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.616400+0000","last_peered":"2024-09-13T23:28:22.616400+0000","last_clean":"2024-09-13T23:28:22.616400+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.616400+0000","last_undegraded":"2024-09-13T23:28:22.616400+0000","last_fullsized":"2024-09-13T23:28:22.616400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:10.971868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.378929+0000","last_change":"2024-09-13T23:25:17.289277+0000","last_active":"2024-09-13T23:25:52.378929+0000","last_peered":"2024-09-13T23:25:52.378929+0000","last_clean":"2024-09-13T23:25:52.378929+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:25:52.378929+0000","last_undegraded":"2024-09-13T23:25:52.378929+0000","last_fullsized":"2024-09-13T23:25:52.378929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:40.810119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'26","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.176935+0000","last_change":"2024-09-13T23:25:19.294964+0000","last_active":"2024-09-13T23:27:20.176935+0000","last_peered":"2024-09-13T23:27:20.176935+0000","last_clean":"2024-09-13T23:27:20.176935+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:27:20.176935+0000","last_undegraded":"2024-09-13T23:27:20.176935+0000","last_fullsized":"2024-09-13T23:27:20.176935+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:15.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374493+0000","last_change":"2024-09-13T23:25:21.305087+0000","last_active":"2024-09-13T23:25:52.374493+0000","last_peered":"2024-09-13T23:25:52.374493+0000","last_clean":"2024-09-13T23:25:52.374493+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:25:52.374493+0000","last_undegraded":"2024-09-13T23:25:52.374493+0000","last_fullsized":"2024-09-13T23:25:52.374493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:44.058731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.187340+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:20.187340+0000","last_peered":"2024-09-13T23:27:20.187340+0000","last_clean":"2024-09-13T23:27:20.187340+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:20.187340+0000","last_undegraded":"2024-09-13T23:27:20.187340+0000","last_fullsized":"2024-09-13T23:27:20.187340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:43.115277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632608+0000","last_change":"2024-09-13T23:25:15.286878+0000","last_active":"2024-09-13T23:28:22.632608+0000","last_peered":"2024-09-13T23:28:22.632608+0000","last_clean":"2024-09-13T23:28:22.632608+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:22.632608+0000","last_undegraded":"2024-09-13T23:28:22.632608+0000","last_fullsized":"2024-09-13T23:28:22.632608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:37.878923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381505+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:25:52.381505+0000","last_peered":"2024-09-13T23:25:52.381505+0000","last_clean":"2024-09-13T23:25:52.381505+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:25:52.381505+0000","last_undegraded":"2024-09-13T23:25:52.381505+0000","last_fullsized":"2024-09-13T23:25:52.381505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.774635+0000","last_change":"2024-09-13T23:25:17.290217+0000","last_active":"2024-09-13T23:27:18.774635+0000","last_peered":"2024-09-13T23:27:18.774635+0000","last_clean":"2024-09-13T23:27:18.774635+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:27:18.774635+0000","last_undegraded":"2024-09-13T23:27:18.774635+0000","last_fullsized":"2024-09-13T23:27:18.774635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'32","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900968+0000","last_change":"2024-09-13T23:25:19.294973+0000","last_active":"2024-09-13T23:28:21.900968+0000","last_peered":"2024-09-13T23:28:21.900968+0000","last_clean":"2024-09-13T23:28:21.900968+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:21.900968+0000","last_undegraded":"2024-09-13T23:28:21.900968+0000","last_fullsized":"2024-09-13T23:28:21.900968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:49.482309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374666+0000","last_change":"2024-09-13T23:25:21.307475+0000","last_active":"2024-09-13T23:25:52.374666+0000","last_peered":"2024-09-13T23:25:52.374666+0000","last_clean":"2024-09-13T23:25:52.374666+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:25:52.374666+0000","last_undegraded":"2024-09-13T23:25:52.374666+0000","last_fullsized":"2024-09-13T23:25:52.374666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:24.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.699992+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.699992+0000","last_peered":"2024-09-13T23:28:22.699992+0000","last_clean":"2024-09-13T23:28:22.699992+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.699992+0000","last_undegraded":"2024-09-13T23:28:22.699992+0000","last_fullsized":"2024-09-13T23:28:22.699992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:57.777775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626210+0000","last_change":"2024-09-13T23:25:15.296960+0000","last_active":"2024-09-13T23:28:22.626210+0000","last_peered":"2024-09-13T23:28:22.626210+0000","last_clean":"2024-09-13T23:28:22.626210+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:22.626210+0000","last_undegraded":"2024-09-13T23:28:22.626210+0000","last_fullsized":"2024-09-13T23:28:22.626210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:32.286703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.610521+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.610521+0000","last_peered":"2024-09-13T23:28:22.610521+0000","last_clean":"2024-09-13T23:28:22.610521+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.610521+0000","last_undegraded":"2024-09-13T23:28:22.610521+0000","last_fullsized":"2024-09-13T23:28:22.610521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733334+0000","last_change":"2024-09-13T23:25:15.285164+0000","last_active":"2024-09-13T23:28:22.733334+0000","last_peered":"2024-09-13T23:28:22.733334+0000","last_clean":"2024-09-13T23:28:22.733334+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:28:22.733334+0000","last_undegraded":"2024-09-13T23:28:22.733334+0000","last_fullsized":"2024-09-13T23:28:22.733334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374101+0000","last_change":"2024-09-13T23:25:13.281843+0000","last_active":"2024-09-13T23:25:52.374101+0000","last_peered":"2024-09-13T23:25:52.374101+0000","last_clean":"2024-09-13T23:25:52.374101+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:25:52.374101+0000","last_undegraded":"2024-09-13T23:25:52.374101+0000","last_fullsized":"2024-09-13T23:25:52.374101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626100+0000","last_change":"2024-09-13T23:25:15.280336+0000","last_active":"2024-09-13T23:28:22.626100+0000","last_peered":"2024-09-13T23:28:22.626100+0000","last_clean":"2024-09-13T23:28:22.626100+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:28:22.626100+0000","last_undegraded":"2024-09-13T23:28:22.626100+0000","last_fullsized":"2024-09-13T23:28:22.626100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:33.711819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374801+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:25:52.374801+0000","last_peered":"2024-09-13T23:25:52.374801+0000","last_clean":"2024-09-13T23:25:52.374801+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:25:52.374801+0000","last_undegraded":"2024-09-13T23:25:52.374801+0000","last_fullsized":"2024-09-13T23:25:52.374801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733197+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.733197+0000","last_peered":"2024-09-13T23:28:22.733197+0000","last_clean":"2024-09-13T23:28:22.733197+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.733197+0000","last_undegraded":"2024-09-13T23:28:22.733197+0000","last_fullsized":"2024-09-13T23:28:22.733197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375346+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:25:52.375346+0000","last_peered":"2024-09-13T23:25:52.375346+0000","last_clean":"2024-09-13T23:25:52.375346+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:25:52.375346+0000","last_undegraded":"2024-09-13T23:25:52.375346+0000","last_fullsized":"2024-09-13T23:25:52.375346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.400507+0000","last_change":"2024-09-13T23:25:15.278977+0000","last_active":"2024-09-13T23:27:18.400507+0000","last_peered":"2024-09-13T23:27:18.400507+0000","last_clean":"2024-09-13T23:27:18.400507+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:27:18.400507+0000","last_undegraded":"2024-09-13T23:27:18.400507+0000","last_fullsized":"2024-09-13T23:27:18.400507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375434+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:25:52.375434+0000","last_peered":"2024-09-13T23:25:52.375434+0000","last_clean":"2024-09-13T23:25:52.375434+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:25:52.375434+0000","last_undegraded":"2024-09-13T23:25:52.375434+0000","last_fullsized":"2024-09-13T23:25:52.375434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871609+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:21.871609+0000","last_peered":"2024-09-13T23:27:21.871609+0000","last_clean":"2024-09-13T23:27:21.871609+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:21.871609+0000","last_undegraded":"2024-09-13T23:27:21.871609+0000","last_fullsized":"2024-09-13T23:27:21.871609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:04.544503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.273183+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:25:54.273183+0000","last_peered":"2024-09-13T23:25:54.273183+0000","last_clean":"2024-09-13T23:25:54.273183+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:25:54.273183+0000","last_undegraded":"2024-09-13T23:25:54.273183+0000","last_fullsized":"2024-09-13T23:25:54.273183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697112+0000","last_change":"2024-09-13T23:25:15.286489+0000","last_active":"2024-09-13T23:28:22.697112+0000","last_peered":"2024-09-13T23:28:22.697112+0000","last_clean":"2024-09-13T23:28:22.697112+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:22.697112+0000","last_undegraded":"2024-09-13T23:28:22.697112+0000","last_fullsized":"2024-09-13T23:28:22.697112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.384574+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:25:52.384574+0000","last_peered":"2024-09-13T23:25:52.384574+0000","last_clean":"2024-09-13T23:25:52.384574+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:25:52.384574+0000","last_undegraded":"2024-09-13T23:25:52.384574+0000","last_fullsized":"2024-09-13T23:25:52.384574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:08.828451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697025+0000","last_change":"2024-09-13T23:25:15.287524+0000","last_active":"2024-09-13T23:28:22.697025+0000","last_peered":"2024-09-13T23:28:22.697025+0000","last_clean":"2024-09-13T23:28:22.697025+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:28:22.697025+0000","last_undegraded":"2024-09-13T23:28:22.697025+0000","last_fullsized":"2024-09-13T23:28:22.697025+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.417154+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:55.417154+0000","last_peered":"2024-09-13T23:25:55.417154+0000","last_clean":"2024-09-13T23:25:55.417154+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:25:55.417154+0000","last_undegraded":"2024-09-13T23:25:55.417154+0000","last_fullsized":"2024-09-13T23:25:55.417154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:41.876893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381077+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:25:52.381077+0000","last_peered":"2024-09-13T23:25:52.381077+0000","last_clean":"2024-09-13T23:25:52.381077+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:25:52.381077+0000","last_undegraded":"2024-09-13T23:25:52.381077+0000","last_fullsized":"2024-09-13T23:25:52.381077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:39.721411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373889+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:25:52.373889+0000","last_peered":"2024-09-13T23:25:52.373889+0000","last_clean":"2024-09-13T23:25:52.373889+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:25:52.373889+0000","last_undegraded":"2024-09-13T23:25:52.373889+0000","last_fullsized":"2024-09-13T23:25:52.373889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:51.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733239+0000","last_change":"2024-09-13T23:25:15.285028+0000","last_active":"2024-09-13T23:28:22.733239+0000","last_peered":"2024-09-13T23:28:22.733239+0000","last_clean":"2024-09-13T23:28:22.733239+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:28:22.733239+0000","last_undegraded":"2024-09-13T23:28:22.733239+0000","last_fullsized":"2024-09-13T23:28:22.733239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:16.065036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.705635+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:26:37.705635+0000","last_peered":"2024-09-13T23:26:37.705635+0000","last_clean":"2024-09-13T23:26:37.705635+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:26:37.705635+0000","last_undegraded":"2024-09-13T23:26:37.705635+0000","last_fullsized":"2024-09-13T23:26:37.705635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376137+0000","last_change":"2024-09-13T23:25:15.278986+0000","last_active":"2024-09-13T23:25:52.376137+0000","last_peered":"2024-09-13T23:25:52.376137+0000","last_clean":"2024-09-13T23:25:52.376137+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:25:52.376137+0000","last_undegraded":"2024-09-13T23:25:52.376137+0000","last_fullsized":"2024-09-13T23:25:52.376137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.729113+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.729113+0000","last_peered":"2024-09-13T23:28:22.729113+0000","last_clean":"2024-09-13T23:28:22.729113+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.729113+0000","last_undegraded":"2024-09-13T23:28:22.729113+0000","last_fullsized":"2024-09-13T23:28:22.729113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478144+0000","last_change":"2024-09-13T23:25:15.285560+0000","last_active":"2024-09-13T23:28:22.478144+0000","last_peered":"2024-09-13T23:28:22.478144+0000","last_clean":"2024-09-13T23:28:22.478144+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:28:22.478144+0000","last_undegraded":"2024-09-13T23:28:22.478144+0000","last_fullsized":"2024-09-13T23:28:22.478144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.422238+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:25:55.422238+0000","last_peered":"2024-09-13T23:25:55.422238+0000","last_clean":"2024-09-13T23:25:55.422238+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:25:55.422238+0000","last_undegraded":"2024-09-13T23:25:55.422238+0000","last_fullsized":"2024-09-13T23:25:55.422238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377262+0000","last_change":"2024-09-13T23:25:15.295677+0000","last_active":"2024-09-13T23:25:52.377262+0000","last_peered":"2024-09-13T23:25:52.377262+0000","last_clean":"2024-09-13T23:25:52.377262+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:25:52.377262+0000","last_undegraded":"2024-09-13T23:25:52.377262+0000","last_fullsized":"2024-09-13T23:25:52.377262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'3","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329947+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:27:28.329947+0000","last_peered":"2024-09-13T23:27:28.329947+0000","last_clean":"2024-09-13T23:27:28.329947+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:27:28.329947+0000","last_undegraded":"2024-09-13T23:27:28.329947+0000","last_fullsized":"2024-09-13T23:27:28.329947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:36.892250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379651+0000","last_change":"2024-09-13T23:25:15.287972+0000","last_active":"2024-09-13T23:25:52.379651+0000","last_peered":"2024-09-13T23:25:52.379651+0000","last_clean":"2024-09-13T23:25:52.379651+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:25:52.379651+0000","last_undegraded":"2024-09-13T23:25:52.379651+0000","last_fullsized":"2024-09-13T23:25:52.379651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383517+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:25:52.383517+0000","last_peered":"2024-09-13T23:25:52.383517+0000","last_clean":"2024-09-13T23:25:52.383517+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:25:52.383517+0000","last_undegraded":"2024-09-13T23:25:52.383517+0000","last_fullsized":"2024-09-13T23:25:52.383517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:21.475245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.399802+0000","last_change":"2024-09-13T23:25:15.289747+0000","last_active":"2024-09-13T23:27:18.399802+0000","last_peered":"2024-09-13T23:27:18.399802+0000","last_clean":"2024-09-13T23:27:18.399802+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:27:18.399802+0000","last_undegraded":"2024-09-13T23:27:18.399802+0000","last_fullsized":"2024-09-13T23:27:18.399802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:46.131004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:13.286270+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842922+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.842922+0000","last_peered":"2024-09-13T23:28:22.842922+0000","last_clean":"2024-09-13T23:28:22.842922+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.842922+0000","last_undegraded":"2024-09-13T23:28:22.842922+0000","last_fullsized":"2024-09-13T23:28:22.842922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380588+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:25:52.380588+0000","last_peered":"2024-09-13T23:25:52.380588+0000","last_clean":"2024-09-13T23:25:52.380588+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:25:52.380588+0000","last_undegraded":"2024-09-13T23:25:52.380588+0000","last_fullsized":"2024-09-13T23:25:52.380588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:43.556989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374102+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:25:52.374102+0000","last_peered":"2024-09-13T23:25:52.374102+0000","last_clean":"2024-09-13T23:25:52.374102+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:25:52.374102+0000","last_undegraded":"2024-09-13T23:25:52.374102+0000","last_fullsized":"2024-09-13T23:25:52.374102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:18.737876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733301+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.733301+0000","last_peered":"2024-09-13T23:28:22.733301+0000","last_clean":"2024-09-13T23:28:22.733301+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.733301+0000","last_undegraded":"2024-09-13T23:28:22.733301+0000","last_fullsized":"2024-09-13T23:28:22.733301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'1","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:36.329312+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:27:36.329312+0000","last_peered":"2024-09-13T23:27:36.329312+0000","last_clean":"2024-09-13T23:27:36.329312+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:27:36.329312+0000","last_undegraded":"2024-09-13T23:27:36.329312+0000","last_fullsized":"2024-09-13T23:27:36.329312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704225+0000","last_change":"2024-09-13T23:25:15.295660+0000","last_active":"2024-09-13T23:28:22.704225+0000","last_peered":"2024-09-13T23:28:22.704225+0000","last_clean":"2024-09-13T23:28:22.704225+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:28:22.704225+0000","last_undegraded":"2024-09-13T23:28:22.704225+0000","last_fullsized":"2024-09-13T23:28:22.704225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44616,"kb_used_data":9272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327224,"statfs":{"total":96636764160,"available":96591077376,"internally_reserved":0,"allocated":9494528,"data_stored":9168045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673007,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52708,"kb_used_data":17364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94319132,"statfs":{"total":96636764160,"available":96582791168,"internally_reserved":0,"allocated":17780736,"data_stored":17508411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673006,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49248,"kb_used_data":13904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322592,"statfs":{"total":96636764160,"available":96586334208,"internally_reserved":0,"allocated":14237696,"data_stored":13950771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43908,"kb_used_data":12724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327932,"statfs":{"total":96636764160,"available":96591802368,"internally_reserved":0,"allocated":13029376,"data_stored":12725025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13225984,"data_stored":13222784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9031680,"data_stored":9028480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:28:30.668 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.793+0000 7fbceef98640 1 Processor -- start 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbceef98640 1 -- start start 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbceef98640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbce809a100 0x7fbce8133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbceef98640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbce809d3b0 con 0x7fbce809bd50 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbceef98640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fbce809c840 con 0x7fbce809a100 2024-09-13T23:28:30.803 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbce7fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fbce809a100 0x7fbce8133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbcecd34640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fbce809bd50 0x7fbce809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40880/0 (socket says 172.21.15.43:40880) 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbcecd34640 1 -- 172.21.15.43:0/3620127241 learned_addr learned my addr 172.21.15.43:0/3620127241 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbce7fff640 1 -- 172.21.15.43:0/3620127241 >> v1:172.21.15.43:6789/0 conn(0x7fbce809bd50 legacy=0x7fbce809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbce77fe640 1 -- 172.21.15.43:0/3620127241 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998380330 0 0) 0x7fbcd8001110 con 0x7fbce809bd50 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.794+0000 7fbce7fff640 1 -- 172.21.15.43:0/3620127241 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce8098230 con 0x7fbce809a100 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.795+0000 7fbce7fff640 1 --2- 172.21.15.43:0/3620127241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8133da0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009720 tx=0x7fbcd002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f859b527b1a7f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.804 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.795+0000 7fbce77fe640 1 -- 172.21.15.43:0/3620127241 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd0037070 con 0x7fbce809a100 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.795+0000 7fbce77fe640 1 -- 172.21.15.43:0/3620127241 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd002ad90 con 0x7fbce809a100 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.795+0000 7fbce77fe640 1 -- 172.21.15.43:0/3620127241 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd0032590 con 0x7fbce809a100 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 -- 172.21.15.43:0/3620127241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 msgr2=0x7fbce8133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 --2- 172.21.15.43:0/3620127241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8133da0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009720 tx=0x7fbcd002a110 comp rx=0 tx=0).stop 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 -- 172.21.15.43:0/3620127241 shutdown_connections 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 --2- 172.21.15.43:0/3620127241 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8133da0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 -- 172.21.15.43:0/3620127241 >> 172.21.15.43:0/3620127241 conn(0x7fbce806d4a0 msgr2=0x7fbce806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 -- 172.21.15.43:0/3620127241 shutdown_connections 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.796+0000 7fbceef98640 1 -- 172.21.15.43:0/3620127241 wait complete. 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbceef98640 1 Processor -- start 2024-09-13T23:28:30.805 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbceef98640 1 -- start start 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbceef98640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbceef98640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fbce8134670 con 0x7fbce809a100 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbcecd34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbcecd34640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34688/0 (socket says 172.21.15.43:34688) 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.797+0000 7fbcecd34640 1 -- 172.21.15.43:0/2267755051 learned_addr learned my addr 172.21.15.43:0/2267755051 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbcecd34640 1 -- 172.21.15.43:0/2267755051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce8125fc0 con 0x7fbce809a100 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbcecd34640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c700 tx=0x7fbcd800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd8018070 con 0x7fbce809a100 2024-09-13T23:28:30.806 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcd80070d0 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce8096570 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcd80073f0 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.798+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce8096f80 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.799+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fbcd801b070 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.799+0000 7fbce57fa640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 0x7fbcc803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.799+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce8126360 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.799+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fbcd804af70 con 0x7fbce809a100 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.799+0000 7fbce7fff640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 0x7fbcc803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:30.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.800+0000 7fbce7fff640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 0x7fbcc803a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0034000 tx=0x7fbcd002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:30.808 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.804+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbce8125fc0 con 0x7fbce809a100 2024-09-13T23:28:30.981 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.980+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbce809d020 con 0x7fbce809a100 2024-09-13T23:28:30.982 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.981+0000 7fbce57fa640 1 -- 172.21.15.43:0/2267755051 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+21260 (secure 0 0 0) 0x7fbce809d3b0 con 0x7fbce809a100 2024-09-13T23:28:30.983 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:30.983 INFO:teuthology.orchestra.run.smithi043.stdout:{"epoch":33,"fsid":"d45f1493-9740-4c4f-a727-0654beec83a1","created":"2024-09-13T23:24:47.264388+0000","modified":"2024-09-13T23:25:52.368467+0000","last_up_change":"2024-09-13T23:24:57.309620+0000","last_in_change":"2024-09-13T23:24:48.339973+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T23:24:59.339268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T23:25:02.932517+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T23:25:11.973441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.440000057220459,"score_stable":1.440000057220459,"optimal_score":1,"raw_score_acting":1.440000057220459,"raw_score_stable":1.440000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T23:25:13.609699+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T23:25:15.592436+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T23:25:17.380105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T23:25:19.329867+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T23:25:21.396430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbc19d48-8273-485f-9a6f-31c1f927425f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6800","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6801","nonce":3849931173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6802","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6803","nonce":3849931173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6806","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6807","nonce":3849931173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.43:6804","nonce":3849931173},{"type":"v1","addr":"172.21.15.43:6805","nonce":3849931173}]},"public_addr":"172.21.15.43:6801/3849931173","cluster_addr":"172.21.15.43:6803/3849931173","heartbeat_back_addr":"172.21.15.43:6807/3849931173","heartbeat_front_addr":"172.21.15.43:6805/3849931173","state":["exists","up"]},{"osd":1,"uuid":"71f3004f-eb62-485d-b2f7-d466392cfba5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6801","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6803","nonce":642925376}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6805","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6807","nonce":642925376}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6815","nonce":642925376}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":642925376},{"type":"v1","addr":"172.21.15.99:6811","nonce":642925376}]},"public_addr":"172.21.15.99:6803/642925376","cluster_addr":"172.21.15.99:6807/642925376","heartbeat_back_addr":"172.21.15.99:6815/642925376","heartbeat_front_addr":"172.21.15.99:6811/642925376","state":["exists","up"]},{"osd":2,"uuid":"8384ecd2-ff83-4338-b221-bd9590425677","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6802","nonce":2157953423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6806","nonce":2157953423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6814","nonce":2157953423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2157953423},{"type":"v1","addr":"172.21.15.99:6810","nonce":2157953423}]},"public_addr":"172.21.15.99:6802/2157953423","cluster_addr":"172.21.15.99:6806/2157953423","heartbeat_back_addr":"172.21.15.99:6814/2157953423","heartbeat_front_addr":"172.21.15.99:6810/2157953423","state":["exists","up"]},{"osd":3,"uuid":"975b1f77-fef9-4942-9b24-2ef1bd202e62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6817","nonce":1212313328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6819","nonce":1212313328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6823","nonce":1212313328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1212313328},{"type":"v1","addr":"172.21.15.99:6821","nonce":1212313328}]},"public_addr":"172.21.15.99:6817/1212313328","cluster_addr":"172.21.15.99:6819/1212313328","heartbeat_back_addr":"172.21.15.99:6823/1212313328","heartbeat_front_addr":"172.21.15.99:6821/1212313328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:54.573871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.107874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.159232+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T23:24:55.590066+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.26","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":3,"to":0}]},{"pgid":"4.3","mappings":[{"from":3,"to":2}]},{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.22","mappings":[{"from":3,"to":0}]},{"pgid":"5.0","mappings":[{"from":0,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 msgr2=0x7fbcc803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 0x7fbcc803a760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0034000 tx=0x7fbcd002e000 comp rx=0 tx=0).stop 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 msgr2=0x7fbce8132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c700 tx=0x7fbcd800cbc0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 shutdown_connections 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fbcc80382a0 0x7fbcc803a760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 --2- 172.21.15.43:0/2267755051 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fbce809a100 0x7fbce8132a40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 >> 172.21.15.43:0/2267755051 conn(0x7fbce806d4a0 msgr2=0x7fbce808d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 shutdown_connections 2024-09-13T23:28:30.985 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:30.983+0000 7fbceef98640 1 -- 172.21.15.43:0/2267755051 wait complete. 2024-09-13T23:28:32.053 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T23:28:32.054 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:28:32.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.171+0000 7fe9a57cf640 1 Processor -- start 2024-09-13T23:28:32.173 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.171+0000 7fe9a57cf640 1 -- start start 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe9a57cf640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe9a006d0c0 0x7fe9a006d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe9a57cf640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9a0099260 con 0x7fe9a006d9e0 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe9a57cf640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fe9a0070670 con 0x7fe9a006d0c0 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99effd640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fe9a006d0c0 0x7fe9a006d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99e7fc640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fe9a006d9e0 0x7fe9a0130b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40890/0 (socket says 172.21.15.43:40890) 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99e7fc640 1 -- 172.21.15.43:0/3514439589 learned_addr learned my addr 172.21.15.43:0/3514439589 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99effd640 1 -- 172.21.15.43:0/3514439589 >> v1:172.21.15.43:6789/0 conn(0x7fe9a006d9e0 legacy=0x7fe9a0130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99effd640 1 -- 172.21.15.43:0/3514439589 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a0071d70 con 0x7fe9a006d0c0 2024-09-13T23:28:32.174 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.172+0000 7fe99dffb640 1 -- 172.21.15.43:0/3514439589 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056722499 0 0) 0x7fe9a0099260 con 0x7fe9a006d9e0 2024-09-13T23:28:32.175 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.173+0000 7fe99effd640 1 --2- 172.21.15.43:0/3514439589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a006d4a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe990009750 tx=0x7fe99002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96596c073a28f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.173+0000 7fe99dffb640 1 -- 172.21.15.43:0/3514439589 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe990037070 con 0x7fe9a006d0c0 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.173+0000 7fe99dffb640 1 -- 172.21.15.43:0/3514439589 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99002ad80 con 0x7fe9a006d0c0 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.173+0000 7fe99dffb640 1 -- 172.21.15.43:0/3514439589 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe990032590 con 0x7fe9a006d0c0 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 -- 172.21.15.43:0/3514439589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 msgr2=0x7fe9a006d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/3514439589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a006d4a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe990009750 tx=0x7fe99002a140 comp rx=0 tx=0).stop 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 -- 172.21.15.43:0/3514439589 shutdown_connections 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/3514439589 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a006d4a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 -- 172.21.15.43:0/3514439589 >> 172.21.15.43:0/3514439589 conn(0x7fe9a00998b0 msgr2=0x7fe9a0099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.176 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 -- 172.21.15.43:0/3514439589 shutdown_connections 2024-09-13T23:28:32.177 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.174+0000 7fe9a57cf640 1 -- 172.21.15.43:0/3514439589 wait complete. 2024-09-13T23:28:32.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe9a57cf640 1 Processor -- start 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe9a57cf640 1 -- start start 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe9a57cf640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe9a57cf640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a0132240 con 0x7fe9a006d0c0 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe99effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe99effd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34708/0 (socket says 172.21.15.43:34708) 2024-09-13T23:28:32.179 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.175+0000 7fe99effd640 1 -- 172.21.15.43:0/1486247452 learned_addr learned my addr 172.21.15.43:0/1486247452 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe99effd640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a00724c0 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe99effd640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe990009750 tx=0x7fe9900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe990041070 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe99003c590 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a0096170 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe990037040 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.176+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a012e4a0 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9a0094930 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fe990044070 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 0x7fe98c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fe99006c720 con 0x7fe9a006d0c0 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 0x7fe98c0465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.180 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe98c046c70 con 0x7fe98c044100 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.177+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe990073050 con 0x7fe9a006d0c0 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.178+0000 7fe99f7fe640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 0x7fe98c0465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.178+0000 7fe99e7fc640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 0x7fe98c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.178+0000 7fe99f7fe640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 0x7fe98c0465a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.178+0000 7fe99e7fc640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 0x7fe98c03a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe994000c00 tx=0x7fe994007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.181 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.179+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== osd.0 v2:172.21.15.43:6800/3849931173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe98c046c70 con 0x7fe98c044100 2024-09-13T23:28:32.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.191+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 --> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe9a006d4a0 con 0x7fe98c044100 2024-09-13T23:28:32.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9877fe640 1 -- 172.21.15.43:0/1486247452 <== osd.0 v2:172.21.15.43:6800/3849931173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe9a006d4a0 con 0x7fe98c044100 2024-09-13T23:28:32.193 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-13T23:28:32.193 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:28:32.193 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-13T23:28:32.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 msgr2=0x7fe98c0465a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 0x7fe98c0465a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.194 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 msgr2=0x7fe98c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 0x7fe98c03a760 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe994000c00 tx=0x7fe994007970 comp rx=0 tx=0).stop 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 msgr2=0x7fe9a012dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fe990009750 tx=0x7fe9900046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 shutdown_connections 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fe98c0382a0 0x7fe98c03a760 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:6800/3849931173,v1:172.21.15.43:6801/3849931173] conn(0x7fe98c044100 0x7fe98c0465a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 --2- 172.21.15.43:0/1486247452 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fe9a006d0c0 0x7fe9a012dd80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 >> 172.21.15.43:0/1486247452 conn(0x7fe9a00998b0 msgr2=0x7fe9a009b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 shutdown_connections 2024-09-13T23:28:32.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.192+0000 7fe9a57cf640 1 -- 172.21.15.43:0/1486247452 wait complete. 2024-09-13T23:28:32.204 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T23:28:32.307 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1fcd91640 1 Processor -- start 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1fcd91640 1 -- start start 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1fcd91640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc1f812cca0 0x7fc1f812d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1fcd91640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f812d5c0 con 0x7fc1f81290e0 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1fcd91640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f806e350 con 0x7fc1f812cca0 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1f659c640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fc1f812cca0 0x7fc1f812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1edd9b640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fc1f81290e0 0x7fc1f8129530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40894/0 (socket says 172.21.15.43:40894) 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1edd9b640 1 -- 172.21.15.43:0/3846673898 learned_addr learned my addr 172.21.15.43:0/3846673898 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1f659c640 1 -- 172.21.15.43:0/3846673898 >> v1:172.21.15.43:6789/0 conn(0x7fc1f81290e0 legacy=0x7fc1f8129530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1f659c640 1 -- 172.21.15.43:0/3846673898 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f8071f70 con 0x7fc1f812cca0 2024-09-13T23:28:32.308 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.306+0000 7fc1f5d9b640 1 -- 172.21.15.43:0/3846673898 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76913875 0 0) 0x7fc1f812d5c0 con 0x7fc1f81290e0 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.307+0000 7fc1f659c640 1 --2- 172.21.15.43:0/3846673898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f812cca0 0x7fc1f812d080 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009720 tx=0x7fc1e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c434866b17faf5ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.307+0000 7fc1f5d9b640 1 -- 172.21.15.43:0/3846673898 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e8037070 con 0x7fc1f812cca0 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.307+0000 7fc1f5d9b640 1 -- 172.21.15.43:0/3846673898 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e802ad90 con 0x7fc1f812cca0 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.307+0000 7fc1f5d9b640 1 -- 172.21.15.43:0/3846673898 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e8032590 con 0x7fc1f812cca0 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 -- 172.21.15.43:0/3846673898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f812cca0 msgr2=0x7fc1f812d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/3846673898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f812cca0 0x7fc1f812d080 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009720 tx=0x7fc1e802a110 comp rx=0 tx=0).stop 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 -- 172.21.15.43:0/3846673898 shutdown_connections 2024-09-13T23:28:32.310 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/3846673898 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f812cca0 0x7fc1f812d080 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 -- 172.21.15.43:0/3846673898 >> 172.21.15.43:0/3846673898 conn(0x7fc1f809a890 msgr2=0x7fc1f809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 -- 172.21.15.43:0/3846673898 shutdown_connections 2024-09-13T23:28:32.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.308+0000 7fc1fcd91640 1 -- 172.21.15.43:0/3846673898 wait complete. 2024-09-13T23:28:32.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.309+0000 7fc1fcd91640 1 Processor -- start 2024-09-13T23:28:32.311 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.309+0000 7fc1fcd91640 1 -- start start 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.309+0000 7fc1fcd91640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.309+0000 7fc1fcd91640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f8070e60 con 0x7fc1f81290e0 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1f659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1f659c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34732/0 (socket says 172.21.15.43:34732) 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1f659c640 1 -- 172.21.15.43:0/2874803311 learned_addr learned my addr 172.21.15.43:0/2874803311 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1f659c640 1 -- 172.21.15.43:0/2874803311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f808c7f0 con 0x7fc1f81290e0 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1f659c640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8035040 tx=0x7fc1e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e8037040 con 0x7fc1f81290e0 2024-09-13T23:28:32.313 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e8004030 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f8126520 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1e8004310 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.310+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f808cfc0 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.311+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fc1e803a040 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.311+0000 7fc1ef7fe640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 0x7fc1d803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.311+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fc1e806c5d0 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.311+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f808df90 con 0x7fc1f81290e0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.311+0000 7fc1edd9b640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 0x7fc1d803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.314 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.312+0000 7fc1edd9b640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 0x7fc1d803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e0007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.317 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.316+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1f808c7f0 con 0x7fc1f81290e0 2024-09-13T23:28:32.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.495+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fc1f808c350 con 0x7fc1d80382a0 2024-09-13T23:28:32.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.495+0000 7fc1ef7fe640 1 -- 172.21.15.43:0/2874803311 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc1f808c350 con 0x7fc1d80382a0 2024-09-13T23:28:32.497 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T23:28:32.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.498+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 msgr2=0x7fc1d803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.498+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 0x7fc1d803a760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0000c00 tx=0x7fc1e0007a40 comp rx=0 tx=0).stop 2024-09-13T23:28:32.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.498+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 msgr2=0x7fc1f808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.500 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.498+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8035040 tx=0x7fc1e80046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 shutdown_connections 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fc1d80382a0 0x7fc1d803a760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 --2- 172.21.15.43:0/2874803311 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fc1f81290e0 0x7fc1f808afc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 >> 172.21.15.43:0/2874803311 conn(0x7fc1f809a890 msgr2=0x7fc1f81288a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 shutdown_connections 2024-09-13T23:28:32.501 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.499+0000 7fc1fcd91640 1 -- 172.21.15.43:0/2874803311 wait complete. 2024-09-13T23:28:32.510 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T23:28:32.511 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f51d78640 1 Processor -- start 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f51d78640 1 -- start start 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f51d78640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6f4c06d0c0 0x7f6f4c06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f51d78640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c099260 con 0x7f6f4c06d9e0 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f51d78640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c070670 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f4b7fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6f4c06d0c0 0x7f6f4c06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f4affd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6f4c06d9e0 0x7f6f4c130b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40896/0 (socket says 172.21.15.43:40896) 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.615+0000 7f6f4affd640 1 -- 172.21.15.43:0/3081274034 learned_addr learned my addr 172.21.15.43:0/3081274034 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.616+0000 7f6f4b7fe640 1 -- 172.21.15.43:0/3081274034 >> v1:172.21.15.43:6789/0 conn(0x7f6f4c06d9e0 legacy=0x7f6f4c130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.617 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.616+0000 7f6f4b7fe640 1 -- 172.21.15.43:0/3081274034 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c071d70 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.616+0000 7f6f4b7fe640 1 --2- 172.21.15.43:0/3081274034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c06d4a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009750 tx=0x7f6f3c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a583f5545ed7914 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.616+0000 7f6f4a7fc640 1 -- 172.21.15.43:0/3081274034 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c037070 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f4a7fc640 1 -- 172.21.15.43:0/3081274034 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c02ad80 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f4a7fc640 1 -- 172.21.15.43:0/3081274034 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c032590 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 -- 172.21.15.43:0/3081274034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 msgr2=0x7f6f4c06d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 --2- 172.21.15.43:0/3081274034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c06d4a0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009750 tx=0x7f6f3c02a140 comp rx=0 tx=0).stop 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 -- 172.21.15.43:0/3081274034 shutdown_connections 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 --2- 172.21.15.43:0/3081274034 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c06d4a0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 -- 172.21.15.43:0/3081274034 >> 172.21.15.43:0/3081274034 conn(0x7f6f4c0998b0 msgr2=0x7f6f4c099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 -- 172.21.15.43:0/3081274034 shutdown_connections 2024-09-13T23:28:32.619 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.617+0000 7f6f51d78640 1 -- 172.21.15.43:0/3081274034 wait complete. 2024-09-13T23:28:32.620 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.618+0000 7f6f51d78640 1 Processor -- start 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.618+0000 7f6f51d78640 1 -- start start 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.618+0000 7f6f51d78640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.618+0000 7f6f51d78640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c132240 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34750/0 (socket says 172.21.15.43:34750) 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f4b7fe640 1 -- 172.21.15.43:0/1499218121 learned_addr learned my addr 172.21.15.43:0/1499218121 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f4b7fe640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c122210 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.622 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f4b7fe640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c041070 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c03c590 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c095d10 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c037040 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.619+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c0969a0 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f4c095870 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6f3c044070 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 0x7f6f3803a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f6f3c06c4a0 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 0x7f6f380465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f3c036e90 con 0x7f6f38044100 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f3c073050 con 0x7f6f4c06d0c0 2024-09-13T23:28:32.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.620+0000 7f6f4affd640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 0x7f6f3803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.621+0000 7f6f4bfff640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 0x7f6f380465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.621+0000 7f6f4affd640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 0x7f6f3803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6f40007fd0 tx=0x7f6f40007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.621+0000 7f6f4bfff640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 0x7f6f380465a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.622+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== osd.1 v2:172.21.15.99:6801/642925376 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f3c036e90 con 0x7f6f38044100 2024-09-13T23:28:32.635 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.634+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 --> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f4c06d4a0 con 0x7f6f38044100 2024-09-13T23:28:32.636 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.635+0000 7f6f33fff640 1 -- 172.21.15.43:0/1499218121 <== osd.1 v2:172.21.15.99:6801/642925376 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f4c06d4a0 con 0x7f6f38044100 2024-09-13T23:28:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-13T23:28:32.636 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:28:32.636 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-13T23:28:32.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.635+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 msgr2=0x7f6f380465a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.635+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 0x7f6f380465a0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 msgr2=0x7f6f3803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 0x7f6f3803a760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6f40007fd0 tx=0x7f6f40007ac0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.638 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 msgr2=0x7f6f4c12e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c0046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 shutdown_connections 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6801/642925376,v1:172.21.15.99:6803/642925376] conn(0x7f6f38044100 0x7f6f380465a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6f380382a0 0x7f6f3803a760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 --2- 172.21.15.43:0/1499218121 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6f4c06d0c0 0x7f6f4c12e820 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 >> 172.21.15.43:0/1499218121 conn(0x7f6f4c0998b0 msgr2=0x7f6f4c08cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 shutdown_connections 2024-09-13T23:28:32.639 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.636+0000 7f6f51d78640 1 -- 172.21.15.43:0/1499218121 wait complete. 2024-09-13T23:28:32.647 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T23:28:32.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4b567b640 1 Processor -- start 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4b567b640 1 -- start start 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4b567b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4b0096230 0x7fa4b0133e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4b567b640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b009e100 con 0x7fa4b0095740 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4b567b640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b009a960 con 0x7fa4b0096230 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4ae7fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa4b0096230 0x7fa4b0133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4aeffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa4b0095740 0x7fa4b0095b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40898/0 (socket says 172.21.15.43:40898) 2024-09-13T23:28:32.750 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.748+0000 7fa4aeffd640 1 -- 172.21.15.43:0/3469532283 learned_addr learned my addr 172.21.15.43:0/3469532283 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:32.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4ae7fc640 1 -- 172.21.15.43:0/3469532283 >> v1:172.21.15.43:6789/0 conn(0x7fa4b0095740 legacy=0x7fa4b0095b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4adffb640 1 -- 172.21.15.43:0/3469532283 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942352402 0 0) 0x7fa4b009e100 con 0x7fa4b0095740 2024-09-13T23:28:32.751 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4ae7fc640 1 -- 172.21.15.43:0/3469532283 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b0097220 con 0x7fa4b0096230 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4ae7fc640 1 --2- 172.21.15.43:0/3469532283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0096230 0x7fa4b0133e20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009720 tx=0x7fa4a402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a56290db412244 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4adffb640 1 -- 172.21.15.43:0/3469532283 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a4037070 con 0x7fa4b0096230 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4adffb640 1 -- 172.21.15.43:0/3469532283 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a402ae20 con 0x7fa4b0096230 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.749+0000 7fa4adffb640 1 -- 172.21.15.43:0/3469532283 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a4032590 con 0x7fa4b0096230 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 -- 172.21.15.43:0/3469532283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0096230 msgr2=0x7fa4b0133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 --2- 172.21.15.43:0/3469532283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0096230 0x7fa4b0133e20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009720 tx=0x7fa4a402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 -- 172.21.15.43:0/3469532283 shutdown_connections 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 --2- 172.21.15.43:0/3469532283 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0096230 0x7fa4b0133e20 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 -- 172.21.15.43:0/3469532283 >> 172.21.15.43:0/3469532283 conn(0x7fa4b009d860 msgr2=0x7fa4b0099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 -- 172.21.15.43:0/3469532283 shutdown_connections 2024-09-13T23:28:32.753 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.750+0000 7fa4b567b640 1 -- 172.21.15.43:0/3469532283 wait complete. 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.751+0000 7fa4b567b640 1 Processor -- start 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.751+0000 7fa4b567b640 1 -- start start 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.751+0000 7fa4b567b640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.751+0000 7fa4b567b640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0096bd0 con 0x7fa4b0095740 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4aeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4aeffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34776/0 (socket says 172.21.15.43:34776) 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4aeffd640 1 -- 172.21.15.43:0/1111197433 learned_addr learned my addr 172.21.15.43:0/1111197433 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4aeffd640 1 -- 172.21.15.43:0/1111197433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b0093e60 con 0x7fa4b0095740 2024-09-13T23:28:32.754 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4aeffd640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000c420 tx=0x7fa4a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a0018070 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a00074d0 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b0093660 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4a0004950 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.752+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b01c3840 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.753+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa4a001b070 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.753+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b0095b20 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.753+0000 7fa4977fe640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 0x7fa49c03a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.754+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa4a004af60 con 0x7fa4b0095740 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.754+0000 7fa4ae7fc640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 0x7fa49c03a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:32.756 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.754+0000 7fa4ae7fc640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 0x7fa49c03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4034000 tx=0x7fa4a402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:32.759 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.758+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4a0011980 con 0x7fa4b0095740 2024-09-13T23:28:32.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.932+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa4b0094030 con 0x7fa49c0382a0 2024-09-13T23:28:32.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.933+0000 7fa4977fe640 1 -- 172.21.15.43:0/1111197433 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa4b0094030 con 0x7fa49c0382a0 2024-09-13T23:28:32.934 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 msgr2=0x7fa49c03a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 0x7fa49c03a760 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4034000 tx=0x7fa4a402e000 comp rx=0 tx=0).stop 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 msgr2=0x7fa4b01c3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa4a000c420 tx=0x7fa4a000c8e0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 shutdown_connections 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa49c0382a0 0x7fa49c03a760 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 --2- 172.21.15.43:0/1111197433 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa4b0095740 0x7fa4b01c3300 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:32.937 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.935+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 >> 172.21.15.43:0/1111197433 conn(0x7fa4b009d860 msgr2=0x7fa4b0098290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:32.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.936+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 shutdown_connections 2024-09-13T23:28:32.938 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:32.936+0000 7fa4b567b640 1 -- 172.21.15.43:0/1111197433 wait complete. 2024-09-13T23:28:32.947 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T23:28:32.947 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:28:33.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.051+0000 7f6fea0d0640 1 Processor -- start 2024-09-13T23:28:33.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.051+0000 7f6fea0d0640 1 -- start start 2024-09-13T23:28:33.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.051+0000 7f6fea0d0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6fe406d0c0 0x7f6fe406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.051+0000 7f6fea0d0640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe4071510 con 0x7f6fe406d9e0 2024-09-13T23:28:33.053 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.051+0000 7f6fea0d0640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe4071d70 con 0x7f6fe406d0c0 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe37fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6fe406d0c0 0x7f6fe406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe2ffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6fe406d9e0 0x7f6fe412cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40900/0 (socket says 172.21.15.43:40900) 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe2ffd640 1 -- 172.21.15.43:0/2585059428 learned_addr learned my addr 172.21.15.43:0/2585059428 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe37fe640 1 --2- 172.21.15.43:0/2585059428 >> v2:172.21.15.43:3300/0 conn(0x7f6fe406d0c0 0x7f6fe406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34792/0 (socket says 172.21.15.43:34792) 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe37fe640 1 -- 172.21.15.43:0/2585059428 >> v1:172.21.15.43:6789/0 conn(0x7f6fe406d9e0 legacy=0x7f6fe412cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.054 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.052+0000 7f6fe37fe640 1 -- 172.21.15.43:0/2585059428 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe4072f50 con 0x7f6fe406d0c0 2024-09-13T23:28:33.055 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fe37fe640 1 --2- 172.21.15.43:0/2585059428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406d4a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009720 tx=0x7f6fd402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37569407ccc79e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fe27fc640 1 -- 172.21.15.43:0/2585059428 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4037070 con 0x7f6fe406d0c0 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fe27fc640 1 -- 172.21.15.43:0/2585059428 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd402ad90 con 0x7f6fe406d0c0 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fe27fc640 1 -- 172.21.15.43:0/2585059428 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4032590 con 0x7f6fe406d0c0 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 -- 172.21.15.43:0/2585059428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 msgr2=0x7f6fe406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/2585059428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406d4a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009720 tx=0x7f6fd402a110 comp rx=0 tx=0).stop 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 -- 172.21.15.43:0/2585059428 shutdown_connections 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/2585059428 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406d4a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 -- 172.21.15.43:0/2585059428 >> 172.21.15.43:0/2585059428 conn(0x7f6fe40998b0 msgr2=0x7f6fe4099cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 -- 172.21.15.43:0/2585059428 shutdown_connections 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.053+0000 7f6fea0d0640 1 -- 172.21.15.43:0/2585059428 wait complete. 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.054+0000 7f6fea0d0640 1 Processor -- start 2024-09-13T23:28:33.056 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.054+0000 7f6fea0d0640 1 -- start start 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fea0d0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fea0d0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe412d210 con 0x7f6fe406d0c0 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fe37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fe37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34796/0 (socket says 172.21.15.43:34796) 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fe37fe640 1 -- 172.21.15.43:0/925984378 learned_addr learned my addr 172.21.15.43:0/925984378 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fe37fe640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe406f660 con 0x7f6fe406d0c0 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.055+0000 7f6fe37fe640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009720 tx=0x7f6fd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.056+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4041070 con 0x7f6fe406d0c0 2024-09-13T23:28:33.059 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.056+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd403c460 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.056+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fd4037040 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.056+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe412bb10 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.056+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe406fe30 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fe412d6f0 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6fd4044070 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 0x7f6fd003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f6fd406c680 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 0x7f6fd0046540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fd402ad90 con 0x7f6fd00440a0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6fd4073050 con 0x7f6fe406d0c0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fe2ffd640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 0x7f6fd003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.057+0000 7f6fe3fff640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 0x7f6fd0046540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.060 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.058+0000 7f6fe2ffd640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 0x7f6fd003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005880 tx=0x7f6fd8007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.058+0000 7f6fe3fff640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 0x7f6fd0046540 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.061 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.059+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== osd.2 v2:172.21.15.99:6800/2157953423 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fd402ad90 con 0x7f6fd00440a0 2024-09-13T23:28:33.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.071+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 --> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fe406f8a0 con 0x7f6fd00440a0 2024-09-13T23:28:33.072 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fcbfff640 1 -- 172.21.15.43:0/925984378 <== osd.2 v2:172.21.15.99:6800/2157953423 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fe406f8a0 con 0x7f6fd00440a0 2024-09-13T23:28:33.073 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-13T23:28:33.073 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:28:33.073 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 msgr2=0x7f6fd0046540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 0x7f6fd0046540 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 msgr2=0x7f6fd003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 0x7f6fd003a760 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005880 tx=0x7f6fd8007a80 comp rx=0 tx=0).stop 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 msgr2=0x7f6fe406e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4009720 tx=0x7f6fd40046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.074 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 shutdown_connections 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6800/2157953423,v1:172.21.15.99:6802/2157953423] conn(0x7f6fd00440a0 0x7f6fd0046540 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6fd00382a0 0x7f6fd003a760 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 --2- 172.21.15.43:0/925984378 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6fe406d0c0 0x7f6fe406e1d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 >> 172.21.15.43:0/925984378 conn(0x7f6fe40998b0 msgr2=0x7f6fe409b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 shutdown_connections 2024-09-13T23:28:33.075 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.072+0000 7f6fea0d0640 1 -- 172.21.15.43:0/925984378 wait complete. 2024-09-13T23:28:33.083 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.184+0000 7fd50acac640 1 Processor -- start 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.184+0000 7fd50acac640 1 -- start start 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.184+0000 7fd50acac640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd504095740 0x7fd504095b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd50acac640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50409e100 con 0x7fd504096060 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd50acac640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fd50409a960 con 0x7fd504095740 2024-09-13T23:28:33.186 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd508a48640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fd504095740 0x7fd504095b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd503fff640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fd504096060 0x7fd50412b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40904/0 (socket says 172.21.15.43:40904) 2024-09-13T23:28:33.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd503fff640 1 -- 172.21.15.43:0/1424719150 learned_addr learned my addr 172.21.15.43:0/1424719150 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:33.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd508a48640 1 -- 172.21.15.43:0/1424719150 >> v1:172.21.15.43:6789/0 conn(0x7fd504096060 legacy=0x7fd50412b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.187 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.185+0000 7fd508a48640 1 -- 172.21.15.43:0/1424719150 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd504097220 con 0x7fd504095740 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd508a48640 1 --2- 172.21.15.43:0/1424719150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd504095b20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009720 tx=0x7fd4f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6162f8a7cfdf12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd5037fe640 1 -- 172.21.15.43:0/1424719150 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4037070 con 0x7fd504095740 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd5037fe640 1 -- 172.21.15.43:0/1424719150 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f402ae20 con 0x7fd504095740 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd5037fe640 1 -- 172.21.15.43:0/1424719150 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4032590 con 0x7fd504095740 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 -- 172.21.15.43:0/1424719150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 msgr2=0x7fd504095b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 --2- 172.21.15.43:0/1424719150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd504095b20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009720 tx=0x7fd4f402a1a0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 -- 172.21.15.43:0/1424719150 shutdown_connections 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 --2- 172.21.15.43:0/1424719150 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd504095b20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.188 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 -- 172.21.15.43:0/1424719150 >> 172.21.15.43:0/1424719150 conn(0x7fd50409d860 msgr2=0x7fd504099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 -- 172.21.15.43:0/1424719150 shutdown_connections 2024-09-13T23:28:33.189 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.186+0000 7fd50acac640 1 -- 172.21.15.43:0/1424719150 wait complete. 2024-09-13T23:28:33.190 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.187+0000 7fd50acac640 1 Processor -- start 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.187+0000 7fd50acac640 1 -- start start 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd50acac640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd50acac640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fd504096440 con 0x7fd504095740 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd508a48640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd508a48640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34822/0 (socket says 172.21.15.43:34822) 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd508a48640 1 -- 172.21.15.43:0/228423347 learned_addr learned my addr 172.21.15.43:0/228423347 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd508a48640 1 -- 172.21.15.43:0/228423347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50406eaa0 con 0x7fd504095740 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.188+0000 7fd508a48640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd4f402adf0 tx=0x7fd4f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4042070 con 0x7fd504095740 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f403e590 con 0x7fd504095740 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd504070cd0 con 0x7fd504095740 2024-09-13T23:28:33.191 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f4037040 con 0x7fd504095740 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd504070740 con 0x7fd504095740 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fd4f4045070 con 0x7fd504095740 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.189+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd504095b20 con 0x7fd504095740 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.190+0000 7fd5017fa640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 0x7fd4f003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.190+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fd4f406c300 con 0x7fd504095740 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.190+0000 7fd503fff640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 0x7fd4f003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.192 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.191+0000 7fd503fff640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 0x7fd4f003a790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8007ac0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.195 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.194+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4f402ae20 con 0x7fd504095740 2024-09-13T23:28:33.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.370+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd5040750f0 con 0x7fd4f00382d0 2024-09-13T23:28:33.371 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.371+0000 7fd5017fa640 1 -- 172.21.15.43:0/228423347 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd5040750f0 con 0x7fd4f00382d0 2024-09-13T23:28:33.372 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T23:28:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 msgr2=0x7fd4f003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 0x7fd4f003a790 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8007fd0 tx=0x7fd4f8007ac0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.374 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 msgr2=0x7fd50406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd4f402adf0 tx=0x7fd4f40046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 shutdown_connections 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fd4f00382d0 0x7fd4f003a790 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 --2- 172.21.15.43:0/228423347 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fd504095740 0x7fd50406dc60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 >> 172.21.15.43:0/228423347 conn(0x7fd50409d860 msgr2=0x7fd5041b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 shutdown_connections 2024-09-13T23:28:33.375 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.373+0000 7fd50acac640 1 -- 172.21.15.43:0/228423347 wait complete. 2024-09-13T23:28:33.385 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T23:28:33.385 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T23:28:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.489+0000 7f1b834a6640 1 Processor -- start 2024-09-13T23:28:33.490 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.489+0000 7f1b834a6640 1 -- start start 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b834a6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1b7c06e0d0 0x7f1b7c133eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b834a6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7c06e9a0 con 0x7f1b7c12ee50 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b834a6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f1b7c098f10 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b80a41640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f1b7c06e0d0 0x7f1b7c133eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b81242640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f1b7c12ee50 0x7f1b7c12f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40910/0 (socket says 172.21.15.43:40910) 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b81242640 1 -- 172.21.15.43:0/3488820098 learned_addr learned my addr 172.21.15.43:0/3488820098 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b80a41640 1 -- 172.21.15.43:0/3488820098 >> v1:172.21.15.43:6789/0 conn(0x7f1b7c12ee50 legacy=0x7f1b7c12f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.490+0000 7f1b80a41640 1 -- 172.21.15.43:0/3488820098 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c06fee0 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b80a41640 1 --2- 172.21.15.43:0/3488820098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c133eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009720 tx=0x7f1b6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce70ad2d554e25b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.492 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b73fff640 1 -- 172.21.15.43:0/3488820098 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6c037070 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b73fff640 1 -- 172.21.15.43:0/3488820098 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c02ad90 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b73fff640 1 -- 172.21.15.43:0/3488820098 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b6c032590 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b834a6640 1 -- 172.21.15.43:0/3488820098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 msgr2=0x7f1b7c133eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b834a6640 1 --2- 172.21.15.43:0/3488820098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c133eb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c009720 tx=0x7f1b6c02a110 comp rx=0 tx=0).stop 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b834a6640 1 -- 172.21.15.43:0/3488820098 shutdown_connections 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b834a6640 1 --2- 172.21.15.43:0/3488820098 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c133eb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.491+0000 7f1b834a6640 1 -- 172.21.15.43:0/3488820098 >> 172.21.15.43:0/3488820098 conn(0x7f1b7c09ca00 msgr2=0x7f1b7c09ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.492+0000 7f1b834a6640 1 -- 172.21.15.43:0/3488820098 shutdown_connections 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.492+0000 7f1b834a6640 1 -- 172.21.15.43:0/3488820098 wait complete. 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.492+0000 7f1b834a6640 1 Processor -- start 2024-09-13T23:28:33.495 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.492+0000 7f1b834a6640 1 -- start start 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b834a6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b834a6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7c134570 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b81242640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b81242640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34848/0 (socket says 172.21.15.43:34848) 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b81242640 1 -- 172.21.15.43:0/4215470537 learned_addr learned my addr 172.21.15.43:0/4215470537 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b81242640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7c093db0 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b81242640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c380 tx=0x7f1b7800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b78005c10 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b78005db0 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7c098450 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.496 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.493+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b78004930 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.497 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.494+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7c094e00 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.494+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f1b7801a020 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.494+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b7c0008d0 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.494+0000 7f1b71ffb640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 0x7f1b6003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f1b7804b3b0 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b71ffb640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 0x7f1b60046520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b78015e50 con 0x7f1b60044080 2024-09-13T23:28:33.498 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1b78052050 con 0x7f1b7c06e0d0 2024-09-13T23:28:33.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b80a41640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 0x7f1b6003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b81a43640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 0x7f1b60046520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b80a41640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 0x7f1b6003a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c034000 tx=0x7f1b6c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.495+0000 7f1b81a43640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 0x7f1b60046520 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.499 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.496+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== osd.3 v2:172.21.15.99:6816/1212313328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b78015e50 con 0x7f1b60044080 2024-09-13T23:28:33.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.509+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 --> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1b7c12ee50 con 0x7f1b60044080 2024-09-13T23:28:33.510 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.509+0000 7f1b71ffb640 1 -- 172.21.15.43:0/4215470537 <== osd.3 v2:172.21.15.99:6816/1212313328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1b7c12ee50 con 0x7f1b60044080 2024-09-13T23:28:33.510 INFO:teuthology.orchestra.run.smithi043.stdout:{ 2024-09-13T23:28:33.511 INFO:teuthology.orchestra.run.smithi043.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T23:28:33.511 INFO:teuthology.orchestra.run.smithi043.stdout:} 2024-09-13T23:28:33.511 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.509+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 msgr2=0x7f1b60046520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.509+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 0x7f1b60046520 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 msgr2=0x7f1b6003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 0x7f1b6003a760 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c034000 tx=0x7f1b6c02e000 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 msgr2=0x7f1b7c092290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c380 tx=0x7f1b7800c840 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 shutdown_connections 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6816/1212313328,v1:172.21.15.99:6817/1212313328] conn(0x7f1b60044080 0x7f1b60046520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f1b600382a0 0x7f1b6003a760 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 --2- 172.21.15.43:0/4215470537 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f1b7c06e0d0 0x7f1b7c092290 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 >> 172.21.15.43:0/4215470537 conn(0x7f1b7c09ca00 msgr2=0x7f1b7c12fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.512 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 shutdown_connections 2024-09-13T23:28:33.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.510+0000 7f1b834a6640 1 -- 172.21.15.43:0/4215470537 wait complete. 2024-09-13T23:28:33.521 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06d4d8d640 1 Processor -- start 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06d4d8d640 1 -- start start 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06d4d8d640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f06d012f9d0 0x7f06d0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06d4d8d640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06d0071f70 con 0x7f06d012cca0 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06d4d8d640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f06d006e350 con 0x7f06d012f9d0 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06ce59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f06d012cca0 0x7f06d012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40918/0 (socket says 172.21.15.43:40918) 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06ce59c640 1 -- 172.21.15.43:0/3400607593 learned_addr learned my addr 172.21.15.43:0/3400607593 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:33.623 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.621+0000 7f06cdd9b640 1 --2- 172.21.15.43:0/3400607593 >> v2:172.21.15.43:3300/0 conn(0x7f06d012f9d0 0x7f06d0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.622+0000 7f06cd59a640 1 -- 172.21.15.43:0/3400607593 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287610730 0 0) 0x7f06d0071f70 con 0x7f06d012cca0 2024-09-13T23:28:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.622+0000 7f06cd59a640 1 -- 172.21.15.43:0/3400607593 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b8003520 con 0x7f06d012cca0 2024-09-13T23:28:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.622+0000 7f06cdd9b640 1 -- 172.21.15.43:0/3400607593 >> v1:172.21.15.43:6789/0 conn(0x7f06d012cca0 legacy=0x7f06d012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.624 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.622+0000 7f06cdd9b640 1 -- 172.21.15.43:0/3400607593 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d00715c0 con 0x7f06d012f9d0 2024-09-13T23:28:33.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.622+0000 7f06cdd9b640 1 --2- 172.21.15.43:0/3400607593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012f9d0 0x7f06d0131dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009720 tx=0x7f06c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cd877485ba6d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06cd59a640 1 -- 172.21.15.43:0/3400607593 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c4037070 con 0x7f06d012f9d0 2024-09-13T23:28:33.626 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06cd59a640 1 -- 172.21.15.43:0/3400607593 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c402ad90 con 0x7f06d012f9d0 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06cd59a640 1 -- 172.21.15.43:0/3400607593 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c4032590 con 0x7f06d012f9d0 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 -- 172.21.15.43:0/3400607593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012f9d0 msgr2=0x7f06d0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/3400607593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012f9d0 0x7f06d0131dc0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009720 tx=0x7f06c402a110 comp rx=0 tx=0).stop 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 -- 172.21.15.43:0/3400607593 shutdown_connections 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/3400607593 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012f9d0 0x7f06d0131dc0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 -- 172.21.15.43:0/3400607593 >> 172.21.15.43:0/3400607593 conn(0x7f06d009a890 msgr2=0x7f06d009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 -- 172.21.15.43:0/3400607593 shutdown_connections 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.623+0000 7f06d4d8d640 1 -- 172.21.15.43:0/3400607593 wait complete. 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.624+0000 7f06d4d8d640 1 Processor -- start 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.624+0000 7f06d4d8d640 1 -- start start 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06d4d8d640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.627 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06d4d8d640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f06d012ca50 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06ce59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06ce59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34866/0 (socket says 172.21.15.43:34866) 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06ce59c640 1 -- 172.21.15.43:0/4032880382 learned_addr learned my addr 172.21.15.43:0/4032880382 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06ce59c640 1 -- 172.21.15.43:0/4032880382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d0129f50 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06ce59c640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c390 tx=0x7f06c000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c0005c10 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d0070240 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06c00070d0 con 0x7f06d012cca0 2024-09-13T23:28:33.628 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.625+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d0070700 con 0x7f06d012cca0 2024-09-13T23:28:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.626+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f06c001a070 con 0x7f06d012cca0 2024-09-13T23:28:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.626+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d0070a40 con 0x7f06d012cca0 2024-09-13T23:28:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.626+0000 7f06beffd640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 0x7f06b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.626+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f06c004b0d0 con 0x7f06d012cca0 2024-09-13T23:28:33.629 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.627+0000 7f06cdd9b640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 0x7f06b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.630 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.627+0000 7f06cdd9b640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 0x7f06b003a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009720 tx=0x7f06c402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.632 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.631+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06c0019e10 con 0x7f06d012cca0 2024-09-13T23:28:33.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.805+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f06d006e510 con 0x7f06b00382a0 2024-09-13T23:28:33.807 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.806+0000 7f06beffd640 1 -- 172.21.15.43:0/4032880382 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f06d006e510 con 0x7f06b00382a0 2024-09-13T23:28:33.808 INFO:teuthology.orchestra.run.smithi043.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T23:28:33.809 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 msgr2=0x7f06b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 0x7f06b003a760 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009720 tx=0x7f06c402e000 comp rx=0 tx=0).stop 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 msgr2=0x7f06d006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f06c000c390 tx=0x7f06c000c850 comp rx=0 tx=0).stop 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 shutdown_connections 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f06b00382a0 0x7f06b003a760 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 --2- 172.21.15.43:0/4032880382 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f06d012cca0 0x7f06d006ea20 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 >> 172.21.15.43:0/4032880382 conn(0x7f06d009a890 msgr2=0x7f06d012fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 shutdown_connections 2024-09-13T23:28:33.810 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.808+0000 7f06d4d8d640 1 -- 172.21.15.43:0/4032880382 wait complete. 2024-09-13T23:28:33.820 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:28:33.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.920+0000 7f379d386640 1 Processor -- start 2024-09-13T23:28:33.922 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.920+0000 7f379d386640 1 -- start start 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f379d386640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f379809a100 0x7f3798133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f379d386640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f379809d3b0 con 0x7f379809bd50 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f379d386640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f379809c840 con 0x7f379809a100 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f37967fc640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f379809a100 0x7f3798133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f3796ffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f379809bd50 0x7f379809c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:40934/0 (socket says 172.21.15.43:40934) 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f3796ffd640 1 -- 172.21.15.43:0/364375986 learned_addr learned my addr 172.21.15.43:0/364375986 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f37967fc640 1 -- 172.21.15.43:0/364375986 >> v1:172.21.15.43:6789/0 conn(0x7f379809bd50 legacy=0x7f379809c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.923 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.921+0000 7f37967fc640 1 -- 172.21.15.43:0/364375986 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3798098230 con 0x7f379809a100 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.922+0000 7f37967fc640 1 --2- 172.21.15.43:0/364375986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f3798133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f378c009720 tx=0x7f378c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797a1f941b77e347 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.922+0000 7f3795ffb640 1 -- 172.21.15.43:0/364375986 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c037070 con 0x7f379809a100 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.922+0000 7f3795ffb640 1 -- 172.21.15.43:0/364375986 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c02ad90 con 0x7f379809a100 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.922+0000 7f3795ffb640 1 -- 172.21.15.43:0/364375986 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f378c032590 con 0x7f379809a100 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 -- 172.21.15.43:0/364375986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 msgr2=0x7f3798133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 --2- 172.21.15.43:0/364375986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f3798133da0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f378c009720 tx=0x7f378c02a110 comp rx=0 tx=0).stop 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 -- 172.21.15.43:0/364375986 shutdown_connections 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 --2- 172.21.15.43:0/364375986 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f3798133da0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 -- 172.21.15.43:0/364375986 >> 172.21.15.43:0/364375986 conn(0x7f379806d4a0 msgr2=0x7f379806d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 -- 172.21.15.43:0/364375986 shutdown_connections 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.923+0000 7f379d386640 1 -- 172.21.15.43:0/364375986 wait complete. 2024-09-13T23:28:33.925 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f379d386640 1 Processor -- start 2024-09-13T23:28:33.926 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f379d386640 1 -- start start 2024-09-13T23:28:33.927 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f379d386640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f379d386640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3798134670 con 0x7f379809a100 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:34888/0 (socket says 172.21.15.43:34888) 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f3796ffd640 1 -- 172.21.15.43:0/1124500413 learned_addr learned my addr 172.21.15.43:0/1124500413 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.924+0000 7f3796ffd640 1 -- 172.21.15.43:0/1124500413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37980963e0 con 0x7f379809a100 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f3796ffd640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f378800c380 tx=0x7f378800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3788005c10 con 0x7f379809a100 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3788005db0 con 0x7f379809a100 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3788004930 con 0x7f379809a100 2024-09-13T23:28:33.928 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3798126090 con 0x7f379809a100 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.925+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37981c3ed0 con 0x7f379809a100 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.926+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f378801a020 con 0x7f379809a100 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.926+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f379809a760 con 0x7f379809a100 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.926+0000 7f377f7fe640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 0x7f378403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.926+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f378804b440 con 0x7f379809a100 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.926+0000 7f37967fc640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 0x7f378403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:33.929 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.927+0000 7f37967fc640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 0x7f378403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f378c034000 tx=0x7f378c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:33.931 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:33.931+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f379809a760 con 0x7f379809a100 2024-09-13T23:28:34.105 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.104+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3798096db0 con 0x7f37840382a0 2024-09-13T23:28:34.121 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.120+0000 7f377f7fe640 1 -- 172.21.15.43:0/1124500413 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+663098 (secure 0 0 0) 0x7f3798096db0 con 0x7f37840382a0 2024-09-13T23:28:34.128 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:34.133 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:28:34.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 msgr2=0x7f378403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:34.135 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 0x7f378403a760 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f378c034000 tx=0x7f378c02e000 comp rx=0 tx=0).stop 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 msgr2=0x7f37981c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f378800c380 tx=0x7f378800c840 comp rx=0 tx=0).stop 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 shutdown_connections 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f37840382a0 0x7f378403a760 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 --2- 172.21.15.43:0/1124500413 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f379809a100 0x7f37981c3990 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 >> 172.21.15.43:0/1124500413 conn(0x7f379806d4a0 msgr2=0x7f379808d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 shutdown_connections 2024-09-13T23:28:34.136 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:34.124+0000 7f379d386640 1 -- 172.21.15.43:0/1124500413 wait complete. 2024-09-13T23:28:34.137 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-13T23:28:33.356951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4609,"ondisk_log_size":4609,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":140072,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377347288,"statfs":{"total":386547056640,"available":386403622912,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4281,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":713,"num_read_kb":672,"num_write":457,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004099"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.326609+0000","last_change":"2024-09-13T23:25:13.287107+0000","last_active":"2024-09-13T23:28:22.326609+0000","last_peered":"2024-09-13T23:28:22.326609+0000","last_clean":"2024-09-13T23:28:22.326609+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:28:22.326609+0000","last_undegraded":"2024-09-13T23:28:22.326609+0000","last_fullsized":"2024-09-13T23:28:22.326609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704068+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.704068+0000","last_peered":"2024-09-13T23:28:22.704068+0000","last_clean":"2024-09-13T23:28:22.704068+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.704068+0000","last_undegraded":"2024-09-13T23:28:22.704068+0000","last_fullsized":"2024-09-13T23:28:22.704068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.300137+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:28:22.300137+0000","last_peered":"2024-09-13T23:28:22.300137+0000","last_clean":"2024-09-13T23:28:22.300137+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:28:22.300137+0000","last_undegraded":"2024-09-13T23:28:22.300137+0000","last_fullsized":"2024-09-13T23:28:22.300137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:02.608771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.715133+0000","last_change":"2024-09-13T23:25:15.283513+0000","last_active":"2024-09-13T23:26:37.715133+0000","last_peered":"2024-09-13T23:26:37.715133+0000","last_clean":"2024-09-13T23:26:37.715133+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:26:37.715133+0000","last_undegraded":"2024-09-13T23:26:37.715133+0000","last_fullsized":"2024-09-13T23:26:37.715133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:19.716730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383611+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:25:52.383611+0000","last_peered":"2024-09-13T23:25:52.383611+0000","last_clean":"2024-09-13T23:25:52.383611+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:25:52.383611+0000","last_undegraded":"2024-09-13T23:25:52.383611+0000","last_fullsized":"2024-09-13T23:25:52.383611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:53.486874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697586+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.697586+0000","last_peered":"2024-09-13T23:28:22.697586+0000","last_clean":"2024-09-13T23:28:22.697586+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.697586+0000","last_undegraded":"2024-09-13T23:28:22.697586+0000","last_fullsized":"2024-09-13T23:28:22.697586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:44.489685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373408+0000","last_change":"2024-09-13T23:25:13.275095+0000","last_active":"2024-09-13T23:25:52.373408+0000","last_peered":"2024-09-13T23:25:52.373408+0000","last_clean":"2024-09-13T23:25:52.373408+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:25:52.373408+0000","last_undegraded":"2024-09-13T23:25:52.373408+0000","last_fullsized":"2024-09-13T23:25:52.373408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717114+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:26:37.717114+0000","last_peered":"2024-09-13T23:26:37.717114+0000","last_clean":"2024-09-13T23:26:37.717114+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:26:37.717114+0000","last_undegraded":"2024-09-13T23:26:37.717114+0000","last_fullsized":"2024-09-13T23:26:37.717114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:35.198533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376609+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:25:52.376609+0000","last_peered":"2024-09-13T23:25:52.376609+0000","last_clean":"2024-09-13T23:25:52.376609+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:25:52.376609+0000","last_undegraded":"2024-09-13T23:25:52.376609+0000","last_fullsized":"2024-09-13T23:25:52.376609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.491515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327695+0000","last_change":"2024-09-13T23:25:15.285777+0000","last_active":"2024-09-13T23:27:18.327695+0000","last_peered":"2024-09-13T23:27:18.327695+0000","last_clean":"2024-09-13T23:27:18.327695+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:27:18.327695+0000","last_undegraded":"2024-09-13T23:27:18.327695+0000","last_fullsized":"2024-09-13T23:27:18.327695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372573+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:25:52.372573+0000","last_peered":"2024-09-13T23:25:52.372573+0000","last_clean":"2024-09-13T23:25:52.372573+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:25:52.372573+0000","last_undegraded":"2024-09-13T23:25:52.372573+0000","last_fullsized":"2024-09-13T23:25:52.372573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:55.330369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697189+0000","last_change":"2024-09-13T23:25:15.290172+0000","last_active":"2024-09-13T23:28:22.697189+0000","last_peered":"2024-09-13T23:28:22.697189+0000","last_clean":"2024-09-13T23:28:22.697189+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:22.697189+0000","last_undegraded":"2024-09-13T23:28:22.697189+0000","last_fullsized":"2024-09-13T23:28:22.697189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:16.423529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377367+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:25:52.377367+0000","last_peered":"2024-09-13T23:25:52.377367+0000","last_clean":"2024-09-13T23:25:52.377367+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:25:52.377367+0000","last_undegraded":"2024-09-13T23:25:52.377367+0000","last_fullsized":"2024-09-13T23:25:52.377367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:15.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374311+0000","last_change":"2024-09-13T23:25:15.288159+0000","last_active":"2024-09-13T23:28:22.374311+0000","last_peered":"2024-09-13T23:28:22.374311+0000","last_clean":"2024-09-13T23:28:22.374311+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:28:22.374311+0000","last_undegraded":"2024-09-13T23:28:22.374311+0000","last_fullsized":"2024-09-13T23:28:22.374311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.728590+0000","last_change":"2024-09-13T23:25:13.285351+0000","last_active":"2024-09-13T23:27:21.728590+0000","last_peered":"2024-09-13T23:27:21.728590+0000","last_clean":"2024-09-13T23:27:21.728590+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:27:21.728590+0000","last_undegraded":"2024-09-13T23:27:21.728590+0000","last_fullsized":"2024-09-13T23:27:21.728590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.816721+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:25:54.816721+0000","last_peered":"2024-09-13T23:25:54.816721+0000","last_clean":"2024-09-13T23:25:54.816721+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:25:54.816721+0000","last_undegraded":"2024-09-13T23:25:54.816721+0000","last_fullsized":"2024-09-13T23:25:54.816721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626345+0000","last_change":"2024-09-13T23:25:15.287032+0000","last_active":"2024-09-13T23:28:22.626345+0000","last_peered":"2024-09-13T23:28:22.626345+0000","last_clean":"2024-09-13T23:28:22.626345+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:28:22.626345+0000","last_undegraded":"2024-09-13T23:28:22.626345+0000","last_fullsized":"2024-09-13T23:28:22.626345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:46:16.113359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331190+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:27:38.331190+0000","last_peered":"2024-09-13T23:27:38.331190+0000","last_clean":"2024-09-13T23:27:38.331190+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:27:38.331190+0000","last_undegraded":"2024-09-13T23:27:38.331190+0000","last_fullsized":"2024-09-13T23:27:38.331190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330966+0000","last_change":"2024-09-13T23:25:15.287488+0000","last_active":"2024-09-13T23:27:38.330966+0000","last_peered":"2024-09-13T23:27:38.330966+0000","last_clean":"2024-09-13T23:27:38.330966+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:27:38.330966+0000","last_undegraded":"2024-09-13T23:27:38.330966+0000","last_fullsized":"2024-09-13T23:27:38.330966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376849+0000","last_change":"2024-09-13T23:25:13.286390+0000","last_active":"2024-09-13T23:25:52.376849+0000","last_peered":"2024-09-13T23:25:52.376849+0000","last_clean":"2024-09-13T23:25:52.376849+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:25:52.376849+0000","last_undegraded":"2024-09-13T23:25:52.376849+0000","last_fullsized":"2024-09-13T23:25:52.376849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632773+0000","last_change":"2024-09-13T23:25:15.284340+0000","last_active":"2024-09-13T23:28:22.632773+0000","last_peered":"2024-09-13T23:28:22.632773+0000","last_clean":"2024-09-13T23:28:22.632773+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:28:22.632773+0000","last_undegraded":"2024-09-13T23:28:22.632773+0000","last_fullsized":"2024-09-13T23:28:22.632773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331140+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:27:38.331140+0000","last_peered":"2024-09-13T23:27:38.331140+0000","last_clean":"2024-09-13T23:27:38.331140+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:27:38.331140+0000","last_undegraded":"2024-09-13T23:27:38.331140+0000","last_fullsized":"2024-09-13T23:27:38.331140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.166890+0000","last_change":"2024-09-13T23:25:15.279035+0000","last_active":"2024-09-13T23:25:55.166890+0000","last_peered":"2024-09-13T23:25:55.166890+0000","last_clean":"2024-09-13T23:25:55.166890+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:25:55.166890+0000","last_undegraded":"2024-09-13T23:25:55.166890+0000","last_fullsized":"2024-09-13T23:25:55.166890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:01.997132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331120+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:27:38.331120+0000","last_peered":"2024-09-13T23:27:38.331120+0000","last_clean":"2024-09-13T23:27:38.331120+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:27:38.331120+0000","last_undegraded":"2024-09-13T23:27:38.331120+0000","last_fullsized":"2024-09-13T23:27:38.331120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373942+0000","last_change":"2024-09-13T23:25:15.280560+0000","last_active":"2024-09-13T23:25:52.373942+0000","last_peered":"2024-09-13T23:25:52.373942+0000","last_clean":"2024-09-13T23:25:52.373942+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:25:52.373942+0000","last_undegraded":"2024-09-13T23:25:52.373942+0000","last_fullsized":"2024-09-13T23:25:52.373942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375633+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:25:52.375633+0000","last_peered":"2024-09-13T23:25:52.375633+0000","last_clean":"2024-09-13T23:25:52.375633+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:25:52.375633+0000","last_undegraded":"2024-09-13T23:25:52.375633+0000","last_fullsized":"2024-09-13T23:25:52.375633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739361+0000","last_change":"2024-09-13T23:25:15.284594+0000","last_active":"2024-09-13T23:28:22.739361+0000","last_peered":"2024-09-13T23:28:22.739361+0000","last_clean":"2024-09-13T23:28:22.739361+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:28:22.739361+0000","last_undegraded":"2024-09-13T23:28:22.739361+0000","last_fullsized":"2024-09-13T23:28:22.739361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374584+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:25:52.374584+0000","last_peered":"2024-09-13T23:25:52.374584+0000","last_clean":"2024-09-13T23:25:52.374584+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:25:52.374584+0000","last_undegraded":"2024-09-13T23:25:52.374584+0000","last_fullsized":"2024-09-13T23:25:52.374584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:50.268744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.748239+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.748239+0000","last_peered":"2024-09-13T23:28:22.748239+0000","last_clean":"2024-09-13T23:28:22.748239+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.748239+0000","last_undegraded":"2024-09-13T23:28:22.748239+0000","last_fullsized":"2024-09-13T23:28:22.748239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374612+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.374612+0000","last_peered":"2024-09-13T23:28:22.374612+0000","last_clean":"2024-09-13T23:28:22.374612+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.374612+0000","last_undegraded":"2024-09-13T23:28:22.374612+0000","last_fullsized":"2024-09-13T23:28:22.374612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:51.011861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376199+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:25:52.376199+0000","last_peered":"2024-09-13T23:25:52.376199+0000","last_clean":"2024-09-13T23:25:52.376199+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:25:52.376199+0000","last_undegraded":"2024-09-13T23:25:52.376199+0000","last_fullsized":"2024-09-13T23:25:52.376199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:28.575656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381408+0000","last_change":"2024-09-13T23:25:17.289713+0000","last_active":"2024-09-13T23:25:52.381408+0000","last_peered":"2024-09-13T23:25:52.381408+0000","last_clean":"2024-09-13T23:25:52.381408+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:25:52.381408+0000","last_undegraded":"2024-09-13T23:25:52.381408+0000","last_fullsized":"2024-09-13T23:25:52.381408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:05.506988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.501575+0000","last_change":"2024-09-13T23:25:19.296863+0000","last_active":"2024-09-13T23:28:29.501575+0000","last_peered":"2024-09-13T23:28:29.501575+0000","last_clean":"2024-09-13T23:28:29.501575+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:29.501575+0000","last_undegraded":"2024-09-13T23:28:29.501575+0000","last_fullsized":"2024-09-13T23:28:29.501575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:01.662692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332738+0000","last_change":"2024-09-13T23:25:21.306129+0000","last_active":"2024-09-13T23:27:48.332738+0000","last_peered":"2024-09-13T23:27:48.332738+0000","last_clean":"2024-09-13T23:27:48.332738+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:27:48.332738+0000","last_undegraded":"2024-09-13T23:27:48.332738+0000","last_fullsized":"2024-09-13T23:27:48.332738+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332553+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:27:48.332553+0000","last_peered":"2024-09-13T23:27:48.332553+0000","last_clean":"2024-09-13T23:27:48.332553+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:27:48.332553+0000","last_undegraded":"2024-09-13T23:27:48.332553+0000","last_fullsized":"2024-09-13T23:27:48.332553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332392+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:27:43.332392+0000","last_peered":"2024-09-13T23:27:43.332392+0000","last_clean":"2024-09-13T23:27:43.332392+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:27:43.332392+0000","last_undegraded":"2024-09-13T23:27:43.332392+0000","last_fullsized":"2024-09-13T23:27:43.332392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:44.441287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372736+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:25:52.372736+0000","last_peered":"2024-09-13T23:25:52.372736+0000","last_clean":"2024-09-13T23:25:52.372736+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:25:52.372736+0000","last_undegraded":"2024-09-13T23:25:52.372736+0000","last_fullsized":"2024-09-13T23:25:52.372736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:36.942478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:13.336031+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:28:13.336031+0000","last_peered":"2024-09-13T23:28:13.336031+0000","last_clean":"2024-09-13T23:28:13.336031+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:28:13.336031+0000","last_undegraded":"2024-09-13T23:28:13.336031+0000","last_fullsized":"2024-09-13T23:28:13.336031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"31'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331994+0000","last_change":"2024-09-13T23:25:19.296507+0000","last_active":"2024-09-13T23:27:43.331994+0000","last_peered":"2024-09-13T23:27:43.331994+0000","last_clean":"2024-09-13T23:27:43.331994+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:27:43.331994+0000","last_undegraded":"2024-09-13T23:27:43.331994+0000","last_fullsized":"2024-09-13T23:27:43.331994+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332701+0000","last_change":"2024-09-13T23:25:21.301362+0000","last_active":"2024-09-13T23:27:48.332701+0000","last_peered":"2024-09-13T23:27:48.332701+0000","last_clean":"2024-09-13T23:27:48.332701+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:27:48.332701+0000","last_undegraded":"2024-09-13T23:27:48.332701+0000","last_fullsized":"2024-09-13T23:27:48.332701+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.481142+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.481142+0000","last_peered":"2024-09-13T23:28:22.481142+0000","last_clean":"2024-09-13T23:28:22.481142+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.481142+0000","last_undegraded":"2024-09-13T23:28:22.481142+0000","last_fullsized":"2024-09-13T23:28:22.481142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:25.274922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871746+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:21.871746+0000","last_peered":"2024-09-13T23:27:21.871746+0000","last_clean":"2024-09-13T23:27:21.871746+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:21.871746+0000","last_undegraded":"2024-09-13T23:27:21.871746+0000","last_fullsized":"2024-09-13T23:27:21.871746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:07:21.355304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379644+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:25:52.379644+0000","last_peered":"2024-09-13T23:25:52.379644+0000","last_clean":"2024-09-13T23:25:52.379644+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:25:52.379644+0000","last_undegraded":"2024-09-13T23:25:52.379644+0000","last_fullsized":"2024-09-13T23:25:52.379644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:18.041761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376883+0000","last_change":"2024-09-13T23:25:17.287013+0000","last_active":"2024-09-13T23:25:52.376883+0000","last_peered":"2024-09-13T23:25:52.376883+0000","last_clean":"2024-09-13T23:25:52.376883+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:25:52.376883+0000","last_undegraded":"2024-09-13T23:25:52.376883+0000","last_fullsized":"2024-09-13T23:25:52.376883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:35.393602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"31'10","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374464+0000","last_change":"2024-09-13T23:25:19.289864+0000","last_active":"2024-09-13T23:25:52.374464+0000","last_peered":"2024-09-13T23:25:52.374464+0000","last_clean":"2024-09-13T23:25:52.374464+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:25:52.374464+0000","last_undegraded":"2024-09-13T23:25:52.374464+0000","last_fullsized":"2024-09-13T23:25:52.374464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:38.226160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":384,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.442135+0000","last_change":"2024-09-13T23:25:21.304299+0000","last_active":"2024-09-13T23:28:29.442135+0000","last_peered":"2024-09-13T23:28:29.442135+0000","last_clean":"2024-09-13T23:28:29.442135+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:29.442135+0000","last_undegraded":"2024-09-13T23:28:29.442135+0000","last_fullsized":"2024-09-13T23:28:29.442135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.160237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.172427+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:25:55.172427+0000","last_peered":"2024-09-13T23:25:55.172427+0000","last_clean":"2024-09-13T23:25:55.172427+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:25:55.172427+0000","last_undegraded":"2024-09-13T23:25:55.172427+0000","last_fullsized":"2024-09-13T23:25:55.172427+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:34.976156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733291+0000","last_change":"2024-09-13T23:25:15.285324+0000","last_active":"2024-09-13T23:28:22.733291+0000","last_peered":"2024-09-13T23:28:22.733291+0000","last_clean":"2024-09-13T23:28:22.733291+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:22.733291+0000","last_undegraded":"2024-09-13T23:28:22.733291+0000","last_fullsized":"2024-09-13T23:28:22.733291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:07.562670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330094+0000","last_change":"2024-09-13T23:25:13.288918+0000","last_active":"2024-09-13T23:27:33.330094+0000","last_peered":"2024-09-13T23:27:33.330094+0000","last_clean":"2024-09-13T23:27:33.330094+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:27:33.330094+0000","last_undegraded":"2024-09-13T23:27:33.330094+0000","last_fullsized":"2024-09-13T23:27:33.330094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.377072+0000","last_change":"2024-09-13T23:25:17.287813+0000","last_active":"2024-09-13T23:25:52.377072+0000","last_peered":"2024-09-13T23:25:52.377072+0000","last_clean":"2024-09-13T23:25:52.377072+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:25:52.377072+0000","last_undegraded":"2024-09-13T23:25:52.377072+0000","last_fullsized":"2024-09-13T23:25:52.377072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:01.764699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.486761+0000","last_change":"2024-09-13T23:25:19.291393+0000","last_active":"2024-09-13T23:28:29.486761+0000","last_peered":"2024-09-13T23:28:29.486761+0000","last_clean":"2024-09-13T23:28:29.486761+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:29.486761+0000","last_undegraded":"2024-09-13T23:28:29.486761+0000","last_fullsized":"2024-09-13T23:28:29.486761+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:41.211829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":444,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.446739+0000","last_change":"2024-09-13T23:25:21.303172+0000","last_active":"2024-09-13T23:28:29.446739+0000","last_peered":"2024-09-13T23:28:29.446739+0000","last_clean":"2024-09-13T23:28:29.446739+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:29.446739+0000","last_undegraded":"2024-09-13T23:28:29.446739+0000","last_fullsized":"2024-09-13T23:28:29.446739+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:04.998376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739506+0000","last_change":"2024-09-13T23:25:15.291664+0000","last_active":"2024-09-13T23:28:22.739506+0000","last_peered":"2024-09-13T23:28:22.739506+0000","last_clean":"2024-09-13T23:28:22.739506+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:22.739506+0000","last_undegraded":"2024-09-13T23:28:22.739506+0000","last_fullsized":"2024-09-13T23:28:22.739506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:54.160656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375841+0000","last_change":"2024-09-13T23:25:13.289874+0000","last_active":"2024-09-13T23:25:52.375841+0000","last_peered":"2024-09-13T23:25:52.375841+0000","last_clean":"2024-09-13T23:25:52.375841+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:25:52.375841+0000","last_undegraded":"2024-09-13T23:25:52.375841+0000","last_fullsized":"2024-09-13T23:25:52.375841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329237+0000","last_change":"2024-09-13T23:25:17.289113+0000","last_active":"2024-09-13T23:27:28.329237+0000","last_peered":"2024-09-13T23:27:28.329237+0000","last_clean":"2024-09-13T23:27:28.329237+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:27:28.329237+0000","last_undegraded":"2024-09-13T23:27:28.329237+0000","last_fullsized":"2024-09-13T23:27:28.329237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'43","reported_seq":94,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.513293+0000","last_change":"2024-09-13T23:25:19.297925+0000","last_active":"2024-09-13T23:28:29.513293+0000","last_peered":"2024-09-13T23:28:29.513293+0000","last_clean":"2024-09-13T23:28:29.513293+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:29.513293+0000","last_undegraded":"2024-09-13T23:28:29.513293+0000","last_fullsized":"2024-09-13T23:28:29.513293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:19.643035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374678+0000","last_change":"2024-09-13T23:25:21.301483+0000","last_active":"2024-09-13T23:25:52.374678+0000","last_peered":"2024-09-13T23:25:52.374678+0000","last_clean":"2024-09-13T23:25:52.374678+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:25:52.374678+0000","last_undegraded":"2024-09-13T23:25:52.374678+0000","last_fullsized":"2024-09-13T23:25:52.374678+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:11.275595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.677351+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.677351+0000","last_peered":"2024-09-13T23:28:22.677351+0000","last_clean":"2024-09-13T23:28:22.677351+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.677351+0000","last_undegraded":"2024-09-13T23:28:22.677351+0000","last_fullsized":"2024-09-13T23:28:22.677351+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:47.879557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329215+0000","last_change":"2024-09-13T23:25:15.285081+0000","last_active":"2024-09-13T23:27:28.329215+0000","last_peered":"2024-09-13T23:27:28.329215+0000","last_clean":"2024-09-13T23:27:28.329215+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:27:28.329215+0000","last_undegraded":"2024-09-13T23:27:28.329215+0000","last_fullsized":"2024-09-13T23:27:28.329215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.260097+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:28:22.260097+0000","last_peered":"2024-09-13T23:28:22.260097+0000","last_clean":"2024-09-13T23:28:22.260097+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:28:22.260097+0000","last_undegraded":"2024-09-13T23:28:22.260097+0000","last_fullsized":"2024-09-13T23:28:22.260097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374895+0000","last_change":"2024-09-13T23:25:17.291228+0000","last_active":"2024-09-13T23:25:52.374895+0000","last_peered":"2024-09-13T23:25:52.374895+0000","last_clean":"2024-09-13T23:25:52.374895+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:25:52.374895+0000","last_undegraded":"2024-09-13T23:25:52.374895+0000","last_fullsized":"2024-09-13T23:25:52.374895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:21:35.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.553751+0000","last_change":"2024-09-13T23:25:19.294956+0000","last_active":"2024-09-13T23:28:29.553751+0000","last_peered":"2024-09-13T23:28:29.553751+0000","last_clean":"2024-09-13T23:28:29.553751+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:29.553751+0000","last_undegraded":"2024-09-13T23:28:29.553751+0000","last_fullsized":"2024-09-13T23:28:29.553751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:35.437725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374433+0000","last_change":"2024-09-13T23:25:21.308307+0000","last_active":"2024-09-13T23:25:52.374433+0000","last_peered":"2024-09-13T23:25:52.374433+0000","last_clean":"2024-09-13T23:25:52.374433+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:25:52.374433+0000","last_undegraded":"2024-09-13T23:25:52.374433+0000","last_fullsized":"2024-09-13T23:25:52.374433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.041258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'3","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329372+0000","last_change":"2024-09-13T23:25:23.307544+0000","last_active":"2024-09-13T23:27:28.329372+0000","last_peered":"2024-09-13T23:27:28.329372+0000","last_clean":"2024-09-13T23:27:28.329372+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:27:28.329372+0000","last_undegraded":"2024-09-13T23:27:28.329372+0000","last_fullsized":"2024-09-13T23:27:28.329372+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479224+0000","last_change":"2024-09-13T23:25:15.287305+0000","last_active":"2024-09-13T23:28:22.479224+0000","last_peered":"2024-09-13T23:28:22.479224+0000","last_clean":"2024-09-13T23:28:22.479224+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:28:22.479224+0000","last_undegraded":"2024-09-13T23:28:22.479224+0000","last_fullsized":"2024-09-13T23:28:22.479224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.249148+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:28:22.249148+0000","last_peered":"2024-09-13T23:28:22.249148+0000","last_clean":"2024-09-13T23:28:22.249148+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:28:22.249148+0000","last_undegraded":"2024-09-13T23:28:22.249148+0000","last_fullsized":"2024-09-13T23:28:22.249148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:38:37.817951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:17.285971+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:54.021576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.518816+0000","last_change":"2024-09-13T23:25:19.299653+0000","last_active":"2024-09-13T23:28:29.518816+0000","last_peered":"2024-09-13T23:28:29.518816+0000","last_clean":"2024-09-13T23:28:29.518816+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:28:29.518816+0000","last_undegraded":"2024-09-13T23:28:29.518816+0000","last_fullsized":"2024-09-13T23:28:29.518816+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:09.850559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":351,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.447983+0000","last_change":"2024-09-13T23:25:21.308757+0000","last_active":"2024-09-13T23:28:29.447983+0000","last_peered":"2024-09-13T23:28:29.447983+0000","last_clean":"2024-09-13T23:28:29.447983+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:29.447983+0000","last_undegraded":"2024-09-13T23:28:29.447983+0000","last_fullsized":"2024-09-13T23:28:29.447983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:45.873152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375463+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:25:52.375463+0000","last_peered":"2024-09-13T23:25:52.375463+0000","last_clean":"2024-09-13T23:25:52.375463+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:25:52.375463+0000","last_undegraded":"2024-09-13T23:25:52.375463+0000","last_fullsized":"2024-09-13T23:25:52.375463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.604079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.696828+0000","last_change":"2024-09-13T23:25:15.283264+0000","last_active":"2024-09-13T23:28:22.696828+0000","last_peered":"2024-09-13T23:28:22.696828+0000","last_clean":"2024-09-13T23:28:22.696828+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:22.696828+0000","last_undegraded":"2024-09-13T23:28:22.696828+0000","last_fullsized":"2024-09-13T23:28:22.696828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.390295+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:18.390295+0000","last_peered":"2024-09-13T23:27:18.390295+0000","last_clean":"2024-09-13T23:27:18.390295+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:18.390295+0000","last_undegraded":"2024-09-13T23:27:18.390295+0000","last_fullsized":"2024-09-13T23:27:18.390295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:32.413205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:17.286788+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:39.422715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":125,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.561788+0000","last_change":"2024-09-13T23:25:19.299651+0000","last_active":"2024-09-13T23:28:29.561788+0000","last_peered":"2024-09-13T23:28:29.561788+0000","last_clean":"2024-09-13T23:28:29.561788+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:28:29.561788+0000","last_undegraded":"2024-09-13T23:28:29.561788+0000","last_fullsized":"2024-09-13T23:28:29.561788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:31.439065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374591+0000","last_change":"2024-09-13T23:25:21.301614+0000","last_active":"2024-09-13T23:25:52.374591+0000","last_peered":"2024-09-13T23:25:52.374591+0000","last_clean":"2024-09-13T23:25:52.374591+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:25:52.374591+0000","last_undegraded":"2024-09-13T23:25:52.374591+0000","last_fullsized":"2024-09-13T23:25:52.374591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:34.459176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.962416+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.962416+0000","last_peered":"2024-09-13T23:28:22.962416+0000","last_clean":"2024-09-13T23:28:22.962416+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.962416+0000","last_undegraded":"2024-09-13T23:28:22.962416+0000","last_fullsized":"2024-09-13T23:28:22.962416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:22.720145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739918+0000","last_change":"2024-09-13T23:25:15.296722+0000","last_active":"2024-09-13T23:28:22.739918+0000","last_peered":"2024-09-13T23:28:22.739918+0000","last_clean":"2024-09-13T23:28:22.739918+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:22.739918+0000","last_undegraded":"2024-09-13T23:28:22.739918+0000","last_fullsized":"2024-09-13T23:28:22.739918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.414481+0000","last_change":"2024-09-13T23:25:13.283881+0000","last_active":"2024-09-13T23:25:55.414481+0000","last_peered":"2024-09-13T23:25:55.414481+0000","last_clean":"2024-09-13T23:25:55.414481+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:25:55.414481+0000","last_undegraded":"2024-09-13T23:25:55.414481+0000","last_fullsized":"2024-09-13T23:25:55.414481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:06.923716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374030+0000","last_change":"2024-09-13T23:25:17.285259+0000","last_active":"2024-09-13T23:25:52.374030+0000","last_peered":"2024-09-13T23:25:52.374030+0000","last_clean":"2024-09-13T23:25:52.374030+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:25:52.374030+0000","last_undegraded":"2024-09-13T23:25:52.374030+0000","last_fullsized":"2024-09-13T23:25:52.374030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:00.997313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.565883+0000","last_change":"2024-09-13T23:25:19.292957+0000","last_active":"2024-09-13T23:28:29.565883+0000","last_peered":"2024-09-13T23:28:29.565883+0000","last_clean":"2024-09-13T23:28:29.565883+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:29.565883+0000","last_undegraded":"2024-09-13T23:28:29.565883+0000","last_fullsized":"2024-09-13T23:28:29.565883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380477+0000","last_change":"2024-09-13T23:25:21.307942+0000","last_active":"2024-09-13T23:25:52.380477+0000","last_peered":"2024-09-13T23:25:52.380477+0000","last_clean":"2024-09-13T23:25:52.380477+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:25:52.380477+0000","last_undegraded":"2024-09-13T23:25:52.380477+0000","last_fullsized":"2024-09-13T23:25:52.380477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:57.825937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329045+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:27:23.329045+0000","last_peered":"2024-09-13T23:27:23.329045+0000","last_clean":"2024-09-13T23:27:23.329045+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:27:23.329045+0000","last_undegraded":"2024-09-13T23:27:23.329045+0000","last_fullsized":"2024-09-13T23:27:23.329045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:16.049837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697480+0000","last_change":"2024-09-13T23:25:15.290226+0000","last_active":"2024-09-13T23:28:22.697480+0000","last_peered":"2024-09-13T23:28:22.697480+0000","last_clean":"2024-09-13T23:28:22.697480+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:22.697480+0000","last_undegraded":"2024-09-13T23:28:22.697480+0000","last_fullsized":"2024-09-13T23:28:22.697480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:58.471027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376787+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:25:52.376787+0000","last_peered":"2024-09-13T23:25:52.376787+0000","last_clean":"2024-09-13T23:25:52.376787+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:25:52.376787+0000","last_undegraded":"2024-09-13T23:25:52.376787+0000","last_fullsized":"2024-09-13T23:25:52.376787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:34.681115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376818+0000","last_change":"2024-09-13T23:25:17.287240+0000","last_active":"2024-09-13T23:25:52.376818+0000","last_peered":"2024-09-13T23:25:52.376818+0000","last_clean":"2024-09-13T23:25:52.376818+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:25:52.376818+0000","last_undegraded":"2024-09-13T23:25:52.376818+0000","last_fullsized":"2024-09-13T23:25:52.376818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:39.205078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'40","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.544367+0000","last_change":"2024-09-13T23:25:19.289083+0000","last_active":"2024-09-13T23:28:29.544367+0000","last_peered":"2024-09-13T23:28:29.544367+0000","last_clean":"2024-09-13T23:28:29.544367+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:29.544367+0000","last_undegraded":"2024-09-13T23:28:29.544367+0000","last_fullsized":"2024-09-13T23:28:29.544367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:42.816869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":434,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.443435+0000","last_change":"2024-09-13T23:25:21.302618+0000","last_active":"2024-09-13T23:28:29.443435+0000","last_peered":"2024-09-13T23:28:29.443435+0000","last_clean":"2024-09-13T23:28:29.443435+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:29.443435+0000","last_undegraded":"2024-09-13T23:28:29.443435+0000","last_fullsized":"2024-09-13T23:28:29.443435+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:32:56.258928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328632+0000","last_change":"2024-09-13T23:25:23.302781+0000","last_active":"2024-09-13T23:27:31.328632+0000","last_peered":"2024-09-13T23:27:31.328632+0000","last_clean":"2024-09-13T23:27:31.328632+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:27:31.328632+0000","last_undegraded":"2024-09-13T23:27:31.328632+0000","last_fullsized":"2024-09-13T23:27:31.328632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:54.025813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.437139+0000","last_change":"2024-09-13T23:25:15.290988+0000","last_active":"2024-09-13T23:25:55.437139+0000","last_peered":"2024-09-13T23:25:55.437139+0000","last_clean":"2024-09-13T23:25:55.437139+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:25:55.437139+0000","last_undegraded":"2024-09-13T23:25:55.437139+0000","last_fullsized":"2024-09-13T23:25:55.437139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374910+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:25:52.374910+0000","last_peered":"2024-09-13T23:25:52.374910+0000","last_clean":"2024-09-13T23:25:52.374910+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:25:52.374910+0000","last_undegraded":"2024-09-13T23:25:52.374910+0000","last_fullsized":"2024-09-13T23:25:52.374910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:41:32.148141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'3","reported_seq":418,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.435344+0000","last_change":"2024-09-13T23:25:17.288588+0000","last_active":"2024-09-13T23:28:29.435344+0000","last_peered":"2024-09-13T23:28:29.435344+0000","last_clean":"2024-09-13T23:28:29.435344+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:29.435344+0000","last_undegraded":"2024-09-13T23:28:29.435344+0000","last_fullsized":"2024-09-13T23:28:29.435344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330751+0000","last_change":"2024-09-13T23:25:19.298296+0000","last_active":"2024-09-13T23:27:33.330751+0000","last_peered":"2024-09-13T23:27:33.330751+0000","last_clean":"2024-09-13T23:27:33.330751+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:27:33.330751+0000","last_undegraded":"2024-09-13T23:27:33.330751+0000","last_fullsized":"2024-09-13T23:27:33.330751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:50:39.743432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":472,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.596930+0000","last_change":"2024-09-13T23:25:21.299515+0000","last_active":"2024-09-13T23:28:29.596930+0000","last_peered":"2024-09-13T23:28:29.596930+0000","last_clean":"2024-09-13T23:28:29.596930+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:29.596930+0000","last_undegraded":"2024-09-13T23:28:29.596930+0000","last_fullsized":"2024-09-13T23:28:29.596930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.844255+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.844255+0000","last_peered":"2024-09-13T23:28:22.844255+0000","last_clean":"2024-09-13T23:28:22.844255+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.844255+0000","last_undegraded":"2024-09-13T23:28:22.844255+0000","last_fullsized":"2024-09-13T23:28:22.844255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:32:46.511629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330399+0000","last_change":"2024-09-13T23:25:15.295321+0000","last_active":"2024-09-13T23:27:33.330399+0000","last_peered":"2024-09-13T23:27:33.330399+0000","last_clean":"2024-09-13T23:27:33.330399+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:27:33.330399+0000","last_undegraded":"2024-09-13T23:27:33.330399+0000","last_fullsized":"2024-09-13T23:27:33.330399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373680+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:25:52.373680+0000","last_peered":"2024-09-13T23:25:52.373680+0000","last_clean":"2024-09-13T23:25:52.373680+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:25:52.373680+0000","last_undegraded":"2024-09-13T23:25:52.373680+0000","last_fullsized":"2024-09-13T23:25:52.373680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:19.192252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376682+0000","last_change":"2024-09-13T23:25:17.288064+0000","last_active":"2024-09-13T23:25:52.376682+0000","last_peered":"2024-09-13T23:25:52.376682+0000","last_clean":"2024-09-13T23:25:52.376682+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:25:52.376682+0000","last_undegraded":"2024-09-13T23:25:52.376682+0000","last_fullsized":"2024-09-13T23:25:52.376682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:40.830361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'42","reported_seq":93,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.505604+0000","last_change":"2024-09-13T23:25:19.292186+0000","last_active":"2024-09-13T23:28:29.505604+0000","last_peered":"2024-09-13T23:28:29.505604+0000","last_clean":"2024-09-13T23:28:29.505604+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:29.505604+0000","last_undegraded":"2024-09-13T23:28:29.505604+0000","last_fullsized":"2024-09-13T23:28:29.505604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373673+0000","last_change":"2024-09-13T23:25:21.307481+0000","last_active":"2024-09-13T23:25:52.373673+0000","last_peered":"2024-09-13T23:25:52.373673+0000","last_clean":"2024-09-13T23:25:52.373673+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:25:52.373673+0000","last_undegraded":"2024-09-13T23:25:52.373673+0000","last_fullsized":"2024-09-13T23:25:52.373673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:21.541131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.964310+0000","last_change":"2024-09-13T23:25:23.303608+0000","last_active":"2024-09-13T23:28:22.964310+0000","last_peered":"2024-09-13T23:28:22.964310+0000","last_clean":"2024-09-13T23:28:22.964310+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:22.964310+0000","last_undegraded":"2024-09-13T23:28:22.964310+0000","last_fullsized":"2024-09-13T23:28:22.964310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.901628+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:26:37.901628+0000","last_peered":"2024-09-13T23:26:37.901628+0000","last_clean":"2024-09-13T23:26:37.901628+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:26:37.901628+0000","last_undegraded":"2024-09-13T23:26:37.901628+0000","last_fullsized":"2024-09-13T23:26:37.901628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:01.400783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:03.325877+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:27:03.325877+0000","last_peered":"2024-09-13T23:27:03.325877+0000","last_clean":"2024-09-13T23:27:03.325877+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:27:03.325877+0000","last_undegraded":"2024-09-13T23:27:03.325877+0000","last_fullsized":"2024-09-13T23:27:03.325877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376079+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:25:52.376079+0000","last_peered":"2024-09-13T23:25:52.376079+0000","last_clean":"2024-09-13T23:25:52.376079+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:25:52.376079+0000","last_undegraded":"2024-09-13T23:25:52.376079+0000","last_fullsized":"2024-09-13T23:25:52.376079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:27.071154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374353+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:25:52.374353+0000","last_peered":"2024-09-13T23:25:52.374353+0000","last_clean":"2024-09-13T23:25:52.374353+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:25:52.374353+0000","last_undegraded":"2024-09-13T23:25:52.374353+0000","last_fullsized":"2024-09-13T23:25:52.374353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:49.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328452+0000","last_change":"2024-09-13T23:25:17.286100+0000","last_active":"2024-09-13T23:27:23.328452+0000","last_peered":"2024-09-13T23:27:23.328452+0000","last_clean":"2024-09-13T23:27:23.328452+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:27:23.328452+0000","last_undegraded":"2024-09-13T23:27:23.328452+0000","last_fullsized":"2024-09-13T23:27:23.328452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'87","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.538058+0000","last_change":"2024-09-13T23:25:19.298079+0000","last_active":"2024-09-13T23:28:29.538058+0000","last_peered":"2024-09-13T23:28:29.538058+0000","last_clean":"2024-09-13T23:28:29.538058+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:28:29.538058+0000","last_undegraded":"2024-09-13T23:28:29.538058+0000","last_fullsized":"2024-09-13T23:28:29.538058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:28.504390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376686+0000","last_change":"2024-09-13T23:25:21.308687+0000","last_active":"2024-09-13T23:25:52.376686+0000","last_peered":"2024-09-13T23:25:52.376686+0000","last_clean":"2024-09-13T23:25:52.376686+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:25:52.376686+0000","last_undegraded":"2024-09-13T23:25:52.376686+0000","last_fullsized":"2024-09-13T23:25:52.376686+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:09.375352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.742526+0000","last_change":"2024-09-13T23:25:23.304383+0000","last_active":"2024-09-13T23:28:22.742526+0000","last_peered":"2024-09-13T23:28:22.742526+0000","last_clean":"2024-09-13T23:28:22.742526+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:22.742526+0000","last_undegraded":"2024-09-13T23:28:22.742526+0000","last_fullsized":"2024-09-13T23:28:22.742526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:15.420600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382727+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.382727+0000","last_peered":"2024-09-13T23:28:22.382727+0000","last_clean":"2024-09-13T23:28:22.382727+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.382727+0000","last_undegraded":"2024-09-13T23:28:22.382727+0000","last_fullsized":"2024-09-13T23:28:22.382727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:49.591312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373570+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:25:52.373570+0000","last_peered":"2024-09-13T23:25:52.373570+0000","last_clean":"2024-09-13T23:25:52.373570+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:25:52.373570+0000","last_undegraded":"2024-09-13T23:25:52.373570+0000","last_fullsized":"2024-09-13T23:25:52.373570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:19.956439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.288893+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:28:22.288893+0000","last_peered":"2024-09-13T23:28:22.288893+0000","last_clean":"2024-09-13T23:28:22.288893+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:28:22.288893+0000","last_undegraded":"2024-09-13T23:28:22.288893+0000","last_fullsized":"2024-09-13T23:28:22.288893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:24.181985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.381102+0000","last_change":"2024-09-13T23:25:17.287907+0000","last_active":"2024-09-13T23:25:52.381102+0000","last_peered":"2024-09-13T23:25:52.381102+0000","last_clean":"2024-09-13T23:25:52.381102+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:25:52.381102+0000","last_undegraded":"2024-09-13T23:25:52.381102+0000","last_fullsized":"2024-09-13T23:25:52.381102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:39:37.373797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'284","reported_seq":501,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.591209+0000","last_change":"2024-09-13T23:25:19.299249+0000","last_active":"2024-09-13T23:28:29.591209+0000","last_peered":"2024-09-13T23:28:29.591209+0000","last_clean":"2024-09-13T23:28:29.591209+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:29.591209+0000","last_undegraded":"2024-09-13T23:28:29.591209+0000","last_fullsized":"2024-09-13T23:28:29.591209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380330+0000","last_change":"2024-09-13T23:25:21.304037+0000","last_active":"2024-09-13T23:25:52.380330+0000","last_peered":"2024-09-13T23:25:52.380330+0000","last_clean":"2024-09-13T23:25:52.380330+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:25:52.380330+0000","last_undegraded":"2024-09-13T23:25:52.380330+0000","last_fullsized":"2024-09-13T23:25:52.380330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:37:34.562617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330216+0000","last_change":"2024-09-13T23:25:23.308546+0000","last_active":"2024-09-13T23:27:33.330216+0000","last_peered":"2024-09-13T23:27:33.330216+0000","last_clean":"2024-09-13T23:27:33.330216+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:27:33.330216+0000","last_undegraded":"2024-09-13T23:27:33.330216+0000","last_fullsized":"2024-09-13T23:27:33.330216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.374990+0000","last_change":"2024-09-13T23:25:15.285194+0000","last_active":"2024-09-13T23:28:22.374990+0000","last_peered":"2024-09-13T23:28:22.374990+0000","last_clean":"2024-09-13T23:28:22.374990+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:28:22.374990+0000","last_undegraded":"2024-09-13T23:28:22.374990+0000","last_fullsized":"2024-09-13T23:28:22.374990+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:32.603182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372184+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:25:52.372184+0000","last_peered":"2024-09-13T23:25:52.372184+0000","last_clean":"2024-09-13T23:25:52.372184+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:25:52.372184+0000","last_undegraded":"2024-09-13T23:25:52.372184+0000","last_fullsized":"2024-09-13T23:25:52.372184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:58:59.080649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.889372+0000","last_change":"2024-09-13T23:25:13.287909+0000","last_active":"2024-09-13T23:26:37.889372+0000","last_peered":"2024-09-13T23:26:37.889372+0000","last_clean":"2024-09-13T23:26:37.889372+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:26:37.889372+0000","last_undegraded":"2024-09-13T23:26:37.889372+0000","last_fullsized":"2024-09-13T23:26:37.889372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:51.034363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"24'2","reported_seq":221,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.415326+0000","last_change":"2024-09-13T23:25:17.283490+0000","last_active":"2024-09-13T23:28:29.415326+0000","last_peered":"2024-09-13T23:28:29.415326+0000","last_clean":"2024-09-13T23:28:29.415326+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:29.415326+0000","last_undegraded":"2024-09-13T23:28:29.415326+0000","last_fullsized":"2024-09-13T23:28:29.415326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.725573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'17","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.364589+0000","last_change":"2024-09-13T23:25:19.293483+0000","last_active":"2024-09-13T23:28:22.364589+0000","last_peered":"2024-09-13T23:28:22.364589+0000","last_clean":"2024-09-13T23:28:22.364589+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:22.364589+0000","last_undegraded":"2024-09-13T23:28:22.364589+0000","last_fullsized":"2024-09-13T23:28:22.364589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:37:37.400352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375104+0000","last_change":"2024-09-13T23:25:21.302444+0000","last_active":"2024-09-13T23:25:52.375104+0000","last_peered":"2024-09-13T23:25:52.375104+0000","last_clean":"2024-09-13T23:25:52.375104+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:25:52.375104+0000","last_undegraded":"2024-09-13T23:25:52.375104+0000","last_fullsized":"2024-09-13T23:25:52.375104+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:59.000917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.075118+0000","last_change":"2024-09-13T23:25:23.311768+0000","last_active":"2024-09-13T23:28:22.075118+0000","last_peered":"2024-09-13T23:28:22.075118+0000","last_clean":"2024-09-13T23:28:22.075118+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:28:22.075118+0000","last_undegraded":"2024-09-13T23:28:22.075118+0000","last_fullsized":"2024-09-13T23:28:22.075118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:53.775798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327023+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:27:21.327023+0000","last_peered":"2024-09-13T23:27:21.327023+0000","last_clean":"2024-09-13T23:27:21.327023+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:27:21.327023+0000","last_undegraded":"2024-09-13T23:27:21.327023+0000","last_fullsized":"2024-09-13T23:27:21.327023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:10.905369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374265+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:25:52.374265+0000","last_peered":"2024-09-13T23:25:52.374265+0000","last_clean":"2024-09-13T23:25:52.374265+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:25:52.374265+0000","last_undegraded":"2024-09-13T23:25:52.374265+0000","last_fullsized":"2024-09-13T23:25:52.374265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:30:49.488237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621755+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.621755+0000","last_peered":"2024-09-13T23:28:22.621755+0000","last_clean":"2024-09-13T23:28:22.621755+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.621755+0000","last_undegraded":"2024-09-13T23:28:22.621755+0000","last_fullsized":"2024-09-13T23:28:22.621755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:55:30.184591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376731+0000","last_change":"2024-09-13T23:25:17.285610+0000","last_active":"2024-09-13T23:25:52.376731+0000","last_peered":"2024-09-13T23:25:52.376731+0000","last_clean":"2024-09-13T23:25:52.376731+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:25:52.376731+0000","last_undegraded":"2024-09-13T23:25:52.376731+0000","last_fullsized":"2024-09-13T23:25:52.376731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:40.895440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.895417+0000","last_change":"2024-09-13T23:25:19.294517+0000","last_active":"2024-09-13T23:28:21.895417+0000","last_peered":"2024-09-13T23:28:21.895417+0000","last_clean":"2024-09-13T23:28:21.895417+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:21.895417+0000","last_undegraded":"2024-09-13T23:28:21.895417+0000","last_fullsized":"2024-09-13T23:28:21.895417+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:57.792215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380367+0000","last_change":"2024-09-13T23:25:21.307983+0000","last_active":"2024-09-13T23:25:52.380367+0000","last_peered":"2024-09-13T23:25:52.380367+0000","last_clean":"2024-09-13T23:25:52.380367+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:25:52.380367+0000","last_undegraded":"2024-09-13T23:25:52.380367+0000","last_fullsized":"2024-09-13T23:25:52.380367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:49.287014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330131+0000","last_change":"2024-09-13T23:25:23.314405+0000","last_active":"2024-09-13T23:27:33.330131+0000","last_peered":"2024-09-13T23:27:33.330131+0000","last_clean":"2024-09-13T23:27:33.330131+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:27:33.330131+0000","last_undegraded":"2024-09-13T23:27:33.330131+0000","last_fullsized":"2024-09-13T23:27:33.330131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328386+0000","last_change":"2024-09-13T23:25:15.295101+0000","last_active":"2024-09-13T23:27:23.328386+0000","last_peered":"2024-09-13T23:27:23.328386+0000","last_clean":"2024-09-13T23:27:23.328386+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:27:23.328386+0000","last_undegraded":"2024-09-13T23:27:23.328386+0000","last_fullsized":"2024-09-13T23:27:23.328386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374467+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:25:52.374467+0000","last_peered":"2024-09-13T23:25:52.374467+0000","last_clean":"2024-09-13T23:25:52.374467+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:25:52.374467+0000","last_undegraded":"2024-09-13T23:25:52.374467+0000","last_fullsized":"2024-09-13T23:25:52.374467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374857+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:25:52.374857+0000","last_peered":"2024-09-13T23:25:52.374857+0000","last_clean":"2024-09-13T23:25:52.374857+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:25:52.374857+0000","last_undegraded":"2024-09-13T23:25:52.374857+0000","last_fullsized":"2024-09-13T23:25:52.374857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.613390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:23.022015+0000","last_change":"2024-09-13T23:25:17.285296+0000","last_active":"2024-09-13T23:28:23.022015+0000","last_peered":"2024-09-13T23:28:23.022015+0000","last_clean":"2024-09-13T23:28:23.022015+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:23.022015+0000","last_undegraded":"2024-09-13T23:28:23.022015+0000","last_fullsized":"2024-09-13T23:28:23.022015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:16.469594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'69","reported_seq":136,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.541287+0000","last_change":"2024-09-13T23:25:19.298514+0000","last_active":"2024-09-13T23:28:29.541287+0000","last_peered":"2024-09-13T23:28:29.541287+0000","last_clean":"2024-09-13T23:28:29.541287+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:29.541287+0000","last_undegraded":"2024-09-13T23:28:29.541287+0000","last_fullsized":"2024-09-13T23:28:29.541287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:01.195077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372567+0000","last_change":"2024-09-13T23:25:21.301624+0000","last_active":"2024-09-13T23:25:52.372567+0000","last_peered":"2024-09-13T23:25:52.372567+0000","last_clean":"2024-09-13T23:25:52.372567+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:25:52.372567+0000","last_undegraded":"2024-09-13T23:25:52.372567+0000","last_fullsized":"2024-09-13T23:25:52.372567+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:48.130925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.785277+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:21.785277+0000","last_peered":"2024-09-13T23:27:21.785277+0000","last_clean":"2024-09-13T23:27:21.785277+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:21.785277+0000","last_undegraded":"2024-09-13T23:27:21.785277+0000","last_fullsized":"2024-09-13T23:27:21.785277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:58.134248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328409+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:27:23.328409+0000","last_peered":"2024-09-13T23:27:23.328409+0000","last_clean":"2024-09-13T23:27:23.328409+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:27:23.328409+0000","last_undegraded":"2024-09-13T23:27:23.328409+0000","last_fullsized":"2024-09-13T23:27:23.328409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375170+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:25:52.375170+0000","last_peered":"2024-09-13T23:25:52.375170+0000","last_clean":"2024-09-13T23:25:52.375170+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:25:52.375170+0000","last_undegraded":"2024-09-13T23:25:52.375170+0000","last_fullsized":"2024-09-13T23:25:52.375170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382386+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:25:52.382386+0000","last_peered":"2024-09-13T23:25:52.382386+0000","last_clean":"2024-09-13T23:25:52.382386+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:25:52.382386+0000","last_undegraded":"2024-09-13T23:25:52.382386+0000","last_fullsized":"2024-09-13T23:25:52.382386+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:17:03.849991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374660+0000","last_change":"2024-09-13T23:25:17.287023+0000","last_active":"2024-09-13T23:25:52.374660+0000","last_peered":"2024-09-13T23:25:52.374660+0000","last_clean":"2024-09-13T23:25:52.374660+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:25:52.374660+0000","last_undegraded":"2024-09-13T23:25:52.374660+0000","last_fullsized":"2024-09-13T23:25:52.374660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:07.084091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"31'14","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328333+0000","last_change":"2024-09-13T23:25:19.294335+0000","last_active":"2024-09-13T23:27:23.328333+0000","last_peered":"2024-09-13T23:27:23.328333+0000","last_clean":"2024-09-13T23:27:23.328333+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:27:23.328333+0000","last_undegraded":"2024-09-13T23:27:23.328333+0000","last_fullsized":"2024-09-13T23:27:23.328333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":373,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.593478+0000","last_change":"2024-09-13T23:25:21.300733+0000","last_active":"2024-09-13T23:28:29.593478+0000","last_peered":"2024-09-13T23:28:29.593478+0000","last_clean":"2024-09-13T23:28:29.593478+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:29.593478+0000","last_undegraded":"2024-09-13T23:28:29.593478+0000","last_fullsized":"2024-09-13T23:28:29.593478+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380261+0000","last_change":"2024-09-13T23:25:23.311239+0000","last_active":"2024-09-13T23:25:52.380261+0000","last_peered":"2024-09-13T23:25:52.380261+0000","last_clean":"2024-09-13T23:25:52.380261+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:25:52.380261+0000","last_undegraded":"2024-09-13T23:25:52.380261+0000","last_fullsized":"2024-09-13T23:25:52.380261+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:38:01.065259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.634716+0000","last_change":"2024-09-13T23:25:15.291433+0000","last_active":"2024-09-13T23:28:22.634716+0000","last_peered":"2024-09-13T23:28:22.634716+0000","last_clean":"2024-09-13T23:28:22.634716+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:22.634716+0000","last_undegraded":"2024-09-13T23:28:22.634716+0000","last_fullsized":"2024-09-13T23:28:22.634716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:25.985146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.424804+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:25:55.424804+0000","last_peered":"2024-09-13T23:25:55.424804+0000","last_clean":"2024-09-13T23:25:55.424804+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:25:55.424804+0000","last_undegraded":"2024-09-13T23:25:55.424804+0000","last_fullsized":"2024-09-13T23:25:55.424804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:04.927068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375533+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:25:52.375533+0000","last_peered":"2024-09-13T23:25:52.375533+0000","last_clean":"2024-09-13T23:25:52.375533+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:25:52.375533+0000","last_undegraded":"2024-09-13T23:25:52.375533+0000","last_fullsized":"2024-09-13T23:25:52.375533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:49:15.742358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388035+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:25:52.388035+0000","last_peered":"2024-09-13T23:25:52.388035+0000","last_clean":"2024-09-13T23:25:52.388035+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:25:52.388035+0000","last_undegraded":"2024-09-13T23:25:52.388035+0000","last_fullsized":"2024-09-13T23:25:52.388035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:07.872328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329205+0000","last_change":"2024-09-13T23:25:19.295671+0000","last_active":"2024-09-13T23:27:23.329205+0000","last_peered":"2024-09-13T23:27:23.329205+0000","last_clean":"2024-09-13T23:27:23.329205+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:27:23.329205+0000","last_undegraded":"2024-09-13T23:27:23.329205+0000","last_fullsized":"2024-09-13T23:27:23.329205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:18.597972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":402,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.445563+0000","last_change":"2024-09-13T23:25:21.300629+0000","last_active":"2024-09-13T23:28:29.445563+0000","last_peered":"2024-09-13T23:28:29.445563+0000","last_clean":"2024-09-13T23:28:29.445563+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:29.445563+0000","last_undegraded":"2024-09-13T23:28:29.445563+0000","last_fullsized":"2024-09-13T23:28:29.445563+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:24.498793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331092+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:27:38.331092+0000","last_peered":"2024-09-13T23:27:38.331092+0000","last_clean":"2024-09-13T23:27:38.331092+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:27:38.331092+0000","last_undegraded":"2024-09-13T23:27:38.331092+0000","last_fullsized":"2024-09-13T23:27:38.331092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.899058+0000","last_change":"2024-09-13T23:25:15.289794+0000","last_active":"2024-09-13T23:26:37.899058+0000","last_peered":"2024-09-13T23:26:37.899058+0000","last_clean":"2024-09-13T23:26:37.899058+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:26:37.899058+0000","last_undegraded":"2024-09-13T23:26:37.899058+0000","last_fullsized":"2024-09-13T23:26:37.899058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:15.552404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621418+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.621418+0000","last_peered":"2024-09-13T23:28:22.621418+0000","last_clean":"2024-09-13T23:28:22.621418+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.621418+0000","last_undegraded":"2024-09-13T23:28:22.621418+0000","last_fullsized":"2024-09-13T23:28:22.621418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380490+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:25:52.380490+0000","last_peered":"2024-09-13T23:25:52.380490+0000","last_clean":"2024-09-13T23:25:52.380490+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:25:52.380490+0000","last_undegraded":"2024-09-13T23:25:52.380490+0000","last_fullsized":"2024-09-13T23:25:52.380490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:11.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.388053+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:25:52.388053+0000","last_peered":"2024-09-13T23:25:52.388053+0000","last_clean":"2024-09-13T23:25:52.388053+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:25:52.388053+0000","last_undegraded":"2024-09-13T23:25:52.388053+0000","last_fullsized":"2024-09-13T23:25:52.388053+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:23:53.886096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'92","reported_seq":176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.585106+0000","last_change":"2024-09-13T23:25:19.291785+0000","last_active":"2024-09-13T23:28:29.585106+0000","last_peered":"2024-09-13T23:28:29.585106+0000","last_clean":"2024-09-13T23:28:29.585106+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:29.585106+0000","last_undegraded":"2024-09-13T23:28:29.585106+0000","last_fullsized":"2024-09-13T23:28:29.585106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:19.764533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374724+0000","last_change":"2024-09-13T23:25:21.301723+0000","last_active":"2024-09-13T23:25:52.374724+0000","last_peered":"2024-09-13T23:25:52.374724+0000","last_clean":"2024-09-13T23:25:52.374724+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:25:52.374724+0000","last_undegraded":"2024-09-13T23:25:52.374724+0000","last_fullsized":"2024-09-13T23:25:52.374724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:00.977979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373401+0000","last_change":"2024-09-13T23:25:23.305632+0000","last_active":"2024-09-13T23:25:52.373401+0000","last_peered":"2024-09-13T23:25:52.373401+0000","last_clean":"2024-09-13T23:25:52.373401+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:25:52.373401+0000","last_undegraded":"2024-09-13T23:25:52.373401+0000","last_fullsized":"2024-09-13T23:25:52.373401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:40.047663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375073+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:25:52.375073+0000","last_peered":"2024-09-13T23:25:52.375073+0000","last_clean":"2024-09-13T23:25:52.375073+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:25:52.375073+0000","last_undegraded":"2024-09-13T23:25:52.375073+0000","last_fullsized":"2024-09-13T23:25:52.375073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:36.465581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.479975+0000","last_change":"2024-09-13T23:25:15.289596+0000","last_active":"2024-09-13T23:28:22.479975+0000","last_peered":"2024-09-13T23:28:22.479975+0000","last_clean":"2024-09-13T23:28:22.479975+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:28:22.479975+0000","last_undegraded":"2024-09-13T23:28:22.479975+0000","last_fullsized":"2024-09-13T23:28:22.479975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:32.021512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375986+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:52.375986+0000","last_peered":"2024-09-13T23:25:52.375986+0000","last_clean":"2024-09-13T23:25:52.375986+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:25:52.375986+0000","last_undegraded":"2024-09-13T23:25:52.375986+0000","last_fullsized":"2024-09-13T23:25:52.375986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:40.257378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331040+0000","last_change":"2024-09-13T23:25:17.286995+0000","last_active":"2024-09-13T23:27:38.331040+0000","last_peered":"2024-09-13T23:27:38.331040+0000","last_clean":"2024-09-13T23:27:38.331040+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:27:38.331040+0000","last_undegraded":"2024-09-13T23:27:38.331040+0000","last_fullsized":"2024-09-13T23:27:38.331040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'35","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.516060+0000","last_change":"2024-09-13T23:25:19.299340+0000","last_active":"2024-09-13T23:28:29.516060+0000","last_peered":"2024-09-13T23:28:29.516060+0000","last_clean":"2024-09-13T23:28:29.516060+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:28:29.516060+0000","last_undegraded":"2024-09-13T23:28:29.516060+0000","last_fullsized":"2024-09-13T23:28:29.516060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:19.887611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374367+0000","last_change":"2024-09-13T23:25:21.306435+0000","last_active":"2024-09-13T23:25:52.374367+0000","last_peered":"2024-09-13T23:25:52.374367+0000","last_clean":"2024-09-13T23:25:52.374367+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:25:52.374367+0000","last_undegraded":"2024-09-13T23:25:52.374367+0000","last_fullsized":"2024-09-13T23:25:52.374367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:57:17.772839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:19.870950+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:19.870950+0000","last_peered":"2024-09-13T23:27:19.870950+0000","last_clean":"2024-09-13T23:27:19.870950+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:19.870950+0000","last_undegraded":"2024-09-13T23:27:19.870950+0000","last_fullsized":"2024-09-13T23:27:19.870950+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:47.394971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842978+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.842978+0000","last_peered":"2024-09-13T23:28:22.842978+0000","last_clean":"2024-09-13T23:28:22.842978+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.842978+0000","last_undegraded":"2024-09-13T23:28:22.842978+0000","last_fullsized":"2024-09-13T23:28:22.842978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.848834+0000","last_change":"2024-09-13T23:25:13.287807+0000","last_active":"2024-09-13T23:27:21.848834+0000","last_peered":"2024-09-13T23:27:21.848834+0000","last_clean":"2024-09-13T23:27:21.848834+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:27:21.848834+0000","last_undegraded":"2024-09-13T23:27:21.848834+0000","last_fullsized":"2024-09-13T23:27:21.848834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379956+0000","last_change":"2024-09-13T23:25:17.287358+0000","last_active":"2024-09-13T23:25:52.379956+0000","last_peered":"2024-09-13T23:25:52.379956+0000","last_clean":"2024-09-13T23:25:52.379956+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:25:52.379956+0000","last_undegraded":"2024-09-13T23:25:52.379956+0000","last_fullsized":"2024-09-13T23:25:52.379956+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:30:52.433067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:21.900136+0000","last_change":"2024-09-13T23:25:19.290459+0000","last_active":"2024-09-13T23:28:21.900136+0000","last_peered":"2024-09-13T23:28:21.900136+0000","last_clean":"2024-09-13T23:28:21.900136+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:21.900136+0000","last_undegraded":"2024-09-13T23:28:21.900136+0000","last_fullsized":"2024-09-13T23:28:21.900136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:21:49.482704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372343+0000","last_change":"2024-09-13T23:25:21.308722+0000","last_active":"2024-09-13T23:25:52.372343+0000","last_peered":"2024-09-13T23:25:52.372343+0000","last_clean":"2024-09-13T23:25:52.372343+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:25:52.372343+0000","last_undegraded":"2024-09-13T23:25:52.372343+0000","last_fullsized":"2024-09-13T23:25:52.372343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:25.511006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.812141+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:25:54.812141+0000","last_peered":"2024-09-13T23:25:54.812141+0000","last_clean":"2024-09-13T23:25:54.812141+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:25:54.812141+0000","last_undegraded":"2024-09-13T23:25:54.812141+0000","last_fullsized":"2024-09-13T23:25:54.812141+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:51.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.478456+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.478456+0000","last_peered":"2024-09-13T23:28:22.478456+0000","last_clean":"2024-09-13T23:28:22.478456+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.478456+0000","last_undegraded":"2024-09-13T23:28:22.478456+0000","last_fullsized":"2024-09-13T23:28:22.478456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:15.090003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.815605+0000","last_change":"2024-09-13T23:25:13.286024+0000","last_active":"2024-09-13T23:27:21.815605+0000","last_peered":"2024-09-13T23:27:21.815605+0000","last_clean":"2024-09-13T23:27:21.815605+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:27:21.815605+0000","last_undegraded":"2024-09-13T23:27:21.815605+0000","last_fullsized":"2024-09-13T23:27:21.815605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:45:17.659117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.371452+0000","last_change":"2024-09-13T23:25:17.286907+0000","last_active":"2024-09-13T23:25:52.371452+0000","last_peered":"2024-09-13T23:25:52.371452+0000","last_clean":"2024-09-13T23:25:52.371452+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:25:52.371452+0000","last_undegraded":"2024-09-13T23:25:52.371452+0000","last_fullsized":"2024-09-13T23:25:52.371452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:40.004624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'44","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.588098+0000","last_change":"2024-09-13T23:25:19.293305+0000","last_active":"2024-09-13T23:28:29.588098+0000","last_peered":"2024-09-13T23:28:29.588098+0000","last_clean":"2024-09-13T23:28:29.588098+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:29.588098+0000","last_undegraded":"2024-09-13T23:28:29.588098+0000","last_fullsized":"2024-09-13T23:28:29.588098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:08:19.534065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331831+0000","last_change":"2024-09-13T23:25:21.299732+0000","last_active":"2024-09-13T23:27:43.331831+0000","last_peered":"2024-09-13T23:27:43.331831+0000","last_clean":"2024-09-13T23:27:43.331831+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:27:43.331831+0000","last_undegraded":"2024-09-13T23:27:43.331831+0000","last_fullsized":"2024-09-13T23:27:43.331831+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374884+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:25:52.374884+0000","last_peered":"2024-09-13T23:25:52.374884+0000","last_clean":"2024-09-13T23:25:52.374884+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:25:52.374884+0000","last_undegraded":"2024-09-13T23:25:52.374884+0000","last_fullsized":"2024-09-13T23:25:52.374884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:40:43.808950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.625968+0000","last_change":"2024-09-13T23:25:15.291739+0000","last_active":"2024-09-13T23:28:22.625968+0000","last_peered":"2024-09-13T23:28:22.625968+0000","last_clean":"2024-09-13T23:28:22.625968+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:22.625968+0000","last_undegraded":"2024-09-13T23:28:22.625968+0000","last_fullsized":"2024-09-13T23:28:22.625968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:57.989606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331179+0000","last_change":"2024-09-13T23:25:13.288670+0000","last_active":"2024-09-13T23:27:38.331179+0000","last_peered":"2024-09-13T23:27:38.331179+0000","last_clean":"2024-09-13T23:27:38.331179+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:27:38.331179+0000","last_undegraded":"2024-09-13T23:27:38.331179+0000","last_fullsized":"2024-09-13T23:27:38.331179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.379765+0000","last_change":"2024-09-13T23:25:17.289029+0000","last_active":"2024-09-13T23:25:52.379765+0000","last_peered":"2024-09-13T23:25:52.379765+0000","last_clean":"2024-09-13T23:25:52.379765+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:25:52.379765+0000","last_undegraded":"2024-09-13T23:25:52.379765+0000","last_fullsized":"2024-09-13T23:25:52.379765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:46.980532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.579396+0000","last_change":"2024-09-13T23:25:19.288912+0000","last_active":"2024-09-13T23:28:29.579396+0000","last_peered":"2024-09-13T23:28:29.579396+0000","last_clean":"2024-09-13T23:28:29.579396+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:29.579396+0000","last_undegraded":"2024-09-13T23:28:29.579396+0000","last_fullsized":"2024-09-13T23:28:29.579396+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:42.902191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373575+0000","last_change":"2024-09-13T23:25:21.298721+0000","last_active":"2024-09-13T23:25:52.373575+0000","last_peered":"2024-09-13T23:25:52.373575+0000","last_clean":"2024-09-13T23:25:52.373575+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:25:52.373575+0000","last_undegraded":"2024-09-13T23:25:52.373575+0000","last_fullsized":"2024-09-13T23:25:52.373575+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:35.119012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739696+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.739696+0000","last_peered":"2024-09-13T23:28:22.739696+0000","last_clean":"2024-09-13T23:28:22.739696+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.739696+0000","last_undegraded":"2024-09-13T23:28:22.739696+0000","last_fullsized":"2024-09-13T23:28:22.739696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:13.221204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373681+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:25:52.373681+0000","last_peered":"2024-09-13T23:25:52.373681+0000","last_clean":"2024-09-13T23:25:52.373681+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:25:52.373681+0000","last_undegraded":"2024-09-13T23:25:52.373681+0000","last_fullsized":"2024-09-13T23:25:52.373681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:04.176141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376297+0000","last_change":"2024-09-13T23:25:17.285736+0000","last_active":"2024-09-13T23:25:52.376297+0000","last_peered":"2024-09-13T23:25:52.376297+0000","last_clean":"2024-09-13T23:25:52.376297+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:25:52.376297+0000","last_undegraded":"2024-09-13T23:25:52.376297+0000","last_fullsized":"2024-09-13T23:25:52.376297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:17.757782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'62","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.576490+0000","last_change":"2024-09-13T23:25:19.290018+0000","last_active":"2024-09-13T23:28:29.576490+0000","last_peered":"2024-09-13T23:28:29.576490+0000","last_clean":"2024-09-13T23:28:29.576490+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:29.576490+0000","last_undegraded":"2024-09-13T23:28:29.576490+0000","last_fullsized":"2024-09-13T23:28:29.576490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:46.123858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374548+0000","last_change":"2024-09-13T23:25:21.300887+0000","last_active":"2024-09-13T23:25:52.374548+0000","last_peered":"2024-09-13T23:25:52.374548+0000","last_clean":"2024-09-13T23:25:52.374548+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:25:52.374548+0000","last_undegraded":"2024-09-13T23:25:52.374548+0000","last_fullsized":"2024-09-13T23:25:52.374548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:45.277378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.869223+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:21.869223+0000","last_peered":"2024-09-13T23:27:21.869223+0000","last_clean":"2024-09-13T23:27:21.869223+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:21.869223+0000","last_undegraded":"2024-09-13T23:27:21.869223+0000","last_fullsized":"2024-09-13T23:27:21.869223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:52.742462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.864009+0000","last_change":"2024-09-13T23:25:15.281867+0000","last_active":"2024-09-13T23:27:21.864009+0000","last_peered":"2024-09-13T23:27:21.864009+0000","last_clean":"2024-09-13T23:27:21.864009+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:27:21.864009+0000","last_undegraded":"2024-09-13T23:27:21.864009+0000","last_fullsized":"2024-09-13T23:27:21.864009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:16.243511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.570938+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:28:29.570938+0000","last_peered":"2024-09-13T23:28:29.570938+0000","last_clean":"2024-09-13T23:28:29.570938+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:28:29.570938+0000","last_undegraded":"2024-09-13T23:28:29.570938+0000","last_fullsized":"2024-09-13T23:28:29.570938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375392+0000","last_change":"2024-09-13T23:25:17.282822+0000","last_active":"2024-09-13T23:25:52.375392+0000","last_peered":"2024-09-13T23:25:52.375392+0000","last_clean":"2024-09-13T23:25:52.375392+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:25:52.375392+0000","last_undegraded":"2024-09-13T23:25:52.375392+0000","last_fullsized":"2024-09-13T23:25:52.375392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:34.290866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'39","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.582359+0000","last_change":"2024-09-13T23:25:19.290348+0000","last_active":"2024-09-13T23:28:29.582359+0000","last_peered":"2024-09-13T23:28:29.582359+0000","last_clean":"2024-09-13T23:28:29.582359+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:29.582359+0000","last_undegraded":"2024-09-13T23:28:29.582359+0000","last_fullsized":"2024-09-13T23:28:29.582359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:41.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.333351+0000","last_change":"2024-09-13T23:25:21.305428+0000","last_active":"2024-09-13T23:27:53.333351+0000","last_peered":"2024-09-13T23:27:53.333351+0000","last_clean":"2024-09-13T23:27:53.333351+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:27:53.333351+0000","last_undegraded":"2024-09-13T23:27:53.333351+0000","last_fullsized":"2024-09-13T23:27:53.333351+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373824+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:25:52.373824+0000","last_peered":"2024-09-13T23:25:52.373824+0000","last_clean":"2024-09-13T23:25:52.373824+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:25:52.373824+0000","last_undegraded":"2024-09-13T23:25:52.373824+0000","last_fullsized":"2024-09-13T23:25:52.373824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:27:45.821221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.717093+0000","last_change":"2024-09-13T23:25:15.290421+0000","last_active":"2024-09-13T23:26:37.717093+0000","last_peered":"2024-09-13T23:26:37.717093+0000","last_clean":"2024-09-13T23:26:37.717093+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:26:37.717093+0000","last_undegraded":"2024-09-13T23:26:37.717093+0000","last_fullsized":"2024-09-13T23:26:37.717093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:22.137388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331848+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:27:43.331848+0000","last_peered":"2024-09-13T23:27:43.331848+0000","last_clean":"2024-09-13T23:27:43.331848+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:27:43.331848+0000","last_undegraded":"2024-09-13T23:27:43.331848+0000","last_fullsized":"2024-09-13T23:27:43.331848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'4","reported_seq":228,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.414725+0000","last_change":"2024-09-13T23:25:17.282523+0000","last_active":"2024-09-13T23:28:29.414725+0000","last_peered":"2024-09-13T23:28:29.414725+0000","last_clean":"2024-09-13T23:28:29.414725+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:29.414725+0000","last_undegraded":"2024-09-13T23:28:29.414725+0000","last_fullsized":"2024-09-13T23:28:29.414725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:09.619639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'35","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.527459+0000","last_change":"2024-09-13T23:25:19.295026+0000","last_active":"2024-09-13T23:28:29.527459+0000","last_peered":"2024-09-13T23:28:29.527459+0000","last_clean":"2024-09-13T23:28:29.527459+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:29.527459+0000","last_undegraded":"2024-09-13T23:28:29.527459+0000","last_fullsized":"2024-09-13T23:28:29.527459+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:09.522905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375400+0000","last_change":"2024-09-13T23:25:21.301455+0000","last_active":"2024-09-13T23:25:52.375400+0000","last_peered":"2024-09-13T23:25:52.375400+0000","last_clean":"2024-09-13T23:25:52.375400+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:25:52.375400+0000","last_undegraded":"2024-09-13T23:25:52.375400+0000","last_fullsized":"2024-09-13T23:25:52.375400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:40.147072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.394588+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.394588+0000","last_peered":"2024-09-13T23:28:22.394588+0000","last_clean":"2024-09-13T23:28:22.394588+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.394588+0000","last_undegraded":"2024-09-13T23:28:22.394588+0000","last_fullsized":"2024-09-13T23:28:22.394588+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:57.414979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.376519+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.376519+0000","last_peered":"2024-09-13T23:28:22.376519+0000","last_clean":"2024-09-13T23:28:22.376519+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.376519+0000","last_undegraded":"2024-09-13T23:28:22.376519+0000","last_fullsized":"2024-09-13T23:28:22.376519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:00.283161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613616+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.613616+0000","last_peered":"2024-09-13T23:28:22.613616+0000","last_clean":"2024-09-13T23:28:22.613616+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.613616+0000","last_undegraded":"2024-09-13T23:28:22.613616+0000","last_fullsized":"2024-09-13T23:28:22.613616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:20.499420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332680+0000","last_change":"2024-09-13T23:25:17.285551+0000","last_active":"2024-09-13T23:27:48.332680+0000","last_peered":"2024-09-13T23:27:48.332680+0000","last_clean":"2024-09-13T23:27:48.332680+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:27:48.332680+0000","last_undegraded":"2024-09-13T23:27:48.332680+0000","last_fullsized":"2024-09-13T23:27:48.332680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'11","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:54.818061+0000","last_change":"2024-09-13T23:25:19.294499+0000","last_active":"2024-09-13T23:25:54.818061+0000","last_peered":"2024-09-13T23:25:54.818061+0000","last_clean":"2024-09-13T23:25:54.818061+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:25:54.818061+0000","last_undegraded":"2024-09-13T23:25:54.818061+0000","last_fullsized":"2024-09-13T23:25:54.818061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:06.976502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":369,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.439086+0000","last_change":"2024-09-13T23:25:21.304914+0000","last_active":"2024-09-13T23:28:29.439086+0000","last_peered":"2024-09-13T23:28:29.439086+0000","last_clean":"2024-09-13T23:28:29.439086+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:29.439086+0000","last_undegraded":"2024-09-13T23:28:29.439086+0000","last_fullsized":"2024-09-13T23:28:29.439086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:29:11.529972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373312+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:25:52.373312+0000","last_peered":"2024-09-13T23:25:52.373312+0000","last_clean":"2024-09-13T23:25:52.373312+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:25:52.373312+0000","last_undegraded":"2024-09-13T23:25:52.373312+0000","last_fullsized":"2024-09-13T23:25:52.373312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:54.970107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626042+0000","last_change":"2024-09-13T23:25:15.286332+0000","last_active":"2024-09-13T23:28:22.626042+0000","last_peered":"2024-09-13T23:28:22.626042+0000","last_clean":"2024-09-13T23:28:22.626042+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:22.626042+0000","last_undegraded":"2024-09-13T23:28:22.626042+0000","last_fullsized":"2024-09-13T23:28:22.626042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:34:15.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331912+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:27:43.331912+0000","last_peered":"2024-09-13T23:27:43.331912+0000","last_clean":"2024-09-13T23:27:43.331912+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:27:43.331912+0000","last_undegraded":"2024-09-13T23:27:43.331912+0000","last_fullsized":"2024-09-13T23:27:43.331912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332615+0000","last_change":"2024-09-13T23:25:17.286289+0000","last_active":"2024-09-13T23:27:48.332615+0000","last_peered":"2024-09-13T23:27:48.332615+0000","last_clean":"2024-09-13T23:27:48.332615+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:27:48.332615+0000","last_undegraded":"2024-09-13T23:27:48.332615+0000","last_fullsized":"2024-09-13T23:27:48.332615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'39","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.548561+0000","last_change":"2024-09-13T23:25:19.296410+0000","last_active":"2024-09-13T23:28:29.548561+0000","last_peered":"2024-09-13T23:28:29.548561+0000","last_clean":"2024-09-13T23:28:29.548561+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:29.548561+0000","last_undegraded":"2024-09-13T23:28:29.548561+0000","last_fullsized":"2024-09-13T23:28:29.548561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373670+0000","last_change":"2024-09-13T23:25:21.307423+0000","last_active":"2024-09-13T23:25:52.373670+0000","last_peered":"2024-09-13T23:25:52.373670+0000","last_clean":"2024-09-13T23:25:52.373670+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:25:52.373670+0000","last_undegraded":"2024-09-13T23:25:52.373670+0000","last_fullsized":"2024-09-13T23:25:52.373670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:32.969751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332724+0000","last_change":"2024-09-13T23:25:23.309558+0000","last_active":"2024-09-13T23:27:48.332724+0000","last_peered":"2024-09-13T23:27:48.332724+0000","last_clean":"2024-09-13T23:27:48.332724+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:27:48.332724+0000","last_undegraded":"2024-09-13T23:27:48.332724+0000","last_fullsized":"2024-09-13T23:27:48.332724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.372351+0000","last_change":"2024-09-13T23:25:15.279688+0000","last_active":"2024-09-13T23:25:52.372351+0000","last_peered":"2024-09-13T23:25:52.372351+0000","last_clean":"2024-09-13T23:25:52.372351+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:25:52.372351+0000","last_undegraded":"2024-09-13T23:25:52.372351+0000","last_fullsized":"2024-09-13T23:25:52.372351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:12.573853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.382669+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:25:52.382669+0000","last_peered":"2024-09-13T23:25:52.382669+0000","last_clean":"2024-09-13T23:25:52.382669+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:25:52.382669+0000","last_undegraded":"2024-09-13T23:25:52.382669+0000","last_fullsized":"2024-09-13T23:25:52.382669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:10.620559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373525+0000","last_change":"2024-09-13T23:25:17.285313+0000","last_active":"2024-09-13T23:25:52.373525+0000","last_peered":"2024-09-13T23:25:52.373525+0000","last_clean":"2024-09-13T23:25:52.373525+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:25:52.373525+0000","last_undegraded":"2024-09-13T23:25:52.373525+0000","last_fullsized":"2024-09-13T23:25:52.373525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:03.256424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'33","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.550885+0000","last_change":"2024-09-13T23:25:19.298312+0000","last_active":"2024-09-13T23:28:29.550885+0000","last_peered":"2024-09-13T23:28:29.550885+0000","last_clean":"2024-09-13T23:28:29.550885+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:29.550885+0000","last_undegraded":"2024-09-13T23:28:29.550885+0000","last_fullsized":"2024-09-13T23:28:29.550885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:23.503939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374897+0000","last_change":"2024-09-13T23:25:21.306963+0000","last_active":"2024-09-13T23:25:52.374897+0000","last_peered":"2024-09-13T23:25:52.374897+0000","last_clean":"2024-09-13T23:25:52.374897+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:25:52.374897+0000","last_undegraded":"2024-09-13T23:25:52.374897+0000","last_fullsized":"2024-09-13T23:25:52.374897+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:16.701389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.896491+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:26:37.896491+0000","last_peered":"2024-09-13T23:26:37.896491+0000","last_clean":"2024-09-13T23:26:37.896491+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:26:37.896491+0000","last_undegraded":"2024-09-13T23:26:37.896491+0000","last_fullsized":"2024-09-13T23:26:37.896491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:16.998081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697384+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.697384+0000","last_peered":"2024-09-13T23:28:22.697384+0000","last_clean":"2024-09-13T23:28:22.697384+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.697384+0000","last_undegraded":"2024-09-13T23:28:22.697384+0000","last_fullsized":"2024-09-13T23:28:22.697384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:03.357373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616400+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.616400+0000","last_peered":"2024-09-13T23:28:22.616400+0000","last_clean":"2024-09-13T23:28:22.616400+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.616400+0000","last_undegraded":"2024-09-13T23:28:22.616400+0000","last_fullsized":"2024-09-13T23:28:22.616400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:10.971868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331775+0000","last_change":"2024-09-13T23:25:17.289277+0000","last_active":"2024-09-13T23:27:43.331775+0000","last_peered":"2024-09-13T23:27:43.331775+0000","last_clean":"2024-09-13T23:27:43.331775+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:27:43.331775+0000","last_undegraded":"2024-09-13T23:27:43.331775+0000","last_fullsized":"2024-09-13T23:27:43.331775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'29","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.521457+0000","last_change":"2024-09-13T23:25:19.294964+0000","last_active":"2024-09-13T23:28:29.521457+0000","last_peered":"2024-09-13T23:28:29.521457+0000","last_clean":"2024-09-13T23:28:29.521457+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:29.521457+0000","last_undegraded":"2024-09-13T23:28:29.521457+0000","last_fullsized":"2024-09-13T23:28:29.521457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:44:15.941658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374493+0000","last_change":"2024-09-13T23:25:21.305087+0000","last_active":"2024-09-13T23:25:52.374493+0000","last_peered":"2024-09-13T23:25:52.374493+0000","last_clean":"2024-09-13T23:25:52.374493+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:25:52.374493+0000","last_undegraded":"2024-09-13T23:25:52.374493+0000","last_fullsized":"2024-09-13T23:25:52.374493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:44.058731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:20.187340+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:20.187340+0000","last_peered":"2024-09-13T23:27:20.187340+0000","last_clean":"2024-09-13T23:27:20.187340+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:20.187340+0000","last_undegraded":"2024-09-13T23:27:20.187340+0000","last_fullsized":"2024-09-13T23:27:20.187340+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:43.115277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632608+0000","last_change":"2024-09-13T23:25:15.286878+0000","last_active":"2024-09-13T23:28:22.632608+0000","last_peered":"2024-09-13T23:28:22.632608+0000","last_clean":"2024-09-13T23:28:22.632608+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:22.632608+0000","last_undegraded":"2024-09-13T23:28:22.632608+0000","last_fullsized":"2024-09-13T23:28:22.632608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:32:37.878923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327757+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:27:18.327757+0000","last_peered":"2024-09-13T23:27:18.327757+0000","last_clean":"2024-09-13T23:27:18.327757+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:27:18.327757+0000","last_undegraded":"2024-09-13T23:27:18.327757+0000","last_fullsized":"2024-09-13T23:27:18.327757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'2","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331801+0000","last_change":"2024-09-13T23:25:17.290217+0000","last_active":"2024-09-13T23:27:43.331801+0000","last_peered":"2024-09-13T23:27:43.331801+0000","last_clean":"2024-09-13T23:27:43.331801+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:27:43.331801+0000","last_undegraded":"2024-09-13T23:27:43.331801+0000","last_fullsized":"2024-09-13T23:27:43.331801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.530260+0000","last_change":"2024-09-13T23:25:19.294973+0000","last_active":"2024-09-13T23:28:29.530260+0000","last_peered":"2024-09-13T23:28:29.530260+0000","last_clean":"2024-09-13T23:28:29.530260+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:29.530260+0000","last_undegraded":"2024-09-13T23:28:29.530260+0000","last_fullsized":"2024-09-13T23:28:29.530260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:49.482309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374666+0000","last_change":"2024-09-13T23:25:21.307475+0000","last_active":"2024-09-13T23:25:52.374666+0000","last_peered":"2024-09-13T23:25:52.374666+0000","last_clean":"2024-09-13T23:25:52.374666+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:25:52.374666+0000","last_undegraded":"2024-09-13T23:25:52.374666+0000","last_fullsized":"2024-09-13T23:25:52.374666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:24.949428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.699992+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.699992+0000","last_peered":"2024-09-13T23:28:22.699992+0000","last_clean":"2024-09-13T23:28:22.699992+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.699992+0000","last_undegraded":"2024-09-13T23:28:22.699992+0000","last_fullsized":"2024-09-13T23:28:22.699992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:57.777775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.635702+0000","last_change":"2024-09-13T23:25:15.296960+0000","last_active":"2024-09-13T23:28:22.635702+0000","last_peered":"2024-09-13T23:28:22.635702+0000","last_clean":"2024-09-13T23:28:22.635702+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:22.635702+0000","last_undegraded":"2024-09-13T23:28:22.635702+0000","last_fullsized":"2024-09-13T23:28:22.635702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.610521+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.610521+0000","last_peered":"2024-09-13T23:28:22.610521+0000","last_clean":"2024-09-13T23:28:22.610521+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.610521+0000","last_undegraded":"2024-09-13T23:28:22.610521+0000","last_fullsized":"2024-09-13T23:28:22.610521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:34.025986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733334+0000","last_change":"2024-09-13T23:25:15.285164+0000","last_active":"2024-09-13T23:28:22.733334+0000","last_peered":"2024-09-13T23:28:22.733334+0000","last_clean":"2024-09-13T23:28:22.733334+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:28:22.733334+0000","last_undegraded":"2024-09-13T23:28:22.733334+0000","last_fullsized":"2024-09-13T23:28:22.733334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:25:04.323404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374101+0000","last_change":"2024-09-13T23:25:13.281843+0000","last_active":"2024-09-13T23:25:52.374101+0000","last_peered":"2024-09-13T23:25:52.374101+0000","last_clean":"2024-09-13T23:25:52.374101+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:25:52.374101+0000","last_undegraded":"2024-09-13T23:25:52.374101+0000","last_fullsized":"2024-09-13T23:25:52.374101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:28:46.088696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.626100+0000","last_change":"2024-09-13T23:25:15.280336+0000","last_active":"2024-09-13T23:28:22.626100+0000","last_peered":"2024-09-13T23:28:22.626100+0000","last_clean":"2024-09-13T23:28:22.626100+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:28:22.626100+0000","last_undegraded":"2024-09-13T23:28:22.626100+0000","last_fullsized":"2024-09-13T23:28:22.626100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:33.711819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374801+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:25:52.374801+0000","last_peered":"2024-09-13T23:25:52.374801+0000","last_clean":"2024-09-13T23:25:52.374801+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:25:52.374801+0000","last_undegraded":"2024-09-13T23:25:52.374801+0000","last_fullsized":"2024-09-13T23:25:52.374801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:01.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733197+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.733197+0000","last_peered":"2024-09-13T23:28:22.733197+0000","last_clean":"2024-09-13T23:28:22.733197+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.733197+0000","last_undegraded":"2024-09-13T23:28:22.733197+0000","last_fullsized":"2024-09-13T23:28:22.733197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:57.634800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375346+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:25:52.375346+0000","last_peered":"2024-09-13T23:25:52.375346+0000","last_clean":"2024-09-13T23:25:52.375346+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:25:52.375346+0000","last_undegraded":"2024-09-13T23:25:52.375346+0000","last_fullsized":"2024-09-13T23:25:52.375346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:47.230261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.400507+0000","last_change":"2024-09-13T23:25:15.278977+0000","last_active":"2024-09-13T23:27:18.400507+0000","last_peered":"2024-09-13T23:27:18.400507+0000","last_clean":"2024-09-13T23:27:18.400507+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:27:18.400507+0000","last_undegraded":"2024-09-13T23:27:18.400507+0000","last_fullsized":"2024-09-13T23:27:18.400507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:30.496566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.375434+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:25:52.375434+0000","last_peered":"2024-09-13T23:25:52.375434+0000","last_clean":"2024-09-13T23:25:52.375434+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:25:52.375434+0000","last_undegraded":"2024-09-13T23:25:52.375434+0000","last_fullsized":"2024-09-13T23:25:52.375434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:58.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328367+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:23.328367+0000","last_peered":"2024-09-13T23:27:23.328367+0000","last_clean":"2024-09-13T23:27:23.328367+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:23.328367+0000","last_undegraded":"2024-09-13T23:27:23.328367+0000","last_fullsized":"2024-09-13T23:27:23.328367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328486+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:27:23.328486+0000","last_peered":"2024-09-13T23:27:23.328486+0000","last_clean":"2024-09-13T23:27:23.328486+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:27:23.328486+0000","last_undegraded":"2024-09-13T23:27:23.328486+0000","last_fullsized":"2024-09-13T23:27:23.328486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.697112+0000","last_change":"2024-09-13T23:25:15.286489+0000","last_active":"2024-09-13T23:28:22.697112+0000","last_peered":"2024-09-13T23:28:22.697112+0000","last_clean":"2024-09-13T23:28:22.697112+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:22.697112+0000","last_undegraded":"2024-09-13T23:28:22.697112+0000","last_fullsized":"2024-09-13T23:28:22.697112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.316531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.384574+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:25:52.384574+0000","last_peered":"2024-09-13T23:25:52.384574+0000","last_clean":"2024-09-13T23:25:52.384574+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:25:52.384574+0000","last_undegraded":"2024-09-13T23:25:52.384574+0000","last_fullsized":"2024-09-13T23:25:52.384574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:01:08.828451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704224+0000","last_change":"2024-09-13T23:25:15.287524+0000","last_active":"2024-09-13T23:28:22.704224+0000","last_peered":"2024-09-13T23:28:22.704224+0000","last_clean":"2024-09-13T23:28:22.704224+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:28:22.704224+0000","last_undegraded":"2024-09-13T23:28:22.704224+0000","last_fullsized":"2024-09-13T23:28:22.704224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:55.417154+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:25:55.417154+0000","last_peered":"2024-09-13T23:25:55.417154+0000","last_clean":"2024-09-13T23:25:55.417154+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:25:55.417154+0000","last_undegraded":"2024-09-13T23:25:55.417154+0000","last_fullsized":"2024-09-13T23:25:55.417154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:41.876893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331208+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:27:38.331208+0000","last_peered":"2024-09-13T23:27:38.331208+0000","last_clean":"2024-09-13T23:27:38.331208+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:27:38.331208+0000","last_undegraded":"2024-09-13T23:27:38.331208+0000","last_fullsized":"2024-09-13T23:27:38.331208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.373889+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:25:52.373889+0000","last_peered":"2024-09-13T23:25:52.373889+0000","last_clean":"2024-09-13T23:25:52.373889+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:25:52.373889+0000","last_undegraded":"2024-09-13T23:25:52.373889+0000","last_fullsized":"2024-09-13T23:25:52.373889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:51.894117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733239+0000","last_change":"2024-09-13T23:25:15.285028+0000","last_active":"2024-09-13T23:28:22.733239+0000","last_peered":"2024-09-13T23:28:22.733239+0000","last_clean":"2024-09-13T23:28:22.733239+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:28:22.733239+0000","last_undegraded":"2024-09-13T23:28:22.733239+0000","last_fullsized":"2024-09-13T23:28:22.733239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:16.065036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:26:37.705635+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:26:37.705635+0000","last_peered":"2024-09-13T23:26:37.705635+0000","last_clean":"2024-09-13T23:26:37.705635+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:26:37.705635+0000","last_undegraded":"2024-09-13T23:26:37.705635+0000","last_fullsized":"2024-09-13T23:26:37.705635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:19:16.034170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376137+0000","last_change":"2024-09-13T23:25:15.278986+0000","last_active":"2024-09-13T23:25:52.376137+0000","last_peered":"2024-09-13T23:25:52.376137+0000","last_clean":"2024-09-13T23:25:52.376137+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:25:52.376137+0000","last_undegraded":"2024-09-13T23:25:52.376137+0000","last_fullsized":"2024-09-13T23:25:52.376137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:28:53.862508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.731386+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.731386+0000","last_peered":"2024-09-13T23:28:22.731386+0000","last_clean":"2024-09-13T23:28:22.731386+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.731386+0000","last_undegraded":"2024-09-13T23:28:22.731386+0000","last_fullsized":"2024-09-13T23:28:22.731386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.485387+0000","last_change":"2024-09-13T23:25:15.285560+0000","last_active":"2024-09-13T23:28:22.485387+0000","last_peered":"2024-09-13T23:28:22.485387+0000","last_clean":"2024-09-13T23:28:22.485387+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:28:22.485387+0000","last_undegraded":"2024-09-13T23:28:22.485387+0000","last_fullsized":"2024-09-13T23:28:22.485387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329322+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:27:28.329322+0000","last_peered":"2024-09-13T23:27:28.329322+0000","last_clean":"2024-09-13T23:27:28.329322+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:27:28.329322+0000","last_undegraded":"2024-09-13T23:27:28.329322+0000","last_fullsized":"2024-09-13T23:27:28.329322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330235+0000","last_change":"2024-09-13T23:25:15.295677+0000","last_active":"2024-09-13T23:27:33.330235+0000","last_peered":"2024-09-13T23:27:33.330235+0000","last_clean":"2024-09-13T23:27:33.330235+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:27:33.330235+0000","last_undegraded":"2024-09-13T23:27:33.330235+0000","last_fullsized":"2024-09-13T23:27:33.330235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.309144+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:28:22.309144+0000","last_peered":"2024-09-13T23:28:22.309144+0000","last_clean":"2024-09-13T23:28:22.309144+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:28:22.309144+0000","last_undegraded":"2024-09-13T23:28:22.309144+0000","last_fullsized":"2024-09-13T23:28:22.309144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:36.892250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330199+0000","last_change":"2024-09-13T23:25:15.287972+0000","last_active":"2024-09-13T23:27:33.330199+0000","last_peered":"2024-09-13T23:27:33.330199+0000","last_clean":"2024-09-13T23:27:33.330199+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:27:33.330199+0000","last_undegraded":"2024-09-13T23:27:33.330199+0000","last_fullsized":"2024-09-13T23:27:33.330199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.383517+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:25:52.383517+0000","last_peered":"2024-09-13T23:25:52.383517+0000","last_clean":"2024-09-13T23:25:52.383517+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:25:52.383517+0000","last_undegraded":"2024-09-13T23:25:52.383517+0000","last_fullsized":"2024-09-13T23:25:52.383517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:21.475245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.399802+0000","last_change":"2024-09-13T23:25:15.289747+0000","last_active":"2024-09-13T23:27:18.399802+0000","last_peered":"2024-09-13T23:27:18.399802+0000","last_clean":"2024-09-13T23:27:18.399802+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:27:18.399802+0000","last_undegraded":"2024-09-13T23:27:18.399802+0000","last_fullsized":"2024-09-13T23:27:18.399802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:46.131004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.376676+0000","last_change":"2024-09-13T23:25:13.286270+0000","last_active":"2024-09-13T23:25:52.376676+0000","last_peered":"2024-09-13T23:25:52.376676+0000","last_clean":"2024-09-13T23:25:52.376676+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:25:52.376676+0000","last_undegraded":"2024-09-13T23:25:52.376676+0000","last_fullsized":"2024-09-13T23:25:52.376676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:18.619062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.843114+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.843114+0000","last_peered":"2024-09-13T23:28:22.843114+0000","last_clean":"2024-09-13T23:28:22.843114+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.843114+0000","last_undegraded":"2024-09-13T23:28:22.843114+0000","last_fullsized":"2024-09-13T23:28:22.843114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.380588+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:25:52.380588+0000","last_peered":"2024-09-13T23:25:52.380588+0000","last_clean":"2024-09-13T23:25:52.380588+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:25:52.380588+0000","last_undegraded":"2024-09-13T23:25:52.380588+0000","last_fullsized":"2024-09-13T23:25:52.380588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:43.556989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:25:52.374102+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:25:52.374102+0000","last_peered":"2024-09-13T23:25:52.374102+0000","last_clean":"2024-09-13T23:25:52.374102+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:25:52.374102+0000","last_undegraded":"2024-09-13T23:25:52.374102+0000","last_fullsized":"2024-09-13T23:25:52.374102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:05:18.737876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.733301+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.733301+0000","last_peered":"2024-09-13T23:28:22.733301+0000","last_clean":"2024-09-13T23:28:22.733301+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.733301+0000","last_undegraded":"2024-09-13T23:28:22.733301+0000","last_fullsized":"2024-09-13T23:28:22.733301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:05:13.919874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.275437+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:28:22.275437+0000","last_peered":"2024-09-13T23:28:22.275437+0000","last_clean":"2024-09-13T23:28:22.275437+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:28:22.275437+0000","last_undegraded":"2024-09-13T23:28:22.275437+0000","last_fullsized":"2024-09-13T23:28:22.275437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:52:17.827396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842926+0000","last_change":"2024-09-13T23:25:15.295660+0000","last_active":"2024-09-13T23:28:22.842926+0000","last_peered":"2024-09-13T23:28:22.842926+0000","last_clean":"2024-09-13T23:28:22.842926+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:28:22.842926+0000","last_undegraded":"2024-09-13T23:28:22.842926+0000","last_fullsized":"2024-09-13T23:28:22.842926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673006,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35796,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336044,"statfs":{"total":96636764160,"available":96600109056,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673008,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673007,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.148 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.149 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.150 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.151 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.152 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.153 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.154 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.155 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.156 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.157 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.158 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.159 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:24:59.389467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=24, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.160 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.161 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.162 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.163 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.164 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.165 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.166 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.167 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.168 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.169 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.170 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.171 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.172 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.173 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.174 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.175 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.176 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.177 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.178 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.179 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.180 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.180 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:34.180 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:28:54.181 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:28:54.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f938db66640 1 Processor -- start 2024-09-13T23:28:54.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f938db66640 1 -- start start 2024-09-13T23:28:54.297 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f938db66640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f938806eda0 0x7f938806f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f938db66640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938806eba0 con 0x7f938806f6c0 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f938db66640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f938806d2f0 con 0x7f938806eda0 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f93877fe640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f938806eda0 0x7f938806f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f9386ffd640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f938806f6c0 0x7f9388121a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:42430/0 (socket says 172.21.15.43:42430) 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.294+0000 7f9386ffd640 1 -- 172.21.15.43:0/3374322344 learned_addr learned my addr 172.21.15.43:0/3374322344 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.295+0000 7f93877fe640 1 -- 172.21.15.43:0/3374322344 >> v1:172.21.15.43:6789/0 conn(0x7f938806f6c0 legacy=0x7f9388121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.295+0000 7f93867fc640 1 -- 172.21.15.43:0/3374322344 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715796521 0 0) 0x7f938806eba0 con 0x7f938806f6c0 2024-09-13T23:28:54.298 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.295+0000 7f93877fe640 1 -- 172.21.15.43:0/3374322344 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9388070d50 con 0x7f938806eda0 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.295+0000 7f93877fe640 1 --2- 172.21.15.43:0/3374322344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938806f180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9378009720 tx=0x7f937802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbf70162fb467c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f93867fc640 1 -- 172.21.15.43:0/3374322344 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378037070 con 0x7f938806eda0 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f93867fc640 1 -- 172.21.15.43:0/3374322344 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937802ae20 con 0x7f938806eda0 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f93867fc640 1 -- 172.21.15.43:0/3374322344 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378032590 con 0x7f938806eda0 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 -- 172.21.15.43:0/3374322344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 msgr2=0x7f938806f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:54.301 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 --2- 172.21.15.43:0/3374322344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938806f180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9378009720 tx=0x7f937802a1a0 comp rx=0 tx=0).stop 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 -- 172.21.15.43:0/3374322344 shutdown_connections 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 --2- 172.21.15.43:0/3374322344 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938806f180 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 -- 172.21.15.43:0/3374322344 >> 172.21.15.43:0/3374322344 conn(0x7f938809a890 msgr2=0x7f938809aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 -- 172.21.15.43:0/3374322344 shutdown_connections 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.296+0000 7f938db66640 1 -- 172.21.15.43:0/3374322344 wait complete. 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.297+0000 7f938db66640 1 Processor -- start 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.297+0000 7f938db66640 1 -- start start 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f938db66640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f938db66640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f9388122160 con 0x7f938806eda0 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f93877fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:54.302 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f93877fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:55536/0 (socket says 172.21.15.43:55536) 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f93877fe640 1 -- 172.21.15.43:0/3567407958 learned_addr learned my addr 172.21.15.43:0/3567407958 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f93877fe640 1 -- 172.21.15.43:0/3567407958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938808c750 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f93877fe640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f937802a1e0 tx=0x7f93780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378042070 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937803e590 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9388128ac0 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.298+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9378037040 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.299+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938808d3e0 con 0x7f938806eda0 2024-09-13T23:28:54.303 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.299+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f9378045070 con 0x7f938806eda0 2024-09-13T23:28:54.304 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.299+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938808c2b0 con 0x7f938806eda0 2024-09-13T23:28:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.299+0000 7f936ffff640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 0x7f937403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:28:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.300+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f937806c590 con 0x7f938806eda0 2024-09-13T23:28:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.300+0000 7f9386ffd640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 0x7f937403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:28:54.305 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.300+0000 7f9386ffd640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 0x7f937403a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c007910 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:28:54.306 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.304+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f937802ae20 con 0x7f938806eda0 2024-09-13T23:28:54.478 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.476+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9388122670 con 0x7f93740382a0 2024-09-13T23:28:54.493 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.491+0000 7f936ffff640 1 -- 172.21.15.43:0/3567407958 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658732 (secure 0 0 0) 0x7f9388122670 con 0x7f93740382a0 2024-09-13T23:28:54.503 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:28:54.509 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:28:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 msgr2=0x7f937403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 0x7f937403a760 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f937c000c00 tx=0x7f937c007910 comp rx=0 tx=0).stop 2024-09-13T23:28:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 msgr2=0x7f938808afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:28:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f937802a1e0 tx=0x7f93780046c0 comp rx=0 tx=0).stop 2024-09-13T23:28:54.513 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 shutdown_connections 2024-09-13T23:28:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f93740382a0 0x7f937403a760 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 --2- 172.21.15.43:0/3567407958 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f938806eda0 0x7f938808afc0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:28:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 >> 172.21.15.43:0/3567407958 conn(0x7f938809a890 msgr2=0x7f93880981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:28:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 shutdown_connections 2024-09-13T23:28:54.514 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:28:54.496+0000 7f938db66640 1 -- 172.21.15.43:0/3567407958 wait complete. 2024-09-13T23:28:54.515 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-13T23:28:53.363113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2861,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4739,"ondisk_log_size":4739,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144224,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343136,"statfs":{"total":386547056640,"available":386399371264,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2569,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003430"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.329617+0000","last_change":"2024-09-13T23:25:13.287107+0000","last_active":"2024-09-13T23:28:22.329617+0000","last_peered":"2024-09-13T23:28:22.329617+0000","last_clean":"2024-09-13T23:28:22.329617+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:28:22.329617+0000","last_undegraded":"2024-09-13T23:28:22.329617+0000","last_fullsized":"2024-09-13T23:28:22.329617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704068+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.704068+0000","last_peered":"2024-09-13T23:28:22.704068+0000","last_clean":"2024-09-13T23:28:22.704068+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.704068+0000","last_undegraded":"2024-09-13T23:28:22.704068+0000","last_fullsized":"2024-09-13T23:28:22.704068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.571099+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:28:29.571099+0000","last_peered":"2024-09-13T23:28:29.571099+0000","last_clean":"2024-09-13T23:28:29.571099+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:28:29.571099+0000","last_undegraded":"2024-09-13T23:28:29.571099+0000","last_fullsized":"2024-09-13T23:28:29.571099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332981+0000","last_change":"2024-09-13T23:25:15.283513+0000","last_active":"2024-09-13T23:27:48.332981+0000","last_peered":"2024-09-13T23:27:48.332981+0000","last_clean":"2024-09-13T23:27:48.332981+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:27:48.332981+0000","last_undegraded":"2024-09-13T23:27:48.332981+0000","last_fullsized":"2024-09-13T23:27:48.332981+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328566+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:27:18.328566+0000","last_peered":"2024-09-13T23:27:18.328566+0000","last_clean":"2024-09-13T23:27:18.328566+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:27:18.328566+0000","last_undegraded":"2024-09-13T23:27:18.328566+0000","last_fullsized":"2024-09-13T23:27:18.328566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704428+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.704428+0000","last_peered":"2024-09-13T23:28:22.704428+0000","last_clean":"2024-09-13T23:28:22.704428+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.704428+0000","last_undegraded":"2024-09-13T23:28:22.704428+0000","last_fullsized":"2024-09-13T23:28:22.704428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327229+0000","last_change":"2024-09-13T23:25:13.275095+0000","last_active":"2024-09-13T23:27:13.327229+0000","last_peered":"2024-09-13T23:27:13.327229+0000","last_clean":"2024-09-13T23:27:13.327229+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:27:13.327229+0000","last_undegraded":"2024-09-13T23:27:13.327229+0000","last_fullsized":"2024-09-13T23:27:13.327229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333076+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:27:48.333076+0000","last_peered":"2024-09-13T23:27:48.333076+0000","last_clean":"2024-09-13T23:27:48.333076+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:27:48.333076+0000","last_undegraded":"2024-09-13T23:27:48.333076+0000","last_fullsized":"2024-09-13T23:27:48.333076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332300+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:27:43.332300+0000","last_peered":"2024-09-13T23:27:43.332300+0000","last_clean":"2024-09-13T23:27:43.332300+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:27:43.332300+0000","last_undegraded":"2024-09-13T23:27:43.332300+0000","last_fullsized":"2024-09-13T23:27:43.332300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327695+0000","last_change":"2024-09-13T23:25:15.285777+0000","last_active":"2024-09-13T23:27:18.327695+0000","last_peered":"2024-09-13T23:27:18.327695+0000","last_clean":"2024-09-13T23:27:18.327695+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:27:18.327695+0000","last_undegraded":"2024-09-13T23:27:18.327695+0000","last_fullsized":"2024-09-13T23:27:18.327695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331431+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:27:43.331431+0000","last_peered":"2024-09-13T23:27:43.331431+0000","last_clean":"2024-09-13T23:27:43.331431+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:27:43.331431+0000","last_undegraded":"2024-09-13T23:27:43.331431+0000","last_fullsized":"2024-09-13T23:27:43.331431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704749+0000","last_change":"2024-09-13T23:25:15.290172+0000","last_active":"2024-09-13T23:28:22.704749+0000","last_peered":"2024-09-13T23:28:22.704749+0000","last_clean":"2024-09-13T23:28:22.704749+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:22.704749+0000","last_undegraded":"2024-09-13T23:28:22.704749+0000","last_fullsized":"2024-09-13T23:28:22.704749+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332219+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:27:43.332219+0000","last_peered":"2024-09-13T23:27:43.332219+0000","last_clean":"2024-09-13T23:27:43.332219+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:27:43.332219+0000","last_undegraded":"2024-09-13T23:27:43.332219+0000","last_fullsized":"2024-09-13T23:27:43.332219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.384515+0000","last_change":"2024-09-13T23:25:15.288159+0000","last_active":"2024-09-13T23:28:22.384515+0000","last_peered":"2024-09-13T23:28:22.384515+0000","last_clean":"2024-09-13T23:28:22.384515+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:28:22.384515+0000","last_undegraded":"2024-09-13T23:28:22.384515+0000","last_fullsized":"2024-09-13T23:28:22.384515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:46.330849+0000","last_change":"2024-09-13T23:25:13.285351+0000","last_active":"2024-09-13T23:27:46.330849+0000","last_peered":"2024-09-13T23:27:46.330849+0000","last_clean":"2024-09-13T23:27:46.330849+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:27:46.330849+0000","last_undegraded":"2024-09-13T23:27:46.330849+0000","last_fullsized":"2024-09-13T23:27:46.330849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328495+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:27:23.328495+0000","last_peered":"2024-09-13T23:27:23.328495+0000","last_clean":"2024-09-13T23:27:23.328495+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:27:23.328495+0000","last_undegraded":"2024-09-13T23:27:23.328495+0000","last_fullsized":"2024-09-13T23:27:23.328495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.635595+0000","last_change":"2024-09-13T23:25:15.287032+0000","last_active":"2024-09-13T23:28:22.635595+0000","last_peered":"2024-09-13T23:28:22.635595+0000","last_clean":"2024-09-13T23:28:22.635595+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:28:22.635595+0000","last_undegraded":"2024-09-13T23:28:22.635595+0000","last_fullsized":"2024-09-13T23:28:22.635595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331190+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:27:38.331190+0000","last_peered":"2024-09-13T23:27:38.331190+0000","last_clean":"2024-09-13T23:27:38.331190+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:27:38.331190+0000","last_undegraded":"2024-09-13T23:27:38.331190+0000","last_fullsized":"2024-09-13T23:27:38.331190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330966+0000","last_change":"2024-09-13T23:25:15.287488+0000","last_active":"2024-09-13T23:27:38.330966+0000","last_peered":"2024-09-13T23:27:38.330966+0000","last_clean":"2024-09-13T23:27:38.330966+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:27:38.330966+0000","last_undegraded":"2024-09-13T23:27:38.330966+0000","last_fullsized":"2024-09-13T23:27:38.330966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330851+0000","last_change":"2024-09-13T23:25:13.286390+0000","last_active":"2024-09-13T23:27:38.330851+0000","last_peered":"2024-09-13T23:27:38.330851+0000","last_clean":"2024-09-13T23:27:38.330851+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:27:38.330851+0000","last_undegraded":"2024-09-13T23:27:38.330851+0000","last_fullsized":"2024-09-13T23:27:38.330851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632773+0000","last_change":"2024-09-13T23:25:15.284340+0000","last_active":"2024-09-13T23:28:22.632773+0000","last_peered":"2024-09-13T23:28:22.632773+0000","last_clean":"2024-09-13T23:28:22.632773+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:28:22.632773+0000","last_undegraded":"2024-09-13T23:28:22.632773+0000","last_fullsized":"2024-09-13T23:28:22.632773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331140+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:27:38.331140+0000","last_peered":"2024-09-13T23:27:38.331140+0000","last_clean":"2024-09-13T23:27:38.331140+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:27:38.331140+0000","last_undegraded":"2024-09-13T23:27:38.331140+0000","last_fullsized":"2024-09-13T23:27:38.331140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330204+0000","last_change":"2024-09-13T23:25:15.279035+0000","last_active":"2024-09-13T23:27:41.330204+0000","last_peered":"2024-09-13T23:27:41.330204+0000","last_clean":"2024-09-13T23:27:41.330204+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:27:41.330204+0000","last_undegraded":"2024-09-13T23:27:41.330204+0000","last_fullsized":"2024-09-13T23:27:41.330204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331120+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:27:38.331120+0000","last_peered":"2024-09-13T23:27:38.331120+0000","last_clean":"2024-09-13T23:27:38.331120+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:27:38.331120+0000","last_undegraded":"2024-09-13T23:27:38.331120+0000","last_fullsized":"2024-09-13T23:27:38.331120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331473+0000","last_change":"2024-09-13T23:25:15.280560+0000","last_active":"2024-09-13T23:27:43.331473+0000","last_peered":"2024-09-13T23:27:43.331473+0000","last_clean":"2024-09-13T23:27:43.331473+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:27:43.331473+0000","last_undegraded":"2024-09-13T23:27:43.331473+0000","last_fullsized":"2024-09-13T23:27:43.331473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330189+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:27:41.330189+0000","last_peered":"2024-09-13T23:27:41.330189+0000","last_clean":"2024-09-13T23:27:41.330189+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:27:41.330189+0000","last_undegraded":"2024-09-13T23:27:41.330189+0000","last_fullsized":"2024-09-13T23:27:41.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739361+0000","last_change":"2024-09-13T23:25:15.284594+0000","last_active":"2024-09-13T23:28:22.739361+0000","last_peered":"2024-09-13T23:28:22.739361+0000","last_clean":"2024-09-13T23:28:22.739361+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:28:22.739361+0000","last_undegraded":"2024-09-13T23:28:22.739361+0000","last_fullsized":"2024-09-13T23:28:22.739361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330686+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:27:33.330686+0000","last_peered":"2024-09-13T23:27:33.330686+0000","last_clean":"2024-09-13T23:27:33.330686+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:27:33.330686+0000","last_undegraded":"2024-09-13T23:27:33.330686+0000","last_fullsized":"2024-09-13T23:27:33.330686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.748239+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.748239+0000","last_peered":"2024-09-13T23:28:22.748239+0000","last_clean":"2024-09-13T23:28:22.748239+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.748239+0000","last_undegraded":"2024-09-13T23:28:22.748239+0000","last_fullsized":"2024-09-13T23:28:22.748239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382312+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.382312+0000","last_peered":"2024-09-13T23:28:22.382312+0000","last_clean":"2024-09-13T23:28:22.382312+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.382312+0000","last_undegraded":"2024-09-13T23:28:22.382312+0000","last_fullsized":"2024-09-13T23:28:22.382312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330720+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:27:33.330720+0000","last_peered":"2024-09-13T23:27:33.330720+0000","last_clean":"2024-09-13T23:27:33.330720+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:27:33.330720+0000","last_undegraded":"2024-09-13T23:27:33.330720+0000","last_fullsized":"2024-09-13T23:27:33.330720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.412219+0000","last_change":"2024-09-13T23:28:35.412268+0000","last_active":"2024-09-13T23:28:35.412219+0000","last_peered":"2024-09-13T23:28:35.412219+0000","last_clean":"2024-09-13T23:28:35.412219+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:28:35.412219+0000","last_undegraded":"2024-09-13T23:28:35.412219+0000","last_fullsized":"2024-09-13T23:28:35.412219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.412096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:03.433021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'33","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.502423+0000","last_change":"2024-09-13T23:25:19.296863+0000","last_active":"2024-09-13T23:28:29.502423+0000","last_peered":"2024-09-13T23:28:29.502423+0000","last_clean":"2024-09-13T23:28:29.502423+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:29.502423+0000","last_undegraded":"2024-09-13T23:28:29.502423+0000","last_fullsized":"2024-09-13T23:28:29.502423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.383764+0000","last_change":"2024-09-13T23:28:42.383806+0000","last_active":"2024-09-13T23:28:42.383764+0000","last_peered":"2024-09-13T23:28:42.383764+0000","last_clean":"2024-09-13T23:28:42.383764+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:28:42.383764+0000","last_undegraded":"2024-09-13T23:28:42.383764+0000","last_fullsized":"2024-09-13T23:28:42.383764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.383654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:23.582962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332553+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:27:48.332553+0000","last_peered":"2024-09-13T23:27:48.332553+0000","last_clean":"2024-09-13T23:27:48.332553+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:27:48.332553+0000","last_undegraded":"2024-09-13T23:27:48.332553+0000","last_fullsized":"2024-09-13T23:27:48.332553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842761+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:28:22.842761+0000","last_peered":"2024-09-13T23:28:22.842761+0000","last_clean":"2024-09-13T23:28:22.842761+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:28:22.842761+0000","last_undegraded":"2024-09-13T23:28:22.842761+0000","last_fullsized":"2024-09-13T23:28:22.842761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330065+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:27:33.330065+0000","last_peered":"2024-09-13T23:27:33.330065+0000","last_clean":"2024-09-13T23:27:33.330065+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:27:33.330065+0000","last_undegraded":"2024-09-13T23:27:33.330065+0000","last_fullsized":"2024-09-13T23:27:33.330065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:13.336031+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:28:13.336031+0000","last_peered":"2024-09-13T23:28:13.336031+0000","last_clean":"2024-09-13T23:28:13.336031+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:28:13.336031+0000","last_undegraded":"2024-09-13T23:28:13.336031+0000","last_fullsized":"2024-09-13T23:28:13.336031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.401547+0000","last_change":"2024-09-13T23:28:39.401603+0000","last_active":"2024-09-13T23:28:39.401547+0000","last_peered":"2024-09-13T23:28:39.401547+0000","last_clean":"2024-09-13T23:28:39.401547+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:28:39.401547+0000","last_undegraded":"2024-09-13T23:28:39.401547+0000","last_fullsized":"2024-09-13T23:28:39.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.401441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:23.948110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.453172+0000","last_change":"2024-09-13T23:28:34.453193+0000","last_active":"2024-09-13T23:28:34.453172+0000","last_peered":"2024-09-13T23:28:34.453172+0000","last_clean":"2024-09-13T23:28:34.453172+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:28:34.453172+0000","last_undegraded":"2024-09-13T23:28:34.453172+0000","last_fullsized":"2024-09-13T23:28:34.453172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.453082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:39.061568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.486705+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.486705+0000","last_peered":"2024-09-13T23:28:22.486705+0000","last_clean":"2024-09-13T23:28:22.486705+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.486705+0000","last_undegraded":"2024-09-13T23:28:22.486705+0000","last_fullsized":"2024-09-13T23:28:22.486705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332451+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:43.332451+0000","last_peered":"2024-09-13T23:27:43.332451+0000","last_clean":"2024-09-13T23:27:43.332451+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:43.332451+0000","last_undegraded":"2024-09-13T23:27:43.332451+0000","last_fullsized":"2024-09-13T23:27:43.332451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330627+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:27:33.330627+0000","last_peered":"2024-09-13T23:27:33.330627+0000","last_clean":"2024-09-13T23:27:33.330627+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:27:33.330627+0000","last_undegraded":"2024-09-13T23:27:33.330627+0000","last_fullsized":"2024-09-13T23:27:33.330627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.916935+0000","last_change":"2024-09-13T23:28:50.917010+0000","last_active":"2024-09-13T23:28:50.916935+0000","last_peered":"2024-09-13T23:28:50.916935+0000","last_clean":"2024-09-13T23:28:50.916935+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:28:50.916935+0000","last_undegraded":"2024-09-13T23:28:50.916935+0000","last_fullsized":"2024-09-13T23:28:50.916935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.916803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:55.569318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.835923+0000","last_change":"2024-09-13T23:28:43.835968+0000","last_active":"2024-09-13T23:28:43.835923+0000","last_peered":"2024-09-13T23:28:43.835923+0000","last_clean":"2024-09-13T23:28:43.835923+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:28:43.835923+0000","last_undegraded":"2024-09-13T23:28:43.835923+0000","last_fullsized":"2024-09-13T23:28:43.835923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.835830+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.336311+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":385,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.594763+0000","last_change":"2024-09-13T23:25:21.304299+0000","last_active":"2024-09-13T23:28:29.594763+0000","last_peered":"2024-09-13T23:28:29.594763+0000","last_clean":"2024-09-13T23:28:29.594763+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:29.594763+0000","last_undegraded":"2024-09-13T23:28:29.594763+0000","last_fullsized":"2024-09-13T23:28:29.594763+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.332766+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:27:53.332766+0000","last_peered":"2024-09-13T23:27:53.332766+0000","last_clean":"2024-09-13T23:27:53.332766+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:27:53.332766+0000","last_undegraded":"2024-09-13T23:27:53.332766+0000","last_fullsized":"2024-09-13T23:27:53.332766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739115+0000","last_change":"2024-09-13T23:25:15.285324+0000","last_active":"2024-09-13T23:28:22.739115+0000","last_peered":"2024-09-13T23:28:22.739115+0000","last_clean":"2024-09-13T23:28:22.739115+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:22.739115+0000","last_undegraded":"2024-09-13T23:28:22.739115+0000","last_fullsized":"2024-09-13T23:28:22.739115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330094+0000","last_change":"2024-09-13T23:25:13.288918+0000","last_active":"2024-09-13T23:27:33.330094+0000","last_peered":"2024-09-13T23:27:33.330094+0000","last_clean":"2024-09-13T23:27:33.330094+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:27:33.330094+0000","last_undegraded":"2024-09-13T23:27:33.330094+0000","last_fullsized":"2024-09-13T23:27:33.330094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.432327+0000","last_change":"2024-09-13T23:28:42.432355+0000","last_active":"2024-09-13T23:28:42.432327+0000","last_peered":"2024-09-13T23:28:42.432327+0000","last_clean":"2024-09-13T23:28:42.432327+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:28:42.432327+0000","last_undegraded":"2024-09-13T23:28:42.432327+0000","last_fullsized":"2024-09-13T23:28:42.432327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.432240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.272484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.853868+0000","last_change":"2024-09-13T23:28:42.853928+0000","last_active":"2024-09-13T23:28:42.853868+0000","last_peered":"2024-09-13T23:28:42.853868+0000","last_clean":"2024-09-13T23:28:42.853868+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:42.853868+0000","last_undegraded":"2024-09-13T23:28:42.853868+0000","last_fullsized":"2024-09-13T23:28:42.853868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.853764+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:24.964571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.867464+0000","last_change":"2024-09-13T23:28:37.867494+0000","last_active":"2024-09-13T23:28:37.867464+0000","last_peered":"2024-09-13T23:28:37.867464+0000","last_clean":"2024-09-13T23:28:37.867464+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:37.867464+0000","last_undegraded":"2024-09-13T23:28:37.867464+0000","last_fullsized":"2024-09-13T23:28:37.867464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.867370+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:50.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.383200+0000","last_change":"2024-09-13T23:28:48.383237+0000","last_active":"2024-09-13T23:28:48.383200+0000","last_peered":"2024-09-13T23:28:48.383200+0000","last_clean":"2024-09-13T23:28:48.383200+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:48.383200+0000","last_undegraded":"2024-09-13T23:28:48.383200+0000","last_fullsized":"2024-09-13T23:28:48.383200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.383091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:30.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329308+0000","last_change":"2024-09-13T23:25:13.289874+0000","last_active":"2024-09-13T23:27:28.329308+0000","last_peered":"2024-09-13T23:27:28.329308+0000","last_clean":"2024-09-13T23:27:28.329308+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:27:28.329308+0000","last_undegraded":"2024-09-13T23:27:28.329308+0000","last_fullsized":"2024-09-13T23:27:28.329308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.221445+0000","last_change":"2024-09-13T23:28:48.221472+0000","last_active":"2024-09-13T23:28:48.221445+0000","last_peered":"2024-09-13T23:28:48.221445+0000","last_clean":"2024-09-13T23:28:48.221445+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:28:48.221445+0000","last_undegraded":"2024-09-13T23:28:48.221445+0000","last_fullsized":"2024-09-13T23:28:48.221445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.221353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:59.646033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.789042+0000","last_change":"2024-09-13T23:28:38.789114+0000","last_active":"2024-09-13T23:28:38.789042+0000","last_peered":"2024-09-13T23:28:38.789042+0000","last_clean":"2024-09-13T23:28:38.789042+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:38.789042+0000","last_undegraded":"2024-09-13T23:28:38.789042+0000","last_fullsized":"2024-09-13T23:28:38.789042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.788930+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:52.119474+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.797110+0000","last_change":"2024-09-13T23:28:35.797133+0000","last_active":"2024-09-13T23:28:35.797110+0000","last_peered":"2024-09-13T23:28:35.797110+0000","last_clean":"2024-09-13T23:28:35.797110+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:28:35.797110+0000","last_undegraded":"2024-09-13T23:28:35.797110+0000","last_fullsized":"2024-09-13T23:28:35.797110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.797014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.737015+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.737015+0000","last_peered":"2024-09-13T23:28:22.737015+0000","last_clean":"2024-09-13T23:28:22.737015+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.737015+0000","last_undegraded":"2024-09-13T23:28:22.737015+0000","last_fullsized":"2024-09-13T23:28:22.737015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329215+0000","last_change":"2024-09-13T23:25:15.285081+0000","last_active":"2024-09-13T23:27:28.329215+0000","last_peered":"2024-09-13T23:27:28.329215+0000","last_clean":"2024-09-13T23:27:28.329215+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:27:28.329215+0000","last_undegraded":"2024-09-13T23:27:28.329215+0000","last_fullsized":"2024-09-13T23:27:28.329215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.571953+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:28:29.571953+0000","last_peered":"2024-09-13T23:28:29.571953+0000","last_clean":"2024-09-13T23:28:29.571953+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:28:29.571953+0000","last_undegraded":"2024-09-13T23:28:29.571953+0000","last_fullsized":"2024-09-13T23:28:29.571953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.878000+0000","last_change":"2024-09-13T23:28:47.878026+0000","last_active":"2024-09-13T23:28:47.878000+0000","last_peered":"2024-09-13T23:28:47.878000+0000","last_clean":"2024-09-13T23:28:47.878000+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:28:47.878000+0000","last_undegraded":"2024-09-13T23:28:47.878000+0000","last_fullsized":"2024-09-13T23:28:47.878000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.877888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:24.096380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.395633+0000","last_change":"2024-09-13T23:28:41.395683+0000","last_active":"2024-09-13T23:28:41.395633+0000","last_peered":"2024-09-13T23:28:41.395633+0000","last_clean":"2024-09-13T23:28:41.395633+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:41.395633+0000","last_undegraded":"2024-09-13T23:28:41.395633+0000","last_fullsized":"2024-09-13T23:28:41.395633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.395529+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:16.720847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.869542+0000","last_change":"2024-09-13T23:28:49.869568+0000","last_active":"2024-09-13T23:28:49.869542+0000","last_peered":"2024-09-13T23:28:49.869542+0000","last_clean":"2024-09-13T23:28:49.869542+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:28:49.869542+0000","last_undegraded":"2024-09-13T23:28:49.869542+0000","last_fullsized":"2024-09-13T23:28:49.869542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.869451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.241159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.227024+0000","last_change":"2024-09-13T23:28:50.227072+0000","last_active":"2024-09-13T23:28:50.227024+0000","last_peered":"2024-09-13T23:28:50.227024+0000","last_clean":"2024-09-13T23:28:50.227024+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:28:50.227024+0000","last_undegraded":"2024-09-13T23:28:50.227024+0000","last_fullsized":"2024-09-13T23:28:50.227024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.226940+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.317457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.485259+0000","last_change":"2024-09-13T23:25:15.287305+0000","last_active":"2024-09-13T23:28:22.485259+0000","last_peered":"2024-09-13T23:28:22.485259+0000","last_clean":"2024-09-13T23:28:22.485259+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:28:22.485259+0000","last_undegraded":"2024-09-13T23:28:22.485259+0000","last_fullsized":"2024-09-13T23:28:22.485259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.572149+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:28:29.572149+0000","last_peered":"2024-09-13T23:28:29.572149+0000","last_clean":"2024-09-13T23:28:29.572149+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:28:29.572149+0000","last_undegraded":"2024-09-13T23:28:29.572149+0000","last_fullsized":"2024-09-13T23:28:29.572149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328685+0000","last_change":"2024-09-13T23:25:17.285971+0000","last_active":"2024-09-13T23:27:31.328685+0000","last_peered":"2024-09-13T23:27:31.328685+0000","last_clean":"2024-09-13T23:27:31.328685+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:27:31.328685+0000","last_undegraded":"2024-09-13T23:27:31.328685+0000","last_fullsized":"2024-09-13T23:27:31.328685+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'40","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.519631+0000","last_change":"2024-09-13T23:25:19.299653+0000","last_active":"2024-09-13T23:28:29.519631+0000","last_peered":"2024-09-13T23:28:29.519631+0000","last_clean":"2024-09-13T23:28:29.519631+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:28:29.519631+0000","last_undegraded":"2024-09-13T23:28:29.519631+0000","last_fullsized":"2024-09-13T23:28:29.519631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":352,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.600300+0000","last_change":"2024-09-13T23:25:21.308757+0000","last_active":"2024-09-13T23:28:29.600300+0000","last_peered":"2024-09-13T23:28:29.600300+0000","last_clean":"2024-09-13T23:28:29.600300+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:29.600300+0000","last_undegraded":"2024-09-13T23:28:29.600300+0000","last_fullsized":"2024-09-13T23:28:29.600300+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:36.329396+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:27:36.329396+0000","last_peered":"2024-09-13T23:27:36.329396+0000","last_clean":"2024-09-13T23:27:36.329396+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:27:36.329396+0000","last_undegraded":"2024-09-13T23:27:36.329396+0000","last_fullsized":"2024-09-13T23:27:36.329396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704297+0000","last_change":"2024-09-13T23:25:15.283264+0000","last_active":"2024-09-13T23:28:22.704297+0000","last_peered":"2024-09-13T23:28:22.704297+0000","last_clean":"2024-09-13T23:28:22.704297+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:22.704297+0000","last_undegraded":"2024-09-13T23:28:22.704297+0000","last_fullsized":"2024-09-13T23:28:22.704297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329931+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:28.329931+0000","last_peered":"2024-09-13T23:27:28.329931+0000","last_clean":"2024-09-13T23:27:28.329931+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:28.329931+0000","last_undegraded":"2024-09-13T23:27:28.329931+0000","last_fullsized":"2024-09-13T23:27:28.329931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327787+0000","last_change":"2024-09-13T23:25:17.286788+0000","last_active":"2024-09-13T23:27:26.327787+0000","last_peered":"2024-09-13T23:27:26.327787+0000","last_clean":"2024-09-13T23:27:26.327787+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:27:26.327787+0000","last_undegraded":"2024-09-13T23:27:26.327787+0000","last_fullsized":"2024-09-13T23:27:26.327787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'61","reported_seq":126,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.562588+0000","last_change":"2024-09-13T23:25:19.299651+0000","last_active":"2024-09-13T23:28:29.562588+0000","last_peered":"2024-09-13T23:28:29.562588+0000","last_clean":"2024-09-13T23:28:29.562588+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:28:29.562588+0000","last_undegraded":"2024-09-13T23:28:29.562588+0000","last_fullsized":"2024-09-13T23:28:29.562588+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.841670+0000","last_change":"2024-09-13T23:28:34.841693+0000","last_active":"2024-09-13T23:28:34.841670+0000","last_peered":"2024-09-13T23:28:34.841670+0000","last_clean":"2024-09-13T23:28:34.841670+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:28:34.841670+0000","last_undegraded":"2024-09-13T23:28:34.841670+0000","last_fullsized":"2024-09-13T23:28:34.841670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.841569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:03.926916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966018+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.966018+0000","last_peered":"2024-09-13T23:28:22.966018+0000","last_clean":"2024-09-13T23:28:22.966018+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.966018+0000","last_undegraded":"2024-09-13T23:28:22.966018+0000","last_fullsized":"2024-09-13T23:28:22.966018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739918+0000","last_change":"2024-09-13T23:25:15.296722+0000","last_active":"2024-09-13T23:28:22.739918+0000","last_peered":"2024-09-13T23:28:22.739918+0000","last_clean":"2024-09-13T23:28:22.739918+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:22.739918+0000","last_undegraded":"2024-09-13T23:28:22.739918+0000","last_fullsized":"2024-09-13T23:28:22.739918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328664+0000","last_change":"2024-09-13T23:25:13.283881+0000","last_active":"2024-09-13T23:27:31.328664+0000","last_peered":"2024-09-13T23:27:31.328664+0000","last_clean":"2024-09-13T23:27:31.328664+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:27:31.328664+0000","last_undegraded":"2024-09-13T23:27:31.328664+0000","last_fullsized":"2024-09-13T23:27:31.328664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.688105+0000","last_change":"2024-09-13T23:28:50.688153+0000","last_active":"2024-09-13T23:28:50.688105+0000","last_peered":"2024-09-13T23:28:50.688105+0000","last_clean":"2024-09-13T23:28:50.688105+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:28:50.688105+0000","last_undegraded":"2024-09-13T23:28:50.688105+0000","last_fullsized":"2024-09-13T23:28:50.688105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.687998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:09.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.386681+0000","last_change":"2024-09-13T23:28:43.386721+0000","last_active":"2024-09-13T23:28:43.386681+0000","last_peered":"2024-09-13T23:28:43.386681+0000","last_clean":"2024-09-13T23:28:43.386681+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:43.386681+0000","last_undegraded":"2024-09-13T23:28:43.386681+0000","last_fullsized":"2024-09-13T23:28:43.386681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.386578+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.830372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331628+0000","last_change":"2024-09-13T23:25:21.307942+0000","last_active":"2024-09-13T23:27:38.331628+0000","last_peered":"2024-09-13T23:27:38.331628+0000","last_clean":"2024-09-13T23:27:38.331628+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:27:38.331628+0000","last_undegraded":"2024-09-13T23:27:38.331628+0000","last_fullsized":"2024-09-13T23:27:38.331628+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.845978+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:28:22.845978+0000","last_peered":"2024-09-13T23:28:22.845978+0000","last_clean":"2024-09-13T23:28:22.845978+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:28:22.845978+0000","last_undegraded":"2024-09-13T23:28:22.845978+0000","last_fullsized":"2024-09-13T23:28:22.845978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.447280+0000","last_change":"2024-09-13T23:28:52.447307+0000","last_active":"2024-09-13T23:28:52.447280+0000","last_peered":"2024-09-13T23:28:52.447280+0000","last_clean":"2024-09-13T23:28:52.447280+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:52.447280+0000","last_undegraded":"2024-09-13T23:28:52.447280+0000","last_fullsized":"2024-09-13T23:28:52.447280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.447192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:03.543667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329222+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:27:23.329222+0000","last_peered":"2024-09-13T23:27:23.329222+0000","last_clean":"2024-09-13T23:27:23.329222+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:27:23.329222+0000","last_undegraded":"2024-09-13T23:27:23.329222+0000","last_fullsized":"2024-09-13T23:27:23.329222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.843970+0000","last_change":"2024-09-13T23:28:48.844011+0000","last_active":"2024-09-13T23:28:48.843970+0000","last_peered":"2024-09-13T23:28:48.843970+0000","last_clean":"2024-09-13T23:28:48.843970+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:28:48.843970+0000","last_undegraded":"2024-09-13T23:28:48.843970+0000","last_fullsized":"2024-09-13T23:28:48.843970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.843846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:04.241715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.801671+0000","last_change":"2024-09-13T23:28:44.801707+0000","last_active":"2024-09-13T23:28:44.801671+0000","last_peered":"2024-09-13T23:28:44.801671+0000","last_clean":"2024-09-13T23:28:44.801671+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:44.801671+0000","last_undegraded":"2024-09-13T23:28:44.801671+0000","last_fullsized":"2024-09-13T23:28:44.801671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.801589+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:14.458499+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.752376+0000","last_change":"2024-09-13T23:28:33.752406+0000","last_active":"2024-09-13T23:28:33.752376+0000","last_peered":"2024-09-13T23:28:33.752376+0000","last_clean":"2024-09-13T23:28:33.752376+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:33.752376+0000","last_undegraded":"2024-09-13T23:28:33.752376+0000","last_fullsized":"2024-09-13T23:28:33.752376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.752282+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:30.865050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'12","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.848258+0000","last_change":"2024-09-13T23:25:23.302781+0000","last_active":"2024-09-13T23:28:22.848258+0000","last_peered":"2024-09-13T23:28:22.848258+0000","last_clean":"2024-09-13T23:28:22.848258+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:28:22.848258+0000","last_undegraded":"2024-09-13T23:28:22.848258+0000","last_fullsized":"2024-09-13T23:28:22.848258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330163+0000","last_change":"2024-09-13T23:25:15.290988+0000","last_active":"2024-09-13T23:27:33.330163+0000","last_peered":"2024-09-13T23:27:33.330163+0000","last_clean":"2024-09-13T23:27:33.330163+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:27:33.330163+0000","last_undegraded":"2024-09-13T23:27:33.330163+0000","last_fullsized":"2024-09-13T23:27:33.330163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329138+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:27:23.329138+0000","last_peered":"2024-09-13T23:27:23.329138+0000","last_clean":"2024-09-13T23:27:23.329138+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:27:23.329138+0000","last_undegraded":"2024-09-13T23:27:23.329138+0000","last_fullsized":"2024-09-13T23:27:23.329138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.183560+0000","last_change":"2024-09-13T23:28:49.183590+0000","last_active":"2024-09-13T23:28:49.183560+0000","last_peered":"2024-09-13T23:28:49.183560+0000","last_clean":"2024-09-13T23:28:49.183560+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:49.183560+0000","last_undegraded":"2024-09-13T23:28:49.183560+0000","last_fullsized":"2024-09-13T23:28:49.183560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.183478+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:30.265049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'11","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.741406+0000","last_change":"2024-09-13T23:25:19.298296+0000","last_active":"2024-09-13T23:28:22.741406+0000","last_peered":"2024-09-13T23:28:22.741406+0000","last_clean":"2024-09-13T23:28:22.741406+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:28:22.741406+0000","last_undegraded":"2024-09-13T23:28:22.741406+0000","last_fullsized":"2024-09-13T23:28:22.741406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":480,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425677+0000","last_change":"2024-09-13T23:28:36.425723+0000","last_active":"2024-09-13T23:28:36.425677+0000","last_peered":"2024-09-13T23:28:36.425677+0000","last_clean":"2024-09-13T23:28:36.425677+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:36.425677+0000","last_undegraded":"2024-09-13T23:28:36.425677+0000","last_fullsized":"2024-09-13T23:28:36.425677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.425562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.620126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.994750+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.994750+0000","last_peered":"2024-09-13T23:28:22.994750+0000","last_clean":"2024-09-13T23:28:22.994750+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.994750+0000","last_undegraded":"2024-09-13T23:28:22.994750+0000","last_fullsized":"2024-09-13T23:28:22.994750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330399+0000","last_change":"2024-09-13T23:25:15.295321+0000","last_active":"2024-09-13T23:27:33.330399+0000","last_peered":"2024-09-13T23:27:33.330399+0000","last_clean":"2024-09-13T23:27:33.330399+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:27:33.330399+0000","last_undegraded":"2024-09-13T23:27:33.330399+0000","last_fullsized":"2024-09-13T23:27:33.330399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329082+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:27:23.329082+0000","last_peered":"2024-09-13T23:27:23.329082+0000","last_clean":"2024-09-13T23:27:23.329082+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:27:23.329082+0000","last_undegraded":"2024-09-13T23:27:23.329082+0000","last_fullsized":"2024-09-13T23:27:23.329082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.394317+0000","last_change":"2024-09-13T23:28:38.394345+0000","last_active":"2024-09-13T23:28:38.394317+0000","last_peered":"2024-09-13T23:28:38.394317+0000","last_clean":"2024-09-13T23:28:38.394317+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:28:38.394317+0000","last_undegraded":"2024-09-13T23:28:38.394317+0000","last_fullsized":"2024-09-13T23:28:38.394317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.394212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:21.836246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.343811+0000","last_change":"2024-09-13T23:28:44.343852+0000","last_active":"2024-09-13T23:28:44.343811+0000","last_peered":"2024-09-13T23:28:44.343811+0000","last_clean":"2024-09-13T23:28:44.343811+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:44.343811+0000","last_undegraded":"2024-09-13T23:28:44.343811+0000","last_fullsized":"2024-09-13T23:28:44.343811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.343715+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.109483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.818959+0000","last_change":"2024-09-13T23:28:41.818982+0000","last_active":"2024-09-13T23:28:41.818959+0000","last_peered":"2024-09-13T23:28:41.818959+0000","last_clean":"2024-09-13T23:28:41.818959+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:28:41.818959+0000","last_undegraded":"2024-09-13T23:28:41.818959+0000","last_fullsized":"2024-09-13T23:28:41.818959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.818869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:39:47.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.308424+0000","last_change":"2024-09-13T23:28:46.308494+0000","last_active":"2024-09-13T23:28:46.308424+0000","last_peered":"2024-09-13T23:28:46.308424+0000","last_clean":"2024-09-13T23:28:46.308424+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:46.308424+0000","last_undegraded":"2024-09-13T23:28:46.308424+0000","last_fullsized":"2024-09-13T23:28:46.308424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.308315+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:05.222355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:58.333686+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:27:58.333686+0000","last_peered":"2024-09-13T23:27:58.333686+0000","last_clean":"2024-09-13T23:27:58.333686+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:27:58.333686+0000","last_undegraded":"2024-09-13T23:27:58.333686+0000","last_fullsized":"2024-09-13T23:27:58.333686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":201,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:03.325877+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:27:03.325877+0000","last_peered":"2024-09-13T23:27:03.325877+0000","last_clean":"2024-09-13T23:27:03.325877+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:27:03.325877+0000","last_undegraded":"2024-09-13T23:27:03.325877+0000","last_fullsized":"2024-09-13T23:27:03.325877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327868+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:27:13.327868+0000","last_peered":"2024-09-13T23:27:13.327868+0000","last_clean":"2024-09-13T23:27:13.327868+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:27:13.327868+0000","last_undegraded":"2024-09-13T23:27:13.327868+0000","last_fullsized":"2024-09-13T23:27:13.327868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328472+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:27:18.328472+0000","last_peered":"2024-09-13T23:27:18.328472+0000","last_clean":"2024-09-13T23:27:18.328472+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:27:18.328472+0000","last_undegraded":"2024-09-13T23:27:18.328472+0000","last_fullsized":"2024-09-13T23:27:18.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.221148+0000","last_change":"2024-09-13T23:28:53.221206+0000","last_active":"2024-09-13T23:28:53.221148+0000","last_peered":"2024-09-13T23:28:53.221148+0000","last_clean":"2024-09-13T23:28:53.221148+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:28:53.221148+0000","last_undegraded":"2024-09-13T23:28:53.221148+0000","last_fullsized":"2024-09-13T23:28:53.221148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.221045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:28.166667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'87","reported_seq":169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.539157+0000","last_change":"2024-09-13T23:25:19.298079+0000","last_active":"2024-09-13T23:28:29.539157+0000","last_peered":"2024-09-13T23:28:29.539157+0000","last_clean":"2024-09-13T23:28:29.539157+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:28:29.539157+0000","last_undegraded":"2024-09-13T23:28:29.539157+0000","last_fullsized":"2024-09-13T23:28:29.539157+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328750+0000","last_change":"2024-09-13T23:25:21.308687+0000","last_active":"2024-09-13T23:27:31.328750+0000","last_peered":"2024-09-13T23:27:31.328750+0000","last_clean":"2024-09-13T23:27:31.328750+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:27:31.328750+0000","last_undegraded":"2024-09-13T23:27:31.328750+0000","last_fullsized":"2024-09-13T23:27:31.328750+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.737352+0000","last_change":"2024-09-13T23:28:49.737380+0000","last_active":"2024-09-13T23:28:49.737352+0000","last_peered":"2024-09-13T23:28:49.737352+0000","last_clean":"2024-09-13T23:28:49.737352+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:49.737352+0000","last_undegraded":"2024-09-13T23:28:49.737352+0000","last_fullsized":"2024-09-13T23:28:49.737352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.737262+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:19.374870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842760+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.842760+0000","last_peered":"2024-09-13T23:28:22.842760+0000","last_clean":"2024-09-13T23:28:22.842760+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.842760+0000","last_undegraded":"2024-09-13T23:28:22.842760+0000","last_fullsized":"2024-09-13T23:28:22.842760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:08.327087+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:27:08.327087+0000","last_peered":"2024-09-13T23:27:08.327087+0000","last_clean":"2024-09-13T23:27:08.327087+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:27:08.327087+0000","last_undegraded":"2024-09-13T23:27:08.327087+0000","last_fullsized":"2024-09-13T23:27:08.327087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.570552+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:28:29.570552+0000","last_peered":"2024-09-13T23:28:29.570552+0000","last_clean":"2024-09-13T23:28:29.570552+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:28:29.570552+0000","last_undegraded":"2024-09-13T23:28:29.570552+0000","last_fullsized":"2024-09-13T23:28:29.570552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.403447+0000","last_change":"2024-09-13T23:28:40.403471+0000","last_active":"2024-09-13T23:28:40.403447+0000","last_peered":"2024-09-13T23:28:40.403447+0000","last_clean":"2024-09-13T23:28:40.403447+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:28:40.403447+0000","last_undegraded":"2024-09-13T23:28:40.403447+0000","last_fullsized":"2024-09-13T23:28:40.403447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.922817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":515,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.424037+0000","last_change":"2024-09-13T23:28:37.424100+0000","last_active":"2024-09-13T23:28:37.424037+0000","last_peered":"2024-09-13T23:28:37.424037+0000","last_clean":"2024-09-13T23:28:37.424037+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:37.424037+0000","last_undegraded":"2024-09-13T23:28:37.424037+0000","last_fullsized":"2024-09-13T23:28:37.424037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'290","last_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_deep_scrub":"33'290","last_deep_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.423958+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:06.509304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329961+0000","last_change":"2024-09-13T23:25:21.304037+0000","last_active":"2024-09-13T23:27:28.329961+0000","last_peered":"2024-09-13T23:27:28.329961+0000","last_clean":"2024-09-13T23:27:28.329961+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:27:28.329961+0000","last_undegraded":"2024-09-13T23:27:28.329961+0000","last_fullsized":"2024-09-13T23:27:28.329961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330216+0000","last_change":"2024-09-13T23:25:23.308546+0000","last_active":"2024-09-13T23:27:33.330216+0000","last_peered":"2024-09-13T23:27:33.330216+0000","last_clean":"2024-09-13T23:27:33.330216+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:27:33.330216+0000","last_undegraded":"2024-09-13T23:27:33.330216+0000","last_fullsized":"2024-09-13T23:27:33.330216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.384594+0000","last_change":"2024-09-13T23:25:15.285194+0000","last_active":"2024-09-13T23:28:22.384594+0000","last_peered":"2024-09-13T23:28:22.384594+0000","last_clean":"2024-09-13T23:28:22.384594+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:28:22.384594+0000","last_undegraded":"2024-09-13T23:28:22.384594+0000","last_fullsized":"2024-09-13T23:28:22.384594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327162+0000","last_change":"2024-09-13T23:25:06.444234+0000","last_active":"2024-09-13T23:27:13.327162+0000","last_peered":"2024-09-13T23:27:13.327162+0000","last_clean":"2024-09-13T23:27:13.327162+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:27:13.327162+0000","last_undegraded":"2024-09-13T23:27:13.327162+0000","last_fullsized":"2024-09-13T23:27:13.327162+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:16.326075+0000","last_change":"2024-09-13T23:25:13.287909+0000","last_active":"2024-09-13T23:27:16.326075+0000","last_peered":"2024-09-13T23:27:16.326075+0000","last_clean":"2024-09-13T23:27:16.326075+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:27:16.326075+0000","last_undegraded":"2024-09-13T23:27:16.326075+0000","last_fullsized":"2024-09-13T23:27:16.326075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":232,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.702573+0000","last_change":"2024-09-13T23:28:51.702609+0000","last_active":"2024-09-13T23:28:51.702573+0000","last_peered":"2024-09-13T23:28:51.702573+0000","last_clean":"2024-09-13T23:28:51.702573+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:51.702573+0000","last_undegraded":"2024-09-13T23:28:51.702573+0000","last_fullsized":"2024-09-13T23:28:51.702573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.702483+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:52.157557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.806124+0000","last_change":"2024-09-13T23:28:39.806174+0000","last_active":"2024-09-13T23:28:39.806124+0000","last_peered":"2024-09-13T23:28:39.806124+0000","last_clean":"2024-09-13T23:28:39.806124+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:39.806124+0000","last_undegraded":"2024-09-13T23:28:39.806124+0000","last_fullsized":"2024-09-13T23:28:39.806124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.806026+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:51.713911+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.882501+0000","last_change":"2024-09-13T23:28:33.882546+0000","last_active":"2024-09-13T23:28:33.882501+0000","last_peered":"2024-09-13T23:28:33.882501+0000","last_clean":"2024-09-13T23:28:33.882501+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:28:33.882501+0000","last_undegraded":"2024-09-13T23:28:33.882501+0000","last_fullsized":"2024-09-13T23:28:33.882501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.882409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:51.076973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.380115+0000","last_change":"2024-09-13T23:25:23.311768+0000","last_active":"2024-09-13T23:28:22.380115+0000","last_peered":"2024-09-13T23:28:22.380115+0000","last_clean":"2024-09-13T23:28:22.380115+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:28:22.380115+0000","last_undegraded":"2024-09-13T23:28:22.380115+0000","last_fullsized":"2024-09-13T23:28:22.380115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842904+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:28:22.842904+0000","last_peered":"2024-09-13T23:28:22.842904+0000","last_clean":"2024-09-13T23:28:22.842904+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:28:22.842904+0000","last_undegraded":"2024-09-13T23:28:22.842904+0000","last_fullsized":"2024-09-13T23:28:22.842904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327817+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:27:13.327817+0000","last_peered":"2024-09-13T23:27:13.327817+0000","last_clean":"2024-09-13T23:27:13.327817+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:27:13.327817+0000","last_undegraded":"2024-09-13T23:27:13.327817+0000","last_fullsized":"2024-09-13T23:27:13.327817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.623943+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.623943+0000","last_peered":"2024-09-13T23:28:22.623943+0000","last_clean":"2024-09-13T23:28:22.623943+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.623943+0000","last_undegraded":"2024-09-13T23:28:22.623943+0000","last_fullsized":"2024-09-13T23:28:22.623943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327038+0000","last_change":"2024-09-13T23:25:17.285610+0000","last_active":"2024-09-13T23:27:21.327038+0000","last_peered":"2024-09-13T23:27:21.327038+0000","last_clean":"2024-09-13T23:27:21.327038+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:27:21.327038+0000","last_undegraded":"2024-09-13T23:27:21.327038+0000","last_fullsized":"2024-09-13T23:27:21.327038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.436738+0000","last_change":"2024-09-13T23:28:39.436815+0000","last_active":"2024-09-13T23:28:39.436738+0000","last_peered":"2024-09-13T23:28:39.436738+0000","last_clean":"2024-09-13T23:28:39.436738+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:39.436738+0000","last_undegraded":"2024-09-13T23:28:39.436738+0000","last_fullsized":"2024-09-13T23:28:39.436738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.436619+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.975861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330824+0000","last_change":"2024-09-13T23:25:21.307983+0000","last_active":"2024-09-13T23:27:33.330824+0000","last_peered":"2024-09-13T23:27:33.330824+0000","last_clean":"2024-09-13T23:27:33.330824+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:27:33.330824+0000","last_undegraded":"2024-09-13T23:27:33.330824+0000","last_fullsized":"2024-09-13T23:27:33.330824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330131+0000","last_change":"2024-09-13T23:25:23.314405+0000","last_active":"2024-09-13T23:27:33.330131+0000","last_peered":"2024-09-13T23:27:33.330131+0000","last_clean":"2024-09-13T23:27:33.330131+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:27:33.330131+0000","last_undegraded":"2024-09-13T23:27:33.330131+0000","last_fullsized":"2024-09-13T23:27:33.330131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328386+0000","last_change":"2024-09-13T23:25:15.295101+0000","last_active":"2024-09-13T23:27:23.328386+0000","last_peered":"2024-09-13T23:27:23.328386+0000","last_clean":"2024-09-13T23:27:23.328386+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:27:23.328386+0000","last_undegraded":"2024-09-13T23:27:23.328386+0000","last_fullsized":"2024-09-13T23:27:23.328386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327825+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:27:18.327825+0000","last_peered":"2024-09-13T23:27:18.327825+0000","last_clean":"2024-09-13T23:27:18.327825+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:27:18.327825+0000","last_undegraded":"2024-09-13T23:27:18.327825+0000","last_fullsized":"2024-09-13T23:27:18.327825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:11.325333+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:27:11.325333+0000","last_peered":"2024-09-13T23:27:11.325333+0000","last_clean":"2024-09-13T23:27:11.325333+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:27:11.325333+0000","last_undegraded":"2024-09-13T23:27:11.325333+0000","last_fullsized":"2024-09-13T23:27:11.325333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'1","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.436172+0000","last_change":"2024-09-13T23:25:17.285296+0000","last_active":"2024-09-13T23:28:29.436172+0000","last_peered":"2024-09-13T23:28:29.436172+0000","last_clean":"2024-09-13T23:28:29.436172+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:29.436172+0000","last_undegraded":"2024-09-13T23:28:29.436172+0000","last_fullsized":"2024-09-13T23:28:29.436172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.871223+0000","last_change":"2024-09-13T23:28:39.871262+0000","last_active":"2024-09-13T23:28:39.871223+0000","last_peered":"2024-09-13T23:28:39.871223+0000","last_clean":"2024-09-13T23:28:39.871223+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:39.871223+0000","last_undegraded":"2024-09-13T23:28:39.871223+0000","last_fullsized":"2024-09-13T23:28:39.871223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.871135+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:40.326209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.710201+0000","last_change":"2024-09-13T23:28:34.710245+0000","last_active":"2024-09-13T23:28:34.710201+0000","last_peered":"2024-09-13T23:28:34.710201+0000","last_clean":"2024-09-13T23:28:34.710201+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:28:34.710201+0000","last_undegraded":"2024-09-13T23:28:34.710201+0000","last_fullsized":"2024-09-13T23:28:34.710201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.710073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:54.079159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330249+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:41.330249+0000","last_peered":"2024-09-13T23:27:41.330249+0000","last_clean":"2024-09-13T23:27:41.330249+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:41.330249+0000","last_undegraded":"2024-09-13T23:27:41.330249+0000","last_fullsized":"2024-09-13T23:27:41.330249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328409+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:27:23.328409+0000","last_peered":"2024-09-13T23:27:23.328409+0000","last_clean":"2024-09-13T23:27:23.328409+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:27:23.328409+0000","last_undegraded":"2024-09-13T23:27:23.328409+0000","last_fullsized":"2024-09-13T23:27:23.328409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327014+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:27:21.327014+0000","last_peered":"2024-09-13T23:27:21.327014+0000","last_clean":"2024-09-13T23:27:21.327014+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:27:21.327014+0000","last_undegraded":"2024-09-13T23:27:21.327014+0000","last_fullsized":"2024-09-13T23:27:21.327014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327925+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:27:13.327925+0000","last_peered":"2024-09-13T23:27:13.327925+0000","last_clean":"2024-09-13T23:27:13.327925+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:27:13.327925+0000","last_undegraded":"2024-09-13T23:27:13.327925+0000","last_fullsized":"2024-09-13T23:27:13.327925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.414518+0000","last_change":"2024-09-13T23:28:43.414539+0000","last_active":"2024-09-13T23:28:43.414518+0000","last_peered":"2024-09-13T23:28:43.414518+0000","last_clean":"2024-09-13T23:28:43.414518+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:28:43.414518+0000","last_undegraded":"2024-09-13T23:28:43.414518+0000","last_fullsized":"2024-09-13T23:28:43.414518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.414417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:10.088043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.380336+0000","last_change":"2024-09-13T23:28:41.380370+0000","last_active":"2024-09-13T23:28:41.380336+0000","last_peered":"2024-09-13T23:28:41.380336+0000","last_clean":"2024-09-13T23:28:41.380336+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:28:41.380336+0000","last_undegraded":"2024-09-13T23:28:41.380336+0000","last_fullsized":"2024-09-13T23:28:41.380336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.380224+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:00.663439+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.460507+0000","last_change":"2024-09-13T23:28:33.460537+0000","last_active":"2024-09-13T23:28:33.460507+0000","last_peered":"2024-09-13T23:28:33.460507+0000","last_clean":"2024-09-13T23:28:33.460507+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:33.460507+0000","last_undegraded":"2024-09-13T23:28:33.460507+0000","last_fullsized":"2024-09-13T23:28:33.460507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.460417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:15.571224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331614+0000","last_change":"2024-09-13T23:25:23.311239+0000","last_active":"2024-09-13T23:27:38.331614+0000","last_peered":"2024-09-13T23:27:38.331614+0000","last_clean":"2024-09-13T23:27:38.331614+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:27:38.331614+0000","last_undegraded":"2024-09-13T23:27:38.331614+0000","last_fullsized":"2024-09-13T23:27:38.331614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.425255+0000","last_change":"2024-09-13T23:28:50.425285+0000","last_active":"2024-09-13T23:28:50.425255+0000","last_peered":"2024-09-13T23:28:50.425255+0000","last_clean":"2024-09-13T23:28:50.425255+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:50.425255+0000","last_undegraded":"2024-09-13T23:28:50.425255+0000","last_fullsized":"2024-09-13T23:28:50.425255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.425164+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:33.299011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329328+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:27:23.329328+0000","last_peered":"2024-09-13T23:27:23.329328+0000","last_clean":"2024-09-13T23:27:23.329328+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:27:23.329328+0000","last_undegraded":"2024-09-13T23:27:23.329328+0000","last_fullsized":"2024-09-13T23:27:23.329328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:16.326182+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:27:16.326182+0000","last_peered":"2024-09-13T23:27:16.326182+0000","last_clean":"2024-09-13T23:27:16.326182+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:27:16.326182+0000","last_undegraded":"2024-09-13T23:27:16.326182+0000","last_fullsized":"2024-09-13T23:27:16.326182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329161+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:27:23.329161+0000","last_peered":"2024-09-13T23:27:23.329161+0000","last_clean":"2024-09-13T23:27:23.329161+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:27:23.329161+0000","last_undegraded":"2024-09-13T23:27:23.329161+0000","last_fullsized":"2024-09-13T23:27:23.329161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.381202+0000","last_change":"2024-09-13T23:28:49.381242+0000","last_active":"2024-09-13T23:28:49.381202+0000","last_peered":"2024-09-13T23:28:49.381202+0000","last_clean":"2024-09-13T23:28:49.381202+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:28:49.381202+0000","last_undegraded":"2024-09-13T23:28:49.381202+0000","last_fullsized":"2024-09-13T23:28:49.381202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.381105+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:20.463802+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":411,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.879334+0000","last_change":"2024-09-13T23:28:38.879400+0000","last_active":"2024-09-13T23:28:38.879334+0000","last_peered":"2024-09-13T23:28:38.879334+0000","last_clean":"2024-09-13T23:28:38.879334+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:38.879334+0000","last_undegraded":"2024-09-13T23:28:38.879334+0000","last_fullsized":"2024-09-13T23:28:38.879334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.879232+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:58.162447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331092+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:27:38.331092+0000","last_peered":"2024-09-13T23:27:38.331092+0000","last_clean":"2024-09-13T23:27:38.331092+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:27:38.331092+0000","last_undegraded":"2024-09-13T23:27:38.331092+0000","last_fullsized":"2024-09-13T23:27:38.331092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328336+0000","last_change":"2024-09-13T23:25:15.289794+0000","last_active":"2024-09-13T23:27:23.328336+0000","last_peered":"2024-09-13T23:27:23.328336+0000","last_clean":"2024-09-13T23:27:23.328336+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:27:23.328336+0000","last_undegraded":"2024-09-13T23:27:23.328336+0000","last_fullsized":"2024-09-13T23:27:23.328336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621418+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.621418+0000","last_peered":"2024-09-13T23:28:22.621418+0000","last_clean":"2024-09-13T23:28:22.621418+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.621418+0000","last_undegraded":"2024-09-13T23:28:22.621418+0000","last_fullsized":"2024-09-13T23:28:22.621418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328607+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:27:18.328607+0000","last_peered":"2024-09-13T23:27:18.328607+0000","last_clean":"2024-09-13T23:27:18.328607+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:27:18.328607+0000","last_undegraded":"2024-09-13T23:27:18.328607+0000","last_fullsized":"2024-09-13T23:27:18.328607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328421+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:27:18.328421+0000","last_peered":"2024-09-13T23:27:18.328421+0000","last_clean":"2024-09-13T23:27:18.328421+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:27:18.328421+0000","last_undegraded":"2024-09-13T23:27:18.328421+0000","last_fullsized":"2024-09-13T23:27:18.328421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.843494+0000","last_change":"2024-09-13T23:28:40.843531+0000","last_active":"2024-09-13T23:28:40.843494+0000","last_peered":"2024-09-13T23:28:40.843494+0000","last_clean":"2024-09-13T23:28:40.843494+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:40.843494+0000","last_undegraded":"2024-09-13T23:28:40.843494+0000","last_fullsized":"2024-09-13T23:28:40.843494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.843409+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:25.282723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.906363+0000","last_change":"2024-09-13T23:28:32.906383+0000","last_active":"2024-09-13T23:28:32.906363+0000","last_peered":"2024-09-13T23:28:32.906363+0000","last_clean":"2024-09-13T23:28:32.906363+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:28:32.906363+0000","last_undegraded":"2024-09-13T23:28:32.906363+0000","last_fullsized":"2024-09-13T23:28:32.906363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_clean_scrub_stamp":"2024-09-13T23:28:32.906287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:02.563197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330804+0000","last_change":"2024-09-13T23:25:23.305632+0000","last_active":"2024-09-13T23:27:38.330804+0000","last_peered":"2024-09-13T23:27:38.330804+0000","last_clean":"2024-09-13T23:27:38.330804+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:27:38.330804+0000","last_undegraded":"2024-09-13T23:27:38.330804+0000","last_fullsized":"2024-09-13T23:27:38.330804+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329282+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:27:28.329282+0000","last_peered":"2024-09-13T23:27:28.329282+0000","last_clean":"2024-09-13T23:27:28.329282+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:27:28.329282+0000","last_undegraded":"2024-09-13T23:27:28.329282+0000","last_fullsized":"2024-09-13T23:27:28.329282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.485476+0000","last_change":"2024-09-13T23:25:15.289596+0000","last_active":"2024-09-13T23:28:22.485476+0000","last_peered":"2024-09-13T23:28:22.485476+0000","last_clean":"2024-09-13T23:28:22.485476+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:28:22.485476+0000","last_undegraded":"2024-09-13T23:28:22.485476+0000","last_fullsized":"2024-09-13T23:28:22.485476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330741+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:27:33.330741+0000","last_peered":"2024-09-13T23:27:33.330741+0000","last_clean":"2024-09-13T23:27:33.330741+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:27:33.330741+0000","last_undegraded":"2024-09-13T23:27:33.330741+0000","last_fullsized":"2024-09-13T23:27:33.330741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.206254+0000","last_change":"2024-09-13T23:28:51.206296+0000","last_active":"2024-09-13T23:28:51.206254+0000","last_peered":"2024-09-13T23:28:51.206254+0000","last_clean":"2024-09-13T23:28:51.206254+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:28:51.206254+0000","last_undegraded":"2024-09-13T23:28:51.206254+0000","last_fullsized":"2024-09-13T23:28:51.206254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.206161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:55.123436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'35","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.516977+0000","last_change":"2024-09-13T23:25:19.299340+0000","last_active":"2024-09-13T23:28:29.516977+0000","last_peered":"2024-09-13T23:28:29.516977+0000","last_clean":"2024-09-13T23:28:29.516977+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:28:29.516977+0000","last_undegraded":"2024-09-13T23:28:29.516977+0000","last_fullsized":"2024-09-13T23:28:29.516977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:18.275108+0000","last_clean_scrub_stamp":"2024-09-13T23:25:18.275108+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332168+0000","last_change":"2024-09-13T23:25:21.306435+0000","last_active":"2024-09-13T23:27:43.332168+0000","last_peered":"2024-09-13T23:27:43.332168+0000","last_clean":"2024-09-13T23:27:43.332168+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:27:43.332168+0000","last_undegraded":"2024-09-13T23:27:43.332168+0000","last_fullsized":"2024-09-13T23:27:43.332168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327882+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:26.327882+0000","last_peered":"2024-09-13T23:27:26.327882+0000","last_clean":"2024-09-13T23:27:26.327882+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:26.327882+0000","last_undegraded":"2024-09-13T23:27:26.327882+0000","last_fullsized":"2024-09-13T23:27:26.327882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842978+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.842978+0000","last_peered":"2024-09-13T23:28:22.842978+0000","last_clean":"2024-09-13T23:28:22.842978+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.842978+0000","last_undegraded":"2024-09-13T23:28:22.842978+0000","last_fullsized":"2024-09-13T23:28:22.842978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330818+0000","last_change":"2024-09-13T23:25:13.287807+0000","last_active":"2024-09-13T23:27:38.330818+0000","last_peered":"2024-09-13T23:27:38.330818+0000","last_clean":"2024-09-13T23:27:38.330818+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:27:38.330818+0000","last_undegraded":"2024-09-13T23:27:38.330818+0000","last_fullsized":"2024-09-13T23:27:38.330818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.419549+0000","last_change":"2024-09-13T23:28:44.419595+0000","last_active":"2024-09-13T23:28:44.419549+0000","last_peered":"2024-09-13T23:28:44.419549+0000","last_clean":"2024-09-13T23:28:44.419549+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:28:44.419549+0000","last_undegraded":"2024-09-13T23:28:44.419549+0000","last_fullsized":"2024-09-13T23:28:44.419549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.419451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:28.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.882244+0000","last_change":"2024-09-13T23:28:44.882276+0000","last_active":"2024-09-13T23:28:44.882244+0000","last_peered":"2024-09-13T23:28:44.882244+0000","last_clean":"2024-09-13T23:28:44.882244+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:44.882244+0000","last_undegraded":"2024-09-13T23:28:44.882244+0000","last_fullsized":"2024-09-13T23:28:44.882244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.882155+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.157762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.770991+0000","last_change":"2024-09-13T23:28:45.771011+0000","last_active":"2024-09-13T23:28:45.770991+0000","last_peered":"2024-09-13T23:28:45.770991+0000","last_clean":"2024-09-13T23:28:45.770991+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:28:45.770991+0000","last_undegraded":"2024-09-13T23:28:45.770991+0000","last_fullsized":"2024-09-13T23:28:45.770991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.770908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:02.965472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:56.332271+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:27:56.332271+0000","last_peered":"2024-09-13T23:27:56.332271+0000","last_clean":"2024-09-13T23:27:56.332271+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:27:56.332271+0000","last_undegraded":"2024-09-13T23:27:56.332271+0000","last_fullsized":"2024-09-13T23:27:56.332271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.484807+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.484807+0000","last_peered":"2024-09-13T23:28:22.484807+0000","last_clean":"2024-09-13T23:28:22.484807+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.484807+0000","last_undegraded":"2024-09-13T23:28:22.484807+0000","last_fullsized":"2024-09-13T23:28:22.484807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.330840+0000","last_change":"2024-09-13T23:25:13.286024+0000","last_active":"2024-09-13T23:27:38.330840+0000","last_peered":"2024-09-13T23:27:38.330840+0000","last_clean":"2024-09-13T23:27:38.330840+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:27:38.330840+0000","last_undegraded":"2024-09-13T23:27:38.330840+0000","last_fullsized":"2024-09-13T23:27:38.330840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.713164+0000","last_change":"2024-09-13T23:28:47.713189+0000","last_active":"2024-09-13T23:28:47.713164+0000","last_peered":"2024-09-13T23:28:47.713164+0000","last_clean":"2024-09-13T23:28:47.713164+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:28:47.713164+0000","last_undegraded":"2024-09-13T23:28:47.713164+0000","last_fullsized":"2024-09-13T23:28:47.713164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.713076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:36.167508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'48","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.861559+0000","last_change":"2024-09-13T23:28:43.861599+0000","last_active":"2024-09-13T23:28:43.861559+0000","last_peered":"2024-09-13T23:28:43.861559+0000","last_clean":"2024-09-13T23:28:43.861559+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:43.861559+0000","last_undegraded":"2024-09-13T23:28:43.861559+0000","last_fullsized":"2024-09-13T23:28:43.861559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.861453+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:50.677647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.470961+0000","last_change":"2024-09-13T23:28:35.470984+0000","last_active":"2024-09-13T23:28:35.470961+0000","last_peered":"2024-09-13T23:28:35.470961+0000","last_clean":"2024-09-13T23:28:35.470961+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:28:35.470961+0000","last_undegraded":"2024-09-13T23:28:35.470961+0000","last_fullsized":"2024-09-13T23:28:35.470961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.470871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:42.091197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.333742+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:27:53.333742+0000","last_peered":"2024-09-13T23:27:53.333742+0000","last_clean":"2024-09-13T23:27:53.333742+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:27:53.333742+0000","last_undegraded":"2024-09-13T23:27:53.333742+0000","last_fullsized":"2024-09-13T23:27:53.333742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.391868+0000","last_change":"2024-09-13T23:28:46.391900+0000","last_active":"2024-09-13T23:28:46.391868+0000","last_peered":"2024-09-13T23:28:46.391868+0000","last_clean":"2024-09-13T23:28:46.391868+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:46.391868+0000","last_undegraded":"2024-09-13T23:28:46.391868+0000","last_fullsized":"2024-09-13T23:28:46.391868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.391777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:57.512441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331179+0000","last_change":"2024-09-13T23:25:13.288670+0000","last_active":"2024-09-13T23:27:38.331179+0000","last_peered":"2024-09-13T23:27:38.331179+0000","last_clean":"2024-09-13T23:27:38.331179+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:27:38.331179+0000","last_undegraded":"2024-09-13T23:27:38.331179+0000","last_fullsized":"2024-09-13T23:27:38.331179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425037+0000","last_change":"2024-09-13T23:28:36.425088+0000","last_active":"2024-09-13T23:28:36.425037+0000","last_peered":"2024-09-13T23:28:36.425037+0000","last_clean":"2024-09-13T23:28:36.425037+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:28:36.425037+0000","last_undegraded":"2024-09-13T23:28:36.425037+0000","last_fullsized":"2024-09-13T23:28:36.425037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.424930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:03.124803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.764356+0000","last_change":"2024-09-13T23:28:46.764392+0000","last_active":"2024-09-13T23:28:46.764356+0000","last_peered":"2024-09-13T23:28:46.764356+0000","last_clean":"2024-09-13T23:28:46.764356+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:46.764356+0000","last_undegraded":"2024-09-13T23:28:46.764356+0000","last_fullsized":"2024-09-13T23:28:46.764356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.764271+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:15.849617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.707109+0000","last_change":"2024-09-13T23:28:36.707149+0000","last_active":"2024-09-13T23:28:36.707109+0000","last_peered":"2024-09-13T23:28:36.707109+0000","last_clean":"2024-09-13T23:28:36.707109+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:28:36.707109+0000","last_undegraded":"2024-09-13T23:28:36.707109+0000","last_fullsized":"2024-09-13T23:28:36.707109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.706974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.091638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842806+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.842806+0000","last_peered":"2024-09-13T23:28:22.842806+0000","last_clean":"2024-09-13T23:28:22.842806+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.842806+0000","last_undegraded":"2024-09-13T23:28:22.842806+0000","last_fullsized":"2024-09-13T23:28:22.842806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331329+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:27:38.331329+0000","last_peered":"2024-09-13T23:27:38.331329+0000","last_clean":"2024-09-13T23:27:38.331329+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:27:38.331329+0000","last_undegraded":"2024-09-13T23:27:38.331329+0000","last_fullsized":"2024-09-13T23:27:38.331329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:16.326215+0000","last_change":"2024-09-13T23:25:17.285736+0000","last_active":"2024-09-13T23:27:16.326215+0000","last_peered":"2024-09-13T23:27:16.326215+0000","last_clean":"2024-09-13T23:27:16.326215+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:27:16.326215+0000","last_undegraded":"2024-09-13T23:27:16.326215+0000","last_fullsized":"2024-09-13T23:27:16.326215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'65","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.838301+0000","last_change":"2024-09-13T23:28:46.838338+0000","last_active":"2024-09-13T23:28:46.838301+0000","last_peered":"2024-09-13T23:28:46.838301+0000","last_clean":"2024-09-13T23:28:46.838301+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:46.838301+0000","last_undegraded":"2024-09-13T23:28:46.838301+0000","last_fullsized":"2024-09-13T23:28:46.838301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'65","last_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_deep_scrub":"33'65","last_deep_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.838216+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.670165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.700661+0000","last_change":"2024-09-13T23:28:35.700684+0000","last_active":"2024-09-13T23:28:35.700661+0000","last_peered":"2024-09-13T23:28:35.700661+0000","last_clean":"2024-09-13T23:28:35.700661+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:28:35.700661+0000","last_undegraded":"2024-09-13T23:28:35.700661+0000","last_fullsized":"2024-09-13T23:28:35.700661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.700569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:06.066777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:46.330915+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:46.330915+0000","last_peered":"2024-09-13T23:27:46.330915+0000","last_clean":"2024-09-13T23:27:46.330915+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:46.330915+0000","last_undegraded":"2024-09-13T23:27:46.330915+0000","last_fullsized":"2024-09-13T23:27:46.330915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.871686+0000","last_change":"2024-09-13T23:25:15.281867+0000","last_active":"2024-09-13T23:27:21.871686+0000","last_peered":"2024-09-13T23:27:21.871686+0000","last_clean":"2024-09-13T23:27:21.871686+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:27:21.871686+0000","last_undegraded":"2024-09-13T23:27:21.871686+0000","last_fullsized":"2024-09-13T23:27:21.871686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.570938+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:28:29.570938+0000","last_peered":"2024-09-13T23:28:29.570938+0000","last_clean":"2024-09-13T23:28:29.570938+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:28:29.570938+0000","last_undegraded":"2024-09-13T23:28:29.570938+0000","last_fullsized":"2024-09-13T23:28:29.570938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.730015+0000","last_change":"2024-09-13T23:28:52.730040+0000","last_active":"2024-09-13T23:28:52.730015+0000","last_peered":"2024-09-13T23:28:52.730015+0000","last_clean":"2024-09-13T23:28:52.730015+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:28:52.730015+0000","last_undegraded":"2024-09-13T23:28:52.730015+0000","last_fullsized":"2024-09-13T23:28:52.730015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.729923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:09.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.432492+0000","last_change":"2024-09-13T23:28:34.432533+0000","last_active":"2024-09-13T23:28:34.432492+0000","last_peered":"2024-09-13T23:28:34.432492+0000","last_clean":"2024-09-13T23:28:34.432492+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:34.432492+0000","last_undegraded":"2024-09-13T23:28:34.432492+0000","last_fullsized":"2024-09-13T23:28:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.432394+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:14.169652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.418506+0000","last_change":"2024-09-13T23:28:38.418547+0000","last_active":"2024-09-13T23:28:38.418506+0000","last_peered":"2024-09-13T23:28:38.418506+0000","last_clean":"2024-09-13T23:28:38.418506+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:28:38.418506+0000","last_undegraded":"2024-09-13T23:28:38.418506+0000","last_fullsized":"2024-09-13T23:28:38.418506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.418363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:26.872796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332242+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:27:43.332242+0000","last_peered":"2024-09-13T23:27:43.332242+0000","last_clean":"2024-09-13T23:27:43.332242+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:27:43.332242+0000","last_undegraded":"2024-09-13T23:27:43.332242+0000","last_fullsized":"2024-09-13T23:27:43.332242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.399289+0000","last_change":"2024-09-13T23:28:51.399332+0000","last_active":"2024-09-13T23:28:51.399289+0000","last_peered":"2024-09-13T23:28:51.399289+0000","last_clean":"2024-09-13T23:28:51.399289+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:28:51.399289+0000","last_undegraded":"2024-09-13T23:28:51.399289+0000","last_fullsized":"2024-09-13T23:28:51.399289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.399178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:24.391607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331848+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:27:43.331848+0000","last_peered":"2024-09-13T23:27:43.331848+0000","last_clean":"2024-09-13T23:27:43.331848+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:27:43.331848+0000","last_undegraded":"2024-09-13T23:27:43.331848+0000","last_fullsized":"2024-09-13T23:27:43.331848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'4","reported_seq":229,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.425225+0000","last_change":"2024-09-13T23:25:17.282523+0000","last_active":"2024-09-13T23:28:29.425225+0000","last_peered":"2024-09-13T23:28:29.425225+0000","last_clean":"2024-09-13T23:28:29.425225+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:29.425225+0000","last_undegraded":"2024-09-13T23:28:29.425225+0000","last_fullsized":"2024-09-13T23:28:29.425225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.872691+0000","last_change":"2024-09-13T23:28:42.872729+0000","last_active":"2024-09-13T23:28:42.872691+0000","last_peered":"2024-09-13T23:28:42.872691+0000","last_clean":"2024-09-13T23:28:42.872691+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:42.872691+0000","last_undegraded":"2024-09-13T23:28:42.872691+0000","last_fullsized":"2024-09-13T23:28:42.872691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.872602+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:27.096735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.838642+0000","last_change":"2024-09-13T23:28:36.838668+0000","last_active":"2024-09-13T23:28:36.838642+0000","last_peered":"2024-09-13T23:28:36.838642+0000","last_clean":"2024-09-13T23:28:36.838642+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:28:36.838642+0000","last_undegraded":"2024-09-13T23:28:36.838642+0000","last_fullsized":"2024-09-13T23:28:36.838642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.838543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:00.388168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.630335+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.630335+0000","last_peered":"2024-09-13T23:28:22.630335+0000","last_clean":"2024-09-13T23:28:22.630335+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.630335+0000","last_undegraded":"2024-09-13T23:28:22.630335+0000","last_fullsized":"2024-09-13T23:28:22.630335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.384568+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.384568+0000","last_peered":"2024-09-13T23:28:22.384568+0000","last_clean":"2024-09-13T23:28:22.384568+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.384568+0000","last_undegraded":"2024-09-13T23:28:22.384568+0000","last_fullsized":"2024-09-13T23:28:22.384568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616044+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.616044+0000","last_peered":"2024-09-13T23:28:22.616044+0000","last_clean":"2024-09-13T23:28:22.616044+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.616044+0000","last_undegraded":"2024-09-13T23:28:22.616044+0000","last_fullsized":"2024-09-13T23:28:22.616044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332680+0000","last_change":"2024-09-13T23:25:17.285551+0000","last_active":"2024-09-13T23:27:48.332680+0000","last_peered":"2024-09-13T23:27:48.332680+0000","last_clean":"2024-09-13T23:27:48.332680+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:27:48.332680+0000","last_undegraded":"2024-09-13T23:27:48.332680+0000","last_fullsized":"2024-09-13T23:27:48.332680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.392835+0000","last_change":"2024-09-13T23:28:37.392868+0000","last_active":"2024-09-13T23:28:37.392835+0000","last_peered":"2024-09-13T23:28:37.392835+0000","last_clean":"2024-09-13T23:28:37.392835+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:28:37.392835+0000","last_undegraded":"2024-09-13T23:28:37.392835+0000","last_fullsized":"2024-09-13T23:28:37.392835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.392753+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:27.511355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":378,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.736242+0000","last_change":"2024-09-13T23:28:37.736270+0000","last_active":"2024-09-13T23:28:37.736242+0000","last_peered":"2024-09-13T23:28:37.736242+0000","last_clean":"2024-09-13T23:28:37.736242+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:37.736242+0000","last_undegraded":"2024-09-13T23:28:37.736242+0000","last_fullsized":"2024-09-13T23:28:37.736242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.736151+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:12.004146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332118+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:27:43.332118+0000","last_peered":"2024-09-13T23:27:43.332118+0000","last_clean":"2024-09-13T23:27:43.332118+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:27:43.332118+0000","last_undegraded":"2024-09-13T23:27:43.332118+0000","last_fullsized":"2024-09-13T23:27:43.332118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632799+0000","last_change":"2024-09-13T23:25:15.286332+0000","last_active":"2024-09-13T23:28:22.632799+0000","last_peered":"2024-09-13T23:28:22.632799+0000","last_clean":"2024-09-13T23:28:22.632799+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:22.632799+0000","last_undegraded":"2024-09-13T23:28:22.632799+0000","last_fullsized":"2024-09-13T23:28:22.632799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331912+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:27:43.331912+0000","last_peered":"2024-09-13T23:27:43.331912+0000","last_clean":"2024-09-13T23:27:43.331912+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:27:43.331912+0000","last_undegraded":"2024-09-13T23:27:43.331912+0000","last_fullsized":"2024-09-13T23:27:43.331912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.172867+0000","last_change":"2024-09-13T23:28:52.172891+0000","last_active":"2024-09-13T23:28:52.172867+0000","last_peered":"2024-09-13T23:28:52.172867+0000","last_clean":"2024-09-13T23:28:52.172867+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:28:52.172867+0000","last_undegraded":"2024-09-13T23:28:52.172867+0000","last_fullsized":"2024-09-13T23:28:52.172867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.172781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.571714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.428570+0000","last_change":"2024-09-13T23:28:40.428650+0000","last_active":"2024-09-13T23:28:40.428570+0000","last_peered":"2024-09-13T23:28:40.428570+0000","last_clean":"2024-09-13T23:28:40.428570+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:40.428570+0000","last_undegraded":"2024-09-13T23:28:40.428570+0000","last_fullsized":"2024-09-13T23:28:40.428570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.428479+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:10.066086+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.913346+0000","last_change":"2024-09-13T23:28:41.913370+0000","last_active":"2024-09-13T23:28:41.913346+0000","last_peered":"2024-09-13T23:28:41.913346+0000","last_clean":"2024-09-13T23:28:41.913346+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:28:41.913346+0000","last_undegraded":"2024-09-13T23:28:41.913346+0000","last_fullsized":"2024-09-13T23:28:41.913346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.913252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:38.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332724+0000","last_change":"2024-09-13T23:25:23.309558+0000","last_active":"2024-09-13T23:27:48.332724+0000","last_peered":"2024-09-13T23:27:48.332724+0000","last_clean":"2024-09-13T23:27:48.332724+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:27:48.332724+0000","last_undegraded":"2024-09-13T23:27:48.332724+0000","last_fullsized":"2024-09-13T23:27:48.332724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332078+0000","last_change":"2024-09-13T23:25:15.279688+0000","last_active":"2024-09-13T23:27:48.332078+0000","last_peered":"2024-09-13T23:27:48.332078+0000","last_clean":"2024-09-13T23:27:48.332078+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:27:48.332078+0000","last_undegraded":"2024-09-13T23:27:48.332078+0000","last_fullsized":"2024-09-13T23:27:48.332078+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332377+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:27:43.332377+0000","last_peered":"2024-09-13T23:27:43.332377+0000","last_clean":"2024-09-13T23:27:43.332377+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:27:43.332377+0000","last_undegraded":"2024-09-13T23:27:43.332377+0000","last_fullsized":"2024-09-13T23:27:43.332377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.761946+0000","last_change":"2024-09-13T23:28:48.761973+0000","last_active":"2024-09-13T23:28:48.761946+0000","last_peered":"2024-09-13T23:28:48.761946+0000","last_clean":"2024-09-13T23:28:48.761946+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:28:48.761946+0000","last_undegraded":"2024-09-13T23:28:48.761946+0000","last_fullsized":"2024-09-13T23:28:48.761946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.761854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:33.308523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.868864+0000","last_change":"2024-09-13T23:28:40.868903+0000","last_active":"2024-09-13T23:28:40.868864+0000","last_peered":"2024-09-13T23:28:40.868864+0000","last_clean":"2024-09-13T23:28:40.868864+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:40.868864+0000","last_undegraded":"2024-09-13T23:28:40.868864+0000","last_fullsized":"2024-09-13T23:28:40.868864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.868753+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:57.312547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332951+0000","last_change":"2024-09-13T23:25:21.306963+0000","last_active":"2024-09-13T23:27:48.332951+0000","last_peered":"2024-09-13T23:27:48.332951+0000","last_clean":"2024-09-13T23:27:48.332951+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:27:48.332951+0000","last_undegraded":"2024-09-13T23:27:48.332951+0000","last_fullsized":"2024-09-13T23:27:48.332951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333179+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:27:48.333179+0000","last_peered":"2024-09-13T23:27:48.333179+0000","last_clean":"2024-09-13T23:27:48.333179+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:27:48.333179+0000","last_undegraded":"2024-09-13T23:27:48.333179+0000","last_fullsized":"2024-09-13T23:27:48.333179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704514+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.704514+0000","last_peered":"2024-09-13T23:28:22.704514+0000","last_clean":"2024-09-13T23:28:22.704514+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.704514+0000","last_undegraded":"2024-09-13T23:28:22.704514+0000","last_fullsized":"2024-09-13T23:28:22.704514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.618718+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.618718+0000","last_peered":"2024-09-13T23:28:22.618718+0000","last_clean":"2024-09-13T23:28:22.618718+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.618718+0000","last_undegraded":"2024-09-13T23:28:22.618718+0000","last_fullsized":"2024-09-13T23:28:22.618718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.259377+0000","last_change":"2024-09-13T23:28:47.259399+0000","last_active":"2024-09-13T23:28:47.259377+0000","last_peered":"2024-09-13T23:28:47.259377+0000","last_clean":"2024-09-13T23:28:47.259377+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:28:47.259377+0000","last_undegraded":"2024-09-13T23:28:47.259377+0000","last_fullsized":"2024-09-13T23:28:47.259377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.259291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.594250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.407054+0000","last_change":"2024-09-13T23:28:47.407089+0000","last_active":"2024-09-13T23:28:47.407054+0000","last_peered":"2024-09-13T23:28:47.407054+0000","last_clean":"2024-09-13T23:28:47.407054+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:47.407054+0000","last_undegraded":"2024-09-13T23:28:47.407054+0000","last_fullsized":"2024-09-13T23:28:47.407054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.406957+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:12.268807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.333690+0000","last_change":"2024-09-13T23:25:21.305087+0000","last_active":"2024-09-13T23:27:53.333690+0000","last_peered":"2024-09-13T23:27:53.333690+0000","last_clean":"2024-09-13T23:27:53.333690+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:27:53.333690+0000","last_undegraded":"2024-09-13T23:27:53.333690+0000","last_fullsized":"2024-09-13T23:27:53.333690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:20.282175+0000","last_clean_scrub_stamp":"2024-09-13T23:25:20.282175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333137+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:48.333137+0000","last_peered":"2024-09-13T23:27:48.333137+0000","last_clean":"2024-09-13T23:27:48.333137+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:48.333137+0000","last_undegraded":"2024-09-13T23:27:48.333137+0000","last_fullsized":"2024-09-13T23:27:48.333137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'9","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842369+0000","last_change":"2024-09-13T23:25:15.286878+0000","last_active":"2024-09-13T23:28:22.842369+0000","last_peered":"2024-09-13T23:28:22.842369+0000","last_clean":"2024-09-13T23:28:22.842369+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:22.842369+0000","last_undegraded":"2024-09-13T23:28:22.842369+0000","last_fullsized":"2024-09-13T23:28:22.842369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327757+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:27:18.327757+0000","last_peered":"2024-09-13T23:27:18.327757+0000","last_clean":"2024-09-13T23:27:18.327757+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:27:18.327757+0000","last_undegraded":"2024-09-13T23:27:18.327757+0000","last_fullsized":"2024-09-13T23:27:18.327757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.345673+0000","last_change":"2024-09-13T23:28:45.345702+0000","last_active":"2024-09-13T23:28:45.345673+0000","last_peered":"2024-09-13T23:28:45.345673+0000","last_clean":"2024-09-13T23:28:45.345673+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:28:45.345673+0000","last_undegraded":"2024-09-13T23:28:45.345673+0000","last_fullsized":"2024-09-13T23:28:45.345673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.345587+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.147860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.376916+0000","last_change":"2024-09-13T23:28:45.376963+0000","last_active":"2024-09-13T23:28:45.376916+0000","last_peered":"2024-09-13T23:28:45.376916+0000","last_clean":"2024-09-13T23:28:45.376916+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:45.376916+0000","last_undegraded":"2024-09-13T23:28:45.376916+0000","last_fullsized":"2024-09-13T23:28:45.376916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.376807+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:21.519688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.830708+0000","last_change":"2024-09-13T23:28:45.830736+0000","last_active":"2024-09-13T23:28:45.830708+0000","last_peered":"2024-09-13T23:28:45.830708+0000","last_clean":"2024-09-13T23:28:45.830708+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:28:45.830708+0000","last_undegraded":"2024-09-13T23:28:45.830708+0000","last_fullsized":"2024-09-13T23:28:45.830708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.830607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.666028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.705711+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.705711+0000","last_peered":"2024-09-13T23:28:22.705711+0000","last_clean":"2024-09-13T23:28:22.705711+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.705711+0000","last_undegraded":"2024-09-13T23:28:22.705711+0000","last_fullsized":"2024-09-13T23:28:22.705711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.635702+0000","last_change":"2024-09-13T23:25:15.296960+0000","last_active":"2024-09-13T23:28:22.635702+0000","last_peered":"2024-09-13T23:28:22.635702+0000","last_clean":"2024-09-13T23:28:22.635702+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:22.635702+0000","last_undegraded":"2024-09-13T23:28:22.635702+0000","last_fullsized":"2024-09-13T23:28:22.635702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613263+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.613263+0000","last_peered":"2024-09-13T23:28:22.613263+0000","last_clean":"2024-09-13T23:28:22.613263+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.613263+0000","last_undegraded":"2024-09-13T23:28:22.613263+0000","last_fullsized":"2024-09-13T23:28:22.613263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739713+0000","last_change":"2024-09-13T23:25:15.285164+0000","last_active":"2024-09-13T23:28:22.739713+0000","last_peered":"2024-09-13T23:28:22.739713+0000","last_clean":"2024-09-13T23:28:22.739713+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:28:22.739713+0000","last_undegraded":"2024-09-13T23:28:22.739713+0000","last_fullsized":"2024-09-13T23:28:22.739713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326934+0000","last_change":"2024-09-13T23:25:13.281843+0000","last_active":"2024-09-13T23:27:21.326934+0000","last_peered":"2024-09-13T23:27:21.326934+0000","last_clean":"2024-09-13T23:27:21.326934+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:27:21.326934+0000","last_undegraded":"2024-09-13T23:27:21.326934+0000","last_fullsized":"2024-09-13T23:27:21.326934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.632858+0000","last_change":"2024-09-13T23:25:15.280336+0000","last_active":"2024-09-13T23:28:22.632858+0000","last_peered":"2024-09-13T23:28:22.632858+0000","last_clean":"2024-09-13T23:28:22.632858+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:28:22.632858+0000","last_undegraded":"2024-09-13T23:28:22.632858+0000","last_fullsized":"2024-09-13T23:28:22.632858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328491+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:27:18.328491+0000","last_peered":"2024-09-13T23:27:18.328491+0000","last_clean":"2024-09-13T23:27:18.328491+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:27:18.328491+0000","last_undegraded":"2024-09-13T23:27:18.328491+0000","last_fullsized":"2024-09-13T23:27:18.328491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739900+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.739900+0000","last_peered":"2024-09-13T23:28:22.739900+0000","last_clean":"2024-09-13T23:28:22.739900+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.739900+0000","last_undegraded":"2024-09-13T23:28:22.739900+0000","last_fullsized":"2024-09-13T23:28:22.739900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326980+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:27:21.326980+0000","last_peered":"2024-09-13T23:27:21.326980+0000","last_clean":"2024-09-13T23:27:21.326980+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:27:21.326980+0000","last_undegraded":"2024-09-13T23:27:21.326980+0000","last_fullsized":"2024-09-13T23:27:21.326980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326998+0000","last_change":"2024-09-13T23:25:15.278977+0000","last_active":"2024-09-13T23:27:21.326998+0000","last_peered":"2024-09-13T23:27:21.326998+0000","last_clean":"2024-09-13T23:27:21.326998+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:27:21.326998+0000","last_undegraded":"2024-09-13T23:27:21.326998+0000","last_fullsized":"2024-09-13T23:27:21.326998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327859+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:27:26.327859+0000","last_peered":"2024-09-13T23:27:26.327859+0000","last_clean":"2024-09-13T23:27:26.327859+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:27:26.327859+0000","last_undegraded":"2024-09-13T23:27:26.327859+0000","last_fullsized":"2024-09-13T23:27:26.327859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328367+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:23.328367+0000","last_peered":"2024-09-13T23:27:23.328367+0000","last_clean":"2024-09-13T23:27:23.328367+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:23.328367+0000","last_undegraded":"2024-09-13T23:27:23.328367+0000","last_fullsized":"2024-09-13T23:27:23.328367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328486+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:27:23.328486+0000","last_peered":"2024-09-13T23:27:23.328486+0000","last_clean":"2024-09-13T23:27:23.328486+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:27:23.328486+0000","last_undegraded":"2024-09-13T23:27:23.328486+0000","last_fullsized":"2024-09-13T23:27:23.328486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704272+0000","last_change":"2024-09-13T23:25:15.286489+0000","last_active":"2024-09-13T23:28:22.704272+0000","last_peered":"2024-09-13T23:28:22.704272+0000","last_clean":"2024-09-13T23:28:22.704272+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:22.704272+0000","last_undegraded":"2024-09-13T23:28:22.704272+0000","last_fullsized":"2024-09-13T23:28:22.704272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328455+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:27:23.328455+0000","last_peered":"2024-09-13T23:27:23.328455+0000","last_clean":"2024-09-13T23:27:23.328455+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:27:23.328455+0000","last_undegraded":"2024-09-13T23:27:23.328455+0000","last_fullsized":"2024-09-13T23:27:23.328455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704224+0000","last_change":"2024-09-13T23:25:15.287524+0000","last_active":"2024-09-13T23:28:22.704224+0000","last_peered":"2024-09-13T23:28:22.704224+0000","last_clean":"2024-09-13T23:28:22.704224+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:28:22.704224+0000","last_undegraded":"2024-09-13T23:28:22.704224+0000","last_fullsized":"2024-09-13T23:28:22.704224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327919+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:27:26.327919+0000","last_peered":"2024-09-13T23:27:26.327919+0000","last_clean":"2024-09-13T23:27:26.327919+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:27:26.327919+0000","last_undegraded":"2024-09-13T23:27:26.327919+0000","last_fullsized":"2024-09-13T23:27:26.327919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331208+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:27:38.331208+0000","last_peered":"2024-09-13T23:27:38.331208+0000","last_clean":"2024-09-13T23:27:38.331208+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:27:38.331208+0000","last_undegraded":"2024-09-13T23:27:38.331208+0000","last_fullsized":"2024-09-13T23:27:38.331208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329102+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:27:23.329102+0000","last_peered":"2024-09-13T23:27:23.329102+0000","last_clean":"2024-09-13T23:27:23.329102+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:27:23.329102+0000","last_undegraded":"2024-09-13T23:27:23.329102+0000","last_fullsized":"2024-09-13T23:27:23.329102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.740013+0000","last_change":"2024-09-13T23:25:15.285028+0000","last_active":"2024-09-13T23:28:22.740013+0000","last_peered":"2024-09-13T23:28:22.740013+0000","last_clean":"2024-09-13T23:28:22.740013+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:28:22.740013+0000","last_undegraded":"2024-09-13T23:28:22.740013+0000","last_fullsized":"2024-09-13T23:28:22.740013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328606+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:27:31.328606+0000","last_peered":"2024-09-13T23:27:31.328606+0000","last_clean":"2024-09-13T23:27:31.328606+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:27:31.328606+0000","last_undegraded":"2024-09-13T23:27:31.328606+0000","last_fullsized":"2024-09-13T23:27:31.328606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328722+0000","last_change":"2024-09-13T23:25:15.278986+0000","last_active":"2024-09-13T23:27:31.328722+0000","last_peered":"2024-09-13T23:27:31.328722+0000","last_clean":"2024-09-13T23:27:31.328722+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:27:31.328722+0000","last_undegraded":"2024-09-13T23:27:31.328722+0000","last_fullsized":"2024-09-13T23:27:31.328722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.731386+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.731386+0000","last_peered":"2024-09-13T23:28:22.731386+0000","last_clean":"2024-09-13T23:28:22.731386+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.731386+0000","last_undegraded":"2024-09-13T23:28:22.731386+0000","last_fullsized":"2024-09-13T23:28:22.731386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.485387+0000","last_change":"2024-09-13T23:25:15.285560+0000","last_active":"2024-09-13T23:28:22.485387+0000","last_peered":"2024-09-13T23:28:22.485387+0000","last_clean":"2024-09-13T23:28:22.485387+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:28:22.485387+0000","last_undegraded":"2024-09-13T23:28:22.485387+0000","last_fullsized":"2024-09-13T23:28:22.485387+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329322+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:27:28.329322+0000","last_peered":"2024-09-13T23:27:28.329322+0000","last_clean":"2024-09-13T23:27:28.329322+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:27:28.329322+0000","last_undegraded":"2024-09-13T23:27:28.329322+0000","last_fullsized":"2024-09-13T23:27:28.329322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330235+0000","last_change":"2024-09-13T23:25:15.295677+0000","last_active":"2024-09-13T23:27:33.330235+0000","last_peered":"2024-09-13T23:27:33.330235+0000","last_clean":"2024-09-13T23:27:33.330235+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:27:33.330235+0000","last_undegraded":"2024-09-13T23:27:33.330235+0000","last_fullsized":"2024-09-13T23:27:33.330235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.575012+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:28:29.575012+0000","last_peered":"2024-09-13T23:28:29.575012+0000","last_clean":"2024-09-13T23:28:29.575012+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:28:29.575012+0000","last_undegraded":"2024-09-13T23:28:29.575012+0000","last_fullsized":"2024-09-13T23:28:29.575012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330199+0000","last_change":"2024-09-13T23:25:15.287972+0000","last_active":"2024-09-13T23:27:33.330199+0000","last_peered":"2024-09-13T23:27:33.330199+0000","last_clean":"2024-09-13T23:27:33.330199+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:27:33.330199+0000","last_undegraded":"2024-09-13T23:27:33.330199+0000","last_fullsized":"2024-09-13T23:27:33.330199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329990+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:27:28.329990+0000","last_peered":"2024-09-13T23:27:28.329990+0000","last_clean":"2024-09-13T23:27:28.329990+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:27:28.329990+0000","last_undegraded":"2024-09-13T23:27:28.329990+0000","last_fullsized":"2024-09-13T23:27:28.329990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330647+0000","last_change":"2024-09-13T23:25:15.289747+0000","last_active":"2024-09-13T23:27:33.330647+0000","last_peered":"2024-09-13T23:27:33.330647+0000","last_clean":"2024-09-13T23:27:33.330647+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:27:33.330647+0000","last_undegraded":"2024-09-13T23:27:33.330647+0000","last_fullsized":"2024-09-13T23:27:33.330647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330146+0000","last_change":"2024-09-13T23:25:13.286270+0000","last_active":"2024-09-13T23:27:33.330146+0000","last_peered":"2024-09-13T23:27:33.330146+0000","last_clean":"2024-09-13T23:27:33.330146+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:27:33.330146+0000","last_undegraded":"2024-09-13T23:27:33.330146+0000","last_fullsized":"2024-09-13T23:27:33.330146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.843114+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.843114+0000","last_peered":"2024-09-13T23:28:22.843114+0000","last_clean":"2024-09-13T23:28:22.843114+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.843114+0000","last_undegraded":"2024-09-13T23:28:22.843114+0000","last_fullsized":"2024-09-13T23:28:22.843114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330835+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:27:33.330835+0000","last_peered":"2024-09-13T23:27:33.330835+0000","last_clean":"2024-09-13T23:27:33.330835+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:27:33.330835+0000","last_undegraded":"2024-09-13T23:27:33.330835+0000","last_fullsized":"2024-09-13T23:27:33.330835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330568+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:27:33.330568+0000","last_peered":"2024-09-13T23:27:33.330568+0000","last_clean":"2024-09-13T23:27:33.330568+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:27:33.330568+0000","last_undegraded":"2024-09-13T23:27:33.330568+0000","last_fullsized":"2024-09-13T23:27:33.330568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739802+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.739802+0000","last_peered":"2024-09-13T23:28:22.739802+0000","last_clean":"2024-09-13T23:28:22.739802+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.739802+0000","last_undegraded":"2024-09-13T23:28:22.739802+0000","last_fullsized":"2024-09-13T23:28:22.739802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.572075+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:28:29.572075+0000","last_peered":"2024-09-13T23:28:29.572075+0000","last_clean":"2024-09-13T23:28:29.572075+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:28:29.572075+0000","last_undegraded":"2024-09-13T23:28:29.572075+0000","last_fullsized":"2024-09-13T23:28:29.572075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842926+0000","last_change":"2024-09-13T23:25:15.295660+0000","last_active":"2024-09-13T23:28:22.842926+0000","last_peered":"2024-09-13T23:28:22.842926+0000","last_clean":"2024-09-13T23:28:22.842926+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:28:22.842926+0000","last_undegraded":"2024-09-13T23:28:22.842926+0000","last_fullsized":"2024-09-13T23:28:22.842926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1498,"ondisk_log_size":1498,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.531 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.532 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.533 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.534 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.535 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.536 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.537 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.537 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.537 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.538 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.538 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.538 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.539 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.539 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.539 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.539 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.540 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.540 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.540 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.540 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.541 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.541 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.541 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.541 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.542 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.542 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.542 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.542 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.543 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.543 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.543 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.543 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.544 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.544 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.544 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:24:59.389467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=24, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.545 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.546 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.547 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.548 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.549 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T23:25:18.275108+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.550 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.551 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.552 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.553 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.554 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T23:25:20.282175+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.555 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.556 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.557 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.558 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:28:54.559 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:29:14.560 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:29:14.675 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.673+0000 7f369ab42640 1 Processor -- start 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.673+0000 7f369ab42640 1 -- start start 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f369ab42640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f369412f1e0 0x7f3694133a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f369ab42640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369406e9a0 con 0x7f369412e6f0 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f369ab42640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f369412f5f0 con 0x7f369412f1e0 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f3693fff640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f369412f1e0 0x7f3694133a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f36988de640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f369412e6f0 0x7f369412ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:60210/0 (socket says 172.21.15.43:60210) 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f36988de640 1 -- 172.21.15.43:0/70916091 learned_addr learned my addr 172.21.15.43:0/70916091 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f3693fff640 1 -- 172.21.15.43:0/70916091 >> v1:172.21.15.43:6789/0 conn(0x7f369412e6f0 legacy=0x7f369412ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:14.676 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.674+0000 7f3693fff640 1 -- 172.21.15.43:0/70916091 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3694134fc0 con 0x7f369412f1e0 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.675+0000 7f3693fff640 1 --2- 172.21.15.43:0/70916091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412f1e0 0x7f3694133a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3680009720 tx=0x7f368002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80228f3c394b6a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.675+0000 7f36937fe640 1 -- 172.21.15.43:0/70916091 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680037070 con 0x7f369412f1e0 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.675+0000 7f36937fe640 1 -- 172.21.15.43:0/70916091 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368002ad90 con 0x7f369412f1e0 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.675+0000 7f36937fe640 1 -- 172.21.15.43:0/70916091 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680032590 con 0x7f369412f1e0 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 -- 172.21.15.43:0/70916091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412f1e0 msgr2=0x7f3694133a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 --2- 172.21.15.43:0/70916091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412f1e0 0x7f3694133a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3680009720 tx=0x7f368002a110 comp rx=0 tx=0).stop 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 -- 172.21.15.43:0/70916091 shutdown_connections 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 --2- 172.21.15.43:0/70916091 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412f1e0 0x7f3694133a70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 -- 172.21.15.43:0/70916091 >> 172.21.15.43:0/70916091 conn(0x7f369409f020 msgr2=0x7f369409f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:14.678 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 -- 172.21.15.43:0/70916091 shutdown_connections 2024-09-13T23:29:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.676+0000 7f369ab42640 1 -- 172.21.15.43:0/70916091 wait complete. 2024-09-13T23:29:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f369ab42640 1 Processor -- start 2024-09-13T23:29:14.679 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f369ab42640 1 -- start start 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f369ab42640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f369ab42640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f3694134340 con 0x7f369412e6f0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f36988de640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f36988de640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:56758/0 (socket says 172.21.15.43:56758) 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.677+0000 7f36988de640 1 -- 172.21.15.43:0/2743746777 learned_addr learned my addr 172.21.15.43:0/2743746777 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f36988de640 1 -- 172.21.15.43:0/2743746777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3694125720 con 0x7f369412e6f0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f36988de640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f368800c480 tx=0x7f368800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3688017070 con 0x7f369412e6f0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3688005c10 con 0x7f369412e6f0 2024-09-13T23:29:14.681 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36880070d0 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3694124b70 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.678+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3694132350 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.679+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f368801a070 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.679+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369412ead0 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.679+0000 7f36917fa640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 0x7f367803a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.680+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f368804ae30 con 0x7f369412e6f0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.680+0000 7f3693fff640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 0x7f367803a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:14.682 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.680+0000 7f3693fff640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 0x7f367803a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3680034000 tx=0x7f368002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:14.685 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.684+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f368801a520 con 0x7f369412e6f0 2024-09-13T23:29:14.858 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.857+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36941336e0 con 0x7f36780382d0 2024-09-13T23:29:14.876 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.872+0000 7f36917fa640 1 -- 172.21.15.43:0/2743746777 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661885 (secure 0 0 0) 0x7f3680032710 con 0x7f36780382d0 2024-09-13T23:29:14.882 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:29:14.886 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:29:14.887 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 msgr2=0x7f367803a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:14.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 0x7f367803a790 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3680034000 tx=0x7f368002e000 comp rx=0 tx=0).stop 2024-09-13T23:29:14.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 msgr2=0x7f3694131e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:14.888 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f368800c480 tx=0x7f368800c940 comp rx=0 tx=0).stop 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 shutdown_connections 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f36780382d0 0x7f367803a790 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 --2- 172.21.15.43:0/2743746777 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f369412e6f0 0x7f3694131e10 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 >> 172.21.15.43:0/2743746777 conn(0x7f369409f020 msgr2=0x7f3694097530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 shutdown_connections 2024-09-13T23:29:14.889 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:14.877+0000 7f369ab42640 1 -- 172.21.15.43:0/2743746777 wait complete. 2024-09-13T23:29:14.891 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-13T23:29:13.369646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4774,"ondisk_log_size":4774,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144224,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343136,"statfs":{"total":386547056640,"available":386399371264,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003793"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.528875+0000","last_change":"2024-09-13T23:29:04.528904+0000","last_active":"2024-09-13T23:29:04.528875+0000","last_peered":"2024-09-13T23:29:04.528875+0000","last_clean":"2024-09-13T23:29:04.528875+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:29:04.528875+0000","last_undegraded":"2024-09-13T23:29:04.528875+0000","last_fullsized":"2024-09-13T23:29:04.528875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.528789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:50.352443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704068+0000","last_change":"2024-09-13T23:25:15.292965+0000","last_active":"2024-09-13T23:28:22.704068+0000","last_peered":"2024-09-13T23:28:22.704068+0000","last_clean":"2024-09-13T23:28:22.704068+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:28:22.704068+0000","last_undegraded":"2024-09-13T23:28:22.704068+0000","last_fullsized":"2024-09-13T23:28:22.704068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.571099+0000","last_change":"2024-09-13T23:25:13.279739+0000","last_active":"2024-09-13T23:28:29.571099+0000","last_peered":"2024-09-13T23:28:29.571099+0000","last_clean":"2024-09-13T23:28:29.571099+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:28:29.571099+0000","last_undegraded":"2024-09-13T23:28:29.571099+0000","last_fullsized":"2024-09-13T23:28:29.571099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.402553+0000","last_change":"2024-09-13T23:29:11.402579+0000","last_active":"2024-09-13T23:29:11.402553+0000","last_peered":"2024-09-13T23:29:11.402553+0000","last_clean":"2024-09-13T23:29:11.402553+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:29:11.402553+0000","last_undegraded":"2024-09-13T23:29:11.402553+0000","last_fullsized":"2024-09-13T23:29:11.402553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.402459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:44.051975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328566+0000","last_change":"2024-09-13T23:25:13.291709+0000","last_active":"2024-09-13T23:27:18.328566+0000","last_peered":"2024-09-13T23:27:18.328566+0000","last_clean":"2024-09-13T23:27:18.328566+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:27:18.328566+0000","last_undegraded":"2024-09-13T23:27:18.328566+0000","last_fullsized":"2024-09-13T23:27:18.328566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704428+0000","last_change":"2024-09-13T23:25:15.282932+0000","last_active":"2024-09-13T23:28:22.704428+0000","last_peered":"2024-09-13T23:28:22.704428+0000","last_clean":"2024-09-13T23:28:22.704428+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:28:22.704428+0000","last_undegraded":"2024-09-13T23:28:22.704428+0000","last_fullsized":"2024-09-13T23:28:22.704428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.588641+0000","last_change":"2024-09-13T23:29:12.588641+0000","last_active":"2024-09-13T23:29:12.588641+0000","last_peered":"2024-09-13T23:29:12.588641+0000","last_clean":"2024-09-13T23:29:12.588641+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:29:12.588641+0000","last_undegraded":"2024-09-13T23:29:12.588641+0000","last_fullsized":"2024-09-13T23:29:12.588641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.588515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.973454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333076+0000","last_change":"2024-09-13T23:25:15.277733+0000","last_active":"2024-09-13T23:27:48.333076+0000","last_peered":"2024-09-13T23:27:48.333076+0000","last_clean":"2024-09-13T23:27:48.333076+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:27:48.333076+0000","last_undegraded":"2024-09-13T23:27:48.333076+0000","last_fullsized":"2024-09-13T23:27:48.333076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332300+0000","last_change":"2024-09-13T23:25:13.283039+0000","last_active":"2024-09-13T23:27:43.332300+0000","last_peered":"2024-09-13T23:27:43.332300+0000","last_clean":"2024-09-13T23:27:43.332300+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:27:43.332300+0000","last_undegraded":"2024-09-13T23:27:43.332300+0000","last_fullsized":"2024-09-13T23:27:43.332300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.235190+0000","last_change":"2024-09-13T23:29:06.235215+0000","last_active":"2024-09-13T23:29:06.235190+0000","last_peered":"2024-09-13T23:29:06.235190+0000","last_clean":"2024-09-13T23:29:06.235190+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:29:06.235190+0000","last_undegraded":"2024-09-13T23:29:06.235190+0000","last_fullsized":"2024-09-13T23:29:06.235190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.235100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:34.242160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331431+0000","last_change":"2024-09-13T23:25:13.275126+0000","last_active":"2024-09-13T23:27:43.331431+0000","last_peered":"2024-09-13T23:27:43.331431+0000","last_clean":"2024-09-13T23:27:43.331431+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:27:43.331431+0000","last_undegraded":"2024-09-13T23:27:43.331431+0000","last_fullsized":"2024-09-13T23:27:43.331431+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.353065+0000","last_change":"2024-09-13T23:28:54.353102+0000","last_active":"2024-09-13T23:28:54.353065+0000","last_peered":"2024-09-13T23:28:54.353065+0000","last_clean":"2024-09-13T23:28:54.353065+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:54.353065+0000","last_undegraded":"2024-09-13T23:28:54.353065+0000","last_fullsized":"2024-09-13T23:28:54.353065+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.352965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:28.479961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332219+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:27:43.332219+0000","last_peered":"2024-09-13T23:27:43.332219+0000","last_clean":"2024-09-13T23:27:43.332219+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:27:43.332219+0000","last_undegraded":"2024-09-13T23:27:43.332219+0000","last_fullsized":"2024-09-13T23:27:43.332219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.509495+0000","last_change":"2024-09-13T23:29:03.509539+0000","last_active":"2024-09-13T23:29:03.509495+0000","last_peered":"2024-09-13T23:29:03.509495+0000","last_clean":"2024-09-13T23:29:03.509495+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:29:03.509495+0000","last_undegraded":"2024-09-13T23:29:03.509495+0000","last_fullsized":"2024-09-13T23:29:03.509495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.509398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:45.386333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.928159+0000","last_change":"2024-09-13T23:29:06.928236+0000","last_active":"2024-09-13T23:29:06.928159+0000","last_peered":"2024-09-13T23:29:06.928159+0000","last_clean":"2024-09-13T23:29:06.928159+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:29:06.928159+0000","last_undegraded":"2024-09-13T23:29:06.928159+0000","last_fullsized":"2024-09-13T23:29:06.928159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.928056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.581026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328495+0000","last_change":"2024-09-13T23:25:15.291424+0000","last_active":"2024-09-13T23:27:23.328495+0000","last_peered":"2024-09-13T23:27:23.328495+0000","last_clean":"2024-09-13T23:27:23.328495+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:27:23.328495+0000","last_undegraded":"2024-09-13T23:27:23.328495+0000","last_fullsized":"2024-09-13T23:27:23.328495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.396623+0000","last_change":"2024-09-13T23:29:08.396667+0000","last_active":"2024-09-13T23:29:08.396623+0000","last_peered":"2024-09-13T23:29:08.396623+0000","last_clean":"2024-09-13T23:29:08.396623+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:29:08.396623+0000","last_undegraded":"2024-09-13T23:29:08.396623+0000","last_fullsized":"2024-09-13T23:29:08.396623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.396493+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:17.076369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331190+0000","last_change":"2024-09-13T23:25:13.287078+0000","last_active":"2024-09-13T23:27:38.331190+0000","last_peered":"2024-09-13T23:27:38.331190+0000","last_clean":"2024-09-13T23:27:38.331190+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:27:38.331190+0000","last_undegraded":"2024-09-13T23:27:38.331190+0000","last_fullsized":"2024-09-13T23:27:38.331190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.166812+0000","last_change":"2024-09-13T23:29:08.166839+0000","last_active":"2024-09-13T23:29:08.166812+0000","last_peered":"2024-09-13T23:29:08.166812+0000","last_clean":"2024-09-13T23:29:08.166812+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:29:08.166812+0000","last_undegraded":"2024-09-13T23:29:08.166812+0000","last_fullsized":"2024-09-13T23:29:08.166812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.166727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:24.485148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.595148+0000","last_change":"2024-09-13T23:29:06.595179+0000","last_active":"2024-09-13T23:29:06.595148+0000","last_peered":"2024-09-13T23:29:06.595148+0000","last_clean":"2024-09-13T23:29:06.595148+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:29:06.595148+0000","last_undegraded":"2024-09-13T23:29:06.595148+0000","last_fullsized":"2024-09-13T23:29:06.595148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.595032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.144296+0000","last_change":"2024-09-13T23:29:09.144341+0000","last_active":"2024-09-13T23:29:09.144296+0000","last_peered":"2024-09-13T23:29:09.144296+0000","last_clean":"2024-09-13T23:29:09.144296+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:29:09.144296+0000","last_undegraded":"2024-09-13T23:29:09.144296+0000","last_fullsized":"2024-09-13T23:29:09.144296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.144187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:54:48.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331140+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:27:38.331140+0000","last_peered":"2024-09-13T23:27:38.331140+0000","last_clean":"2024-09-13T23:27:38.331140+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:27:38.331140+0000","last_undegraded":"2024-09-13T23:27:38.331140+0000","last_fullsized":"2024-09-13T23:27:38.331140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.890183+0000","last_change":"2024-09-13T23:29:07.890225+0000","last_active":"2024-09-13T23:29:07.890183+0000","last_peered":"2024-09-13T23:29:07.890183+0000","last_clean":"2024-09-13T23:29:07.890183+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:29:07.890183+0000","last_undegraded":"2024-09-13T23:29:07.890183+0000","last_fullsized":"2024-09-13T23:29:07.890183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.890094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.804774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331120+0000","last_change":"2024-09-13T23:25:13.276465+0000","last_active":"2024-09-13T23:27:38.331120+0000","last_peered":"2024-09-13T23:27:38.331120+0000","last_clean":"2024-09-13T23:27:38.331120+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:27:38.331120+0000","last_undegraded":"2024-09-13T23:27:38.331120+0000","last_fullsized":"2024-09-13T23:27:38.331120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.639015+0000","last_change":"2024-09-13T23:28:56.639079+0000","last_active":"2024-09-13T23:28:56.639015+0000","last_peered":"2024-09-13T23:28:56.639015+0000","last_clean":"2024-09-13T23:28:56.639015+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:28:56.639015+0000","last_undegraded":"2024-09-13T23:28:56.639015+0000","last_fullsized":"2024-09-13T23:28:56.639015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.638914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:33.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330189+0000","last_change":"2024-09-13T23:25:13.280884+0000","last_active":"2024-09-13T23:27:41.330189+0000","last_peered":"2024-09-13T23:27:41.330189+0000","last_clean":"2024-09-13T23:27:41.330189+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:27:41.330189+0000","last_undegraded":"2024-09-13T23:27:41.330189+0000","last_fullsized":"2024-09-13T23:27:41.330189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.213714+0000","last_change":"2024-09-13T23:29:07.213741+0000","last_active":"2024-09-13T23:29:07.213714+0000","last_peered":"2024-09-13T23:29:07.213714+0000","last_clean":"2024-09-13T23:29:07.213714+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:29:07.213714+0000","last_undegraded":"2024-09-13T23:29:07.213714+0000","last_fullsized":"2024-09-13T23:29:07.213714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.213605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:01.540063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330686+0000","last_change":"2024-09-13T23:25:13.281928+0000","last_active":"2024-09-13T23:27:33.330686+0000","last_peered":"2024-09-13T23:27:33.330686+0000","last_clean":"2024-09-13T23:27:33.330686+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:27:33.330686+0000","last_undegraded":"2024-09-13T23:27:33.330686+0000","last_fullsized":"2024-09-13T23:27:33.330686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'35","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.748239+0000","last_change":"2024-09-13T23:25:23.316244+0000","last_active":"2024-09-13T23:28:22.748239+0000","last_peered":"2024-09-13T23:28:22.748239+0000","last_clean":"2024-09-13T23:28:22.748239+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:28:22.748239+0000","last_undegraded":"2024-09-13T23:28:22.748239+0000","last_fullsized":"2024-09-13T23:28:22.748239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.382312+0000","last_change":"2024-09-13T23:25:15.279328+0000","last_active":"2024-09-13T23:28:22.382312+0000","last_peered":"2024-09-13T23:28:22.382312+0000","last_clean":"2024-09-13T23:28:22.382312+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:28:22.382312+0000","last_undegraded":"2024-09-13T23:28:22.382312+0000","last_fullsized":"2024-09-13T23:28:22.382312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330720+0000","last_change":"2024-09-13T23:25:13.283296+0000","last_active":"2024-09-13T23:27:33.330720+0000","last_peered":"2024-09-13T23:27:33.330720+0000","last_clean":"2024-09-13T23:27:33.330720+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:27:33.330720+0000","last_undegraded":"2024-09-13T23:27:33.330720+0000","last_fullsized":"2024-09-13T23:27:33.330720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.412219+0000","last_change":"2024-09-13T23:28:35.412268+0000","last_active":"2024-09-13T23:28:35.412219+0000","last_peered":"2024-09-13T23:28:35.412219+0000","last_clean":"2024-09-13T23:28:35.412219+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:28:35.412219+0000","last_undegraded":"2024-09-13T23:28:35.412219+0000","last_fullsized":"2024-09-13T23:28:35.412219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.412096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:03.433021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.403834+0000","last_change":"2024-09-13T23:28:53.403875+0000","last_active":"2024-09-13T23:28:53.403834+0000","last_peered":"2024-09-13T23:28:53.403834+0000","last_clean":"2024-09-13T23:28:53.403834+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:53.403834+0000","last_undegraded":"2024-09-13T23:28:53.403834+0000","last_fullsized":"2024-09-13T23:28:53.403834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.403743+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:52.708366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.383764+0000","last_change":"2024-09-13T23:28:42.383806+0000","last_active":"2024-09-13T23:28:42.383764+0000","last_peered":"2024-09-13T23:28:42.383764+0000","last_clean":"2024-09-13T23:28:42.383764+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:28:42.383764+0000","last_undegraded":"2024-09-13T23:28:42.383764+0000","last_fullsized":"2024-09-13T23:28:42.383764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.383654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:23.582962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.332553+0000","last_change":"2024-09-13T23:25:23.316117+0000","last_active":"2024-09-13T23:27:48.332553+0000","last_peered":"2024-09-13T23:27:48.332553+0000","last_clean":"2024-09-13T23:27:48.332553+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:27:48.332553+0000","last_undegraded":"2024-09-13T23:27:48.332553+0000","last_fullsized":"2024-09-13T23:27:48.332553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842761+0000","last_change":"2024-09-13T23:25:15.279992+0000","last_active":"2024-09-13T23:28:22.842761+0000","last_peered":"2024-09-13T23:28:22.842761+0000","last_clean":"2024-09-13T23:28:22.842761+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:28:22.842761+0000","last_undegraded":"2024-09-13T23:28:22.842761+0000","last_fullsized":"2024-09-13T23:28:22.842761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330065+0000","last_change":"2024-09-13T23:25:13.285563+0000","last_active":"2024-09-13T23:27:33.330065+0000","last_peered":"2024-09-13T23:27:33.330065+0000","last_clean":"2024-09-13T23:27:33.330065+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:27:33.330065+0000","last_undegraded":"2024-09-13T23:27:33.330065+0000","last_fullsized":"2024-09-13T23:27:33.330065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:13.336031+0000","last_change":"2024-09-13T23:25:52.381577+0000","last_active":"2024-09-13T23:28:13.336031+0000","last_peered":"2024-09-13T23:28:13.336031+0000","last_clean":"2024-09-13T23:28:13.336031+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:28:13.336031+0000","last_undegraded":"2024-09-13T23:28:13.336031+0000","last_fullsized":"2024-09-13T23:28:13.336031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.401547+0000","last_change":"2024-09-13T23:28:39.401603+0000","last_active":"2024-09-13T23:28:39.401547+0000","last_peered":"2024-09-13T23:28:39.401547+0000","last_clean":"2024-09-13T23:28:39.401547+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:28:39.401547+0000","last_undegraded":"2024-09-13T23:28:39.401547+0000","last_fullsized":"2024-09-13T23:28:39.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.401441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:23.948110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.453172+0000","last_change":"2024-09-13T23:28:34.453193+0000","last_active":"2024-09-13T23:28:34.453172+0000","last_peered":"2024-09-13T23:28:34.453172+0000","last_clean":"2024-09-13T23:28:34.453172+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:28:34.453172+0000","last_undegraded":"2024-09-13T23:28:34.453172+0000","last_fullsized":"2024-09-13T23:28:34.453172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.453082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:39.061568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.486705+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.486705+0000","last_peered":"2024-09-13T23:28:22.486705+0000","last_clean":"2024-09-13T23:28:22.486705+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.486705+0000","last_undegraded":"2024-09-13T23:28:22.486705+0000","last_fullsized":"2024-09-13T23:28:22.486705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332451+0000","last_change":"2024-09-13T23:25:15.278920+0000","last_active":"2024-09-13T23:27:43.332451+0000","last_peered":"2024-09-13T23:27:43.332451+0000","last_clean":"2024-09-13T23:27:43.332451+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:27:43.332451+0000","last_undegraded":"2024-09-13T23:27:43.332451+0000","last_fullsized":"2024-09-13T23:27:43.332451+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330627+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:27:33.330627+0000","last_peered":"2024-09-13T23:27:33.330627+0000","last_clean":"2024-09-13T23:27:33.330627+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:27:33.330627+0000","last_undegraded":"2024-09-13T23:27:33.330627+0000","last_fullsized":"2024-09-13T23:27:33.330627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.916935+0000","last_change":"2024-09-13T23:28:50.917010+0000","last_active":"2024-09-13T23:28:50.916935+0000","last_peered":"2024-09-13T23:28:50.916935+0000","last_clean":"2024-09-13T23:28:50.916935+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:28:50.916935+0000","last_undegraded":"2024-09-13T23:28:50.916935+0000","last_fullsized":"2024-09-13T23:28:50.916935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.916803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:55.569318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.835923+0000","last_change":"2024-09-13T23:28:43.835968+0000","last_active":"2024-09-13T23:28:43.835923+0000","last_peered":"2024-09-13T23:28:43.835923+0000","last_clean":"2024-09-13T23:28:43.835923+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:28:43.835923+0000","last_undegraded":"2024-09-13T23:28:43.835923+0000","last_fullsized":"2024-09-13T23:28:43.835923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.835830+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.336311+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":393,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.332450+0000","last_change":"2024-09-13T23:28:58.332504+0000","last_active":"2024-09-13T23:28:58.332450+0000","last_peered":"2024-09-13T23:28:58.332450+0000","last_clean":"2024-09-13T23:28:58.332450+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:58.332450+0000","last_undegraded":"2024-09-13T23:28:58.332450+0000","last_fullsized":"2024-09-13T23:28:58.332450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.332349+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:44.416231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.332766+0000","last_change":"2024-09-13T23:25:23.309250+0000","last_active":"2024-09-13T23:27:53.332766+0000","last_peered":"2024-09-13T23:27:53.332766+0000","last_clean":"2024-09-13T23:27:53.332766+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:27:53.332766+0000","last_undegraded":"2024-09-13T23:27:53.332766+0000","last_fullsized":"2024-09-13T23:27:53.332766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.847241+0000","last_change":"2024-09-13T23:28:59.847269+0000","last_active":"2024-09-13T23:28:59.847241+0000","last_peered":"2024-09-13T23:28:59.847241+0000","last_clean":"2024-09-13T23:28:59.847241+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:59.847241+0000","last_undegraded":"2024-09-13T23:28:59.847241+0000","last_fullsized":"2024-09-13T23:28:59.847241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.847154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:32.418333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.073919+0000","last_change":"2024-09-13T23:29:11.073943+0000","last_active":"2024-09-13T23:29:11.073919+0000","last_peered":"2024-09-13T23:29:11.073919+0000","last_clean":"2024-09-13T23:29:11.073919+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:29:11.073919+0000","last_undegraded":"2024-09-13T23:29:11.073919+0000","last_fullsized":"2024-09-13T23:29:11.073919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.073831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:30.480544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.432327+0000","last_change":"2024-09-13T23:28:42.432355+0000","last_active":"2024-09-13T23:28:42.432327+0000","last_peered":"2024-09-13T23:28:42.432327+0000","last_clean":"2024-09-13T23:28:42.432327+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:28:42.432327+0000","last_undegraded":"2024-09-13T23:28:42.432327+0000","last_fullsized":"2024-09-13T23:28:42.432327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.432240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.272484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.853868+0000","last_change":"2024-09-13T23:28:42.853928+0000","last_active":"2024-09-13T23:28:42.853868+0000","last_peered":"2024-09-13T23:28:42.853868+0000","last_clean":"2024-09-13T23:28:42.853868+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:42.853868+0000","last_undegraded":"2024-09-13T23:28:42.853868+0000","last_fullsized":"2024-09-13T23:28:42.853868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.853764+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:24.964571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.867464+0000","last_change":"2024-09-13T23:28:37.867494+0000","last_active":"2024-09-13T23:28:37.867464+0000","last_peered":"2024-09-13T23:28:37.867464+0000","last_clean":"2024-09-13T23:28:37.867464+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:37.867464+0000","last_undegraded":"2024-09-13T23:28:37.867464+0000","last_fullsized":"2024-09-13T23:28:37.867464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.867370+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:50.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.383200+0000","last_change":"2024-09-13T23:28:48.383237+0000","last_active":"2024-09-13T23:28:48.383200+0000","last_peered":"2024-09-13T23:28:48.383200+0000","last_clean":"2024-09-13T23:28:48.383200+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:48.383200+0000","last_undegraded":"2024-09-13T23:28:48.383200+0000","last_fullsized":"2024-09-13T23:28:48.383200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.383091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:30.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.539887+0000","last_change":"2024-09-13T23:29:00.539913+0000","last_active":"2024-09-13T23:29:00.539887+0000","last_peered":"2024-09-13T23:29:00.539887+0000","last_clean":"2024-09-13T23:29:00.539887+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:29:00.539887+0000","last_undegraded":"2024-09-13T23:29:00.539887+0000","last_fullsized":"2024-09-13T23:29:00.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.539784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:15.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.221445+0000","last_change":"2024-09-13T23:28:48.221472+0000","last_active":"2024-09-13T23:28:48.221445+0000","last_peered":"2024-09-13T23:28:48.221445+0000","last_clean":"2024-09-13T23:28:48.221445+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:28:48.221445+0000","last_undegraded":"2024-09-13T23:28:48.221445+0000","last_fullsized":"2024-09-13T23:28:48.221445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.221353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:59.646033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.789042+0000","last_change":"2024-09-13T23:28:38.789114+0000","last_active":"2024-09-13T23:28:38.789042+0000","last_peered":"2024-09-13T23:28:38.789042+0000","last_clean":"2024-09-13T23:28:38.789042+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:38.789042+0000","last_undegraded":"2024-09-13T23:28:38.789042+0000","last_fullsized":"2024-09-13T23:28:38.789042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.788930+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:52.119474+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.797110+0000","last_change":"2024-09-13T23:28:35.797133+0000","last_active":"2024-09-13T23:28:35.797110+0000","last_peered":"2024-09-13T23:28:35.797110+0000","last_clean":"2024-09-13T23:28:35.797110+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:28:35.797110+0000","last_undegraded":"2024-09-13T23:28:35.797110+0000","last_fullsized":"2024-09-13T23:28:35.797110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.797014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.737015+0000","last_change":"2024-09-13T23:25:23.314735+0000","last_active":"2024-09-13T23:28:22.737015+0000","last_peered":"2024-09-13T23:28:22.737015+0000","last_clean":"2024-09-13T23:28:22.737015+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:28:22.737015+0000","last_undegraded":"2024-09-13T23:28:22.737015+0000","last_fullsized":"2024-09-13T23:28:22.737015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.193171+0000","last_change":"2024-09-13T23:29:05.193218+0000","last_active":"2024-09-13T23:29:05.193171+0000","last_peered":"2024-09-13T23:29:05.193171+0000","last_clean":"2024-09-13T23:29:05.193171+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:29:05.193171+0000","last_undegraded":"2024-09-13T23:29:05.193171+0000","last_fullsized":"2024-09-13T23:29:05.193171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.193061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:54.252627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.571953+0000","last_change":"2024-09-13T23:25:13.283774+0000","last_active":"2024-09-13T23:28:29.571953+0000","last_peered":"2024-09-13T23:28:29.571953+0000","last_clean":"2024-09-13T23:28:29.571953+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:28:29.571953+0000","last_undegraded":"2024-09-13T23:28:29.571953+0000","last_fullsized":"2024-09-13T23:28:29.571953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.878000+0000","last_change":"2024-09-13T23:28:47.878026+0000","last_active":"2024-09-13T23:28:47.878000+0000","last_peered":"2024-09-13T23:28:47.878000+0000","last_clean":"2024-09-13T23:28:47.878000+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:28:47.878000+0000","last_undegraded":"2024-09-13T23:28:47.878000+0000","last_fullsized":"2024-09-13T23:28:47.878000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.877888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:24.096380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.395633+0000","last_change":"2024-09-13T23:28:41.395683+0000","last_active":"2024-09-13T23:28:41.395633+0000","last_peered":"2024-09-13T23:28:41.395633+0000","last_clean":"2024-09-13T23:28:41.395633+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:41.395633+0000","last_undegraded":"2024-09-13T23:28:41.395633+0000","last_fullsized":"2024-09-13T23:28:41.395633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.395529+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:16.720847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.869542+0000","last_change":"2024-09-13T23:28:49.869568+0000","last_active":"2024-09-13T23:28:49.869542+0000","last_peered":"2024-09-13T23:28:49.869542+0000","last_clean":"2024-09-13T23:28:49.869542+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:28:49.869542+0000","last_undegraded":"2024-09-13T23:28:49.869542+0000","last_fullsized":"2024-09-13T23:28:49.869542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.869451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.241159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.227024+0000","last_change":"2024-09-13T23:28:50.227072+0000","last_active":"2024-09-13T23:28:50.227024+0000","last_peered":"2024-09-13T23:28:50.227024+0000","last_clean":"2024-09-13T23:28:50.227024+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:28:50.227024+0000","last_undegraded":"2024-09-13T23:28:50.227024+0000","last_fullsized":"2024-09-13T23:28:50.227024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.226940+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.317457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.574276+0000","last_change":"2024-09-13T23:29:01.574304+0000","last_active":"2024-09-13T23:29:01.574276+0000","last_peered":"2024-09-13T23:29:01.574276+0000","last_clean":"2024-09-13T23:29:01.574276+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:29:01.574276+0000","last_undegraded":"2024-09-13T23:29:01.574276+0000","last_fullsized":"2024-09-13T23:29:01.574276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.574185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:53.945893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.572149+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:28:29.572149+0000","last_peered":"2024-09-13T23:28:29.572149+0000","last_clean":"2024-09-13T23:28:29.572149+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:28:29.572149+0000","last_undegraded":"2024-09-13T23:28:29.572149+0000","last_fullsized":"2024-09-13T23:28:29.572149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.848048+0000","last_change":"2024-09-13T23:28:52.848076+0000","last_active":"2024-09-13T23:28:52.848048+0000","last_peered":"2024-09-13T23:28:52.848048+0000","last_clean":"2024-09-13T23:28:52.848048+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:28:52.848048+0000","last_undegraded":"2024-09-13T23:28:52.848048+0000","last_fullsized":"2024-09-13T23:28:52.848048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.847961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.924204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'47","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.373548+0000","last_change":"2024-09-13T23:29:02.373593+0000","last_active":"2024-09-13T23:29:02.373548+0000","last_peered":"2024-09-13T23:29:02.373548+0000","last_clean":"2024-09-13T23:29:02.373548+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:29:02.373548+0000","last_undegraded":"2024-09-13T23:29:02.373548+0000","last_fullsized":"2024-09-13T23:29:02.373548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.373443+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:09.196717+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":360,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.901602+0000","last_change":"2024-09-13T23:28:57.901638+0000","last_active":"2024-09-13T23:28:57.901602+0000","last_peered":"2024-09-13T23:28:57.901602+0000","last_clean":"2024-09-13T23:28:57.901602+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:57.901602+0000","last_undegraded":"2024-09-13T23:28:57.901602+0000","last_fullsized":"2024-09-13T23:28:57.901602+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.901512+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:41.619080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:36.329396+0000","last_change":"2024-09-13T23:25:23.305825+0000","last_active":"2024-09-13T23:27:36.329396+0000","last_peered":"2024-09-13T23:27:36.329396+0000","last_clean":"2024-09-13T23:27:36.329396+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:27:36.329396+0000","last_undegraded":"2024-09-13T23:27:36.329396+0000","last_fullsized":"2024-09-13T23:27:36.329396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.672169+0000","last_change":"2024-09-13T23:28:55.672214+0000","last_active":"2024-09-13T23:28:55.672169+0000","last_peered":"2024-09-13T23:28:55.672169+0000","last_clean":"2024-09-13T23:28:55.672169+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:55.672169+0000","last_undegraded":"2024-09-13T23:28:55.672169+0000","last_fullsized":"2024-09-13T23:28:55.672169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.672076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:02.488271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329931+0000","last_change":"2024-09-13T23:25:13.281343+0000","last_active":"2024-09-13T23:27:28.329931+0000","last_peered":"2024-09-13T23:27:28.329931+0000","last_clean":"2024-09-13T23:27:28.329931+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:27:28.329931+0000","last_undegraded":"2024-09-13T23:27:28.329931+0000","last_fullsized":"2024-09-13T23:27:28.329931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.872634+0000","last_change":"2024-09-13T23:28:51.872681+0000","last_active":"2024-09-13T23:28:51.872634+0000","last_peered":"2024-09-13T23:28:51.872634+0000","last_clean":"2024-09-13T23:28:51.872634+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:28:51.872634+0000","last_undegraded":"2024-09-13T23:28:51.872634+0000","last_fullsized":"2024-09-13T23:28:51.872634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.872543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:15.808273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":139,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.300257+0000","last_change":"2024-09-13T23:29:00.300292+0000","last_active":"2024-09-13T23:29:00.300257+0000","last_peered":"2024-09-13T23:29:00.300257+0000","last_clean":"2024-09-13T23:29:00.300257+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:29:00.300257+0000","last_undegraded":"2024-09-13T23:29:00.300257+0000","last_fullsized":"2024-09-13T23:29:00.300257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'66","last_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_deep_scrub":"33'66","last_deep_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.300157+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:45.866727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.841670+0000","last_change":"2024-09-13T23:28:34.841693+0000","last_active":"2024-09-13T23:28:34.841670+0000","last_peered":"2024-09-13T23:28:34.841670+0000","last_clean":"2024-09-13T23:28:34.841670+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:28:34.841670+0000","last_undegraded":"2024-09-13T23:28:34.841670+0000","last_fullsized":"2024-09-13T23:28:34.841670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.841569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:03.926916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966018+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.966018+0000","last_peered":"2024-09-13T23:28:22.966018+0000","last_clean":"2024-09-13T23:28:22.966018+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.966018+0000","last_undegraded":"2024-09-13T23:28:22.966018+0000","last_fullsized":"2024-09-13T23:28:22.966018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.232888+0000","last_change":"2024-09-13T23:28:57.232952+0000","last_active":"2024-09-13T23:28:57.232888+0000","last_peered":"2024-09-13T23:28:57.232888+0000","last_clean":"2024-09-13T23:28:57.232888+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:57.232888+0000","last_undegraded":"2024-09-13T23:28:57.232888+0000","last_fullsized":"2024-09-13T23:28:57.232888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.232786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:36.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.864586+0000","last_change":"2024-09-13T23:29:08.864615+0000","last_active":"2024-09-13T23:29:08.864586+0000","last_peered":"2024-09-13T23:29:08.864586+0000","last_clean":"2024-09-13T23:29:08.864586+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:29:08.864586+0000","last_undegraded":"2024-09-13T23:29:08.864586+0000","last_fullsized":"2024-09-13T23:29:08.864586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.864495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:40.831517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.688105+0000","last_change":"2024-09-13T23:28:50.688153+0000","last_active":"2024-09-13T23:28:50.688105+0000","last_peered":"2024-09-13T23:28:50.688105+0000","last_clean":"2024-09-13T23:28:50.688105+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:28:50.688105+0000","last_undegraded":"2024-09-13T23:28:50.688105+0000","last_fullsized":"2024-09-13T23:28:50.688105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.687998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:09.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.386681+0000","last_change":"2024-09-13T23:28:43.386721+0000","last_active":"2024-09-13T23:28:43.386681+0000","last_peered":"2024-09-13T23:28:43.386681+0000","last_clean":"2024-09-13T23:28:43.386681+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:43.386681+0000","last_undegraded":"2024-09-13T23:28:43.386681+0000","last_fullsized":"2024-09-13T23:28:43.386681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.386578+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.830372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.325018+0000","last_change":"2024-09-13T23:29:01.325076+0000","last_active":"2024-09-13T23:29:01.325018+0000","last_peered":"2024-09-13T23:29:01.325018+0000","last_clean":"2024-09-13T23:29:01.325018+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:29:01.325018+0000","last_undegraded":"2024-09-13T23:29:01.325018+0000","last_fullsized":"2024-09-13T23:29:01.325018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.324903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:21.454194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'3","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.845978+0000","last_change":"2024-09-13T23:25:23.312154+0000","last_active":"2024-09-13T23:28:22.845978+0000","last_peered":"2024-09-13T23:28:22.845978+0000","last_clean":"2024-09-13T23:28:22.845978+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:28:22.845978+0000","last_undegraded":"2024-09-13T23:28:22.845978+0000","last_fullsized":"2024-09-13T23:28:22.845978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.447280+0000","last_change":"2024-09-13T23:28:52.447307+0000","last_active":"2024-09-13T23:28:52.447280+0000","last_peered":"2024-09-13T23:28:52.447280+0000","last_clean":"2024-09-13T23:28:52.447280+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:52.447280+0000","last_undegraded":"2024-09-13T23:28:52.447280+0000","last_fullsized":"2024-09-13T23:28:52.447280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.447192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:03.543667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329222+0000","last_change":"2024-09-13T23:25:13.281819+0000","last_active":"2024-09-13T23:27:23.329222+0000","last_peered":"2024-09-13T23:27:23.329222+0000","last_clean":"2024-09-13T23:27:23.329222+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:27:23.329222+0000","last_undegraded":"2024-09-13T23:27:23.329222+0000","last_fullsized":"2024-09-13T23:27:23.329222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.843970+0000","last_change":"2024-09-13T23:28:48.844011+0000","last_active":"2024-09-13T23:28:48.843970+0000","last_peered":"2024-09-13T23:28:48.843970+0000","last_clean":"2024-09-13T23:28:48.843970+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:28:48.843970+0000","last_undegraded":"2024-09-13T23:28:48.843970+0000","last_fullsized":"2024-09-13T23:28:48.843970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.843846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:04.241715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.801671+0000","last_change":"2024-09-13T23:28:44.801707+0000","last_active":"2024-09-13T23:28:44.801671+0000","last_peered":"2024-09-13T23:28:44.801671+0000","last_clean":"2024-09-13T23:28:44.801671+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:44.801671+0000","last_undegraded":"2024-09-13T23:28:44.801671+0000","last_fullsized":"2024-09-13T23:28:44.801671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.801589+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:14.458499+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.752376+0000","last_change":"2024-09-13T23:28:33.752406+0000","last_active":"2024-09-13T23:28:33.752376+0000","last_peered":"2024-09-13T23:28:33.752376+0000","last_clean":"2024-09-13T23:28:33.752376+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:33.752376+0000","last_undegraded":"2024-09-13T23:28:33.752376+0000","last_fullsized":"2024-09-13T23:28:33.752376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.752282+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:30.865050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.848909+0000","last_change":"2024-09-13T23:29:01.848945+0000","last_active":"2024-09-13T23:29:01.848909+0000","last_peered":"2024-09-13T23:29:01.848909+0000","last_clean":"2024-09-13T23:29:01.848909+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:29:01.848909+0000","last_undegraded":"2024-09-13T23:29:01.848909+0000","last_fullsized":"2024-09-13T23:29:01.848909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.848809+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:59.151044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.562134+0000","last_change":"2024-09-13T23:29:09.562160+0000","last_active":"2024-09-13T23:29:09.562134+0000","last_peered":"2024-09-13T23:29:09.562134+0000","last_clean":"2024-09-13T23:29:09.562134+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:29:09.562134+0000","last_undegraded":"2024-09-13T23:29:09.562134+0000","last_fullsized":"2024-09-13T23:29:09.562134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.562025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:49.934234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329138+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:27:23.329138+0000","last_peered":"2024-09-13T23:27:23.329138+0000","last_clean":"2024-09-13T23:27:23.329138+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:27:23.329138+0000","last_undegraded":"2024-09-13T23:27:23.329138+0000","last_fullsized":"2024-09-13T23:27:23.329138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.183560+0000","last_change":"2024-09-13T23:28:49.183590+0000","last_active":"2024-09-13T23:28:49.183560+0000","last_peered":"2024-09-13T23:28:49.183560+0000","last_clean":"2024-09-13T23:28:49.183560+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:49.183560+0000","last_undegraded":"2024-09-13T23:28:49.183560+0000","last_fullsized":"2024-09-13T23:28:49.183560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.183478+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:30.265049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.395542+0000","last_change":"2024-09-13T23:29:04.395583+0000","last_active":"2024-09-13T23:29:04.395542+0000","last_peered":"2024-09-13T23:29:04.395542+0000","last_clean":"2024-09-13T23:29:04.395542+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:29:04.395542+0000","last_undegraded":"2024-09-13T23:29:04.395542+0000","last_fullsized":"2024-09-13T23:29:04.395542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.395455+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:53.348397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":480,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425677+0000","last_change":"2024-09-13T23:28:36.425723+0000","last_active":"2024-09-13T23:28:36.425677+0000","last_peered":"2024-09-13T23:28:36.425677+0000","last_clean":"2024-09-13T23:28:36.425677+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:36.425677+0000","last_undegraded":"2024-09-13T23:28:36.425677+0000","last_fullsized":"2024-09-13T23:28:36.425677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.425562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.620126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.994750+0000","last_change":"2024-09-13T23:25:23.305793+0000","last_active":"2024-09-13T23:28:22.994750+0000","last_peered":"2024-09-13T23:28:22.994750+0000","last_clean":"2024-09-13T23:28:22.994750+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:28:22.994750+0000","last_undegraded":"2024-09-13T23:28:22.994750+0000","last_fullsized":"2024-09-13T23:28:22.994750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.185495+0000","last_change":"2024-09-13T23:29:01.185521+0000","last_active":"2024-09-13T23:29:01.185495+0000","last_peered":"2024-09-13T23:29:01.185495+0000","last_clean":"2024-09-13T23:29:01.185495+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:29:01.185495+0000","last_undegraded":"2024-09-13T23:29:01.185495+0000","last_fullsized":"2024-09-13T23:29:01.185495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.185393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:49.860619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329082+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:27:23.329082+0000","last_peered":"2024-09-13T23:27:23.329082+0000","last_clean":"2024-09-13T23:27:23.329082+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:27:23.329082+0000","last_undegraded":"2024-09-13T23:27:23.329082+0000","last_fullsized":"2024-09-13T23:27:23.329082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.394317+0000","last_change":"2024-09-13T23:28:38.394345+0000","last_active":"2024-09-13T23:28:38.394317+0000","last_peered":"2024-09-13T23:28:38.394317+0000","last_clean":"2024-09-13T23:28:38.394317+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:28:38.394317+0000","last_undegraded":"2024-09-13T23:28:38.394317+0000","last_fullsized":"2024-09-13T23:28:38.394317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.394212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:21.836246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.343811+0000","last_change":"2024-09-13T23:28:44.343852+0000","last_active":"2024-09-13T23:28:44.343811+0000","last_peered":"2024-09-13T23:28:44.343811+0000","last_clean":"2024-09-13T23:28:44.343811+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:44.343811+0000","last_undegraded":"2024-09-13T23:28:44.343811+0000","last_fullsized":"2024-09-13T23:28:44.343811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.343715+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.109483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.818959+0000","last_change":"2024-09-13T23:28:41.818982+0000","last_active":"2024-09-13T23:28:41.818959+0000","last_peered":"2024-09-13T23:28:41.818959+0000","last_clean":"2024-09-13T23:28:41.818959+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:28:41.818959+0000","last_undegraded":"2024-09-13T23:28:41.818959+0000","last_fullsized":"2024-09-13T23:28:41.818959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.818869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:39:47.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.308424+0000","last_change":"2024-09-13T23:28:46.308494+0000","last_active":"2024-09-13T23:28:46.308424+0000","last_peered":"2024-09-13T23:28:46.308424+0000","last_clean":"2024-09-13T23:28:46.308424+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:46.308424+0000","last_undegraded":"2024-09-13T23:28:46.308424+0000","last_fullsized":"2024-09-13T23:28:46.308424+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.308315+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:05.222355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:58.333686+0000","last_change":"2024-09-13T23:25:52.391379+0000","last_active":"2024-09-13T23:27:58.333686+0000","last_peered":"2024-09-13T23:27:58.333686+0000","last_clean":"2024-09-13T23:27:58.333686+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:27:58.333686+0000","last_undegraded":"2024-09-13T23:27:58.333686+0000","last_fullsized":"2024-09-13T23:27:58.333686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.934544+0000","last_change":"2024-09-13T23:25:01.121874+0000","last_active":"2024-09-13T23:28:32.934544+0000","last_peered":"2024-09-13T23:28:32.934544+0000","last_clean":"2024-09-13T23:28:32.934544+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:28:32.934544+0000","last_undegraded":"2024-09-13T23:28:32.934544+0000","last_fullsized":"2024-09-13T23:28:32.934544+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:24:59.389467+0000","last_clean_scrub_stamp":"2024-09-13T23:24:59.389467+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327868+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:27:13.327868+0000","last_peered":"2024-09-13T23:27:13.327868+0000","last_clean":"2024-09-13T23:27:13.327868+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:27:13.327868+0000","last_undegraded":"2024-09-13T23:27:13.327868+0000","last_fullsized":"2024-09-13T23:27:13.327868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328472+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:27:18.328472+0000","last_peered":"2024-09-13T23:27:18.328472+0000","last_clean":"2024-09-13T23:27:18.328472+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:27:18.328472+0000","last_undegraded":"2024-09-13T23:27:18.328472+0000","last_fullsized":"2024-09-13T23:27:18.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.221148+0000","last_change":"2024-09-13T23:28:53.221206+0000","last_active":"2024-09-13T23:28:53.221148+0000","last_peered":"2024-09-13T23:28:53.221148+0000","last_clean":"2024-09-13T23:28:53.221148+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:28:53.221148+0000","last_undegraded":"2024-09-13T23:28:53.221148+0000","last_fullsized":"2024-09-13T23:28:53.221148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.221045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:28.166667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'92","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.357703+0000","last_change":"2024-09-13T23:29:06.357739+0000","last_active":"2024-09-13T23:29:06.357703+0000","last_peered":"2024-09-13T23:29:06.357703+0000","last_clean":"2024-09-13T23:29:06.357703+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:29:06.357703+0000","last_undegraded":"2024-09-13T23:29:06.357703+0000","last_fullsized":"2024-09-13T23:29:06.357703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.357608+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:02.482328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.823638+0000","last_change":"2024-09-13T23:28:53.823673+0000","last_active":"2024-09-13T23:28:53.823638+0000","last_peered":"2024-09-13T23:28:53.823638+0000","last_clean":"2024-09-13T23:28:53.823638+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:28:53.823638+0000","last_undegraded":"2024-09-13T23:28:53.823638+0000","last_fullsized":"2024-09-13T23:28:53.823638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.823527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:30.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.737352+0000","last_change":"2024-09-13T23:28:49.737380+0000","last_active":"2024-09-13T23:28:49.737352+0000","last_peered":"2024-09-13T23:28:49.737352+0000","last_clean":"2024-09-13T23:28:49.737352+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:49.737352+0000","last_undegraded":"2024-09-13T23:28:49.737352+0000","last_fullsized":"2024-09-13T23:28:49.737352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.737262+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:19.374870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'11","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842760+0000","last_change":"2024-09-13T23:25:15.279033+0000","last_active":"2024-09-13T23:28:22.842760+0000","last_peered":"2024-09-13T23:28:22.842760+0000","last_clean":"2024-09-13T23:28:22.842760+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:28:22.842760+0000","last_undegraded":"2024-09-13T23:28:22.842760+0000","last_fullsized":"2024-09-13T23:28:22.842760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807657+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:28:33.807657+0000","last_peered":"2024-09-13T23:28:33.807657+0000","last_clean":"2024-09-13T23:28:33.807657+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:28:33.807657+0000","last_undegraded":"2024-09-13T23:28:33.807657+0000","last_fullsized":"2024-09-13T23:28:33.807657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.570552+0000","last_change":"2024-09-13T23:25:13.277883+0000","last_active":"2024-09-13T23:28:29.570552+0000","last_peered":"2024-09-13T23:28:29.570552+0000","last_clean":"2024-09-13T23:28:29.570552+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:28:29.570552+0000","last_undegraded":"2024-09-13T23:28:29.570552+0000","last_fullsized":"2024-09-13T23:28:29.570552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.403447+0000","last_change":"2024-09-13T23:28:40.403471+0000","last_active":"2024-09-13T23:28:40.403447+0000","last_peered":"2024-09-13T23:28:40.403447+0000","last_clean":"2024-09-13T23:28:40.403447+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:28:40.403447+0000","last_undegraded":"2024-09-13T23:28:40.403447+0000","last_fullsized":"2024-09-13T23:28:40.403447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.922817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":515,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.424037+0000","last_change":"2024-09-13T23:28:37.424100+0000","last_active":"2024-09-13T23:28:37.424037+0000","last_peered":"2024-09-13T23:28:37.424037+0000","last_clean":"2024-09-13T23:28:37.424037+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:37.424037+0000","last_undegraded":"2024-09-13T23:28:37.424037+0000","last_fullsized":"2024-09-13T23:28:37.424037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'290","last_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_deep_scrub":"33'290","last_deep_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.423958+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:06.509304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.332730+0000","last_change":"2024-09-13T23:28:59.332791+0000","last_active":"2024-09-13T23:28:59.332730+0000","last_peered":"2024-09-13T23:28:59.332730+0000","last_clean":"2024-09-13T23:28:59.332730+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:28:59.332730+0000","last_undegraded":"2024-09-13T23:28:59.332730+0000","last_fullsized":"2024-09-13T23:28:59.332730+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.332635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.559378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.257463+0000","last_change":"2024-09-13T23:28:54.257508+0000","last_active":"2024-09-13T23:28:54.257463+0000","last_peered":"2024-09-13T23:28:54.257463+0000","last_clean":"2024-09-13T23:28:54.257463+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:28:54.257463+0000","last_undegraded":"2024-09-13T23:28:54.257463+0000","last_fullsized":"2024-09-13T23:28:54.257463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.257339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:02.842442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.870873+0000","last_change":"2024-09-13T23:29:00.870912+0000","last_active":"2024-09-13T23:29:00.870873+0000","last_peered":"2024-09-13T23:29:00.870873+0000","last_clean":"2024-09-13T23:29:00.870873+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:29:00.870873+0000","last_undegraded":"2024-09-13T23:29:00.870873+0000","last_fullsized":"2024-09-13T23:29:00.870873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.870738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:34.532435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.571845+0000","last_change":"2024-09-13T23:29:11.571870+0000","last_active":"2024-09-13T23:29:11.571845+0000","last_peered":"2024-09-13T23:29:11.571845+0000","last_clean":"2024-09-13T23:29:11.571845+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:29:11.571845+0000","last_undegraded":"2024-09-13T23:29:11.571845+0000","last_fullsized":"2024-09-13T23:29:11.571845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.571739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:44.142918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.914766+0000","last_change":"2024-09-13T23:29:04.914793+0000","last_active":"2024-09-13T23:29:04.914766+0000","last_peered":"2024-09-13T23:29:04.914766+0000","last_clean":"2024-09-13T23:29:04.914766+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:29:04.914766+0000","last_undegraded":"2024-09-13T23:29:04.914766+0000","last_fullsized":"2024-09-13T23:29:04.914766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.914680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:41.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":232,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.702573+0000","last_change":"2024-09-13T23:28:51.702609+0000","last_active":"2024-09-13T23:28:51.702573+0000","last_peered":"2024-09-13T23:28:51.702573+0000","last_clean":"2024-09-13T23:28:51.702573+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:51.702573+0000","last_undegraded":"2024-09-13T23:28:51.702573+0000","last_fullsized":"2024-09-13T23:28:51.702573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.702483+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:52.157557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":101,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.806124+0000","last_change":"2024-09-13T23:28:39.806174+0000","last_active":"2024-09-13T23:28:39.806124+0000","last_peered":"2024-09-13T23:28:39.806124+0000","last_clean":"2024-09-13T23:28:39.806124+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:39.806124+0000","last_undegraded":"2024-09-13T23:28:39.806124+0000","last_fullsized":"2024-09-13T23:28:39.806124+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.806026+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:51.713911+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.882501+0000","last_change":"2024-09-13T23:28:33.882546+0000","last_active":"2024-09-13T23:28:33.882501+0000","last_peered":"2024-09-13T23:28:33.882501+0000","last_clean":"2024-09-13T23:28:33.882501+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:28:33.882501+0000","last_undegraded":"2024-09-13T23:28:33.882501+0000","last_fullsized":"2024-09-13T23:28:33.882501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.882409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:51.076973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.334715+0000","last_change":"2024-09-13T23:29:13.334740+0000","last_active":"2024-09-13T23:29:13.334715+0000","last_peered":"2024-09-13T23:29:13.334715+0000","last_clean":"2024-09-13T23:29:13.334715+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:29:13.334715+0000","last_undegraded":"2024-09-13T23:29:13.334715+0000","last_fullsized":"2024-09-13T23:29:13.334715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.334630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:41.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842904+0000","last_change":"2024-09-13T23:25:15.284653+0000","last_active":"2024-09-13T23:28:22.842904+0000","last_peered":"2024-09-13T23:28:22.842904+0000","last_clean":"2024-09-13T23:28:22.842904+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:28:22.842904+0000","last_undegraded":"2024-09-13T23:28:22.842904+0000","last_fullsized":"2024-09-13T23:28:22.842904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327817+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:27:13.327817+0000","last_peered":"2024-09-13T23:27:13.327817+0000","last_clean":"2024-09-13T23:27:13.327817+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:27:13.327817+0000","last_undegraded":"2024-09-13T23:27:13.327817+0000","last_fullsized":"2024-09-13T23:27:13.327817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.623943+0000","last_change":"2024-09-13T23:25:13.275527+0000","last_active":"2024-09-13T23:28:22.623943+0000","last_peered":"2024-09-13T23:28:22.623943+0000","last_clean":"2024-09-13T23:28:22.623943+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:28:22.623943+0000","last_undegraded":"2024-09-13T23:28:22.623943+0000","last_fullsized":"2024-09-13T23:28:22.623943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.851635+0000","last_change":"2024-09-13T23:28:55.851664+0000","last_active":"2024-09-13T23:28:55.851635+0000","last_peered":"2024-09-13T23:28:55.851635+0000","last_clean":"2024-09-13T23:28:55.851635+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:28:55.851635+0000","last_undegraded":"2024-09-13T23:28:55.851635+0000","last_fullsized":"2024-09-13T23:28:55.851635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.851536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.407551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.436738+0000","last_change":"2024-09-13T23:28:39.436815+0000","last_active":"2024-09-13T23:28:39.436738+0000","last_peered":"2024-09-13T23:28:39.436738+0000","last_clean":"2024-09-13T23:28:39.436738+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:39.436738+0000","last_undegraded":"2024-09-13T23:28:39.436738+0000","last_fullsized":"2024-09-13T23:28:39.436738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.436619+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.975861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.387718+0000","last_change":"2024-09-13T23:29:05.387757+0000","last_active":"2024-09-13T23:29:05.387718+0000","last_peered":"2024-09-13T23:29:05.387718+0000","last_clean":"2024-09-13T23:29:05.387718+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:29:05.387718+0000","last_undegraded":"2024-09-13T23:29:05.387718+0000","last_fullsized":"2024-09-13T23:29:05.387718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.387595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:27.332966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.209538+0000","last_change":"2024-09-13T23:29:02.209565+0000","last_active":"2024-09-13T23:29:02.209538+0000","last_peered":"2024-09-13T23:29:02.209538+0000","last_clean":"2024-09-13T23:29:02.209538+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:29:02.209538+0000","last_undegraded":"2024-09-13T23:29:02.209538+0000","last_fullsized":"2024-09-13T23:29:02.209538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.209446+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:20.762436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.243897+0000","last_change":"2024-09-13T23:29:03.243922+0000","last_active":"2024-09-13T23:29:03.243897+0000","last_peered":"2024-09-13T23:29:03.243897+0000","last_clean":"2024-09-13T23:29:03.243897+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:29:03.243897+0000","last_undegraded":"2024-09-13T23:29:03.243897+0000","last_fullsized":"2024-09-13T23:29:03.243897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.243808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:56.628747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327825+0000","last_change":"2024-09-13T23:25:13.275652+0000","last_active":"2024-09-13T23:27:18.327825+0000","last_peered":"2024-09-13T23:27:18.327825+0000","last_clean":"2024-09-13T23:27:18.327825+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:27:18.327825+0000","last_undegraded":"2024-09-13T23:27:18.327825+0000","last_fullsized":"2024-09-13T23:27:18.327825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:11.325333+0000","last_change":"2024-09-13T23:25:06.413621+0000","last_active":"2024-09-13T23:27:11.325333+0000","last_peered":"2024-09-13T23:27:11.325333+0000","last_clean":"2024-09-13T23:27:11.325333+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:27:11.325333+0000","last_undegraded":"2024-09-13T23:27:11.325333+0000","last_fullsized":"2024-09-13T23:27:11.325333+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.874047+0000","last_change":"2024-09-13T23:28:56.874110+0000","last_active":"2024-09-13T23:28:56.874047+0000","last_peered":"2024-09-13T23:28:56.874047+0000","last_clean":"2024-09-13T23:28:56.874047+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:56.874047+0000","last_undegraded":"2024-09-13T23:28:56.874047+0000","last_fullsized":"2024-09-13T23:28:56.874047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.873926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:08.273545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.871223+0000","last_change":"2024-09-13T23:28:39.871262+0000","last_active":"2024-09-13T23:28:39.871223+0000","last_peered":"2024-09-13T23:28:39.871223+0000","last_clean":"2024-09-13T23:28:39.871223+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:39.871223+0000","last_undegraded":"2024-09-13T23:28:39.871223+0000","last_fullsized":"2024-09-13T23:28:39.871223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.871135+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:40.326209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.710201+0000","last_change":"2024-09-13T23:28:34.710245+0000","last_active":"2024-09-13T23:28:34.710201+0000","last_peered":"2024-09-13T23:28:34.710201+0000","last_clean":"2024-09-13T23:28:34.710201+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:28:34.710201+0000","last_undegraded":"2024-09-13T23:28:34.710201+0000","last_fullsized":"2024-09-13T23:28:34.710201+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.710073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:54.079159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330249+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:41.330249+0000","last_peered":"2024-09-13T23:27:41.330249+0000","last_clean":"2024-09-13T23:27:41.330249+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:41.330249+0000","last_undegraded":"2024-09-13T23:27:41.330249+0000","last_fullsized":"2024-09-13T23:27:41.330249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328409+0000","last_change":"2024-09-13T23:25:52.381083+0000","last_active":"2024-09-13T23:27:23.328409+0000","last_peered":"2024-09-13T23:27:23.328409+0000","last_clean":"2024-09-13T23:27:23.328409+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:27:23.328409+0000","last_undegraded":"2024-09-13T23:27:23.328409+0000","last_fullsized":"2024-09-13T23:27:23.328409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.327014+0000","last_change":"2024-09-13T23:25:13.281022+0000","last_active":"2024-09-13T23:27:21.327014+0000","last_peered":"2024-09-13T23:27:21.327014+0000","last_clean":"2024-09-13T23:27:21.327014+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:27:21.327014+0000","last_undegraded":"2024-09-13T23:27:21.327014+0000","last_fullsized":"2024-09-13T23:27:21.327014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:13.327925+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:27:13.327925+0000","last_peered":"2024-09-13T23:27:13.327925+0000","last_clean":"2024-09-13T23:27:13.327925+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:27:13.327925+0000","last_undegraded":"2024-09-13T23:27:13.327925+0000","last_fullsized":"2024-09-13T23:27:13.327925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.414518+0000","last_change":"2024-09-13T23:28:43.414539+0000","last_active":"2024-09-13T23:28:43.414518+0000","last_peered":"2024-09-13T23:28:43.414518+0000","last_clean":"2024-09-13T23:28:43.414518+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:28:43.414518+0000","last_undegraded":"2024-09-13T23:28:43.414518+0000","last_fullsized":"2024-09-13T23:28:43.414518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.414417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:10.088043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.380336+0000","last_change":"2024-09-13T23:28:41.380370+0000","last_active":"2024-09-13T23:28:41.380336+0000","last_peered":"2024-09-13T23:28:41.380336+0000","last_clean":"2024-09-13T23:28:41.380336+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:28:41.380336+0000","last_undegraded":"2024-09-13T23:28:41.380336+0000","last_fullsized":"2024-09-13T23:28:41.380336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.380224+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:00.663439+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":381,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.460507+0000","last_change":"2024-09-13T23:28:33.460537+0000","last_active":"2024-09-13T23:28:33.460507+0000","last_peered":"2024-09-13T23:28:33.460507+0000","last_clean":"2024-09-13T23:28:33.460507+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:33.460507+0000","last_undegraded":"2024-09-13T23:28:33.460507+0000","last_fullsized":"2024-09-13T23:28:33.460507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.460417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:15.571224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.402643+0000","last_change":"2024-09-13T23:29:09.402665+0000","last_active":"2024-09-13T23:29:09.402643+0000","last_peered":"2024-09-13T23:29:09.402643+0000","last_clean":"2024-09-13T23:29:09.402643+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:29:09.402643+0000","last_undegraded":"2024-09-13T23:29:09.402643+0000","last_fullsized":"2024-09-13T23:29:09.402643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.402546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:24.217280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.425255+0000","last_change":"2024-09-13T23:28:50.425285+0000","last_active":"2024-09-13T23:28:50.425255+0000","last_peered":"2024-09-13T23:28:50.425255+0000","last_clean":"2024-09-13T23:28:50.425255+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:50.425255+0000","last_undegraded":"2024-09-13T23:28:50.425255+0000","last_fullsized":"2024-09-13T23:28:50.425255+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.425164+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:33.299011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329328+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:27:23.329328+0000","last_peered":"2024-09-13T23:27:23.329328+0000","last_clean":"2024-09-13T23:27:23.329328+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:27:23.329328+0000","last_undegraded":"2024-09-13T23:27:23.329328+0000","last_fullsized":"2024-09-13T23:27:23.329328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:16.326182+0000","last_change":"2024-09-13T23:25:06.413616+0000","last_active":"2024-09-13T23:27:16.326182+0000","last_peered":"2024-09-13T23:27:16.326182+0000","last_clean":"2024-09-13T23:27:16.326182+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:27:16.326182+0000","last_undegraded":"2024-09-13T23:27:16.326182+0000","last_fullsized":"2024-09-13T23:27:16.326182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329161+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:27:23.329161+0000","last_peered":"2024-09-13T23:27:23.329161+0000","last_clean":"2024-09-13T23:27:23.329161+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:27:23.329161+0000","last_undegraded":"2024-09-13T23:27:23.329161+0000","last_fullsized":"2024-09-13T23:27:23.329161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.381202+0000","last_change":"2024-09-13T23:28:49.381242+0000","last_active":"2024-09-13T23:28:49.381202+0000","last_peered":"2024-09-13T23:28:49.381202+0000","last_clean":"2024-09-13T23:28:49.381202+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:28:49.381202+0000","last_undegraded":"2024-09-13T23:28:49.381202+0000","last_fullsized":"2024-09-13T23:28:49.381202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.381105+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:20.463802+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":411,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.879334+0000","last_change":"2024-09-13T23:28:38.879400+0000","last_active":"2024-09-13T23:28:38.879334+0000","last_peered":"2024-09-13T23:28:38.879334+0000","last_clean":"2024-09-13T23:28:38.879334+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:38.879334+0000","last_undegraded":"2024-09-13T23:28:38.879334+0000","last_fullsized":"2024-09-13T23:28:38.879334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.879232+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:58.162447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331092+0000","last_change":"2024-09-13T23:25:23.316268+0000","last_active":"2024-09-13T23:27:38.331092+0000","last_peered":"2024-09-13T23:27:38.331092+0000","last_clean":"2024-09-13T23:27:38.331092+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:27:38.331092+0000","last_undegraded":"2024-09-13T23:27:38.331092+0000","last_fullsized":"2024-09-13T23:27:38.331092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.601026+0000","last_change":"2024-09-13T23:29:07.601069+0000","last_active":"2024-09-13T23:29:07.601026+0000","last_peered":"2024-09-13T23:29:07.601026+0000","last_clean":"2024-09-13T23:29:07.601026+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:29:07.601026+0000","last_undegraded":"2024-09-13T23:29:07.601026+0000","last_fullsized":"2024-09-13T23:29:07.601026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.600916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:00.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.621418+0000","last_change":"2024-09-13T23:25:13.278336+0000","last_active":"2024-09-13T23:28:22.621418+0000","last_peered":"2024-09-13T23:28:22.621418+0000","last_clean":"2024-09-13T23:28:22.621418+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:28:22.621418+0000","last_undegraded":"2024-09-13T23:28:22.621418+0000","last_fullsized":"2024-09-13T23:28:22.621418+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328607+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:27:18.328607+0000","last_peered":"2024-09-13T23:27:18.328607+0000","last_clean":"2024-09-13T23:27:18.328607+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:27:18.328607+0000","last_undegraded":"2024-09-13T23:27:18.328607+0000","last_fullsized":"2024-09-13T23:27:18.328607+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328421+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:27:18.328421+0000","last_peered":"2024-09-13T23:27:18.328421+0000","last_clean":"2024-09-13T23:27:18.328421+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:27:18.328421+0000","last_undegraded":"2024-09-13T23:27:18.328421+0000","last_fullsized":"2024-09-13T23:27:18.328421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.843494+0000","last_change":"2024-09-13T23:28:40.843531+0000","last_active":"2024-09-13T23:28:40.843494+0000","last_peered":"2024-09-13T23:28:40.843494+0000","last_clean":"2024-09-13T23:28:40.843494+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:40.843494+0000","last_undegraded":"2024-09-13T23:28:40.843494+0000","last_fullsized":"2024-09-13T23:28:40.843494+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.843409+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:25.282723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.906363+0000","last_change":"2024-09-13T23:28:32.906383+0000","last_active":"2024-09-13T23:28:32.906363+0000","last_peered":"2024-09-13T23:28:32.906363+0000","last_clean":"2024-09-13T23:28:32.906363+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:28:32.906363+0000","last_undegraded":"2024-09-13T23:28:32.906363+0000","last_fullsized":"2024-09-13T23:28:32.906363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_clean_scrub_stamp":"2024-09-13T23:28:32.906287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:02.563197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.690617+0000","last_change":"2024-09-13T23:28:53.690642+0000","last_active":"2024-09-13T23:28:53.690617+0000","last_peered":"2024-09-13T23:28:53.690617+0000","last_clean":"2024-09-13T23:28:53.690617+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:28:53.690617+0000","last_undegraded":"2024-09-13T23:28:53.690617+0000","last_fullsized":"2024-09-13T23:28:53.690617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.690487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:50.456254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329282+0000","last_change":"2024-09-13T23:25:23.311547+0000","last_active":"2024-09-13T23:27:28.329282+0000","last_peered":"2024-09-13T23:27:28.329282+0000","last_clean":"2024-09-13T23:27:28.329282+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:27:28.329282+0000","last_undegraded":"2024-09-13T23:27:28.329282+0000","last_fullsized":"2024-09-13T23:27:28.329282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.572393+0000","last_change":"2024-09-13T23:29:05.572440+0000","last_active":"2024-09-13T23:29:05.572393+0000","last_peered":"2024-09-13T23:29:05.572393+0000","last_clean":"2024-09-13T23:29:05.572393+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:29:05.572393+0000","last_undegraded":"2024-09-13T23:29:05.572393+0000","last_fullsized":"2024-09-13T23:29:05.572393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.572289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:29.963092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330741+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:27:33.330741+0000","last_peered":"2024-09-13T23:27:33.330741+0000","last_clean":"2024-09-13T23:27:33.330741+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:27:33.330741+0000","last_undegraded":"2024-09-13T23:27:33.330741+0000","last_fullsized":"2024-09-13T23:27:33.330741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.206254+0000","last_change":"2024-09-13T23:28:51.206296+0000","last_active":"2024-09-13T23:28:51.206254+0000","last_peered":"2024-09-13T23:28:51.206254+0000","last_clean":"2024-09-13T23:28:51.206254+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:28:51.206254+0000","last_undegraded":"2024-09-13T23:28:51.206254+0000","last_fullsized":"2024-09-13T23:28:51.206254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.206161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:55.123436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'40","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.380671+0000","last_change":"2024-09-13T23:29:03.380714+0000","last_active":"2024-09-13T23:29:03.380671+0000","last_peered":"2024-09-13T23:29:03.380671+0000","last_clean":"2024-09-13T23:29:03.380671+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:29:03.380671+0000","last_undegraded":"2024-09-13T23:29:03.380671+0000","last_fullsized":"2024-09-13T23:29:03.380671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.380585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:23.091624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.323477+0000","last_change":"2024-09-13T23:28:55.323501+0000","last_active":"2024-09-13T23:28:55.323477+0000","last_peered":"2024-09-13T23:28:55.323477+0000","last_clean":"2024-09-13T23:28:55.323477+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:28:55.323477+0000","last_undegraded":"2024-09-13T23:28:55.323477+0000","last_fullsized":"2024-09-13T23:28:55.323477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.323390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:04.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327882+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:27:26.327882+0000","last_peered":"2024-09-13T23:27:26.327882+0000","last_clean":"2024-09-13T23:27:26.327882+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:27:26.327882+0000","last_undegraded":"2024-09-13T23:27:26.327882+0000","last_fullsized":"2024-09-13T23:27:26.327882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'9","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842978+0000","last_change":"2024-09-13T23:25:15.291762+0000","last_active":"2024-09-13T23:28:22.842978+0000","last_peered":"2024-09-13T23:28:22.842978+0000","last_clean":"2024-09-13T23:28:22.842978+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:28:22.842978+0000","last_undegraded":"2024-09-13T23:28:22.842978+0000","last_fullsized":"2024-09-13T23:28:22.842978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.534732+0000","last_change":"2024-09-13T23:29:02.534760+0000","last_active":"2024-09-13T23:29:02.534732+0000","last_peered":"2024-09-13T23:29:02.534732+0000","last_clean":"2024-09-13T23:29:02.534732+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:29:02.534732+0000","last_undegraded":"2024-09-13T23:29:02.534732+0000","last_fullsized":"2024-09-13T23:29:02.534732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.534643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:37.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.419549+0000","last_change":"2024-09-13T23:28:44.419595+0000","last_active":"2024-09-13T23:28:44.419549+0000","last_peered":"2024-09-13T23:28:44.419549+0000","last_clean":"2024-09-13T23:28:44.419549+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:28:44.419549+0000","last_undegraded":"2024-09-13T23:28:44.419549+0000","last_fullsized":"2024-09-13T23:28:44.419549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.419451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:28.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.882244+0000","last_change":"2024-09-13T23:28:44.882276+0000","last_active":"2024-09-13T23:28:44.882244+0000","last_peered":"2024-09-13T23:28:44.882244+0000","last_clean":"2024-09-13T23:28:44.882244+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:44.882244+0000","last_undegraded":"2024-09-13T23:28:44.882244+0000","last_fullsized":"2024-09-13T23:28:44.882244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.882155+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.157762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.770991+0000","last_change":"2024-09-13T23:28:45.771011+0000","last_active":"2024-09-13T23:28:45.770991+0000","last_peered":"2024-09-13T23:28:45.770991+0000","last_clean":"2024-09-13T23:28:45.770991+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:28:45.770991+0000","last_undegraded":"2024-09-13T23:28:45.770991+0000","last_fullsized":"2024-09-13T23:28:45.770991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.770908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:02.965472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:56.332271+0000","last_change":"2024-09-13T23:25:23.305973+0000","last_active":"2024-09-13T23:27:56.332271+0000","last_peered":"2024-09-13T23:27:56.332271+0000","last_clean":"2024-09-13T23:27:56.332271+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:27:56.332271+0000","last_undegraded":"2024-09-13T23:27:56.332271+0000","last_fullsized":"2024-09-13T23:27:56.332271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.484807+0000","last_change":"2024-09-13T23:25:15.283156+0000","last_active":"2024-09-13T23:28:22.484807+0000","last_peered":"2024-09-13T23:28:22.484807+0000","last_clean":"2024-09-13T23:28:22.484807+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:28:22.484807+0000","last_undegraded":"2024-09-13T23:28:22.484807+0000","last_fullsized":"2024-09-13T23:28:22.484807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.602669+0000","last_change":"2024-09-13T23:29:10.602698+0000","last_active":"2024-09-13T23:29:10.602669+0000","last_peered":"2024-09-13T23:29:10.602669+0000","last_clean":"2024-09-13T23:29:10.602669+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:29:10.602669+0000","last_undegraded":"2024-09-13T23:29:10.602669+0000","last_fullsized":"2024-09-13T23:29:10.602669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.602581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:02.399450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.713164+0000","last_change":"2024-09-13T23:28:47.713189+0000","last_active":"2024-09-13T23:28:47.713164+0000","last_peered":"2024-09-13T23:28:47.713164+0000","last_clean":"2024-09-13T23:28:47.713164+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:28:47.713164+0000","last_undegraded":"2024-09-13T23:28:47.713164+0000","last_fullsized":"2024-09-13T23:28:47.713164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.713076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:36.167508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'48","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.861559+0000","last_change":"2024-09-13T23:28:43.861599+0000","last_active":"2024-09-13T23:28:43.861559+0000","last_peered":"2024-09-13T23:28:43.861559+0000","last_clean":"2024-09-13T23:28:43.861559+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:43.861559+0000","last_undegraded":"2024-09-13T23:28:43.861559+0000","last_fullsized":"2024-09-13T23:28:43.861559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.861453+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:50.677647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.470961+0000","last_change":"2024-09-13T23:28:35.470984+0000","last_active":"2024-09-13T23:28:35.470961+0000","last_peered":"2024-09-13T23:28:35.470961+0000","last_clean":"2024-09-13T23:28:35.470961+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:28:35.470961+0000","last_undegraded":"2024-09-13T23:28:35.470961+0000","last_fullsized":"2024-09-13T23:28:35.470961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.470871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:42.091197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.333742+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:27:53.333742+0000","last_peered":"2024-09-13T23:27:53.333742+0000","last_clean":"2024-09-13T23:27:53.333742+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:27:53.333742+0000","last_undegraded":"2024-09-13T23:27:53.333742+0000","last_fullsized":"2024-09-13T23:27:53.333742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.391868+0000","last_change":"2024-09-13T23:28:46.391900+0000","last_active":"2024-09-13T23:28:46.391868+0000","last_peered":"2024-09-13T23:28:46.391868+0000","last_clean":"2024-09-13T23:28:46.391868+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:46.391868+0000","last_undegraded":"2024-09-13T23:28:46.391868+0000","last_fullsized":"2024-09-13T23:28:46.391868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.391777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:57.512441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.055925+0000","last_change":"2024-09-13T23:29:13.055977+0000","last_active":"2024-09-13T23:29:13.055925+0000","last_peered":"2024-09-13T23:29:13.055925+0000","last_clean":"2024-09-13T23:29:13.055925+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:29:13.055925+0000","last_undegraded":"2024-09-13T23:29:13.055925+0000","last_fullsized":"2024-09-13T23:29:13.055925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.055822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:46.390759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425037+0000","last_change":"2024-09-13T23:28:36.425088+0000","last_active":"2024-09-13T23:28:36.425037+0000","last_peered":"2024-09-13T23:28:36.425037+0000","last_clean":"2024-09-13T23:28:36.425037+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:28:36.425037+0000","last_undegraded":"2024-09-13T23:28:36.425037+0000","last_fullsized":"2024-09-13T23:28:36.425037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.424930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:03.124803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.764356+0000","last_change":"2024-09-13T23:28:46.764392+0000","last_active":"2024-09-13T23:28:46.764356+0000","last_peered":"2024-09-13T23:28:46.764356+0000","last_clean":"2024-09-13T23:28:46.764356+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:46.764356+0000","last_undegraded":"2024-09-13T23:28:46.764356+0000","last_fullsized":"2024-09-13T23:28:46.764356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.764271+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:15.849617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.707109+0000","last_change":"2024-09-13T23:28:36.707149+0000","last_active":"2024-09-13T23:28:36.707109+0000","last_peered":"2024-09-13T23:28:36.707109+0000","last_clean":"2024-09-13T23:28:36.707109+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:28:36.707109+0000","last_undegraded":"2024-09-13T23:28:36.707109+0000","last_fullsized":"2024-09-13T23:28:36.707109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.706974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.091638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'5","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.842806+0000","last_change":"2024-09-13T23:25:15.281679+0000","last_active":"2024-09-13T23:28:22.842806+0000","last_peered":"2024-09-13T23:28:22.842806+0000","last_clean":"2024-09-13T23:28:22.842806+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:28:22.842806+0000","last_undegraded":"2024-09-13T23:28:22.842806+0000","last_fullsized":"2024-09-13T23:28:22.842806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331329+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:27:38.331329+0000","last_peered":"2024-09-13T23:27:38.331329+0000","last_clean":"2024-09-13T23:27:38.331329+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:27:38.331329+0000","last_undegraded":"2024-09-13T23:27:38.331329+0000","last_fullsized":"2024-09-13T23:27:38.331329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.823017+0000","last_change":"2024-09-13T23:28:54.823047+0000","last_active":"2024-09-13T23:28:54.823017+0000","last_peered":"2024-09-13T23:28:54.823017+0000","last_clean":"2024-09-13T23:28:54.823017+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:28:54.823017+0000","last_undegraded":"2024-09-13T23:28:54.823017+0000","last_fullsized":"2024-09-13T23:28:54.823017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.822942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:27.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'65","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.838301+0000","last_change":"2024-09-13T23:28:46.838338+0000","last_active":"2024-09-13T23:28:46.838301+0000","last_peered":"2024-09-13T23:28:46.838301+0000","last_clean":"2024-09-13T23:28:46.838301+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:46.838301+0000","last_undegraded":"2024-09-13T23:28:46.838301+0000","last_fullsized":"2024-09-13T23:28:46.838301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'65","last_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_deep_scrub":"33'65","last_deep_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.838216+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.670165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.700661+0000","last_change":"2024-09-13T23:28:35.700684+0000","last_active":"2024-09-13T23:28:35.700661+0000","last_peered":"2024-09-13T23:28:35.700661+0000","last_clean":"2024-09-13T23:28:35.700661+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:28:35.700661+0000","last_undegraded":"2024-09-13T23:28:35.700661+0000","last_fullsized":"2024-09-13T23:28:35.700661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.700569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:06.066777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:46.330915+0000","last_change":"2024-09-13T23:25:23.306187+0000","last_active":"2024-09-13T23:27:46.330915+0000","last_peered":"2024-09-13T23:27:46.330915+0000","last_clean":"2024-09-13T23:27:46.330915+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:27:46.330915+0000","last_undegraded":"2024-09-13T23:27:46.330915+0000","last_fullsized":"2024-09-13T23:27:46.330915+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.879135+0000","last_change":"2024-09-13T23:29:09.879160+0000","last_active":"2024-09-13T23:29:09.879135+0000","last_peered":"2024-09-13T23:29:09.879135+0000","last_clean":"2024-09-13T23:29:09.879135+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:29:09.879135+0000","last_undegraded":"2024-09-13T23:29:09.879135+0000","last_fullsized":"2024-09-13T23:29:09.879135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.879042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:02.841770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.570938+0000","last_change":"2024-09-13T23:25:13.284407+0000","last_active":"2024-09-13T23:28:29.570938+0000","last_peered":"2024-09-13T23:28:29.570938+0000","last_clean":"2024-09-13T23:28:29.570938+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:28:29.570938+0000","last_undegraded":"2024-09-13T23:28:29.570938+0000","last_fullsized":"2024-09-13T23:28:29.570938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.730015+0000","last_change":"2024-09-13T23:28:52.730040+0000","last_active":"2024-09-13T23:28:52.730015+0000","last_peered":"2024-09-13T23:28:52.730015+0000","last_clean":"2024-09-13T23:28:52.730015+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:28:52.730015+0000","last_undegraded":"2024-09-13T23:28:52.730015+0000","last_fullsized":"2024-09-13T23:28:52.730015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.729923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:09.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.432492+0000","last_change":"2024-09-13T23:28:34.432533+0000","last_active":"2024-09-13T23:28:34.432492+0000","last_peered":"2024-09-13T23:28:34.432492+0000","last_clean":"2024-09-13T23:28:34.432492+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:34.432492+0000","last_undegraded":"2024-09-13T23:28:34.432492+0000","last_fullsized":"2024-09-13T23:28:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.432394+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:14.169652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.418506+0000","last_change":"2024-09-13T23:28:38.418547+0000","last_active":"2024-09-13T23:28:38.418506+0000","last_peered":"2024-09-13T23:28:38.418506+0000","last_clean":"2024-09-13T23:28:38.418506+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:28:38.418506+0000","last_undegraded":"2024-09-13T23:28:38.418506+0000","last_fullsized":"2024-09-13T23:28:38.418506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.418363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:26.872796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332242+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:27:43.332242+0000","last_peered":"2024-09-13T23:27:43.332242+0000","last_clean":"2024-09-13T23:27:43.332242+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:27:43.332242+0000","last_undegraded":"2024-09-13T23:27:43.332242+0000","last_fullsized":"2024-09-13T23:27:43.332242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.399289+0000","last_change":"2024-09-13T23:28:51.399332+0000","last_active":"2024-09-13T23:28:51.399289+0000","last_peered":"2024-09-13T23:28:51.399289+0000","last_clean":"2024-09-13T23:28:51.399289+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:28:51.399289+0000","last_undegraded":"2024-09-13T23:28:51.399289+0000","last_fullsized":"2024-09-13T23:28:51.399289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.399178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:24.391607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331848+0000","last_change":"2024-09-13T23:25:13.277639+0000","last_active":"2024-09-13T23:27:43.331848+0000","last_peered":"2024-09-13T23:27:43.331848+0000","last_clean":"2024-09-13T23:27:43.331848+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:27:43.331848+0000","last_undegraded":"2024-09-13T23:27:43.331848+0000","last_fullsized":"2024-09-13T23:27:43.331848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.671431+0000","last_change":"2024-09-13T23:28:54.671459+0000","last_active":"2024-09-13T23:28:54.671431+0000","last_peered":"2024-09-13T23:28:54.671431+0000","last_clean":"2024-09-13T23:28:54.671431+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:54.671431+0000","last_undegraded":"2024-09-13T23:28:54.671431+0000","last_fullsized":"2024-09-13T23:28:54.671431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.671339+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:38.895472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.872691+0000","last_change":"2024-09-13T23:28:42.872729+0000","last_active":"2024-09-13T23:28:42.872691+0000","last_peered":"2024-09-13T23:28:42.872691+0000","last_clean":"2024-09-13T23:28:42.872691+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:42.872691+0000","last_undegraded":"2024-09-13T23:28:42.872691+0000","last_fullsized":"2024-09-13T23:28:42.872691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.872602+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:27.096735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.838642+0000","last_change":"2024-09-13T23:28:36.838668+0000","last_active":"2024-09-13T23:28:36.838642+0000","last_peered":"2024-09-13T23:28:36.838642+0000","last_clean":"2024-09-13T23:28:36.838642+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:28:36.838642+0000","last_undegraded":"2024-09-13T23:28:36.838642+0000","last_fullsized":"2024-09-13T23:28:36.838642+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.838543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:00.388168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.630335+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.630335+0000","last_peered":"2024-09-13T23:28:22.630335+0000","last_clean":"2024-09-13T23:28:22.630335+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.630335+0000","last_undegraded":"2024-09-13T23:28:22.630335+0000","last_fullsized":"2024-09-13T23:28:22.630335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.384568+0000","last_change":"2024-09-13T23:25:15.285109+0000","last_active":"2024-09-13T23:28:22.384568+0000","last_peered":"2024-09-13T23:28:22.384568+0000","last_clean":"2024-09-13T23:28:22.384568+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:28:22.384568+0000","last_undegraded":"2024-09-13T23:28:22.384568+0000","last_fullsized":"2024-09-13T23:28:22.384568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616044+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.616044+0000","last_peered":"2024-09-13T23:28:22.616044+0000","last_clean":"2024-09-13T23:28:22.616044+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.616044+0000","last_undegraded":"2024-09-13T23:28:22.616044+0000","last_fullsized":"2024-09-13T23:28:22.616044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.274118+0000","last_change":"2024-09-13T23:28:55.274173+0000","last_active":"2024-09-13T23:28:55.274118+0000","last_peered":"2024-09-13T23:28:55.274118+0000","last_clean":"2024-09-13T23:28:55.274118+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:28:55.274118+0000","last_undegraded":"2024-09-13T23:28:55.274118+0000","last_fullsized":"2024-09-13T23:28:55.274118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.273979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.097633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.392835+0000","last_change":"2024-09-13T23:28:37.392868+0000","last_active":"2024-09-13T23:28:37.392835+0000","last_peered":"2024-09-13T23:28:37.392835+0000","last_clean":"2024-09-13T23:28:37.392835+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:28:37.392835+0000","last_undegraded":"2024-09-13T23:28:37.392835+0000","last_fullsized":"2024-09-13T23:28:37.392835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.392753+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:27.511355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":378,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.736242+0000","last_change":"2024-09-13T23:28:37.736270+0000","last_active":"2024-09-13T23:28:37.736242+0000","last_peered":"2024-09-13T23:28:37.736242+0000","last_clean":"2024-09-13T23:28:37.736242+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:37.736242+0000","last_undegraded":"2024-09-13T23:28:37.736242+0000","last_fullsized":"2024-09-13T23:28:37.736242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.736151+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:12.004146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332118+0000","last_change":"2024-09-13T23:25:23.312123+0000","last_active":"2024-09-13T23:27:43.332118+0000","last_peered":"2024-09-13T23:27:43.332118+0000","last_clean":"2024-09-13T23:27:43.332118+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:27:43.332118+0000","last_undegraded":"2024-09-13T23:27:43.332118+0000","last_fullsized":"2024-09-13T23:27:43.332118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.616003+0000","last_change":"2024-09-13T23:28:57.616072+0000","last_active":"2024-09-13T23:28:57.616003+0000","last_peered":"2024-09-13T23:28:57.616003+0000","last_clean":"2024-09-13T23:28:57.616003+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:57.616003+0000","last_undegraded":"2024-09-13T23:28:57.616003+0000","last_fullsized":"2024-09-13T23:28:57.616003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.615887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:32.451308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.331912+0000","last_change":"2024-09-13T23:25:13.284559+0000","last_active":"2024-09-13T23:27:43.331912+0000","last_peered":"2024-09-13T23:27:43.331912+0000","last_clean":"2024-09-13T23:27:43.331912+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:27:43.331912+0000","last_undegraded":"2024-09-13T23:27:43.331912+0000","last_fullsized":"2024-09-13T23:27:43.331912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.172867+0000","last_change":"2024-09-13T23:28:52.172891+0000","last_active":"2024-09-13T23:28:52.172867+0000","last_peered":"2024-09-13T23:28:52.172867+0000","last_clean":"2024-09-13T23:28:52.172867+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:28:52.172867+0000","last_undegraded":"2024-09-13T23:28:52.172867+0000","last_fullsized":"2024-09-13T23:28:52.172867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.172781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.571714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.428570+0000","last_change":"2024-09-13T23:28:40.428650+0000","last_active":"2024-09-13T23:28:40.428570+0000","last_peered":"2024-09-13T23:28:40.428570+0000","last_clean":"2024-09-13T23:28:40.428570+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:40.428570+0000","last_undegraded":"2024-09-13T23:28:40.428570+0000","last_fullsized":"2024-09-13T23:28:40.428570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.428479+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:10.066086+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.913346+0000","last_change":"2024-09-13T23:28:41.913370+0000","last_active":"2024-09-13T23:28:41.913346+0000","last_peered":"2024-09-13T23:28:41.913346+0000","last_clean":"2024-09-13T23:28:41.913346+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:28:41.913346+0000","last_undegraded":"2024-09-13T23:28:41.913346+0000","last_fullsized":"2024-09-13T23:28:41.913346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.913252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:38.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.193716+0000","last_change":"2024-09-13T23:28:58.193740+0000","last_active":"2024-09-13T23:28:58.193716+0000","last_peered":"2024-09-13T23:28:58.193716+0000","last_clean":"2024-09-13T23:28:58.193716+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:28:58.193716+0000","last_undegraded":"2024-09-13T23:28:58.193716+0000","last_fullsized":"2024-09-13T23:28:58.193716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.193629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:31.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.569758+0000","last_change":"2024-09-13T23:28:58.569782+0000","last_active":"2024-09-13T23:28:58.569758+0000","last_peered":"2024-09-13T23:28:58.569758+0000","last_clean":"2024-09-13T23:28:58.569758+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:28:58.569758+0000","last_undegraded":"2024-09-13T23:28:58.569758+0000","last_fullsized":"2024-09-13T23:28:58.569758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.569633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:33.401582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332377+0000","last_change":"2024-09-13T23:25:13.291707+0000","last_active":"2024-09-13T23:27:43.332377+0000","last_peered":"2024-09-13T23:27:43.332377+0000","last_clean":"2024-09-13T23:27:43.332377+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:27:43.332377+0000","last_undegraded":"2024-09-13T23:27:43.332377+0000","last_fullsized":"2024-09-13T23:27:43.332377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.761946+0000","last_change":"2024-09-13T23:28:48.761973+0000","last_active":"2024-09-13T23:28:48.761946+0000","last_peered":"2024-09-13T23:28:48.761946+0000","last_clean":"2024-09-13T23:28:48.761946+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:28:48.761946+0000","last_undegraded":"2024-09-13T23:28:48.761946+0000","last_fullsized":"2024-09-13T23:28:48.761946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.761854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:33.308523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.868864+0000","last_change":"2024-09-13T23:28:40.868903+0000","last_active":"2024-09-13T23:28:40.868864+0000","last_peered":"2024-09-13T23:28:40.868864+0000","last_clean":"2024-09-13T23:28:40.868864+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:40.868864+0000","last_undegraded":"2024-09-13T23:28:40.868864+0000","last_fullsized":"2024-09-13T23:28:40.868864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.868753+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:57.312547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.366001+0000","last_change":"2024-09-13T23:28:57.366023+0000","last_active":"2024-09-13T23:28:57.366001+0000","last_peered":"2024-09-13T23:28:57.366001+0000","last_clean":"2024-09-13T23:28:57.366001+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:28:57.366001+0000","last_undegraded":"2024-09-13T23:28:57.366001+0000","last_fullsized":"2024-09-13T23:28:57.366001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.365894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:37:00.729302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333179+0000","last_change":"2024-09-13T23:25:23.313116+0000","last_active":"2024-09-13T23:27:48.333179+0000","last_peered":"2024-09-13T23:27:48.333179+0000","last_clean":"2024-09-13T23:27:48.333179+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:27:48.333179+0000","last_undegraded":"2024-09-13T23:27:48.333179+0000","last_fullsized":"2024-09-13T23:27:48.333179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.704514+0000","last_change":"2024-09-13T23:25:52.382086+0000","last_active":"2024-09-13T23:28:22.704514+0000","last_peered":"2024-09-13T23:28:22.704514+0000","last_clean":"2024-09-13T23:28:22.704514+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:28:22.704514+0000","last_undegraded":"2024-09-13T23:28:22.704514+0000","last_fullsized":"2024-09-13T23:28:22.704514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.618718+0000","last_change":"2024-09-13T23:25:13.280639+0000","last_active":"2024-09-13T23:28:22.618718+0000","last_peered":"2024-09-13T23:28:22.618718+0000","last_clean":"2024-09-13T23:28:22.618718+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:28:22.618718+0000","last_undegraded":"2024-09-13T23:28:22.618718+0000","last_fullsized":"2024-09-13T23:28:22.618718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.259377+0000","last_change":"2024-09-13T23:28:47.259399+0000","last_active":"2024-09-13T23:28:47.259377+0000","last_peered":"2024-09-13T23:28:47.259377+0000","last_clean":"2024-09-13T23:28:47.259377+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:28:47.259377+0000","last_undegraded":"2024-09-13T23:28:47.259377+0000","last_fullsized":"2024-09-13T23:28:47.259377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.259291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.594250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.407054+0000","last_change":"2024-09-13T23:28:47.407089+0000","last_active":"2024-09-13T23:28:47.407054+0000","last_peered":"2024-09-13T23:28:47.407054+0000","last_clean":"2024-09-13T23:28:47.407054+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:47.407054+0000","last_undegraded":"2024-09-13T23:28:47.407054+0000","last_fullsized":"2024-09-13T23:28:47.407054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.406957+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:12.268807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.367378+0000","last_change":"2024-09-13T23:28:56.367406+0000","last_active":"2024-09-13T23:28:56.367378+0000","last_peered":"2024-09-13T23:28:56.367378+0000","last_clean":"2024-09-13T23:28:56.367378+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:28:56.367378+0000","last_undegraded":"2024-09-13T23:28:56.367378+0000","last_fullsized":"2024-09-13T23:28:56.367378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.367288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:36.192963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333137+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:48.333137+0000","last_peered":"2024-09-13T23:27:48.333137+0000","last_clean":"2024-09-13T23:27:48.333137+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:48.333137+0000","last_undegraded":"2024-09-13T23:27:48.333137+0000","last_fullsized":"2024-09-13T23:27:48.333137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.563381+0000","last_change":"2024-09-13T23:28:59.563436+0000","last_active":"2024-09-13T23:28:59.563381+0000","last_peered":"2024-09-13T23:28:59.563381+0000","last_clean":"2024-09-13T23:28:59.563381+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:59.563381+0000","last_undegraded":"2024-09-13T23:28:59.563381+0000","last_fullsized":"2024-09-13T23:28:59.563381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.563236+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:35.781729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.327757+0000","last_change":"2024-09-13T23:25:13.279578+0000","last_active":"2024-09-13T23:27:18.327757+0000","last_peered":"2024-09-13T23:27:18.327757+0000","last_clean":"2024-09-13T23:27:18.327757+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:27:18.327757+0000","last_undegraded":"2024-09-13T23:27:18.327757+0000","last_fullsized":"2024-09-13T23:27:18.327757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.345673+0000","last_change":"2024-09-13T23:28:45.345702+0000","last_active":"2024-09-13T23:28:45.345673+0000","last_peered":"2024-09-13T23:28:45.345673+0000","last_clean":"2024-09-13T23:28:45.345673+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:28:45.345673+0000","last_undegraded":"2024-09-13T23:28:45.345673+0000","last_fullsized":"2024-09-13T23:28:45.345673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.345587+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.147860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.376916+0000","last_change":"2024-09-13T23:28:45.376963+0000","last_active":"2024-09-13T23:28:45.376916+0000","last_peered":"2024-09-13T23:28:45.376916+0000","last_clean":"2024-09-13T23:28:45.376916+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:45.376916+0000","last_undegraded":"2024-09-13T23:28:45.376916+0000","last_fullsized":"2024-09-13T23:28:45.376916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.376807+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:21.519688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.830708+0000","last_change":"2024-09-13T23:28:45.830736+0000","last_active":"2024-09-13T23:28:45.830708+0000","last_peered":"2024-09-13T23:28:45.830708+0000","last_clean":"2024-09-13T23:28:45.830708+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:28:45.830708+0000","last_undegraded":"2024-09-13T23:28:45.830708+0000","last_fullsized":"2024-09-13T23:28:45.830708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.830607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.666028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.705711+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.705711+0000","last_peered":"2024-09-13T23:28:22.705711+0000","last_clean":"2024-09-13T23:28:22.705711+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.705711+0000","last_undegraded":"2024-09-13T23:28:22.705711+0000","last_fullsized":"2024-09-13T23:28:22.705711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.240903+0000","last_change":"2024-09-13T23:28:56.240948+0000","last_active":"2024-09-13T23:28:56.240903+0000","last_peered":"2024-09-13T23:28:56.240903+0000","last_clean":"2024-09-13T23:28:56.240903+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:56.240903+0000","last_undegraded":"2024-09-13T23:28:56.240903+0000","last_fullsized":"2024-09-13T23:28:56.240903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.240805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:20.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.613263+0000","last_change":"2024-09-13T23:25:13.279179+0000","last_active":"2024-09-13T23:28:22.613263+0000","last_peered":"2024-09-13T23:28:22.613263+0000","last_clean":"2024-09-13T23:28:22.613263+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:28:22.613263+0000","last_undegraded":"2024-09-13T23:28:22.613263+0000","last_fullsized":"2024-09-13T23:28:22.613263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.844111+0000","last_change":"2024-09-13T23:29:02.844145+0000","last_active":"2024-09-13T23:29:02.844111+0000","last_peered":"2024-09-13T23:29:02.844111+0000","last_clean":"2024-09-13T23:29:02.844111+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:29:02.844111+0000","last_undegraded":"2024-09-13T23:29:02.844111+0000","last_fullsized":"2024-09-13T23:29:02.844111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.844013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:02.339878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.834151+0000","last_change":"2024-09-13T23:29:10.834175+0000","last_active":"2024-09-13T23:29:10.834151+0000","last_peered":"2024-09-13T23:29:10.834151+0000","last_clean":"2024-09-13T23:29:10.834151+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:29:10.834151+0000","last_undegraded":"2024-09-13T23:29:10.834151+0000","last_fullsized":"2024-09-13T23:29:10.834151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.834057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:43.901277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.358597+0000","last_change":"2024-09-13T23:29:12.358637+0000","last_active":"2024-09-13T23:29:12.358597+0000","last_peered":"2024-09-13T23:29:12.358597+0000","last_clean":"2024-09-13T23:29:12.358597+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:29:12.358597+0000","last_undegraded":"2024-09-13T23:29:12.358597+0000","last_fullsized":"2024-09-13T23:29:12.358597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.358491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:40.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:18.328491+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:27:18.328491+0000","last_peered":"2024-09-13T23:27:18.328491+0000","last_clean":"2024-09-13T23:27:18.328491+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:27:18.328491+0000","last_undegraded":"2024-09-13T23:27:18.328491+0000","last_fullsized":"2024-09-13T23:27:18.328491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739900+0000","last_change":"2024-09-13T23:25:15.284884+0000","last_active":"2024-09-13T23:28:22.739900+0000","last_peered":"2024-09-13T23:28:22.739900+0000","last_clean":"2024-09-13T23:28:22.739900+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:28:22.739900+0000","last_undegraded":"2024-09-13T23:28:22.739900+0000","last_fullsized":"2024-09-13T23:28:22.739900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:21.326980+0000","last_change":"2024-09-13T23:25:13.280663+0000","last_active":"2024-09-13T23:27:21.326980+0000","last_peered":"2024-09-13T23:27:21.326980+0000","last_clean":"2024-09-13T23:27:21.326980+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:27:21.326980+0000","last_undegraded":"2024-09-13T23:27:21.326980+0000","last_fullsized":"2024-09-13T23:27:21.326980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.891471+0000","last_change":"2024-09-13T23:29:03.891498+0000","last_active":"2024-09-13T23:29:03.891471+0000","last_peered":"2024-09-13T23:29:03.891471+0000","last_clean":"2024-09-13T23:29:03.891471+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:29:03.891471+0000","last_undegraded":"2024-09-13T23:29:03.891471+0000","last_fullsized":"2024-09-13T23:29:03.891471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.891377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:38.332864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327859+0000","last_change":"2024-09-13T23:25:13.279660+0000","last_active":"2024-09-13T23:27:26.327859+0000","last_peered":"2024-09-13T23:27:26.327859+0000","last_clean":"2024-09-13T23:27:26.327859+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:27:26.327859+0000","last_undegraded":"2024-09-13T23:27:26.327859+0000","last_fullsized":"2024-09-13T23:27:26.327859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328367+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:27:23.328367+0000","last_peered":"2024-09-13T23:27:23.328367+0000","last_clean":"2024-09-13T23:27:23.328367+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:27:23.328367+0000","last_undegraded":"2024-09-13T23:27:23.328367+0000","last_fullsized":"2024-09-13T23:27:23.328367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328486+0000","last_change":"2024-09-13T23:25:13.286083+0000","last_active":"2024-09-13T23:27:23.328486+0000","last_peered":"2024-09-13T23:27:23.328486+0000","last_clean":"2024-09-13T23:27:23.328486+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:27:23.328486+0000","last_undegraded":"2024-09-13T23:27:23.328486+0000","last_fullsized":"2024-09-13T23:27:23.328486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.880684+0000","last_change":"2024-09-13T23:28:58.880712+0000","last_active":"2024-09-13T23:28:58.880684+0000","last_peered":"2024-09-13T23:28:58.880684+0000","last_clean":"2024-09-13T23:28:58.880684+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:58.880684+0000","last_undegraded":"2024-09-13T23:28:58.880684+0000","last_fullsized":"2024-09-13T23:28:58.880684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.880594+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:50.677464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.328455+0000","last_change":"2024-09-13T23:25:52.382494+0000","last_active":"2024-09-13T23:27:23.328455+0000","last_peered":"2024-09-13T23:27:23.328455+0000","last_clean":"2024-09-13T23:27:23.328455+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:27:23.328455+0000","last_undegraded":"2024-09-13T23:27:23.328455+0000","last_fullsized":"2024-09-13T23:27:23.328455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.102488+0000","last_change":"2024-09-13T23:29:10.102517+0000","last_active":"2024-09-13T23:29:10.102488+0000","last_peered":"2024-09-13T23:29:10.102488+0000","last_clean":"2024-09-13T23:29:10.102488+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:29:10.102488+0000","last_undegraded":"2024-09-13T23:29:10.102488+0000","last_fullsized":"2024-09-13T23:29:10.102488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.102348+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:25:08.910893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:26.327919+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:27:26.327919+0000","last_peered":"2024-09-13T23:27:26.327919+0000","last_clean":"2024-09-13T23:27:26.327919+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:27:26.327919+0000","last_undegraded":"2024-09-13T23:27:26.327919+0000","last_fullsized":"2024-09-13T23:27:26.327919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331208+0000","last_change":"2024-09-13T23:25:15.290013+0000","last_active":"2024-09-13T23:27:38.331208+0000","last_peered":"2024-09-13T23:27:38.331208+0000","last_clean":"2024-09-13T23:27:38.331208+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:27:38.331208+0000","last_undegraded":"2024-09-13T23:27:38.331208+0000","last_fullsized":"2024-09-13T23:27:38.331208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:23.329102+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:27:23.329102+0000","last_peered":"2024-09-13T23:27:23.329102+0000","last_clean":"2024-09-13T23:27:23.329102+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:27:23.329102+0000","last_undegraded":"2024-09-13T23:27:23.329102+0000","last_fullsized":"2024-09-13T23:27:23.329102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.398875+0000","last_change":"2024-09-13T23:29:10.398912+0000","last_active":"2024-09-13T23:29:10.398875+0000","last_peered":"2024-09-13T23:29:10.398875+0000","last_clean":"2024-09-13T23:29:10.398875+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:29:10.398875+0000","last_undegraded":"2024-09-13T23:29:10.398875+0000","last_fullsized":"2024-09-13T23:29:10.398875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.398784+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.393158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:31.328606+0000","last_change":"2024-09-13T23:25:13.277837+0000","last_active":"2024-09-13T23:27:31.328606+0000","last_peered":"2024-09-13T23:27:31.328606+0000","last_clean":"2024-09-13T23:27:31.328606+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:27:31.328606+0000","last_undegraded":"2024-09-13T23:27:31.328606+0000","last_fullsized":"2024-09-13T23:27:31.328606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.895895+0000","last_change":"2024-09-13T23:29:05.895957+0000","last_active":"2024-09-13T23:29:05.895895+0000","last_peered":"2024-09-13T23:29:05.895895+0000","last_clean":"2024-09-13T23:29:05.895895+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:29:05.895895+0000","last_undegraded":"2024-09-13T23:29:05.895895+0000","last_fullsized":"2024-09-13T23:29:05.895895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.895771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.311567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.731386+0000","last_change":"2024-09-13T23:25:13.280489+0000","last_active":"2024-09-13T23:28:22.731386+0000","last_peered":"2024-09-13T23:28:22.731386+0000","last_clean":"2024-09-13T23:28:22.731386+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:28:22.731386+0000","last_undegraded":"2024-09-13T23:28:22.731386+0000","last_fullsized":"2024-09-13T23:28:22.731386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.241759+0000","last_change":"2024-09-13T23:29:04.241797+0000","last_active":"2024-09-13T23:29:04.241759+0000","last_peered":"2024-09-13T23:29:04.241759+0000","last_clean":"2024-09-13T23:29:04.241759+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:29:04.241759+0000","last_undegraded":"2024-09-13T23:29:04.241759+0000","last_fullsized":"2024-09-13T23:29:04.241759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.241674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329322+0000","last_change":"2024-09-13T23:25:13.278170+0000","last_active":"2024-09-13T23:27:28.329322+0000","last_peered":"2024-09-13T23:27:28.329322+0000","last_clean":"2024-09-13T23:27:28.329322+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:27:28.329322+0000","last_undegraded":"2024-09-13T23:27:28.329322+0000","last_fullsized":"2024-09-13T23:27:28.329322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.175613+0000","last_change":"2024-09-13T23:28:59.175652+0000","last_active":"2024-09-13T23:28:59.175613+0000","last_peered":"2024-09-13T23:28:59.175613+0000","last_clean":"2024-09-13T23:28:59.175613+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:28:59.175613+0000","last_undegraded":"2024-09-13T23:28:59.175613+0000","last_fullsized":"2024-09-13T23:28:59.175613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.175522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:16.558152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.575012+0000","last_change":"2024-09-13T23:25:13.282967+0000","last_active":"2024-09-13T23:28:29.575012+0000","last_peered":"2024-09-13T23:28:29.575012+0000","last_clean":"2024-09-13T23:28:29.575012+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:28:29.575012+0000","last_undegraded":"2024-09-13T23:28:29.575012+0000","last_fullsized":"2024-09-13T23:28:29.575012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.071476+0000","last_change":"2024-09-13T23:29:12.071500+0000","last_active":"2024-09-13T23:29:12.071476+0000","last_peered":"2024-09-13T23:29:12.071476+0000","last_clean":"2024-09-13T23:29:12.071476+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:29:12.071476+0000","last_undegraded":"2024-09-13T23:29:12.071476+0000","last_fullsized":"2024-09-13T23:29:12.071476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.071386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:05.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:28.329990+0000","last_change":"2024-09-13T23:25:13.281324+0000","last_active":"2024-09-13T23:27:28.329990+0000","last_peered":"2024-09-13T23:27:28.329990+0000","last_clean":"2024-09-13T23:27:28.329990+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:27:28.329990+0000","last_undegraded":"2024-09-13T23:27:28.329990+0000","last_fullsized":"2024-09-13T23:27:28.329990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.360814+0000","last_change":"2024-09-13T23:29:07.360863+0000","last_active":"2024-09-13T23:29:07.360814+0000","last_peered":"2024-09-13T23:29:07.360814+0000","last_clean":"2024-09-13T23:29:07.360814+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:29:07.360814+0000","last_undegraded":"2024-09-13T23:29:07.360814+0000","last_fullsized":"2024-09-13T23:29:07.360814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.360714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:38.924264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.579791+0000","last_change":"2024-09-13T23:29:08.579817+0000","last_active":"2024-09-13T23:29:08.579791+0000","last_peered":"2024-09-13T23:29:08.579791+0000","last_clean":"2024-09-13T23:29:08.579791+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:29:08.579791+0000","last_undegraded":"2024-09-13T23:29:08.579791+0000","last_fullsized":"2024-09-13T23:29:08.579791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.579696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:25.962325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'19","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.843114+0000","last_change":"2024-09-13T23:25:15.287996+0000","last_active":"2024-09-13T23:28:22.843114+0000","last_peered":"2024-09-13T23:28:22.843114+0000","last_clean":"2024-09-13T23:28:22.843114+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:28:22.843114+0000","last_undegraded":"2024-09-13T23:28:22.843114+0000","last_fullsized":"2024-09-13T23:28:22.843114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330835+0000","last_change":"2024-09-13T23:25:13.291833+0000","last_active":"2024-09-13T23:27:33.330835+0000","last_peered":"2024-09-13T23:27:33.330835+0000","last_clean":"2024-09-13T23:27:33.330835+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:27:33.330835+0000","last_undegraded":"2024-09-13T23:27:33.330835+0000","last_fullsized":"2024-09-13T23:27:33.330835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330568+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:27:33.330568+0000","last_peered":"2024-09-13T23:27:33.330568+0000","last_clean":"2024-09-13T23:27:33.330568+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:27:33.330568+0000","last_undegraded":"2024-09-13T23:27:33.330568+0000","last_fullsized":"2024-09-13T23:27:33.330568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.739802+0000","last_change":"2024-09-13T23:25:15.284878+0000","last_active":"2024-09-13T23:28:22.739802+0000","last_peered":"2024-09-13T23:28:22.739802+0000","last_clean":"2024-09-13T23:28:22.739802+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:28:22.739802+0000","last_undegraded":"2024-09-13T23:28:22.739802+0000","last_fullsized":"2024-09-13T23:28:22.739802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.572075+0000","last_change":"2024-09-13T23:25:13.280746+0000","last_active":"2024-09-13T23:28:29.572075+0000","last_peered":"2024-09-13T23:28:29.572075+0000","last_clean":"2024-09-13T23:28:29.572075+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:28:29.572075+0000","last_undegraded":"2024-09-13T23:28:29.572075+0000","last_fullsized":"2024-09-13T23:28:29.572075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.185869+0000","last_change":"2024-09-13T23:29:00.185902+0000","last_active":"2024-09-13T23:29:00.185869+0000","last_peered":"2024-09-13T23:29:00.185869+0000","last_clean":"2024-09-13T23:29:00.185869+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:29:00.185869+0000","last_undegraded":"2024-09-13T23:29:00.185869+0000","last_fullsized":"2024-09-13T23:29:00.185869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.185781+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:40.557990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":475,"ondisk_log_size":475,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673014,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673016,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:29:14.901 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.901 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.901 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.902 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.903 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.904 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.905 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.906 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.906 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.906 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.906 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.907 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.907 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.907 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T23:24:59.389467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=24, tm_sec=59, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.907 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.907 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.908 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.908 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.908 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.908 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.908 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.909 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.910 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.911 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.912 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.913 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.914 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.915 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.916 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:14.917 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:29:34.918 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:29:35.033 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.032+0000 7fa3c48e4640 1 Processor -- start 2024-09-13T23:29:35.034 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.032+0000 7fa3c48e4640 1 -- start start 2024-09-13T23:29:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3c48e4640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3c012f9d0 0x7fa3c0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3c48e4640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3c0071f70 con 0x7fa3c012cca0 2024-09-13T23:29:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3c48e4640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7fa3c006e350 con 0x7fa3c012f9d0 2024-09-13T23:29:35.035 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3bdd9b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7fa3c012f9d0 0x7fa3c0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3be59c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7fa3c012cca0 0x7fa3c012d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:44160/0 (socket says 172.21.15.43:44160) 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3be59c640 1 -- 172.21.15.43:0/728239938 learned_addr learned my addr 172.21.15.43:0/728239938 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3bdd9b640 1 -- 172.21.15.43:0/728239938 >> v1:172.21.15.43:6789/0 conn(0x7fa3c012cca0 legacy=0x7fa3c012d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.033+0000 7fa3bdd9b640 1 -- 172.21.15.43:0/728239938 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c00715c0 con 0x7fa3c012f9d0 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.034+0000 7fa3bdd9b640 1 --2- 172.21.15.43:0/728239938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012f9d0 0x7fa3c0131dc0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009720 tx=0x7fa3b402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631cce4de3e6f8cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.034+0000 7fa3bd59a640 1 -- 172.21.15.43:0/728239938 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b4037070 con 0x7fa3c012f9d0 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.034+0000 7fa3bd59a640 1 -- 172.21.15.43:0/728239938 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b402ad90 con 0x7fa3c012f9d0 2024-09-13T23:29:35.036 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.034+0000 7fa3bd59a640 1 -- 172.21.15.43:0/728239938 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b4032590 con 0x7fa3c012f9d0 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 -- 172.21.15.43:0/728239938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012f9d0 msgr2=0x7fa3c0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/728239938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012f9d0 0x7fa3c0131dc0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009720 tx=0x7fa3b402a110 comp rx=0 tx=0).stop 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 -- 172.21.15.43:0/728239938 shutdown_connections 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/728239938 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012f9d0 0x7fa3c0131dc0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 -- 172.21.15.43:0/728239938 >> 172.21.15.43:0/728239938 conn(0x7fa3c009a890 msgr2=0x7fa3c009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 -- 172.21.15.43:0/728239938 shutdown_connections 2024-09-13T23:29:35.040 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.035+0000 7fa3c48e4640 1 -- 172.21.15.43:0/728239938 wait complete. 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.036+0000 7fa3c48e4640 1 Processor -- start 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.036+0000 7fa3c48e4640 1 -- start start 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.036+0000 7fa3c48e4640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.036+0000 7fa3c48e4640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7fa3c012ca50 con 0x7fa3c012cca0 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.036+0000 7fa3be59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3be59c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:33664/0 (socket says 172.21.15.43:33664) 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3be59c640 1 -- 172.21.15.43:0/3170910749 learned_addr learned my addr 172.21.15.43:0/3170910749 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3be59c640 1 -- 172.21.15.43:0/3170910749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3c0123af0 con 0x7fa3c012cca0 2024-09-13T23:29:35.041 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3be59c640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c480 tx=0x7fa3b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b0017070 con 0x7fa3c012cca0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b0005c10 con 0x7fa3c012cca0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3c0126db0 con 0x7fa3c012cca0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3b00070d0 con 0x7fa3c012cca0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.037+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3c0125df0 con 0x7fa3c012cca0 2024-09-13T23:29:35.042 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.038+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7fa3b001a070 con 0x7fa3c012cca0 2024-09-13T23:29:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.038+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c0073120 con 0x7fa3c012cca0 2024-09-13T23:29:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.038+0000 7fa3aeffd640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 0x7fa3a003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.038+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7fa3b004ae30 con 0x7fa3c012cca0 2024-09-13T23:29:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.039+0000 7fa3bdd9b640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 0x7fa3a003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:35.043 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.039+0000 7fa3bdd9b640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 0x7fa3a003a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009720 tx=0x7fa3b402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:35.044 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.043+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3c0073120 con 0x7fa3c012cca0 2024-09-13T23:29:35.219 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.217+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3c0124af0 con 0x7fa3a00382a0 2024-09-13T23:29:35.234 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.233+0000 7fa3aeffd640 1 -- 172.21.15.43:0/3170910749 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664752 (secure 0 0 0) 0x7fa3c0124af0 con 0x7fa3a00382a0 2024-09-13T23:29:35.242 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:29:35.248 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:29:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 msgr2=0x7fa3a003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 0x7fa3a003a760 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009720 tx=0x7fa3b402e000 comp rx=0 tx=0).stop 2024-09-13T23:29:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 msgr2=0x7fa3c01258b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000c480 tx=0x7fa3b000c940 comp rx=0 tx=0).stop 2024-09-13T23:29:35.251 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 shutdown_connections 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7fa3a00382a0 0x7fa3a003a760 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 --2- 172.21.15.43:0/3170910749 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7fa3c012cca0 0x7fa3c01258b0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 >> 172.21.15.43:0/3170910749 conn(0x7fa3c009a890 msgr2=0x7fa3c0097ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 shutdown_connections 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:35.238+0000 7fa3c48e4640 1 -- 172.21.15.43:0/3170910749 wait complete. 2024-09-13T23:29:35.252 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-09-13T23:29:33.376065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144224,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343136,"statfs":{"total":386547056640,"available":386399371264,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003732"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.528904+0000","last_change":"2024-09-13T23:29:04.528904+0000","last_active":"2024-09-13T23:29:04.528904+0000","last_peered":"2024-09-13T23:29:04.528904+0000","last_clean":"2024-09-13T23:29:04.528904+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:29:04.528904+0000","last_undegraded":"2024-09-13T23:29:04.528904+0000","last_fullsized":"2024-09-13T23:29:04.528904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.528789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:50.352443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.226954+0000","last_change":"2024-09-13T23:29:28.227005+0000","last_active":"2024-09-13T23:29:28.226954+0000","last_peered":"2024-09-13T23:29:28.226954+0000","last_clean":"2024-09-13T23:29:28.226954+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:29:28.226954+0000","last_undegraded":"2024-09-13T23:29:28.226954+0000","last_fullsized":"2024-09-13T23:29:28.226954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.226821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:06.285889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.590162+0000","last_change":"2024-09-13T23:29:24.590162+0000","last_active":"2024-09-13T23:29:24.590162+0000","last_peered":"2024-09-13T23:29:24.590162+0000","last_clean":"2024-09-13T23:29:24.590162+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:29:24.590162+0000","last_undegraded":"2024-09-13T23:29:24.590162+0000","last_fullsized":"2024-09-13T23:29:24.590162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.590043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.937596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.402553+0000","last_change":"2024-09-13T23:29:11.402579+0000","last_active":"2024-09-13T23:29:11.402553+0000","last_peered":"2024-09-13T23:29:11.402553+0000","last_clean":"2024-09-13T23:29:11.402553+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:29:11.402553+0000","last_undegraded":"2024-09-13T23:29:11.402553+0000","last_fullsized":"2024-09-13T23:29:11.402553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.402459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:44.051975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.291238+0000","last_change":"2024-09-13T23:29:24.291261+0000","last_active":"2024-09-13T23:29:24.291238+0000","last_peered":"2024-09-13T23:29:24.291238+0000","last_clean":"2024-09-13T23:29:24.291238+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:29:24.291238+0000","last_undegraded":"2024-09-13T23:29:24.291238+0000","last_fullsized":"2024-09-13T23:29:24.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.291152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:45.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.294481+0000","last_change":"2024-09-13T23:29:14.294522+0000","last_active":"2024-09-13T23:29:14.294481+0000","last_peered":"2024-09-13T23:29:14.294481+0000","last_clean":"2024-09-13T23:29:14.294481+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:29:14.294481+0000","last_undegraded":"2024-09-13T23:29:14.294481+0000","last_fullsized":"2024-09-13T23:29:14.294481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.294392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:06.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.588641+0000","last_change":"2024-09-13T23:29:12.588641+0000","last_active":"2024-09-13T23:29:12.588641+0000","last_peered":"2024-09-13T23:29:12.588641+0000","last_clean":"2024-09-13T23:29:12.588641+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:29:12.588641+0000","last_undegraded":"2024-09-13T23:29:12.588641+0000","last_fullsized":"2024-09-13T23:29:12.588641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.588515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.973454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.254160+0000","last_change":"2024-09-13T23:29:22.254201+0000","last_active":"2024-09-13T23:29:22.254160+0000","last_peered":"2024-09-13T23:29:22.254160+0000","last_clean":"2024-09-13T23:29:22.254160+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:29:22.254160+0000","last_undegraded":"2024-09-13T23:29:22.254160+0000","last_fullsized":"2024-09-13T23:29:22.254160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.254042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:04.901135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.179305+0000","last_change":"2024-09-13T23:29:31.179333+0000","last_active":"2024-09-13T23:29:31.179305+0000","last_peered":"2024-09-13T23:29:31.179305+0000","last_clean":"2024-09-13T23:29:31.179305+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:29:31.179305+0000","last_undegraded":"2024-09-13T23:29:31.179305+0000","last_fullsized":"2024-09-13T23:29:31.179305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.179217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:35.444208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.235215+0000","last_change":"2024-09-13T23:29:06.235215+0000","last_active":"2024-09-13T23:29:06.235215+0000","last_peered":"2024-09-13T23:29:06.235215+0000","last_clean":"2024-09-13T23:29:06.235215+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:29:06.235215+0000","last_undegraded":"2024-09-13T23:29:06.235215+0000","last_fullsized":"2024-09-13T23:29:06.235215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.235100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:34.242160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.619586+0000","last_change":"2024-09-13T23:29:13.619615+0000","last_active":"2024-09-13T23:29:13.619586+0000","last_peered":"2024-09-13T23:29:13.619586+0000","last_clean":"2024-09-13T23:29:13.619586+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:29:13.619586+0000","last_undegraded":"2024-09-13T23:29:13.619586+0000","last_fullsized":"2024-09-13T23:29:13.619586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.619476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:22.716408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.353102+0000","last_change":"2024-09-13T23:28:54.353102+0000","last_active":"2024-09-13T23:28:54.353102+0000","last_peered":"2024-09-13T23:28:54.353102+0000","last_clean":"2024-09-13T23:28:54.353102+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:54.353102+0000","last_undegraded":"2024-09-13T23:28:54.353102+0000","last_fullsized":"2024-09-13T23:28:54.353102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.352965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:28.479961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332219+0000","last_change":"2024-09-13T23:25:13.278963+0000","last_active":"2024-09-13T23:27:43.332219+0000","last_peered":"2024-09-13T23:27:43.332219+0000","last_clean":"2024-09-13T23:27:43.332219+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:27:43.332219+0000","last_undegraded":"2024-09-13T23:27:43.332219+0000","last_fullsized":"2024-09-13T23:27:43.332219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.509539+0000","last_change":"2024-09-13T23:29:03.509539+0000","last_active":"2024-09-13T23:29:03.509539+0000","last_peered":"2024-09-13T23:29:03.509539+0000","last_clean":"2024-09-13T23:29:03.509539+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:29:03.509539+0000","last_undegraded":"2024-09-13T23:29:03.509539+0000","last_fullsized":"2024-09-13T23:29:03.509539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.509398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:45.386333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.928159+0000","last_change":"2024-09-13T23:29:06.928236+0000","last_active":"2024-09-13T23:29:06.928159+0000","last_peered":"2024-09-13T23:29:06.928159+0000","last_clean":"2024-09-13T23:29:06.928159+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:29:06.928159+0000","last_undegraded":"2024-09-13T23:29:06.928159+0000","last_fullsized":"2024-09-13T23:29:06.928159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.928056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.581026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.519547+0000","last_change":"2024-09-13T23:29:19.519547+0000","last_active":"2024-09-13T23:29:19.519547+0000","last_peered":"2024-09-13T23:29:19.519547+0000","last_clean":"2024-09-13T23:29:19.519547+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:29:19.519547+0000","last_undegraded":"2024-09-13T23:29:19.519547+0000","last_fullsized":"2024-09-13T23:29:19.519547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.519430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:37:02.172401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.396623+0000","last_change":"2024-09-13T23:29:08.396667+0000","last_active":"2024-09-13T23:29:08.396623+0000","last_peered":"2024-09-13T23:29:08.396623+0000","last_clean":"2024-09-13T23:29:08.396623+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:29:08.396623+0000","last_undegraded":"2024-09-13T23:29:08.396623+0000","last_fullsized":"2024-09-13T23:29:08.396623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.396493+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:17.076369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.051518+0000","last_change":"2024-09-13T23:29:15.051540+0000","last_active":"2024-09-13T23:29:15.051518+0000","last_peered":"2024-09-13T23:29:15.051518+0000","last_clean":"2024-09-13T23:29:15.051518+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:29:15.051518+0000","last_undegraded":"2024-09-13T23:29:15.051518+0000","last_fullsized":"2024-09-13T23:29:15.051518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.051419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:59.097722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.166812+0000","last_change":"2024-09-13T23:29:08.166839+0000","last_active":"2024-09-13T23:29:08.166812+0000","last_peered":"2024-09-13T23:29:08.166812+0000","last_clean":"2024-09-13T23:29:08.166812+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:29:08.166812+0000","last_undegraded":"2024-09-13T23:29:08.166812+0000","last_fullsized":"2024-09-13T23:29:08.166812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.166727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:24.485148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.595148+0000","last_change":"2024-09-13T23:29:06.595179+0000","last_active":"2024-09-13T23:29:06.595148+0000","last_peered":"2024-09-13T23:29:06.595148+0000","last_clean":"2024-09-13T23:29:06.595148+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:29:06.595148+0000","last_undegraded":"2024-09-13T23:29:06.595148+0000","last_fullsized":"2024-09-13T23:29:06.595148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.595032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.144296+0000","last_change":"2024-09-13T23:29:09.144341+0000","last_active":"2024-09-13T23:29:09.144296+0000","last_peered":"2024-09-13T23:29:09.144296+0000","last_clean":"2024-09-13T23:29:09.144296+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:29:09.144296+0000","last_undegraded":"2024-09-13T23:29:09.144296+0000","last_fullsized":"2024-09-13T23:29:09.144296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.144187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:54:48.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331140+0000","last_change":"2024-09-13T23:25:52.407370+0000","last_active":"2024-09-13T23:27:38.331140+0000","last_peered":"2024-09-13T23:27:38.331140+0000","last_clean":"2024-09-13T23:27:38.331140+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:27:38.331140+0000","last_undegraded":"2024-09-13T23:27:38.331140+0000","last_fullsized":"2024-09-13T23:27:38.331140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.890183+0000","last_change":"2024-09-13T23:29:07.890225+0000","last_active":"2024-09-13T23:29:07.890183+0000","last_peered":"2024-09-13T23:29:07.890183+0000","last_clean":"2024-09-13T23:29:07.890183+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:29:07.890183+0000","last_undegraded":"2024-09-13T23:29:07.890183+0000","last_fullsized":"2024-09-13T23:29:07.890183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.890094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.804774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.208876+0000","last_change":"2024-09-13T23:29:21.208916+0000","last_active":"2024-09-13T23:29:21.208876+0000","last_peered":"2024-09-13T23:29:21.208876+0000","last_clean":"2024-09-13T23:29:21.208876+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:29:21.208876+0000","last_undegraded":"2024-09-13T23:29:21.208876+0000","last_fullsized":"2024-09-13T23:29:21.208876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.208791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:18.571722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.639015+0000","last_change":"2024-09-13T23:28:56.639079+0000","last_active":"2024-09-13T23:28:56.639015+0000","last_peered":"2024-09-13T23:28:56.639015+0000","last_clean":"2024-09-13T23:28:56.639015+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:28:56.639015+0000","last_undegraded":"2024-09-13T23:28:56.639015+0000","last_fullsized":"2024-09-13T23:28:56.639015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.638914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:33.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.718552+0000","last_change":"2024-09-13T23:29:16.718580+0000","last_active":"2024-09-13T23:29:16.718552+0000","last_peered":"2024-09-13T23:29:16.718552+0000","last_clean":"2024-09-13T23:29:16.718552+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:29:16.718552+0000","last_undegraded":"2024-09-13T23:29:16.718552+0000","last_fullsized":"2024-09-13T23:29:16.718552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.718459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:51.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.213714+0000","last_change":"2024-09-13T23:29:07.213741+0000","last_active":"2024-09-13T23:29:07.213714+0000","last_peered":"2024-09-13T23:29:07.213714+0000","last_clean":"2024-09-13T23:29:07.213714+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:29:07.213714+0000","last_undegraded":"2024-09-13T23:29:07.213714+0000","last_fullsized":"2024-09-13T23:29:07.213714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.213605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:01.540063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.162742+0000","last_change":"2024-09-13T23:29:27.162764+0000","last_active":"2024-09-13T23:29:27.162742+0000","last_peered":"2024-09-13T23:29:27.162742+0000","last_clean":"2024-09-13T23:29:27.162742+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:29:27.162742+0000","last_undegraded":"2024-09-13T23:29:27.162742+0000","last_fullsized":"2024-09-13T23:29:27.162742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.162654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:25.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.195768+0000","last_change":"2024-09-13T23:29:30.195793+0000","last_active":"2024-09-13T23:29:30.195768+0000","last_peered":"2024-09-13T23:29:30.195768+0000","last_clean":"2024-09-13T23:29:30.195768+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:29:30.195768+0000","last_undegraded":"2024-09-13T23:29:30.195768+0000","last_fullsized":"2024-09-13T23:29:30.195768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.195679+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:33.795978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.250487+0000","last_change":"2024-09-13T23:29:18.250515+0000","last_active":"2024-09-13T23:29:18.250487+0000","last_peered":"2024-09-13T23:29:18.250487+0000","last_clean":"2024-09-13T23:29:18.250487+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:29:18.250487+0000","last_undegraded":"2024-09-13T23:29:18.250487+0000","last_fullsized":"2024-09-13T23:29:18.250487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.250363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:36.745243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.195756+0000","last_change":"2024-09-13T23:29:33.195808+0000","last_active":"2024-09-13T23:29:33.195756+0000","last_peered":"2024-09-13T23:29:33.195756+0000","last_clean":"2024-09-13T23:29:33.195756+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:29:33.195756+0000","last_undegraded":"2024-09-13T23:29:33.195756+0000","last_fullsized":"2024-09-13T23:29:33.195756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.195648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:34.430333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.412219+0000","last_change":"2024-09-13T23:28:35.412268+0000","last_active":"2024-09-13T23:28:35.412219+0000","last_peered":"2024-09-13T23:28:35.412219+0000","last_clean":"2024-09-13T23:28:35.412219+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:28:35.412219+0000","last_undegraded":"2024-09-13T23:28:35.412219+0000","last_fullsized":"2024-09-13T23:28:35.412219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.412096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:03.433021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.403834+0000","last_change":"2024-09-13T23:28:53.403875+0000","last_active":"2024-09-13T23:28:53.403834+0000","last_peered":"2024-09-13T23:28:53.403834+0000","last_clean":"2024-09-13T23:28:53.403834+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:53.403834+0000","last_undegraded":"2024-09-13T23:28:53.403834+0000","last_fullsized":"2024-09-13T23:28:53.403834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.403743+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:52.708366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.383764+0000","last_change":"2024-09-13T23:28:42.383806+0000","last_active":"2024-09-13T23:28:42.383764+0000","last_peered":"2024-09-13T23:28:42.383764+0000","last_clean":"2024-09-13T23:28:42.383764+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:28:42.383764+0000","last_undegraded":"2024-09-13T23:28:42.383764+0000","last_fullsized":"2024-09-13T23:28:42.383764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.383654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:23.582962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.190460+0000","last_change":"2024-09-13T23:29:29.190517+0000","last_active":"2024-09-13T23:29:29.190460+0000","last_peered":"2024-09-13T23:29:29.190460+0000","last_clean":"2024-09-13T23:29:29.190460+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:29:29.190460+0000","last_undegraded":"2024-09-13T23:29:29.190460+0000","last_fullsized":"2024-09-13T23:29:29.190460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.190360+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:54.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.298202+0000","last_change":"2024-09-13T23:29:16.298230+0000","last_active":"2024-09-13T23:29:16.298202+0000","last_peered":"2024-09-13T23:29:16.298202+0000","last_clean":"2024-09-13T23:29:16.298202+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:29:16.298202+0000","last_undegraded":"2024-09-13T23:29:16.298202+0000","last_fullsized":"2024-09-13T23:29:16.298202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.298110+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:05.867340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.525437+0000","last_change":"2024-09-13T23:29:18.525462+0000","last_active":"2024-09-13T23:29:18.525437+0000","last_peered":"2024-09-13T23:29:18.525437+0000","last_clean":"2024-09-13T23:29:18.525437+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:29:18.525437+0000","last_undegraded":"2024-09-13T23:29:18.525437+0000","last_fullsized":"2024-09-13T23:29:18.525437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.525350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:40.941146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.285642+0000","last_change":"2024-09-13T23:29:33.285670+0000","last_active":"2024-09-13T23:29:33.285642+0000","last_peered":"2024-09-13T23:29:33.285642+0000","last_clean":"2024-09-13T23:29:33.285642+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:29:33.285642+0000","last_undegraded":"2024-09-13T23:29:33.285642+0000","last_fullsized":"2024-09-13T23:29:33.285642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.285554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.109619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.401547+0000","last_change":"2024-09-13T23:28:39.401603+0000","last_active":"2024-09-13T23:28:39.401547+0000","last_peered":"2024-09-13T23:28:39.401547+0000","last_clean":"2024-09-13T23:28:39.401547+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:28:39.401547+0000","last_undegraded":"2024-09-13T23:28:39.401547+0000","last_fullsized":"2024-09-13T23:28:39.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.401441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:23.948110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.453172+0000","last_change":"2024-09-13T23:28:34.453193+0000","last_active":"2024-09-13T23:28:34.453172+0000","last_peered":"2024-09-13T23:28:34.453172+0000","last_clean":"2024-09-13T23:28:34.453172+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:28:34.453172+0000","last_undegraded":"2024-09-13T23:28:34.453172+0000","last_fullsized":"2024-09-13T23:28:34.453172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.453082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:39.061568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.486705+0000","last_change":"2024-09-13T23:25:23.306295+0000","last_active":"2024-09-13T23:28:22.486705+0000","last_peered":"2024-09-13T23:28:22.486705+0000","last_clean":"2024-09-13T23:28:22.486705+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:28:22.486705+0000","last_undegraded":"2024-09-13T23:28:22.486705+0000","last_fullsized":"2024-09-13T23:28:22.486705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.254465+0000","last_change":"2024-09-13T23:29:20.254517+0000","last_active":"2024-09-13T23:29:20.254465+0000","last_peered":"2024-09-13T23:29:20.254465+0000","last_clean":"2024-09-13T23:29:20.254465+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:29:20.254465+0000","last_undegraded":"2024-09-13T23:29:20.254465+0000","last_fullsized":"2024-09-13T23:29:20.254465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.254341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:55.274744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330627+0000","last_change":"2024-09-13T23:25:13.279395+0000","last_active":"2024-09-13T23:27:33.330627+0000","last_peered":"2024-09-13T23:27:33.330627+0000","last_clean":"2024-09-13T23:27:33.330627+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:27:33.330627+0000","last_undegraded":"2024-09-13T23:27:33.330627+0000","last_fullsized":"2024-09-13T23:27:33.330627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.916935+0000","last_change":"2024-09-13T23:28:50.917010+0000","last_active":"2024-09-13T23:28:50.916935+0000","last_peered":"2024-09-13T23:28:50.916935+0000","last_clean":"2024-09-13T23:28:50.916935+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:28:50.916935+0000","last_undegraded":"2024-09-13T23:28:50.916935+0000","last_fullsized":"2024-09-13T23:28:50.916935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.916803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:55.569318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.835923+0000","last_change":"2024-09-13T23:28:43.835968+0000","last_active":"2024-09-13T23:28:43.835923+0000","last_peered":"2024-09-13T23:28:43.835923+0000","last_clean":"2024-09-13T23:28:43.835923+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:28:43.835923+0000","last_undegraded":"2024-09-13T23:28:43.835923+0000","last_fullsized":"2024-09-13T23:28:43.835923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.835830+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.336311+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":393,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.332450+0000","last_change":"2024-09-13T23:28:58.332504+0000","last_active":"2024-09-13T23:28:58.332450+0000","last_peered":"2024-09-13T23:28:58.332450+0000","last_clean":"2024-09-13T23:28:58.332450+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:58.332450+0000","last_undegraded":"2024-09-13T23:28:58.332450+0000","last_fullsized":"2024-09-13T23:28:58.332450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.332349+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:44.416231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.600162+0000","last_change":"2024-09-13T23:29:21.600189+0000","last_active":"2024-09-13T23:29:21.600162+0000","last_peered":"2024-09-13T23:29:21.600162+0000","last_clean":"2024-09-13T23:29:21.600162+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:29:21.600162+0000","last_undegraded":"2024-09-13T23:29:21.600162+0000","last_fullsized":"2024-09-13T23:29:21.600162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.600069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:19:33.000348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.847241+0000","last_change":"2024-09-13T23:28:59.847269+0000","last_active":"2024-09-13T23:28:59.847241+0000","last_peered":"2024-09-13T23:28:59.847241+0000","last_clean":"2024-09-13T23:28:59.847241+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:59.847241+0000","last_undegraded":"2024-09-13T23:28:59.847241+0000","last_fullsized":"2024-09-13T23:28:59.847241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.847154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:32.418333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.073919+0000","last_change":"2024-09-13T23:29:11.073943+0000","last_active":"2024-09-13T23:29:11.073919+0000","last_peered":"2024-09-13T23:29:11.073919+0000","last_clean":"2024-09-13T23:29:11.073919+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:29:11.073919+0000","last_undegraded":"2024-09-13T23:29:11.073919+0000","last_fullsized":"2024-09-13T23:29:11.073919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.073831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:30.480544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.432327+0000","last_change":"2024-09-13T23:28:42.432355+0000","last_active":"2024-09-13T23:28:42.432327+0000","last_peered":"2024-09-13T23:28:42.432327+0000","last_clean":"2024-09-13T23:28:42.432327+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:28:42.432327+0000","last_undegraded":"2024-09-13T23:28:42.432327+0000","last_fullsized":"2024-09-13T23:28:42.432327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.432240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.272484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.853868+0000","last_change":"2024-09-13T23:28:42.853928+0000","last_active":"2024-09-13T23:28:42.853868+0000","last_peered":"2024-09-13T23:28:42.853868+0000","last_clean":"2024-09-13T23:28:42.853868+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:42.853868+0000","last_undegraded":"2024-09-13T23:28:42.853868+0000","last_fullsized":"2024-09-13T23:28:42.853868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.853764+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:24.964571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.867464+0000","last_change":"2024-09-13T23:28:37.867494+0000","last_active":"2024-09-13T23:28:37.867464+0000","last_peered":"2024-09-13T23:28:37.867464+0000","last_clean":"2024-09-13T23:28:37.867464+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:37.867464+0000","last_undegraded":"2024-09-13T23:28:37.867464+0000","last_fullsized":"2024-09-13T23:28:37.867464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.867370+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:50.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":84,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.383200+0000","last_change":"2024-09-13T23:28:48.383237+0000","last_active":"2024-09-13T23:28:48.383200+0000","last_peered":"2024-09-13T23:28:48.383200+0000","last_clean":"2024-09-13T23:28:48.383200+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:48.383200+0000","last_undegraded":"2024-09-13T23:28:48.383200+0000","last_fullsized":"2024-09-13T23:28:48.383200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.383091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:30.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.539887+0000","last_change":"2024-09-13T23:29:00.539913+0000","last_active":"2024-09-13T23:29:00.539887+0000","last_peered":"2024-09-13T23:29:00.539887+0000","last_clean":"2024-09-13T23:29:00.539887+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:29:00.539887+0000","last_undegraded":"2024-09-13T23:29:00.539887+0000","last_fullsized":"2024-09-13T23:29:00.539887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.539784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:15.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.221445+0000","last_change":"2024-09-13T23:28:48.221472+0000","last_active":"2024-09-13T23:28:48.221445+0000","last_peered":"2024-09-13T23:28:48.221445+0000","last_clean":"2024-09-13T23:28:48.221445+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:28:48.221445+0000","last_undegraded":"2024-09-13T23:28:48.221445+0000","last_fullsized":"2024-09-13T23:28:48.221445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.221353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:59.646033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.789042+0000","last_change":"2024-09-13T23:28:38.789114+0000","last_active":"2024-09-13T23:28:38.789042+0000","last_peered":"2024-09-13T23:28:38.789042+0000","last_clean":"2024-09-13T23:28:38.789042+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:38.789042+0000","last_undegraded":"2024-09-13T23:28:38.789042+0000","last_fullsized":"2024-09-13T23:28:38.789042+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.788930+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:52.119474+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.797110+0000","last_change":"2024-09-13T23:28:35.797133+0000","last_active":"2024-09-13T23:28:35.797110+0000","last_peered":"2024-09-13T23:28:35.797110+0000","last_clean":"2024-09-13T23:28:35.797110+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:28:35.797110+0000","last_undegraded":"2024-09-13T23:28:35.797110+0000","last_fullsized":"2024-09-13T23:28:35.797110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.797014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.615531+0000","last_change":"2024-09-13T23:29:23.615531+0000","last_active":"2024-09-13T23:29:23.615531+0000","last_peered":"2024-09-13T23:29:23.615531+0000","last_clean":"2024-09-13T23:29:23.615531+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:29:23.615531+0000","last_undegraded":"2024-09-13T23:29:23.615531+0000","last_fullsized":"2024-09-13T23:29:23.615531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.615415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:56.682635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.193171+0000","last_change":"2024-09-13T23:29:05.193218+0000","last_active":"2024-09-13T23:29:05.193171+0000","last_peered":"2024-09-13T23:29:05.193171+0000","last_clean":"2024-09-13T23:29:05.193171+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:29:05.193171+0000","last_undegraded":"2024-09-13T23:29:05.193171+0000","last_fullsized":"2024-09-13T23:29:05.193171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.193061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:54.252627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.516160+0000","last_change":"2024-09-13T23:29:17.516198+0000","last_active":"2024-09-13T23:29:17.516160+0000","last_peered":"2024-09-13T23:29:17.516160+0000","last_clean":"2024-09-13T23:29:17.516160+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:29:17.516160+0000","last_undegraded":"2024-09-13T23:29:17.516160+0000","last_fullsized":"2024-09-13T23:29:17.516160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.516070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:33.834491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.878000+0000","last_change":"2024-09-13T23:28:47.878026+0000","last_active":"2024-09-13T23:28:47.878000+0000","last_peered":"2024-09-13T23:28:47.878000+0000","last_clean":"2024-09-13T23:28:47.878000+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:28:47.878000+0000","last_undegraded":"2024-09-13T23:28:47.878000+0000","last_fullsized":"2024-09-13T23:28:47.878000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.877888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:24.096380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.395633+0000","last_change":"2024-09-13T23:28:41.395683+0000","last_active":"2024-09-13T23:28:41.395633+0000","last_peered":"2024-09-13T23:28:41.395633+0000","last_clean":"2024-09-13T23:28:41.395633+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:41.395633+0000","last_undegraded":"2024-09-13T23:28:41.395633+0000","last_fullsized":"2024-09-13T23:28:41.395633+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.395529+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:16.720847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.869542+0000","last_change":"2024-09-13T23:28:49.869568+0000","last_active":"2024-09-13T23:28:49.869542+0000","last_peered":"2024-09-13T23:28:49.869542+0000","last_clean":"2024-09-13T23:28:49.869542+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:28:49.869542+0000","last_undegraded":"2024-09-13T23:28:49.869542+0000","last_fullsized":"2024-09-13T23:28:49.869542+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.869451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.241159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.227072+0000","last_change":"2024-09-13T23:28:50.227072+0000","last_active":"2024-09-13T23:28:50.227072+0000","last_peered":"2024-09-13T23:28:50.227072+0000","last_clean":"2024-09-13T23:28:50.227072+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:28:50.227072+0000","last_undegraded":"2024-09-13T23:28:50.227072+0000","last_fullsized":"2024-09-13T23:28:50.227072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.226940+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.317457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.574276+0000","last_change":"2024-09-13T23:29:01.574304+0000","last_active":"2024-09-13T23:29:01.574276+0000","last_peered":"2024-09-13T23:29:01.574276+0000","last_clean":"2024-09-13T23:29:01.574276+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:29:01.574276+0000","last_undegraded":"2024-09-13T23:29:01.574276+0000","last_fullsized":"2024-09-13T23:29:01.574276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.574185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:53.945893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:29.572149+0000","last_change":"2024-09-13T23:25:13.284949+0000","last_active":"2024-09-13T23:28:29.572149+0000","last_peered":"2024-09-13T23:28:29.572149+0000","last_clean":"2024-09-13T23:28:29.572149+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:28:29.572149+0000","last_undegraded":"2024-09-13T23:28:29.572149+0000","last_fullsized":"2024-09-13T23:28:29.572149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.848048+0000","last_change":"2024-09-13T23:28:52.848076+0000","last_active":"2024-09-13T23:28:52.848048+0000","last_peered":"2024-09-13T23:28:52.848048+0000","last_clean":"2024-09-13T23:28:52.848048+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:28:52.848048+0000","last_undegraded":"2024-09-13T23:28:52.848048+0000","last_fullsized":"2024-09-13T23:28:52.848048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.847961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.924204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'47","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.373548+0000","last_change":"2024-09-13T23:29:02.373593+0000","last_active":"2024-09-13T23:29:02.373548+0000","last_peered":"2024-09-13T23:29:02.373548+0000","last_clean":"2024-09-13T23:29:02.373548+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:29:02.373548+0000","last_undegraded":"2024-09-13T23:29:02.373548+0000","last_fullsized":"2024-09-13T23:29:02.373548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.373443+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:09.196717+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":360,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.901602+0000","last_change":"2024-09-13T23:28:57.901638+0000","last_active":"2024-09-13T23:28:57.901602+0000","last_peered":"2024-09-13T23:28:57.901602+0000","last_clean":"2024-09-13T23:28:57.901602+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:57.901602+0000","last_undegraded":"2024-09-13T23:28:57.901602+0000","last_fullsized":"2024-09-13T23:28:57.901602+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.901512+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:41.619080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.614142+0000","last_change":"2024-09-13T23:29:28.614182+0000","last_active":"2024-09-13T23:29:28.614142+0000","last_peered":"2024-09-13T23:29:28.614142+0000","last_clean":"2024-09-13T23:29:28.614142+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:29:28.614142+0000","last_undegraded":"2024-09-13T23:29:28.614142+0000","last_fullsized":"2024-09-13T23:29:28.614142+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.614044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:14.521686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.672169+0000","last_change":"2024-09-13T23:28:55.672214+0000","last_active":"2024-09-13T23:28:55.672169+0000","last_peered":"2024-09-13T23:28:55.672169+0000","last_clean":"2024-09-13T23:28:55.672169+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:55.672169+0000","last_undegraded":"2024-09-13T23:28:55.672169+0000","last_fullsized":"2024-09-13T23:28:55.672169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.672076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:02.488271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.188786+0000","last_change":"2024-09-13T23:29:30.188812+0000","last_active":"2024-09-13T23:29:30.188786+0000","last_peered":"2024-09-13T23:29:30.188786+0000","last_clean":"2024-09-13T23:29:30.188786+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:29:30.188786+0000","last_undegraded":"2024-09-13T23:29:30.188786+0000","last_fullsized":"2024-09-13T23:29:30.188786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.188678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:01.676356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.872634+0000","last_change":"2024-09-13T23:28:51.872681+0000","last_active":"2024-09-13T23:28:51.872634+0000","last_peered":"2024-09-13T23:28:51.872634+0000","last_clean":"2024-09-13T23:28:51.872634+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:28:51.872634+0000","last_undegraded":"2024-09-13T23:28:51.872634+0000","last_fullsized":"2024-09-13T23:28:51.872634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.872543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:15.808273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":139,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.300257+0000","last_change":"2024-09-13T23:29:00.300292+0000","last_active":"2024-09-13T23:29:00.300257+0000","last_peered":"2024-09-13T23:29:00.300257+0000","last_clean":"2024-09-13T23:29:00.300257+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:29:00.300257+0000","last_undegraded":"2024-09-13T23:29:00.300257+0000","last_fullsized":"2024-09-13T23:29:00.300257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'66","last_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_deep_scrub":"33'66","last_deep_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.300157+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:45.866727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.841670+0000","last_change":"2024-09-13T23:28:34.841693+0000","last_active":"2024-09-13T23:28:34.841670+0000","last_peered":"2024-09-13T23:28:34.841670+0000","last_clean":"2024-09-13T23:28:34.841670+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:28:34.841670+0000","last_undegraded":"2024-09-13T23:28:34.841670+0000","last_fullsized":"2024-09-13T23:28:34.841670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.841569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:03.926916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'20","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.966018+0000","last_change":"2024-09-13T23:25:23.311525+0000","last_active":"2024-09-13T23:28:22.966018+0000","last_peered":"2024-09-13T23:28:22.966018+0000","last_clean":"2024-09-13T23:28:22.966018+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:28:22.966018+0000","last_undegraded":"2024-09-13T23:28:22.966018+0000","last_fullsized":"2024-09-13T23:28:22.966018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":81,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.232888+0000","last_change":"2024-09-13T23:28:57.232952+0000","last_active":"2024-09-13T23:28:57.232888+0000","last_peered":"2024-09-13T23:28:57.232888+0000","last_clean":"2024-09-13T23:28:57.232888+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:57.232888+0000","last_undegraded":"2024-09-13T23:28:57.232888+0000","last_fullsized":"2024-09-13T23:28:57.232888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.232786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:36.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.864586+0000","last_change":"2024-09-13T23:29:08.864615+0000","last_active":"2024-09-13T23:29:08.864586+0000","last_peered":"2024-09-13T23:29:08.864586+0000","last_clean":"2024-09-13T23:29:08.864586+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:29:08.864586+0000","last_undegraded":"2024-09-13T23:29:08.864586+0000","last_fullsized":"2024-09-13T23:29:08.864586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.864495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:40.831517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.688105+0000","last_change":"2024-09-13T23:28:50.688153+0000","last_active":"2024-09-13T23:28:50.688105+0000","last_peered":"2024-09-13T23:28:50.688105+0000","last_clean":"2024-09-13T23:28:50.688105+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:28:50.688105+0000","last_undegraded":"2024-09-13T23:28:50.688105+0000","last_fullsized":"2024-09-13T23:28:50.688105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.687998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:09.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.386681+0000","last_change":"2024-09-13T23:28:43.386721+0000","last_active":"2024-09-13T23:28:43.386681+0000","last_peered":"2024-09-13T23:28:43.386681+0000","last_clean":"2024-09-13T23:28:43.386681+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:43.386681+0000","last_undegraded":"2024-09-13T23:28:43.386681+0000","last_fullsized":"2024-09-13T23:28:43.386681+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.386578+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.830372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.325018+0000","last_change":"2024-09-13T23:29:01.325076+0000","last_active":"2024-09-13T23:29:01.325018+0000","last_peered":"2024-09-13T23:29:01.325018+0000","last_clean":"2024-09-13T23:29:01.325018+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:29:01.325018+0000","last_undegraded":"2024-09-13T23:29:01.325018+0000","last_fullsized":"2024-09-13T23:29:01.325018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.324903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:21.454194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.252111+0000","last_change":"2024-09-13T23:29:21.252111+0000","last_active":"2024-09-13T23:29:21.252111+0000","last_peered":"2024-09-13T23:29:21.252111+0000","last_clean":"2024-09-13T23:29:21.252111+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:29:21.252111+0000","last_undegraded":"2024-09-13T23:29:21.252111+0000","last_fullsized":"2024-09-13T23:29:21.252111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.251980+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:04.952259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.447280+0000","last_change":"2024-09-13T23:28:52.447307+0000","last_active":"2024-09-13T23:28:52.447280+0000","last_peered":"2024-09-13T23:28:52.447280+0000","last_clean":"2024-09-13T23:28:52.447280+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:52.447280+0000","last_undegraded":"2024-09-13T23:28:52.447280+0000","last_fullsized":"2024-09-13T23:28:52.447280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.447192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:03.543667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.127947+0000","last_change":"2024-09-13T23:29:28.127947+0000","last_active":"2024-09-13T23:29:28.127947+0000","last_peered":"2024-09-13T23:29:28.127947+0000","last_clean":"2024-09-13T23:29:28.127947+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:29:28.127947+0000","last_undegraded":"2024-09-13T23:29:28.127947+0000","last_fullsized":"2024-09-13T23:29:28.127947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.127828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.066301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.843970+0000","last_change":"2024-09-13T23:28:48.844011+0000","last_active":"2024-09-13T23:28:48.843970+0000","last_peered":"2024-09-13T23:28:48.843970+0000","last_clean":"2024-09-13T23:28:48.843970+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:28:48.843970+0000","last_undegraded":"2024-09-13T23:28:48.843970+0000","last_fullsized":"2024-09-13T23:28:48.843970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.843846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:04.241715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.801671+0000","last_change":"2024-09-13T23:28:44.801707+0000","last_active":"2024-09-13T23:28:44.801671+0000","last_peered":"2024-09-13T23:28:44.801671+0000","last_clean":"2024-09-13T23:28:44.801671+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:44.801671+0000","last_undegraded":"2024-09-13T23:28:44.801671+0000","last_fullsized":"2024-09-13T23:28:44.801671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.801589+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:14.458499+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.752376+0000","last_change":"2024-09-13T23:28:33.752406+0000","last_active":"2024-09-13T23:28:33.752376+0000","last_peered":"2024-09-13T23:28:33.752376+0000","last_clean":"2024-09-13T23:28:33.752376+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:33.752376+0000","last_undegraded":"2024-09-13T23:28:33.752376+0000","last_fullsized":"2024-09-13T23:28:33.752376+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.752282+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:30.865050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.848909+0000","last_change":"2024-09-13T23:29:01.848945+0000","last_active":"2024-09-13T23:29:01.848909+0000","last_peered":"2024-09-13T23:29:01.848909+0000","last_clean":"2024-09-13T23:29:01.848909+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:29:01.848909+0000","last_undegraded":"2024-09-13T23:29:01.848909+0000","last_fullsized":"2024-09-13T23:29:01.848909+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.848809+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:59.151044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.562134+0000","last_change":"2024-09-13T23:29:09.562160+0000","last_active":"2024-09-13T23:29:09.562134+0000","last_peered":"2024-09-13T23:29:09.562134+0000","last_clean":"2024-09-13T23:29:09.562134+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:29:09.562134+0000","last_undegraded":"2024-09-13T23:29:09.562134+0000","last_fullsized":"2024-09-13T23:29:09.562134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.562025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:49.934234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807842+0000","last_change":"2024-09-13T23:25:13.279885+0000","last_active":"2024-09-13T23:28:33.807842+0000","last_peered":"2024-09-13T23:28:33.807842+0000","last_clean":"2024-09-13T23:28:33.807842+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:28:33.807842+0000","last_undegraded":"2024-09-13T23:28:33.807842+0000","last_fullsized":"2024-09-13T23:28:33.807842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":428,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.183560+0000","last_change":"2024-09-13T23:28:49.183590+0000","last_active":"2024-09-13T23:28:49.183560+0000","last_peered":"2024-09-13T23:28:49.183560+0000","last_clean":"2024-09-13T23:28:49.183560+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:49.183560+0000","last_undegraded":"2024-09-13T23:28:49.183560+0000","last_fullsized":"2024-09-13T23:28:49.183560+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.183478+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:30.265049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.395542+0000","last_change":"2024-09-13T23:29:04.395583+0000","last_active":"2024-09-13T23:29:04.395542+0000","last_peered":"2024-09-13T23:29:04.395542+0000","last_clean":"2024-09-13T23:29:04.395542+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:29:04.395542+0000","last_undegraded":"2024-09-13T23:29:04.395542+0000","last_fullsized":"2024-09-13T23:29:04.395542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.395455+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:53.348397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":480,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425677+0000","last_change":"2024-09-13T23:28:36.425723+0000","last_active":"2024-09-13T23:28:36.425677+0000","last_peered":"2024-09-13T23:28:36.425677+0000","last_clean":"2024-09-13T23:28:36.425677+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:36.425677+0000","last_undegraded":"2024-09-13T23:28:36.425677+0000","last_fullsized":"2024-09-13T23:28:36.425677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.425562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.620126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.564601+0000","last_change":"2024-09-13T23:29:20.564601+0000","last_active":"2024-09-13T23:29:20.564601+0000","last_peered":"2024-09-13T23:29:20.564601+0000","last_clean":"2024-09-13T23:29:20.564601+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:29:20.564601+0000","last_undegraded":"2024-09-13T23:29:20.564601+0000","last_fullsized":"2024-09-13T23:29:20.564601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.564390+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.971103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.185495+0000","last_change":"2024-09-13T23:29:01.185521+0000","last_active":"2024-09-13T23:29:01.185495+0000","last_peered":"2024-09-13T23:29:01.185495+0000","last_clean":"2024-09-13T23:29:01.185495+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:29:01.185495+0000","last_undegraded":"2024-09-13T23:29:01.185495+0000","last_fullsized":"2024-09-13T23:29:01.185495+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.185393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:49.860619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807808+0000","last_change":"2024-09-13T23:25:13.284140+0000","last_active":"2024-09-13T23:28:33.807808+0000","last_peered":"2024-09-13T23:28:33.807808+0000","last_clean":"2024-09-13T23:28:33.807808+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:28:33.807808+0000","last_undegraded":"2024-09-13T23:28:33.807808+0000","last_fullsized":"2024-09-13T23:28:33.807808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.394317+0000","last_change":"2024-09-13T23:28:38.394345+0000","last_active":"2024-09-13T23:28:38.394317+0000","last_peered":"2024-09-13T23:28:38.394317+0000","last_clean":"2024-09-13T23:28:38.394317+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:28:38.394317+0000","last_undegraded":"2024-09-13T23:28:38.394317+0000","last_fullsized":"2024-09-13T23:28:38.394317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.394212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:21.836246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":108,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.343811+0000","last_change":"2024-09-13T23:28:44.343852+0000","last_active":"2024-09-13T23:28:44.343811+0000","last_peered":"2024-09-13T23:28:44.343811+0000","last_clean":"2024-09-13T23:28:44.343811+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:44.343811+0000","last_undegraded":"2024-09-13T23:28:44.343811+0000","last_fullsized":"2024-09-13T23:28:44.343811+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.343715+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.109483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.818959+0000","last_change":"2024-09-13T23:28:41.818982+0000","last_active":"2024-09-13T23:28:41.818959+0000","last_peered":"2024-09-13T23:28:41.818959+0000","last_clean":"2024-09-13T23:28:41.818959+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:28:41.818959+0000","last_undegraded":"2024-09-13T23:28:41.818959+0000","last_fullsized":"2024-09-13T23:28:41.818959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.818869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:39:47.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.308494+0000","last_change":"2024-09-13T23:28:46.308494+0000","last_active":"2024-09-13T23:28:46.308494+0000","last_peered":"2024-09-13T23:28:46.308494+0000","last_clean":"2024-09-13T23:28:46.308494+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:46.308494+0000","last_undegraded":"2024-09-13T23:28:46.308494+0000","last_fullsized":"2024-09-13T23:28:46.308494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.308315+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:05.222355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.609131+0000","last_change":"2024-09-13T23:29:26.609157+0000","last_active":"2024-09-13T23:29:26.609131+0000","last_peered":"2024-09-13T23:29:26.609131+0000","last_clean":"2024-09-13T23:29:26.609131+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:29:26.609131+0000","last_undegraded":"2024-09-13T23:29:26.609131+0000","last_fullsized":"2024-09-13T23:29:26.609131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.609024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:44.317023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.163503+0000","last_change":"2024-09-13T23:29:20.163541+0000","last_active":"2024-09-13T23:29:20.163503+0000","last_peered":"2024-09-13T23:29:20.163503+0000","last_clean":"2024-09-13T23:29:20.163503+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:29:20.163503+0000","last_undegraded":"2024-09-13T23:29:20.163503+0000","last_fullsized":"2024-09-13T23:29:20.163503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.163405+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:46.471149+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807657+0000","last_change":"2024-09-13T23:25:06.412073+0000","last_active":"2024-09-13T23:28:33.807657+0000","last_peered":"2024-09-13T23:28:33.807657+0000","last_clean":"2024-09-13T23:28:33.807657+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:28:33.807657+0000","last_undegraded":"2024-09-13T23:28:33.807657+0000","last_fullsized":"2024-09-13T23:28:33.807657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807720+0000","last_change":"2024-09-13T23:25:13.280977+0000","last_active":"2024-09-13T23:28:33.807720+0000","last_peered":"2024-09-13T23:28:33.807720+0000","last_clean":"2024-09-13T23:28:33.807720+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:28:33.807720+0000","last_undegraded":"2024-09-13T23:28:33.807720+0000","last_fullsized":"2024-09-13T23:28:33.807720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.221206+0000","last_change":"2024-09-13T23:28:53.221206+0000","last_active":"2024-09-13T23:28:53.221206+0000","last_peered":"2024-09-13T23:28:53.221206+0000","last_clean":"2024-09-13T23:28:53.221206+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:28:53.221206+0000","last_undegraded":"2024-09-13T23:28:53.221206+0000","last_fullsized":"2024-09-13T23:28:53.221206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.221045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:28.166667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'92","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.357703+0000","last_change":"2024-09-13T23:29:06.357739+0000","last_active":"2024-09-13T23:29:06.357703+0000","last_peered":"2024-09-13T23:29:06.357703+0000","last_clean":"2024-09-13T23:29:06.357703+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:29:06.357703+0000","last_undegraded":"2024-09-13T23:29:06.357703+0000","last_fullsized":"2024-09-13T23:29:06.357703+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.357608+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:02.482328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.823638+0000","last_change":"2024-09-13T23:28:53.823673+0000","last_active":"2024-09-13T23:28:53.823638+0000","last_peered":"2024-09-13T23:28:53.823638+0000","last_clean":"2024-09-13T23:28:53.823638+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:28:53.823638+0000","last_undegraded":"2024-09-13T23:28:53.823638+0000","last_fullsized":"2024-09-13T23:28:53.823638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.823527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:30.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":173,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.737352+0000","last_change":"2024-09-13T23:28:49.737380+0000","last_active":"2024-09-13T23:28:49.737352+0000","last_peered":"2024-09-13T23:28:49.737352+0000","last_clean":"2024-09-13T23:28:49.737352+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:49.737352+0000","last_undegraded":"2024-09-13T23:28:49.737352+0000","last_fullsized":"2024-09-13T23:28:49.737352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.737262+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:19.374870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.227111+0000","last_change":"2024-09-13T23:29:19.227141+0000","last_active":"2024-09-13T23:29:19.227111+0000","last_peered":"2024-09-13T23:29:19.227111+0000","last_clean":"2024-09-13T23:29:19.227111+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:29:19.227111+0000","last_undegraded":"2024-09-13T23:29:19.227111+0000","last_fullsized":"2024-09-13T23:29:19.227111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.227009+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:09.980858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807657+0000","last_change":"2024-09-13T23:25:06.411034+0000","last_active":"2024-09-13T23:28:33.807657+0000","last_peered":"2024-09-13T23:28:33.807657+0000","last_clean":"2024-09-13T23:28:33.807657+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:28:33.807657+0000","last_undegraded":"2024-09-13T23:28:33.807657+0000","last_fullsized":"2024-09-13T23:28:33.807657+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.548895+0000","last_change":"2024-09-13T23:29:22.548895+0000","last_active":"2024-09-13T23:29:22.548895+0000","last_peered":"2024-09-13T23:29:22.548895+0000","last_clean":"2024-09-13T23:29:22.548895+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:29:22.548895+0000","last_undegraded":"2024-09-13T23:29:22.548895+0000","last_fullsized":"2024-09-13T23:29:22.548895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.548710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:02.141054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.403447+0000","last_change":"2024-09-13T23:28:40.403471+0000","last_active":"2024-09-13T23:28:40.403447+0000","last_peered":"2024-09-13T23:28:40.403447+0000","last_clean":"2024-09-13T23:28:40.403447+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:28:40.403447+0000","last_undegraded":"2024-09-13T23:28:40.403447+0000","last_fullsized":"2024-09-13T23:28:40.403447+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.922817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":516,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.424100+0000","last_change":"2024-09-13T23:28:37.424100+0000","last_active":"2024-09-13T23:28:37.424100+0000","last_peered":"2024-09-13T23:28:37.424100+0000","last_clean":"2024-09-13T23:28:37.424100+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:37.424100+0000","last_undegraded":"2024-09-13T23:28:37.424100+0000","last_fullsized":"2024-09-13T23:28:37.424100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'290","last_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_deep_scrub":"33'290","last_deep_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.423958+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:06.509304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.332791+0000","last_change":"2024-09-13T23:28:59.332791+0000","last_active":"2024-09-13T23:28:59.332791+0000","last_peered":"2024-09-13T23:28:59.332791+0000","last_clean":"2024-09-13T23:28:59.332791+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:28:59.332791+0000","last_undegraded":"2024-09-13T23:28:59.332791+0000","last_fullsized":"2024-09-13T23:28:59.332791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.332635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.559378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.257463+0000","last_change":"2024-09-13T23:28:54.257508+0000","last_active":"2024-09-13T23:28:54.257463+0000","last_peered":"2024-09-13T23:28:54.257463+0000","last_clean":"2024-09-13T23:28:54.257463+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:28:54.257463+0000","last_undegraded":"2024-09-13T23:28:54.257463+0000","last_fullsized":"2024-09-13T23:28:54.257463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.257339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:02.842442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.870873+0000","last_change":"2024-09-13T23:29:00.870912+0000","last_active":"2024-09-13T23:29:00.870873+0000","last_peered":"2024-09-13T23:29:00.870873+0000","last_clean":"2024-09-13T23:29:00.870873+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:29:00.870873+0000","last_undegraded":"2024-09-13T23:29:00.870873+0000","last_fullsized":"2024-09-13T23:29:00.870873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.870738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:34.532435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.571870+0000","last_change":"2024-09-13T23:29:11.571870+0000","last_active":"2024-09-13T23:29:11.571870+0000","last_peered":"2024-09-13T23:29:11.571870+0000","last_clean":"2024-09-13T23:29:11.571870+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:29:11.571870+0000","last_undegraded":"2024-09-13T23:29:11.571870+0000","last_fullsized":"2024-09-13T23:29:11.571870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.571739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:44.142918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.914793+0000","last_change":"2024-09-13T23:29:04.914793+0000","last_active":"2024-09-13T23:29:04.914793+0000","last_peered":"2024-09-13T23:29:04.914793+0000","last_clean":"2024-09-13T23:29:04.914793+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:29:04.914793+0000","last_undegraded":"2024-09-13T23:29:04.914793+0000","last_fullsized":"2024-09-13T23:29:04.914793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.914680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:41.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":232,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.702573+0000","last_change":"2024-09-13T23:28:51.702609+0000","last_active":"2024-09-13T23:28:51.702573+0000","last_peered":"2024-09-13T23:28:51.702573+0000","last_clean":"2024-09-13T23:28:51.702573+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:51.702573+0000","last_undegraded":"2024-09-13T23:28:51.702573+0000","last_fullsized":"2024-09-13T23:28:51.702573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.702483+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:52.157557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.806174+0000","last_change":"2024-09-13T23:28:39.806174+0000","last_active":"2024-09-13T23:28:39.806174+0000","last_peered":"2024-09-13T23:28:39.806174+0000","last_clean":"2024-09-13T23:28:39.806174+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:39.806174+0000","last_undegraded":"2024-09-13T23:28:39.806174+0000","last_fullsized":"2024-09-13T23:28:39.806174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.806026+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:51.713911+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.882546+0000","last_change":"2024-09-13T23:28:33.882546+0000","last_active":"2024-09-13T23:28:33.882546+0000","last_peered":"2024-09-13T23:28:33.882546+0000","last_clean":"2024-09-13T23:28:33.882546+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:28:33.882546+0000","last_undegraded":"2024-09-13T23:28:33.882546+0000","last_fullsized":"2024-09-13T23:28:33.882546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.882409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:51.076973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.334715+0000","last_change":"2024-09-13T23:29:13.334740+0000","last_active":"2024-09-13T23:29:13.334715+0000","last_peered":"2024-09-13T23:29:13.334715+0000","last_clean":"2024-09-13T23:29:13.334715+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:29:13.334715+0000","last_undegraded":"2024-09-13T23:29:13.334715+0000","last_fullsized":"2024-09-13T23:29:13.334715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.334630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:41.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.809935+0000","last_change":"2024-09-13T23:29:13.809935+0000","last_active":"2024-09-13T23:29:13.809935+0000","last_peered":"2024-09-13T23:29:13.809935+0000","last_clean":"2024-09-13T23:29:13.809935+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:29:13.809935+0000","last_undegraded":"2024-09-13T23:29:13.809935+0000","last_fullsized":"2024-09-13T23:29:13.809935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.809798+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:31.517797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807698+0000","last_change":"2024-09-13T23:25:06.411752+0000","last_active":"2024-09-13T23:28:33.807698+0000","last_peered":"2024-09-13T23:28:33.807698+0000","last_clean":"2024-09-13T23:28:33.807698+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:28:33.807698+0000","last_undegraded":"2024-09-13T23:28:33.807698+0000","last_fullsized":"2024-09-13T23:28:33.807698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.573654+0000","last_change":"2024-09-13T23:29:14.573654+0000","last_active":"2024-09-13T23:29:14.573654+0000","last_peered":"2024-09-13T23:29:14.573654+0000","last_clean":"2024-09-13T23:29:14.573654+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:29:14.573654+0000","last_undegraded":"2024-09-13T23:29:14.573654+0000","last_fullsized":"2024-09-13T23:29:14.573654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.573539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:03.633104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.851664+0000","last_change":"2024-09-13T23:28:55.851664+0000","last_active":"2024-09-13T23:28:55.851664+0000","last_peered":"2024-09-13T23:28:55.851664+0000","last_clean":"2024-09-13T23:28:55.851664+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:28:55.851664+0000","last_undegraded":"2024-09-13T23:28:55.851664+0000","last_fullsized":"2024-09-13T23:28:55.851664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.851536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.407551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.436738+0000","last_change":"2024-09-13T23:28:39.436815+0000","last_active":"2024-09-13T23:28:39.436738+0000","last_peered":"2024-09-13T23:28:39.436738+0000","last_clean":"2024-09-13T23:28:39.436738+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:39.436738+0000","last_undegraded":"2024-09-13T23:28:39.436738+0000","last_fullsized":"2024-09-13T23:28:39.436738+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.436619+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.975861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.387718+0000","last_change":"2024-09-13T23:29:05.387757+0000","last_active":"2024-09-13T23:29:05.387718+0000","last_peered":"2024-09-13T23:29:05.387718+0000","last_clean":"2024-09-13T23:29:05.387718+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:29:05.387718+0000","last_undegraded":"2024-09-13T23:29:05.387718+0000","last_fullsized":"2024-09-13T23:29:05.387718+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.387595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:27.332966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.209538+0000","last_change":"2024-09-13T23:29:02.209565+0000","last_active":"2024-09-13T23:29:02.209538+0000","last_peered":"2024-09-13T23:29:02.209538+0000","last_clean":"2024-09-13T23:29:02.209538+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:29:02.209538+0000","last_undegraded":"2024-09-13T23:29:02.209538+0000","last_fullsized":"2024-09-13T23:29:02.209538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.209446+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:20.762436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.243922+0000","last_change":"2024-09-13T23:29:03.243922+0000","last_active":"2024-09-13T23:29:03.243922+0000","last_peered":"2024-09-13T23:29:03.243922+0000","last_clean":"2024-09-13T23:29:03.243922+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:29:03.243922+0000","last_undegraded":"2024-09-13T23:29:03.243922+0000","last_fullsized":"2024-09-13T23:29:03.243922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.243808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:56.628747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.531080+0000","last_change":"2024-09-13T23:29:15.531080+0000","last_active":"2024-09-13T23:29:15.531080+0000","last_peered":"2024-09-13T23:29:15.531080+0000","last_clean":"2024-09-13T23:29:15.531080+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:29:15.531080+0000","last_undegraded":"2024-09-13T23:29:15.531080+0000","last_fullsized":"2024-09-13T23:29:15.531080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.530856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:05.204799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.643519+0000","last_change":"2024-09-13T23:29:20.643550+0000","last_active":"2024-09-13T23:29:20.643519+0000","last_peered":"2024-09-13T23:29:20.643519+0000","last_clean":"2024-09-13T23:29:20.643519+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:29:20.643519+0000","last_undegraded":"2024-09-13T23:29:20.643519+0000","last_fullsized":"2024-09-13T23:29:20.643519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.643435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:53.234522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.874110+0000","last_change":"2024-09-13T23:28:56.874110+0000","last_active":"2024-09-13T23:28:56.874110+0000","last_peered":"2024-09-13T23:28:56.874110+0000","last_clean":"2024-09-13T23:28:56.874110+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:56.874110+0000","last_undegraded":"2024-09-13T23:28:56.874110+0000","last_fullsized":"2024-09-13T23:28:56.874110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.873926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:08.273545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.871262+0000","last_change":"2024-09-13T23:28:39.871262+0000","last_active":"2024-09-13T23:28:39.871262+0000","last_peered":"2024-09-13T23:28:39.871262+0000","last_clean":"2024-09-13T23:28:39.871262+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:39.871262+0000","last_undegraded":"2024-09-13T23:28:39.871262+0000","last_fullsized":"2024-09-13T23:28:39.871262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.871135+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:40.326209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.710245+0000","last_change":"2024-09-13T23:28:34.710245+0000","last_active":"2024-09-13T23:28:34.710245+0000","last_peered":"2024-09-13T23:28:34.710245+0000","last_clean":"2024-09-13T23:28:34.710245+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:28:34.710245+0000","last_undegraded":"2024-09-13T23:28:34.710245+0000","last_fullsized":"2024-09-13T23:28:34.710245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.710073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:54.079159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:41.330249+0000","last_change":"2024-09-13T23:25:23.308169+0000","last_active":"2024-09-13T23:27:41.330249+0000","last_peered":"2024-09-13T23:27:41.330249+0000","last_clean":"2024-09-13T23:27:41.330249+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:27:41.330249+0000","last_undegraded":"2024-09-13T23:27:41.330249+0000","last_fullsized":"2024-09-13T23:27:41.330249+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.241484+0000","last_change":"2024-09-13T23:29:32.241520+0000","last_active":"2024-09-13T23:29:32.241484+0000","last_peered":"2024-09-13T23:29:32.241484+0000","last_clean":"2024-09-13T23:29:32.241484+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:29:32.241484+0000","last_undegraded":"2024-09-13T23:29:32.241484+0000","last_fullsized":"2024-09-13T23:29:32.241484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.241399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:22.020934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.766210+0000","last_change":"2024-09-13T23:29:14.766210+0000","last_active":"2024-09-13T23:29:14.766210+0000","last_peered":"2024-09-13T23:29:14.766210+0000","last_clean":"2024-09-13T23:29:14.766210+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:29:14.766210+0000","last_undegraded":"2024-09-13T23:29:14.766210+0000","last_fullsized":"2024-09-13T23:29:14.766210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.766103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:57.073467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807672+0000","last_change":"2024-09-13T23:25:06.411042+0000","last_active":"2024-09-13T23:28:33.807672+0000","last_peered":"2024-09-13T23:28:33.807672+0000","last_clean":"2024-09-13T23:28:33.807672+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:28:33.807672+0000","last_undegraded":"2024-09-13T23:28:33.807672+0000","last_fullsized":"2024-09-13T23:28:33.807672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.414539+0000","last_change":"2024-09-13T23:28:43.414539+0000","last_active":"2024-09-13T23:28:43.414539+0000","last_peered":"2024-09-13T23:28:43.414539+0000","last_clean":"2024-09-13T23:28:43.414539+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:28:43.414539+0000","last_undegraded":"2024-09-13T23:28:43.414539+0000","last_fullsized":"2024-09-13T23:28:43.414539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.414417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:10.088043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.380370+0000","last_change":"2024-09-13T23:28:41.380370+0000","last_active":"2024-09-13T23:28:41.380370+0000","last_peered":"2024-09-13T23:28:41.380370+0000","last_clean":"2024-09-13T23:28:41.380370+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:28:41.380370+0000","last_undegraded":"2024-09-13T23:28:41.380370+0000","last_fullsized":"2024-09-13T23:28:41.380370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.380224+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:00.663439+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":382,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.460537+0000","last_change":"2024-09-13T23:28:33.460537+0000","last_active":"2024-09-13T23:28:33.460537+0000","last_peered":"2024-09-13T23:28:33.460537+0000","last_clean":"2024-09-13T23:28:33.460537+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:33.460537+0000","last_undegraded":"2024-09-13T23:28:33.460537+0000","last_fullsized":"2024-09-13T23:28:33.460537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.460417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:15.571224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.402643+0000","last_change":"2024-09-13T23:29:09.402665+0000","last_active":"2024-09-13T23:29:09.402643+0000","last_peered":"2024-09-13T23:29:09.402643+0000","last_clean":"2024-09-13T23:29:09.402643+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:29:09.402643+0000","last_undegraded":"2024-09-13T23:29:09.402643+0000","last_fullsized":"2024-09-13T23:29:09.402643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.402546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:24.217280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.425285+0000","last_change":"2024-09-13T23:28:50.425285+0000","last_active":"2024-09-13T23:28:50.425285+0000","last_peered":"2024-09-13T23:28:50.425285+0000","last_clean":"2024-09-13T23:28:50.425285+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:50.425285+0000","last_undegraded":"2024-09-13T23:28:50.425285+0000","last_fullsized":"2024-09-13T23:28:50.425285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.425164+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:33.299011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807741+0000","last_change":"2024-09-13T23:25:13.279089+0000","last_active":"2024-09-13T23:28:33.807741+0000","last_peered":"2024-09-13T23:28:33.807741+0000","last_clean":"2024-09-13T23:28:33.807741+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:28:33.807741+0000","last_undegraded":"2024-09-13T23:28:33.807741+0000","last_fullsized":"2024-09-13T23:28:33.807741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.649065+0000","last_change":"2024-09-13T23:29:19.649065+0000","last_active":"2024-09-13T23:29:19.649065+0000","last_peered":"2024-09-13T23:29:19.649065+0000","last_clean":"2024-09-13T23:29:19.649065+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:29:19.649065+0000","last_undegraded":"2024-09-13T23:29:19.649065+0000","last_fullsized":"2024-09-13T23:29:19.649065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.648941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:56.406515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808592+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:28:33.808592+0000","last_peered":"2024-09-13T23:28:33.808592+0000","last_clean":"2024-09-13T23:28:33.808592+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:28:33.808592+0000","last_undegraded":"2024-09-13T23:28:33.808592+0000","last_fullsized":"2024-09-13T23:28:33.808592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.381242+0000","last_change":"2024-09-13T23:28:49.381242+0000","last_active":"2024-09-13T23:28:49.381242+0000","last_peered":"2024-09-13T23:28:49.381242+0000","last_clean":"2024-09-13T23:28:49.381242+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:28:49.381242+0000","last_undegraded":"2024-09-13T23:28:49.381242+0000","last_fullsized":"2024-09-13T23:28:49.381242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.381105+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:20.463802+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.879400+0000","last_change":"2024-09-13T23:28:38.879400+0000","last_active":"2024-09-13T23:28:38.879400+0000","last_peered":"2024-09-13T23:28:38.879400+0000","last_clean":"2024-09-13T23:28:38.879400+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:38.879400+0000","last_undegraded":"2024-09-13T23:28:38.879400+0000","last_fullsized":"2024-09-13T23:28:38.879400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.879232+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:58.162447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.197519+0000","last_change":"2024-09-13T23:29:31.197573+0000","last_active":"2024-09-13T23:29:31.197519+0000","last_peered":"2024-09-13T23:29:31.197519+0000","last_clean":"2024-09-13T23:29:31.197519+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:29:31.197519+0000","last_undegraded":"2024-09-13T23:29:31.197519+0000","last_fullsized":"2024-09-13T23:29:31.197519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.197417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:14.373909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.601069+0000","last_change":"2024-09-13T23:29:07.601069+0000","last_active":"2024-09-13T23:29:07.601069+0000","last_peered":"2024-09-13T23:29:07.601069+0000","last_clean":"2024-09-13T23:29:07.601069+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:29:07.601069+0000","last_undegraded":"2024-09-13T23:29:07.601069+0000","last_fullsized":"2024-09-13T23:29:07.601069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.600916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:00.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.266733+0000","last_change":"2024-09-13T23:29:24.266733+0000","last_active":"2024-09-13T23:29:24.266733+0000","last_peered":"2024-09-13T23:29:24.266733+0000","last_clean":"2024-09-13T23:29:24.266733+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:29:24.266733+0000","last_undegraded":"2024-09-13T23:29:24.266733+0000","last_fullsized":"2024-09-13T23:29:24.266733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.266619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:10.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.807686+0000","last_change":"2024-09-13T23:25:06.411831+0000","last_active":"2024-09-13T23:28:33.807686+0000","last_peered":"2024-09-13T23:28:33.807686+0000","last_clean":"2024-09-13T23:28:33.807686+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:28:33.807686+0000","last_undegraded":"2024-09-13T23:28:33.807686+0000","last_fullsized":"2024-09-13T23:28:33.807686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:03.395615+0000","last_clean_scrub_stamp":"2024-09-13T23:25:03.395615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808585+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:28:33.808585+0000","last_peered":"2024-09-13T23:28:33.808585+0000","last_clean":"2024-09-13T23:28:33.808585+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:28:33.808585+0000","last_undegraded":"2024-09-13T23:28:33.808585+0000","last_fullsized":"2024-09-13T23:28:33.808585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.843531+0000","last_change":"2024-09-13T23:28:40.843531+0000","last_active":"2024-09-13T23:28:40.843531+0000","last_peered":"2024-09-13T23:28:40.843531+0000","last_clean":"2024-09-13T23:28:40.843531+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:40.843531+0000","last_undegraded":"2024-09-13T23:28:40.843531+0000","last_fullsized":"2024-09-13T23:28:40.843531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.843409+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:25.282723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.906383+0000","last_change":"2024-09-13T23:28:32.906383+0000","last_active":"2024-09-13T23:28:32.906383+0000","last_peered":"2024-09-13T23:28:32.906383+0000","last_clean":"2024-09-13T23:28:32.906383+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:28:32.906383+0000","last_undegraded":"2024-09-13T23:28:32.906383+0000","last_fullsized":"2024-09-13T23:28:32.906383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_clean_scrub_stamp":"2024-09-13T23:28:32.906287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:02.563197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.690617+0000","last_change":"2024-09-13T23:28:53.690642+0000","last_active":"2024-09-13T23:28:53.690617+0000","last_peered":"2024-09-13T23:28:53.690617+0000","last_clean":"2024-09-13T23:28:53.690617+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:28:53.690617+0000","last_undegraded":"2024-09-13T23:28:53.690617+0000","last_fullsized":"2024-09-13T23:28:53.690617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.690487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:50.456254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.602393+0000","last_change":"2024-09-13T23:29:22.602393+0000","last_active":"2024-09-13T23:29:22.602393+0000","last_peered":"2024-09-13T23:29:22.602393+0000","last_clean":"2024-09-13T23:29:22.602393+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:29:22.602393+0000","last_undegraded":"2024-09-13T23:29:22.602393+0000","last_fullsized":"2024-09-13T23:29:22.602393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.602254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:11.951905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.572393+0000","last_change":"2024-09-13T23:29:05.572440+0000","last_active":"2024-09-13T23:29:05.572393+0000","last_peered":"2024-09-13T23:29:05.572393+0000","last_clean":"2024-09-13T23:29:05.572393+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:29:05.572393+0000","last_undegraded":"2024-09-13T23:29:05.572393+0000","last_fullsized":"2024-09-13T23:29:05.572393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.572289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:29.963092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330741+0000","last_change":"2024-09-13T23:25:13.281110+0000","last_active":"2024-09-13T23:27:33.330741+0000","last_peered":"2024-09-13T23:27:33.330741+0000","last_clean":"2024-09-13T23:27:33.330741+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:27:33.330741+0000","last_undegraded":"2024-09-13T23:27:33.330741+0000","last_fullsized":"2024-09-13T23:27:33.330741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.206254+0000","last_change":"2024-09-13T23:28:51.206296+0000","last_active":"2024-09-13T23:28:51.206254+0000","last_peered":"2024-09-13T23:28:51.206254+0000","last_clean":"2024-09-13T23:28:51.206254+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:28:51.206254+0000","last_undegraded":"2024-09-13T23:28:51.206254+0000","last_fullsized":"2024-09-13T23:28:51.206254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.206161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:55.123436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'40","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.380671+0000","last_change":"2024-09-13T23:29:03.380714+0000","last_active":"2024-09-13T23:29:03.380671+0000","last_peered":"2024-09-13T23:29:03.380671+0000","last_clean":"2024-09-13T23:29:03.380671+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:29:03.380671+0000","last_undegraded":"2024-09-13T23:29:03.380671+0000","last_fullsized":"2024-09-13T23:29:03.380671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.380585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:23.091624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.323477+0000","last_change":"2024-09-13T23:28:55.323501+0000","last_active":"2024-09-13T23:28:55.323477+0000","last_peered":"2024-09-13T23:28:55.323477+0000","last_clean":"2024-09-13T23:28:55.323477+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:28:55.323477+0000","last_undegraded":"2024-09-13T23:28:55.323477+0000","last_fullsized":"2024-09-13T23:28:55.323477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.323390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:04.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.498057+0000","last_change":"2024-09-13T23:25:23.311336+0000","last_active":"2024-09-13T23:28:32.498057+0000","last_peered":"2024-09-13T23:28:32.498057+0000","last_clean":"2024-09-13T23:28:32.498057+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:28:32.498057+0000","last_undegraded":"2024-09-13T23:28:32.498057+0000","last_fullsized":"2024-09-13T23:28:32.498057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.129075+0000","last_change":"2024-09-13T23:29:18.129114+0000","last_active":"2024-09-13T23:29:18.129075+0000","last_peered":"2024-09-13T23:29:18.129075+0000","last_clean":"2024-09-13T23:29:18.129075+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:29:18.129075+0000","last_undegraded":"2024-09-13T23:29:18.129075+0000","last_fullsized":"2024-09-13T23:29:18.129075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.128983+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:24.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.534732+0000","last_change":"2024-09-13T23:29:02.534760+0000","last_active":"2024-09-13T23:29:02.534732+0000","last_peered":"2024-09-13T23:29:02.534732+0000","last_clean":"2024-09-13T23:29:02.534732+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:29:02.534732+0000","last_undegraded":"2024-09-13T23:29:02.534732+0000","last_fullsized":"2024-09-13T23:29:02.534732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.534643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:37.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.419549+0000","last_change":"2024-09-13T23:28:44.419595+0000","last_active":"2024-09-13T23:28:44.419549+0000","last_peered":"2024-09-13T23:28:44.419549+0000","last_clean":"2024-09-13T23:28:44.419549+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:28:44.419549+0000","last_undegraded":"2024-09-13T23:28:44.419549+0000","last_fullsized":"2024-09-13T23:28:44.419549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.419451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:28.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.882244+0000","last_change":"2024-09-13T23:28:44.882276+0000","last_active":"2024-09-13T23:28:44.882244+0000","last_peered":"2024-09-13T23:28:44.882244+0000","last_clean":"2024-09-13T23:28:44.882244+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:44.882244+0000","last_undegraded":"2024-09-13T23:28:44.882244+0000","last_fullsized":"2024-09-13T23:28:44.882244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.882155+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.157762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.770991+0000","last_change":"2024-09-13T23:28:45.771011+0000","last_active":"2024-09-13T23:28:45.770991+0000","last_peered":"2024-09-13T23:28:45.770991+0000","last_clean":"2024-09-13T23:28:45.770991+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:28:45.770991+0000","last_undegraded":"2024-09-13T23:28:45.770991+0000","last_fullsized":"2024-09-13T23:28:45.770991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.770908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:02.965472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.620279+0000","last_change":"2024-09-13T23:29:29.620306+0000","last_active":"2024-09-13T23:29:29.620279+0000","last_peered":"2024-09-13T23:29:29.620279+0000","last_clean":"2024-09-13T23:29:29.620279+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:29:29.620279+0000","last_undegraded":"2024-09-13T23:29:29.620279+0000","last_fullsized":"2024-09-13T23:29:29.620279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:36:47.509114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.866124+0000","last_change":"2024-09-13T23:29:11.866151+0000","last_active":"2024-09-13T23:29:11.866124+0000","last_peered":"2024-09-13T23:29:11.866124+0000","last_clean":"2024-09-13T23:29:11.866124+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:29:11.866124+0000","last_undegraded":"2024-09-13T23:29:11.866124+0000","last_fullsized":"2024-09-13T23:29:11.866124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.866030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:36.997837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.602669+0000","last_change":"2024-09-13T23:29:10.602698+0000","last_active":"2024-09-13T23:29:10.602669+0000","last_peered":"2024-09-13T23:29:10.602669+0000","last_clean":"2024-09-13T23:29:10.602669+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:29:10.602669+0000","last_undegraded":"2024-09-13T23:29:10.602669+0000","last_fullsized":"2024-09-13T23:29:10.602669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.602581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:02.399450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.713164+0000","last_change":"2024-09-13T23:28:47.713189+0000","last_active":"2024-09-13T23:28:47.713164+0000","last_peered":"2024-09-13T23:28:47.713164+0000","last_clean":"2024-09-13T23:28:47.713164+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:28:47.713164+0000","last_undegraded":"2024-09-13T23:28:47.713164+0000","last_fullsized":"2024-09-13T23:28:47.713164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.713076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:36.167508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'48","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.861559+0000","last_change":"2024-09-13T23:28:43.861599+0000","last_active":"2024-09-13T23:28:43.861559+0000","last_peered":"2024-09-13T23:28:43.861559+0000","last_clean":"2024-09-13T23:28:43.861559+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:43.861559+0000","last_undegraded":"2024-09-13T23:28:43.861559+0000","last_fullsized":"2024-09-13T23:28:43.861559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.861453+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:50.677647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.470961+0000","last_change":"2024-09-13T23:28:35.470984+0000","last_active":"2024-09-13T23:28:35.470961+0000","last_peered":"2024-09-13T23:28:35.470961+0000","last_clean":"2024-09-13T23:28:35.470961+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:28:35.470961+0000","last_undegraded":"2024-09-13T23:28:35.470961+0000","last_fullsized":"2024-09-13T23:28:35.470961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.470871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:42.091197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:53.333742+0000","last_change":"2024-09-13T23:25:23.313770+0000","last_active":"2024-09-13T23:27:53.333742+0000","last_peered":"2024-09-13T23:27:53.333742+0000","last_clean":"2024-09-13T23:27:53.333742+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:27:53.333742+0000","last_undegraded":"2024-09-13T23:27:53.333742+0000","last_fullsized":"2024-09-13T23:27:53.333742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.391868+0000","last_change":"2024-09-13T23:28:46.391900+0000","last_active":"2024-09-13T23:28:46.391868+0000","last_peered":"2024-09-13T23:28:46.391868+0000","last_clean":"2024-09-13T23:28:46.391868+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:46.391868+0000","last_undegraded":"2024-09-13T23:28:46.391868+0000","last_fullsized":"2024-09-13T23:28:46.391868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.391777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:57.512441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.055925+0000","last_change":"2024-09-13T23:29:13.055977+0000","last_active":"2024-09-13T23:29:13.055925+0000","last_peered":"2024-09-13T23:29:13.055925+0000","last_clean":"2024-09-13T23:29:13.055925+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:29:13.055925+0000","last_undegraded":"2024-09-13T23:29:13.055925+0000","last_fullsized":"2024-09-13T23:29:13.055925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.055822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:46.390759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425037+0000","last_change":"2024-09-13T23:28:36.425088+0000","last_active":"2024-09-13T23:28:36.425037+0000","last_peered":"2024-09-13T23:28:36.425037+0000","last_clean":"2024-09-13T23:28:36.425037+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:28:36.425037+0000","last_undegraded":"2024-09-13T23:28:36.425037+0000","last_fullsized":"2024-09-13T23:28:36.425037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.424930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:03.124803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.764356+0000","last_change":"2024-09-13T23:28:46.764392+0000","last_active":"2024-09-13T23:28:46.764356+0000","last_peered":"2024-09-13T23:28:46.764356+0000","last_clean":"2024-09-13T23:28:46.764356+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:46.764356+0000","last_undegraded":"2024-09-13T23:28:46.764356+0000","last_fullsized":"2024-09-13T23:28:46.764356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.764271+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:15.849617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.707109+0000","last_change":"2024-09-13T23:28:36.707149+0000","last_active":"2024-09-13T23:28:36.707109+0000","last_peered":"2024-09-13T23:28:36.707109+0000","last_clean":"2024-09-13T23:28:36.707109+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:28:36.707109+0000","last_undegraded":"2024-09-13T23:28:36.707109+0000","last_fullsized":"2024-09-13T23:28:36.707109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.706974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.091638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.253579+0000","last_change":"2024-09-13T23:29:15.253579+0000","last_active":"2024-09-13T23:29:15.253579+0000","last_peered":"2024-09-13T23:29:15.253579+0000","last_clean":"2024-09-13T23:29:15.253579+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:29:15.253579+0000","last_undegraded":"2024-09-13T23:29:15.253579+0000","last_fullsized":"2024-09-13T23:29:15.253579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.253463+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:56.543757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:38.331329+0000","last_change":"2024-09-13T23:25:13.283956+0000","last_active":"2024-09-13T23:27:38.331329+0000","last_peered":"2024-09-13T23:27:38.331329+0000","last_clean":"2024-09-13T23:27:38.331329+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:27:38.331329+0000","last_undegraded":"2024-09-13T23:27:38.331329+0000","last_fullsized":"2024-09-13T23:27:38.331329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.823047+0000","last_change":"2024-09-13T23:28:54.823047+0000","last_active":"2024-09-13T23:28:54.823047+0000","last_peered":"2024-09-13T23:28:54.823047+0000","last_clean":"2024-09-13T23:28:54.823047+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:28:54.823047+0000","last_undegraded":"2024-09-13T23:28:54.823047+0000","last_fullsized":"2024-09-13T23:28:54.823047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.822942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:27.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'65","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.838301+0000","last_change":"2024-09-13T23:28:46.838338+0000","last_active":"2024-09-13T23:28:46.838301+0000","last_peered":"2024-09-13T23:28:46.838301+0000","last_clean":"2024-09-13T23:28:46.838301+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:46.838301+0000","last_undegraded":"2024-09-13T23:28:46.838301+0000","last_fullsized":"2024-09-13T23:28:46.838301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'65","last_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_deep_scrub":"33'65","last_deep_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.838216+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.670165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.700661+0000","last_change":"2024-09-13T23:28:35.700684+0000","last_active":"2024-09-13T23:28:35.700661+0000","last_peered":"2024-09-13T23:28:35.700661+0000","last_clean":"2024-09-13T23:28:35.700661+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:28:35.700661+0000","last_undegraded":"2024-09-13T23:28:35.700661+0000","last_fullsized":"2024-09-13T23:28:35.700661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.700569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:06.066777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.634315+0000","last_change":"2024-09-13T23:29:30.634367+0000","last_active":"2024-09-13T23:29:30.634315+0000","last_peered":"2024-09-13T23:29:30.634315+0000","last_clean":"2024-09-13T23:29:30.634315+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:29:30.634315+0000","last_undegraded":"2024-09-13T23:29:30.634315+0000","last_fullsized":"2024-09-13T23:29:30.634315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.634191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:01.458256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.879160+0000","last_change":"2024-09-13T23:29:09.879160+0000","last_active":"2024-09-13T23:29:09.879160+0000","last_peered":"2024-09-13T23:29:09.879160+0000","last_clean":"2024-09-13T23:29:09.879160+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:29:09.879160+0000","last_undegraded":"2024-09-13T23:29:09.879160+0000","last_fullsized":"2024-09-13T23:29:09.879160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.879042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:02.841770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.251484+0000","last_change":"2024-09-13T23:29:27.251517+0000","last_active":"2024-09-13T23:29:27.251484+0000","last_peered":"2024-09-13T23:29:27.251484+0000","last_clean":"2024-09-13T23:29:27.251484+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:29:27.251484+0000","last_undegraded":"2024-09-13T23:29:27.251484+0000","last_fullsized":"2024-09-13T23:29:27.251484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.251359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:01:54.226319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.730040+0000","last_change":"2024-09-13T23:28:52.730040+0000","last_active":"2024-09-13T23:28:52.730040+0000","last_peered":"2024-09-13T23:28:52.730040+0000","last_clean":"2024-09-13T23:28:52.730040+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:28:52.730040+0000","last_undegraded":"2024-09-13T23:28:52.730040+0000","last_fullsized":"2024-09-13T23:28:52.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.729923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:09.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.432492+0000","last_change":"2024-09-13T23:28:34.432533+0000","last_active":"2024-09-13T23:28:34.432492+0000","last_peered":"2024-09-13T23:28:34.432492+0000","last_clean":"2024-09-13T23:28:34.432492+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:34.432492+0000","last_undegraded":"2024-09-13T23:28:34.432492+0000","last_fullsized":"2024-09-13T23:28:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.432394+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:14.169652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.418506+0000","last_change":"2024-09-13T23:28:38.418547+0000","last_active":"2024-09-13T23:28:38.418506+0000","last_peered":"2024-09-13T23:28:38.418506+0000","last_clean":"2024-09-13T23:28:38.418506+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:28:38.418506+0000","last_undegraded":"2024-09-13T23:28:38.418506+0000","last_fullsized":"2024-09-13T23:28:38.418506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.418363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:26.872796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332242+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:27:43.332242+0000","last_peered":"2024-09-13T23:27:43.332242+0000","last_clean":"2024-09-13T23:27:43.332242+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:27:43.332242+0000","last_undegraded":"2024-09-13T23:27:43.332242+0000","last_fullsized":"2024-09-13T23:27:43.332242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.399289+0000","last_change":"2024-09-13T23:28:51.399332+0000","last_active":"2024-09-13T23:28:51.399289+0000","last_peered":"2024-09-13T23:28:51.399289+0000","last_clean":"2024-09-13T23:28:51.399289+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:28:51.399289+0000","last_undegraded":"2024-09-13T23:28:51.399289+0000","last_fullsized":"2024-09-13T23:28:51.399289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.399178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:24.391607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.183241+0000","last_change":"2024-09-13T23:29:22.183283+0000","last_active":"2024-09-13T23:29:22.183241+0000","last_peered":"2024-09-13T23:29:22.183241+0000","last_clean":"2024-09-13T23:29:22.183241+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:29:22.183241+0000","last_undegraded":"2024-09-13T23:29:22.183241+0000","last_fullsized":"2024-09-13T23:29:22.183241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.183135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:55.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.671431+0000","last_change":"2024-09-13T23:28:54.671459+0000","last_active":"2024-09-13T23:28:54.671431+0000","last_peered":"2024-09-13T23:28:54.671431+0000","last_clean":"2024-09-13T23:28:54.671431+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:54.671431+0000","last_undegraded":"2024-09-13T23:28:54.671431+0000","last_fullsized":"2024-09-13T23:28:54.671431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.671339+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:38.895472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.872729+0000","last_change":"2024-09-13T23:28:42.872729+0000","last_active":"2024-09-13T23:28:42.872729+0000","last_peered":"2024-09-13T23:28:42.872729+0000","last_clean":"2024-09-13T23:28:42.872729+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:42.872729+0000","last_undegraded":"2024-09-13T23:28:42.872729+0000","last_fullsized":"2024-09-13T23:28:42.872729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.872602+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:27.096735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.838668+0000","last_change":"2024-09-13T23:28:36.838668+0000","last_active":"2024-09-13T23:28:36.838668+0000","last_peered":"2024-09-13T23:28:36.838668+0000","last_clean":"2024-09-13T23:28:36.838668+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:28:36.838668+0000","last_undegraded":"2024-09-13T23:28:36.838668+0000","last_fullsized":"2024-09-13T23:28:36.838668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.838543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:00.388168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.630335+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.630335+0000","last_peered":"2024-09-13T23:28:22.630335+0000","last_clean":"2024-09-13T23:28:22.630335+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.630335+0000","last_undegraded":"2024-09-13T23:28:22.630335+0000","last_fullsized":"2024-09-13T23:28:22.630335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.646845+0000","last_change":"2024-09-13T23:29:27.646872+0000","last_active":"2024-09-13T23:29:27.646845+0000","last_peered":"2024-09-13T23:29:27.646845+0000","last_clean":"2024-09-13T23:29:27.646845+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:29:27.646845+0000","last_undegraded":"2024-09-13T23:29:27.646845+0000","last_fullsized":"2024-09-13T23:29:27.646845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.646739+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:10.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.616044+0000","last_change":"2024-09-13T23:25:13.283509+0000","last_active":"2024-09-13T23:28:22.616044+0000","last_peered":"2024-09-13T23:28:22.616044+0000","last_clean":"2024-09-13T23:28:22.616044+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:28:22.616044+0000","last_undegraded":"2024-09-13T23:28:22.616044+0000","last_fullsized":"2024-09-13T23:28:22.616044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.274118+0000","last_change":"2024-09-13T23:28:55.274173+0000","last_active":"2024-09-13T23:28:55.274118+0000","last_peered":"2024-09-13T23:28:55.274118+0000","last_clean":"2024-09-13T23:28:55.274118+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:28:55.274118+0000","last_undegraded":"2024-09-13T23:28:55.274118+0000","last_fullsized":"2024-09-13T23:28:55.274118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.273979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.097633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.392868+0000","last_change":"2024-09-13T23:28:37.392868+0000","last_active":"2024-09-13T23:28:37.392868+0000","last_peered":"2024-09-13T23:28:37.392868+0000","last_clean":"2024-09-13T23:28:37.392868+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:28:37.392868+0000","last_undegraded":"2024-09-13T23:28:37.392868+0000","last_fullsized":"2024-09-13T23:28:37.392868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.392753+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:27.511355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":379,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.736270+0000","last_change":"2024-09-13T23:28:37.736270+0000","last_active":"2024-09-13T23:28:37.736270+0000","last_peered":"2024-09-13T23:28:37.736270+0000","last_clean":"2024-09-13T23:28:37.736270+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:37.736270+0000","last_undegraded":"2024-09-13T23:28:37.736270+0000","last_fullsized":"2024-09-13T23:28:37.736270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.736151+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:12.004146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.286601+0000","last_change":"2024-09-13T23:29:17.286625+0000","last_active":"2024-09-13T23:29:17.286601+0000","last_peered":"2024-09-13T23:29:17.286601+0000","last_clean":"2024-09-13T23:29:17.286601+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:29:17.286601+0000","last_undegraded":"2024-09-13T23:29:17.286601+0000","last_fullsized":"2024-09-13T23:29:17.286601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.286508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:34.136659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.616003+0000","last_change":"2024-09-13T23:28:57.616072+0000","last_active":"2024-09-13T23:28:57.616003+0000","last_peered":"2024-09-13T23:28:57.616003+0000","last_clean":"2024-09-13T23:28:57.616003+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:57.616003+0000","last_undegraded":"2024-09-13T23:28:57.616003+0000","last_fullsized":"2024-09-13T23:28:57.616003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.615887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:32.451308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.162725+0000","last_change":"2024-09-13T23:29:19.162747+0000","last_active":"2024-09-13T23:29:19.162725+0000","last_peered":"2024-09-13T23:29:19.162725+0000","last_clean":"2024-09-13T23:29:19.162725+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:29:19.162725+0000","last_undegraded":"2024-09-13T23:29:19.162725+0000","last_fullsized":"2024-09-13T23:29:19.162725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.162640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.937244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.172867+0000","last_change":"2024-09-13T23:28:52.172891+0000","last_active":"2024-09-13T23:28:52.172867+0000","last_peered":"2024-09-13T23:28:52.172867+0000","last_clean":"2024-09-13T23:28:52.172867+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:28:52.172867+0000","last_undegraded":"2024-09-13T23:28:52.172867+0000","last_fullsized":"2024-09-13T23:28:52.172867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.172781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.571714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.428570+0000","last_change":"2024-09-13T23:28:40.428650+0000","last_active":"2024-09-13T23:28:40.428570+0000","last_peered":"2024-09-13T23:28:40.428570+0000","last_clean":"2024-09-13T23:28:40.428570+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:40.428570+0000","last_undegraded":"2024-09-13T23:28:40.428570+0000","last_fullsized":"2024-09-13T23:28:40.428570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.428479+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:10.066086+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.913346+0000","last_change":"2024-09-13T23:28:41.913370+0000","last_active":"2024-09-13T23:28:41.913346+0000","last_peered":"2024-09-13T23:28:41.913346+0000","last_clean":"2024-09-13T23:28:41.913346+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:28:41.913346+0000","last_undegraded":"2024-09-13T23:28:41.913346+0000","last_fullsized":"2024-09-13T23:28:41.913346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.913252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:38.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.193716+0000","last_change":"2024-09-13T23:28:58.193740+0000","last_active":"2024-09-13T23:28:58.193716+0000","last_peered":"2024-09-13T23:28:58.193716+0000","last_clean":"2024-09-13T23:28:58.193716+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:28:58.193716+0000","last_undegraded":"2024-09-13T23:28:58.193716+0000","last_fullsized":"2024-09-13T23:28:58.193716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.193629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:31.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.569758+0000","last_change":"2024-09-13T23:28:58.569782+0000","last_active":"2024-09-13T23:28:58.569758+0000","last_peered":"2024-09-13T23:28:58.569758+0000","last_clean":"2024-09-13T23:28:58.569758+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:28:58.569758+0000","last_undegraded":"2024-09-13T23:28:58.569758+0000","last_fullsized":"2024-09-13T23:28:58.569758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.569633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:33.401582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.207054+0000","last_change":"2024-09-13T23:29:26.207097+0000","last_active":"2024-09-13T23:29:26.207054+0000","last_peered":"2024-09-13T23:29:26.207054+0000","last_clean":"2024-09-13T23:29:26.207054+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:29:26.207054+0000","last_undegraded":"2024-09-13T23:29:26.207054+0000","last_fullsized":"2024-09-13T23:29:26.207054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.206939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:01.274448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.761946+0000","last_change":"2024-09-13T23:28:48.761973+0000","last_active":"2024-09-13T23:28:48.761946+0000","last_peered":"2024-09-13T23:28:48.761946+0000","last_clean":"2024-09-13T23:28:48.761946+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:28:48.761946+0000","last_undegraded":"2024-09-13T23:28:48.761946+0000","last_fullsized":"2024-09-13T23:28:48.761946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.761854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:33.308523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.868864+0000","last_change":"2024-09-13T23:28:40.868903+0000","last_active":"2024-09-13T23:28:40.868864+0000","last_peered":"2024-09-13T23:28:40.868864+0000","last_clean":"2024-09-13T23:28:40.868864+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:40.868864+0000","last_undegraded":"2024-09-13T23:28:40.868864+0000","last_fullsized":"2024-09-13T23:28:40.868864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.868753+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:57.312547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.366001+0000","last_change":"2024-09-13T23:28:57.366023+0000","last_active":"2024-09-13T23:28:57.366001+0000","last_peered":"2024-09-13T23:28:57.366001+0000","last_clean":"2024-09-13T23:28:57.366001+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:28:57.366001+0000","last_undegraded":"2024-09-13T23:28:57.366001+0000","last_fullsized":"2024-09-13T23:28:57.366001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.365894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:37:00.729302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.246819+0000","last_change":"2024-09-13T23:29:25.246850+0000","last_active":"2024-09-13T23:29:25.246819+0000","last_peered":"2024-09-13T23:29:25.246819+0000","last_clean":"2024-09-13T23:29:25.246819+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:29:25.246819+0000","last_undegraded":"2024-09-13T23:29:25.246819+0000","last_fullsized":"2024-09-13T23:29:25.246819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.246730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:35.183768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.639235+0000","last_change":"2024-09-13T23:29:24.639260+0000","last_active":"2024-09-13T23:29:24.639235+0000","last_peered":"2024-09-13T23:29:24.639235+0000","last_clean":"2024-09-13T23:29:24.639235+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:29:24.639235+0000","last_undegraded":"2024-09-13T23:29:24.639235+0000","last_fullsized":"2024-09-13T23:29:24.639235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.639140+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:49.770946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.577686+0000","last_change":"2024-09-13T23:29:25.577713+0000","last_active":"2024-09-13T23:29:25.577686+0000","last_peered":"2024-09-13T23:29:25.577686+0000","last_clean":"2024-09-13T23:29:25.577686+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:29:25.577686+0000","last_undegraded":"2024-09-13T23:29:25.577686+0000","last_fullsized":"2024-09-13T23:29:25.577686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.577568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.172717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.259377+0000","last_change":"2024-09-13T23:28:47.259399+0000","last_active":"2024-09-13T23:28:47.259377+0000","last_peered":"2024-09-13T23:28:47.259377+0000","last_clean":"2024-09-13T23:28:47.259377+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:28:47.259377+0000","last_undegraded":"2024-09-13T23:28:47.259377+0000","last_fullsized":"2024-09-13T23:28:47.259377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.259291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.594250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.407054+0000","last_change":"2024-09-13T23:28:47.407089+0000","last_active":"2024-09-13T23:28:47.407054+0000","last_peered":"2024-09-13T23:28:47.407054+0000","last_clean":"2024-09-13T23:28:47.407054+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:47.407054+0000","last_undegraded":"2024-09-13T23:28:47.407054+0000","last_fullsized":"2024-09-13T23:28:47.407054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.406957+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:12.268807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.367378+0000","last_change":"2024-09-13T23:28:56.367406+0000","last_active":"2024-09-13T23:28:56.367378+0000","last_peered":"2024-09-13T23:28:56.367378+0000","last_clean":"2024-09-13T23:28:56.367378+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:28:56.367378+0000","last_undegraded":"2024-09-13T23:28:56.367378+0000","last_fullsized":"2024-09-13T23:28:56.367378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.367288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:36.192963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:48.333137+0000","last_change":"2024-09-13T23:25:23.313200+0000","last_active":"2024-09-13T23:27:48.333137+0000","last_peered":"2024-09-13T23:27:48.333137+0000","last_clean":"2024-09-13T23:27:48.333137+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:27:48.333137+0000","last_undegraded":"2024-09-13T23:27:48.333137+0000","last_fullsized":"2024-09-13T23:27:48.333137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.563381+0000","last_change":"2024-09-13T23:28:59.563436+0000","last_active":"2024-09-13T23:28:59.563381+0000","last_peered":"2024-09-13T23:28:59.563381+0000","last_clean":"2024-09-13T23:28:59.563381+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:59.563381+0000","last_undegraded":"2024-09-13T23:28:59.563381+0000","last_fullsized":"2024-09-13T23:28:59.563381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.563236+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:35.781729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.253112+0000","last_change":"2024-09-13T23:29:25.253137+0000","last_active":"2024-09-13T23:29:25.253112+0000","last_peered":"2024-09-13T23:29:25.253112+0000","last_clean":"2024-09-13T23:29:25.253112+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:29:25.253112+0000","last_undegraded":"2024-09-13T23:29:25.253112+0000","last_fullsized":"2024-09-13T23:29:25.253112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.252974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:32.325506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.345673+0000","last_change":"2024-09-13T23:28:45.345702+0000","last_active":"2024-09-13T23:28:45.345673+0000","last_peered":"2024-09-13T23:28:45.345673+0000","last_clean":"2024-09-13T23:28:45.345673+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:28:45.345673+0000","last_undegraded":"2024-09-13T23:28:45.345673+0000","last_fullsized":"2024-09-13T23:28:45.345673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.345587+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.147860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.376916+0000","last_change":"2024-09-13T23:28:45.376963+0000","last_active":"2024-09-13T23:28:45.376916+0000","last_peered":"2024-09-13T23:28:45.376916+0000","last_clean":"2024-09-13T23:28:45.376916+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:45.376916+0000","last_undegraded":"2024-09-13T23:28:45.376916+0000","last_fullsized":"2024-09-13T23:28:45.376916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.376807+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:21.519688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.830708+0000","last_change":"2024-09-13T23:28:45.830736+0000","last_active":"2024-09-13T23:28:45.830708+0000","last_peered":"2024-09-13T23:28:45.830708+0000","last_clean":"2024-09-13T23:28:45.830708+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:28:45.830708+0000","last_undegraded":"2024-09-13T23:28:45.830708+0000","last_fullsized":"2024-09-13T23:28:45.830708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.830607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.666028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.705711+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.705711+0000","last_peered":"2024-09-13T23:28:22.705711+0000","last_clean":"2024-09-13T23:28:22.705711+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.705711+0000","last_undegraded":"2024-09-13T23:28:22.705711+0000","last_fullsized":"2024-09-13T23:28:22.705711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.240903+0000","last_change":"2024-09-13T23:28:56.240948+0000","last_active":"2024-09-13T23:28:56.240903+0000","last_peered":"2024-09-13T23:28:56.240903+0000","last_clean":"2024-09-13T23:28:56.240903+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:56.240903+0000","last_undegraded":"2024-09-13T23:28:56.240903+0000","last_fullsized":"2024-09-13T23:28:56.240903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.240805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:20.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.557352+0000","last_change":"2024-09-13T23:29:16.557352+0000","last_active":"2024-09-13T23:29:16.557352+0000","last_peered":"2024-09-13T23:29:16.557352+0000","last_clean":"2024-09-13T23:29:16.557352+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:29:16.557352+0000","last_undegraded":"2024-09-13T23:29:16.557352+0000","last_fullsized":"2024-09-13T23:29:16.557352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.557180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:10.883638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.844111+0000","last_change":"2024-09-13T23:29:02.844145+0000","last_active":"2024-09-13T23:29:02.844111+0000","last_peered":"2024-09-13T23:29:02.844111+0000","last_clean":"2024-09-13T23:29:02.844111+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:29:02.844111+0000","last_undegraded":"2024-09-13T23:29:02.844111+0000","last_fullsized":"2024-09-13T23:29:02.844111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.844013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:02.339878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.834175+0000","last_change":"2024-09-13T23:29:10.834175+0000","last_active":"2024-09-13T23:29:10.834175+0000","last_peered":"2024-09-13T23:29:10.834175+0000","last_clean":"2024-09-13T23:29:10.834175+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:29:10.834175+0000","last_undegraded":"2024-09-13T23:29:10.834175+0000","last_fullsized":"2024-09-13T23:29:10.834175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.834057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:43.901277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.358597+0000","last_change":"2024-09-13T23:29:12.358637+0000","last_active":"2024-09-13T23:29:12.358597+0000","last_peered":"2024-09-13T23:29:12.358597+0000","last_clean":"2024-09-13T23:29:12.358597+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:29:12.358597+0000","last_undegraded":"2024-09-13T23:29:12.358597+0000","last_fullsized":"2024-09-13T23:29:12.358597+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.358491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:40.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808036+0000","last_change":"2024-09-13T23:25:13.280309+0000","last_active":"2024-09-13T23:28:33.808036+0000","last_peered":"2024-09-13T23:28:33.808036+0000","last_clean":"2024-09-13T23:28:33.808036+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:28:33.808036+0000","last_undegraded":"2024-09-13T23:28:33.808036+0000","last_fullsized":"2024-09-13T23:28:33.808036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.704612+0000","last_change":"2024-09-13T23:29:17.704641+0000","last_active":"2024-09-13T23:29:17.704612+0000","last_peered":"2024-09-13T23:29:17.704612+0000","last_clean":"2024-09-13T23:29:17.704612+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:29:17.704612+0000","last_undegraded":"2024-09-13T23:29:17.704612+0000","last_fullsized":"2024-09-13T23:29:17.704612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.704520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:44.012264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.611316+0000","last_change":"2024-09-13T23:29:26.611343+0000","last_active":"2024-09-13T23:29:26.611316+0000","last_peered":"2024-09-13T23:29:26.611316+0000","last_clean":"2024-09-13T23:29:26.611316+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:29:26.611316+0000","last_undegraded":"2024-09-13T23:29:26.611316+0000","last_fullsized":"2024-09-13T23:29:26.611316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.611220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:02.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.891498+0000","last_change":"2024-09-13T23:29:03.891498+0000","last_active":"2024-09-13T23:29:03.891498+0000","last_peered":"2024-09-13T23:29:03.891498+0000","last_clean":"2024-09-13T23:29:03.891498+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:29:03.891498+0000","last_undegraded":"2024-09-13T23:29:03.891498+0000","last_fullsized":"2024-09-13T23:29:03.891498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.891377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:38.332864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.552307+0000","last_change":"2024-09-13T23:29:23.552331+0000","last_active":"2024-09-13T23:29:23.552307+0000","last_peered":"2024-09-13T23:29:23.552307+0000","last_clean":"2024-09-13T23:29:23.552307+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:29:23.552307+0000","last_undegraded":"2024-09-13T23:29:23.552307+0000","last_fullsized":"2024-09-13T23:29:23.552307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.552205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:53.424634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.934885+0000","last_change":"2024-09-13T23:25:52.386076+0000","last_active":"2024-09-13T23:28:32.934885+0000","last_peered":"2024-09-13T23:28:32.934885+0000","last_clean":"2024-09-13T23:28:32.934885+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:28:32.934885+0000","last_undegraded":"2024-09-13T23:28:32.934885+0000","last_fullsized":"2024-09-13T23:28:32.934885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:14.264195+0000","last_clean_scrub_stamp":"2024-09-13T23:25:14.264195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.105327+0000","last_change":"2024-09-13T23:29:17.105327+0000","last_active":"2024-09-13T23:29:17.105327+0000","last_peered":"2024-09-13T23:29:17.105327+0000","last_clean":"2024-09-13T23:29:17.105327+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:29:17.105327+0000","last_undegraded":"2024-09-13T23:29:17.105327+0000","last_fullsized":"2024-09-13T23:29:17.105327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.105202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:24.212381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.880712+0000","last_change":"2024-09-13T23:28:58.880712+0000","last_active":"2024-09-13T23:28:58.880712+0000","last_peered":"2024-09-13T23:28:58.880712+0000","last_clean":"2024-09-13T23:28:58.880712+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:58.880712+0000","last_undegraded":"2024-09-13T23:28:58.880712+0000","last_fullsized":"2024-09-13T23:28:58.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.880594+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:50.677464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.632996+0000","last_change":"2024-09-13T23:29:25.632996+0000","last_active":"2024-09-13T23:29:25.632996+0000","last_peered":"2024-09-13T23:29:25.632996+0000","last_clean":"2024-09-13T23:29:25.632996+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:29:25.632996+0000","last_undegraded":"2024-09-13T23:29:25.632996+0000","last_fullsized":"2024-09-13T23:29:25.632996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.632887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:23.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.102517+0000","last_change":"2024-09-13T23:29:10.102517+0000","last_active":"2024-09-13T23:29:10.102517+0000","last_peered":"2024-09-13T23:29:10.102517+0000","last_clean":"2024-09-13T23:29:10.102517+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:29:10.102517+0000","last_undegraded":"2024-09-13T23:29:10.102517+0000","last_fullsized":"2024-09-13T23:29:10.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.102348+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:25:08.910893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.847585+0000","last_change":"2024-09-13T23:29:12.847610+0000","last_active":"2024-09-13T23:29:12.847585+0000","last_peered":"2024-09-13T23:29:12.847585+0000","last_clean":"2024-09-13T23:29:12.847585+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:29:12.847585+0000","last_undegraded":"2024-09-13T23:29:12.847585+0000","last_fullsized":"2024-09-13T23:29:12.847585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.847494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:56.893797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.067437+0000","last_change":"2024-09-13T23:29:16.067463+0000","last_active":"2024-09-13T23:29:16.067437+0000","last_peered":"2024-09-13T23:29:16.067437+0000","last_clean":"2024-09-13T23:29:16.067437+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:29:16.067437+0000","last_undegraded":"2024-09-13T23:29:16.067437+0000","last_fullsized":"2024-09-13T23:29:16.067437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.067342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:01.072491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808060+0000","last_change":"2024-09-13T23:25:13.276589+0000","last_active":"2024-09-13T23:28:33.808060+0000","last_peered":"2024-09-13T23:28:33.808060+0000","last_clean":"2024-09-13T23:28:33.808060+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:28:33.808060+0000","last_undegraded":"2024-09-13T23:28:33.808060+0000","last_fullsized":"2024-09-13T23:28:33.808060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.398875+0000","last_change":"2024-09-13T23:29:10.398912+0000","last_active":"2024-09-13T23:29:10.398875+0000","last_peered":"2024-09-13T23:29:10.398875+0000","last_clean":"2024-09-13T23:29:10.398875+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:29:10.398875+0000","last_undegraded":"2024-09-13T23:29:10.398875+0000","last_fullsized":"2024-09-13T23:29:10.398875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.398784+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.393158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.596004+0000","last_change":"2024-09-13T23:29:21.596036+0000","last_active":"2024-09-13T23:29:21.596004+0000","last_peered":"2024-09-13T23:29:21.596004+0000","last_clean":"2024-09-13T23:29:21.596004+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:29:21.596004+0000","last_undegraded":"2024-09-13T23:29:21.596004+0000","last_fullsized":"2024-09-13T23:29:21.596004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.595907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:26.153996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.895895+0000","last_change":"2024-09-13T23:29:05.895957+0000","last_active":"2024-09-13T23:29:05.895895+0000","last_peered":"2024-09-13T23:29:05.895895+0000","last_clean":"2024-09-13T23:29:05.895895+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:29:05.895895+0000","last_undegraded":"2024-09-13T23:29:05.895895+0000","last_fullsized":"2024-09-13T23:29:05.895895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.895771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.311567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.223493+0000","last_change":"2024-09-13T23:29:26.223521+0000","last_active":"2024-09-13T23:29:26.223493+0000","last_peered":"2024-09-13T23:29:26.223493+0000","last_clean":"2024-09-13T23:29:26.223493+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:29:26.223493+0000","last_undegraded":"2024-09-13T23:29:26.223493+0000","last_fullsized":"2024-09-13T23:29:26.223493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.223409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:56.095839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.241759+0000","last_change":"2024-09-13T23:29:04.241797+0000","last_active":"2024-09-13T23:29:04.241759+0000","last_peered":"2024-09-13T23:29:04.241759+0000","last_clean":"2024-09-13T23:29:04.241759+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:29:04.241759+0000","last_undegraded":"2024-09-13T23:29:04.241759+0000","last_fullsized":"2024-09-13T23:29:04.241759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.241674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.223397+0000","last_change":"2024-09-13T23:29:23.223443+0000","last_active":"2024-09-13T23:29:23.223397+0000","last_peered":"2024-09-13T23:29:23.223397+0000","last_clean":"2024-09-13T23:29:23.223397+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:29:23.223397+0000","last_undegraded":"2024-09-13T23:29:23.223397+0000","last_fullsized":"2024-09-13T23:29:23.223397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.223288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:55.814375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.175613+0000","last_change":"2024-09-13T23:28:59.175652+0000","last_active":"2024-09-13T23:28:59.175613+0000","last_peered":"2024-09-13T23:28:59.175613+0000","last_clean":"2024-09-13T23:28:59.175613+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:28:59.175613+0000","last_undegraded":"2024-09-13T23:28:59.175613+0000","last_fullsized":"2024-09-13T23:28:59.175613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.175522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:16.558152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.153559+0000","last_change":"2024-09-13T23:29:29.153588+0000","last_active":"2024-09-13T23:29:29.153559+0000","last_peered":"2024-09-13T23:29:29.153559+0000","last_clean":"2024-09-13T23:29:29.153559+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:29:29.153559+0000","last_undegraded":"2024-09-13T23:29:29.153559+0000","last_fullsized":"2024-09-13T23:29:29.153559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.153466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:20.138130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.071476+0000","last_change":"2024-09-13T23:29:12.071500+0000","last_active":"2024-09-13T23:29:12.071476+0000","last_peered":"2024-09-13T23:29:12.071476+0000","last_clean":"2024-09-13T23:29:12.071476+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:29:12.071476+0000","last_undegraded":"2024-09-13T23:29:12.071476+0000","last_fullsized":"2024-09-13T23:29:12.071476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.071386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:05.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.225432+0000","last_change":"2024-09-13T23:29:32.225489+0000","last_active":"2024-09-13T23:29:32.225432+0000","last_peered":"2024-09-13T23:29:32.225432+0000","last_clean":"2024-09-13T23:29:32.225432+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:29:32.225432+0000","last_undegraded":"2024-09-13T23:29:32.225432+0000","last_fullsized":"2024-09-13T23:29:32.225432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.225283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:38.368651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.360814+0000","last_change":"2024-09-13T23:29:07.360863+0000","last_active":"2024-09-13T23:29:07.360814+0000","last_peered":"2024-09-13T23:29:07.360814+0000","last_clean":"2024-09-13T23:29:07.360814+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:29:07.360814+0000","last_undegraded":"2024-09-13T23:29:07.360814+0000","last_fullsized":"2024-09-13T23:29:07.360814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.360714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:38.924264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.579791+0000","last_change":"2024-09-13T23:29:08.579817+0000","last_active":"2024-09-13T23:29:08.579791+0000","last_peered":"2024-09-13T23:29:08.579791+0000","last_clean":"2024-09-13T23:29:08.579791+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:29:08.579791+0000","last_undegraded":"2024-09-13T23:29:08.579791+0000","last_fullsized":"2024-09-13T23:29:08.579791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.579696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:25.962325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'22","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.013610+0000","last_change":"2024-09-13T23:29:14.013647+0000","last_active":"2024-09-13T23:29:14.013610+0000","last_peered":"2024-09-13T23:29:14.013610+0000","last_clean":"2024-09-13T23:29:14.013610+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:29:14.013610+0000","last_undegraded":"2024-09-13T23:29:14.013610+0000","last_fullsized":"2024-09-13T23:29:14.013610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.013525+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:39.145331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.251358+0000","last_change":"2024-09-13T23:29:23.251384+0000","last_active":"2024-09-13T23:29:23.251358+0000","last_peered":"2024-09-13T23:29:23.251358+0000","last_clean":"2024-09-13T23:29:23.251358+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:29:23.251358+0000","last_undegraded":"2024-09-13T23:29:23.251358+0000","last_fullsized":"2024-09-13T23:29:23.251358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.251266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:20.867611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:33.330568+0000","last_change":"2024-09-13T23:25:13.290464+0000","last_active":"2024-09-13T23:27:33.330568+0000","last_peered":"2024-09-13T23:27:33.330568+0000","last_clean":"2024-09-13T23:27:33.330568+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:27:33.330568+0000","last_undegraded":"2024-09-13T23:27:33.330568+0000","last_fullsized":"2024-09-13T23:27:33.330568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:12.261858+0000","last_clean_scrub_stamp":"2024-09-13T23:25:12.261858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.722961+0000","last_change":"2024-09-13T23:29:15.722993+0000","last_active":"2024-09-13T23:29:15.722961+0000","last_peered":"2024-09-13T23:29:15.722961+0000","last_clean":"2024-09-13T23:29:15.722961+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:29:15.722961+0000","last_undegraded":"2024-09-13T23:29:15.722961+0000","last_fullsized":"2024-09-13T23:29:15.722961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.722865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:22.325909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.694251+0000","last_change":"2024-09-13T23:29:18.694276+0000","last_active":"2024-09-13T23:29:18.694251+0000","last_peered":"2024-09-13T23:29:18.694251+0000","last_clean":"2024-09-13T23:29:18.694251+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:29:18.694251+0000","last_undegraded":"2024-09-13T23:29:18.694251+0000","last_fullsized":"2024-09-13T23:29:18.694251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.694159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:03.264071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.185869+0000","last_change":"2024-09-13T23:29:00.185902+0000","last_active":"2024-09-13T23:29:00.185869+0000","last_peered":"2024-09-13T23:29:00.185869+0000","last_clean":"2024-09-13T23:29:00.185869+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:29:00.185869+0000","last_undegraded":"2024-09-13T23:29:00.185869+0000","last_fullsized":"2024-09-13T23:29:00.185869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.185781+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:40.557990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673018,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673019,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705722,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:29:35.264 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.264 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.265 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.265 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.265 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.265 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.266 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.266 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.266 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.266 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.266 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.267 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.267 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.267 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.267 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.268 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.268 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T23:25:03.395615+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.268 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.268 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.268 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.269 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.269 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.269 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.269 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.269 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.270 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.270 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.270 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.270 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T23:25:14.264195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=14, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.271 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.271 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T23:25:12.261858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=12, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:35.271 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:29:55.272 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c9aa6640 1 Processor -- start 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c9aa6640 1 -- start start 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c9aa6640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f67c412e940 0x7f67c4130d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c9aa6640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67c406eba0 con 0x7f67c406eda0 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c9aa6640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f67c406d2f0 con 0x7f67c412e940 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c37fe640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f67c406eda0 0x7f67c406f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:50124/0 (socket says 172.21.15.43:50124) 2024-09-13T23:29:55.389 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c37fe640 1 -- 172.21.15.43:0/772536222 learned_addr learned my addr 172.21.15.43:0/772536222 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:29:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c2ffd640 1 --2- 172.21.15.43:0/772536222 >> v2:172.21.15.43:3300/0 conn(0x7f67c412e940 0x7f67c4130d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c27fc640 1 -- 172.21.15.43:0/772536222 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191014102 0 0) 0x7f67c406eba0 con 0x7f67c406eda0 2024-09-13T23:29:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.387+0000 7f67c27fc640 1 -- 172.21.15.43:0/772536222 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ac003520 con 0x7f67c406eda0 2024-09-13T23:29:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c2ffd640 1 -- 172.21.15.43:0/772536222 >> v1:172.21.15.43:6789/0 conn(0x7f67c406eda0 legacy=0x7f67c406f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:55.390 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c2ffd640 1 -- 172.21.15.43:0/772536222 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c4070d50 con 0x7f67c412e940 2024-09-13T23:29:55.392 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c2ffd640 1 --2- 172.21.15.43:0/772536222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c412e940 0x7f67c4130d30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009720 tx=0x7f67b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985c62b2d1388892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c27fc640 1 -- 172.21.15.43:0/772536222 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67b8037070 con 0x7f67c412e940 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c27fc640 1 -- 172.21.15.43:0/772536222 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b802ae20 con 0x7f67c412e940 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.388+0000 7f67c27fc640 1 -- 172.21.15.43:0/772536222 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67b8032590 con 0x7f67c412e940 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 -- 172.21.15.43:0/772536222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c412e940 msgr2=0x7f67c4130d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/772536222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c412e940 0x7f67c4130d30 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f67b8009720 tx=0x7f67b802a1a0 comp rx=0 tx=0).stop 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 -- 172.21.15.43:0/772536222 shutdown_connections 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/772536222 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c412e940 0x7f67c4130d30 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 -- 172.21.15.43:0/772536222 >> 172.21.15.43:0/772536222 conn(0x7f67c409a890 msgr2=0x7f67c409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 -- 172.21.15.43:0/772536222 shutdown_connections 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.389+0000 7f67c9aa6640 1 -- 172.21.15.43:0/772536222 wait complete. 2024-09-13T23:29:55.393 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.390+0000 7f67c9aa6640 1 Processor -- start 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.390+0000 7f67c9aa6640 1 -- start start 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c9aa6640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c9aa6640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f67c406fcd0 con 0x7f67c406eda0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c37fe640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:57106/0 (socket says 172.21.15.43:57106) 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c37fe640 1 -- 172.21.15.43:0/2954058106 learned_addr learned my addr 172.21.15.43:0/2954058106 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c37fe640 1 -- 172.21.15.43:0/2954058106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c412bb00 con 0x7f67c406eda0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c37fe640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c480 tx=0x7f67b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67b4017070 con 0x7f67c406eda0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b4005c10 con 0x7f67c406eda0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c4125780 con 0x7f67c406eda0 2024-09-13T23:29:55.394 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67b4007070 con 0x7f67c406eda0 2024-09-13T23:29:55.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.391+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c41252e0 con 0x7f67c406eda0 2024-09-13T23:29:55.395 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.392+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f67b401a070 con 0x7f67c406eda0 2024-09-13T23:29:55.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.392+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c406f180 con 0x7f67c406eda0 2024-09-13T23:29:55.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.393+0000 7f67abfff640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 0x7f67b003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:29:55.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.393+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f67b404af00 con 0x7f67c406eda0 2024-09-13T23:29:55.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.393+0000 7f67c2ffd640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 0x7f67b003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:29:55.396 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.394+0000 7f67c2ffd640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 0x7f67b003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f67b8034000 tx=0x7f67b802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:29:55.398 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.397+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b401b9c0 con 0x7f67c406eda0 2024-09-13T23:29:55.576 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.574+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67c406bba0 con 0x7f67b00382a0 2024-09-13T23:29:55.591 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.590+0000 7f67abfff640 1 -- 172.21.15.43:0/2954058106 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665742 (secure 0 0 0) 0x7f67c406bba0 con 0x7f67b00382a0 2024-09-13T23:29:55.598 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:29:55.603 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:29:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 msgr2=0x7f67b003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:55.605 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 0x7f67b003a760 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f67b8034000 tx=0x7f67b802e000 comp rx=0 tx=0).stop 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 msgr2=0x7f67c41293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f67b400c480 tx=0x7f67b400c940 comp rx=0 tx=0).stop 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 shutdown_connections 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f67b00382a0 0x7f67b003a760 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 --2- 172.21.15.43:0/2954058106 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f67c406eda0 0x7f67c41293b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 >> 172.21.15.43:0/2954058106 conn(0x7f67c409a890 msgr2=0x7f67c412ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 shutdown_connections 2024-09-13T23:29:55.606 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:29:55.595+0000 7f67c9aa6640 1 -- 172.21.15.43:0/2954058106 wait complete. 2024-09-13T23:29:55.607 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-13T23:29:55.383054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4792,"ondisk_log_size":4792,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144224,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343136,"statfs":{"total":386547056640,"available":386399371264,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003959"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.528904+0000","last_change":"2024-09-13T23:29:04.528904+0000","last_active":"2024-09-13T23:29:04.528904+0000","last_peered":"2024-09-13T23:29:04.528904+0000","last_clean":"2024-09-13T23:29:04.528904+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:29:04.528904+0000","last_undegraded":"2024-09-13T23:29:04.528904+0000","last_fullsized":"2024-09-13T23:29:04.528904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.528789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:50.352443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.226954+0000","last_change":"2024-09-13T23:29:28.227005+0000","last_active":"2024-09-13T23:29:28.226954+0000","last_peered":"2024-09-13T23:29:28.226954+0000","last_clean":"2024-09-13T23:29:28.226954+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:29:28.226954+0000","last_undegraded":"2024-09-13T23:29:28.226954+0000","last_fullsized":"2024-09-13T23:29:28.226954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.226821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:06.285889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.590162+0000","last_change":"2024-09-13T23:29:24.590162+0000","last_active":"2024-09-13T23:29:24.590162+0000","last_peered":"2024-09-13T23:29:24.590162+0000","last_clean":"2024-09-13T23:29:24.590162+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:29:24.590162+0000","last_undegraded":"2024-09-13T23:29:24.590162+0000","last_fullsized":"2024-09-13T23:29:24.590162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.590043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.937596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.402553+0000","last_change":"2024-09-13T23:29:11.402579+0000","last_active":"2024-09-13T23:29:11.402553+0000","last_peered":"2024-09-13T23:29:11.402553+0000","last_clean":"2024-09-13T23:29:11.402553+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:29:11.402553+0000","last_undegraded":"2024-09-13T23:29:11.402553+0000","last_fullsized":"2024-09-13T23:29:11.402553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.402459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:44.051975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.291238+0000","last_change":"2024-09-13T23:29:24.291261+0000","last_active":"2024-09-13T23:29:24.291238+0000","last_peered":"2024-09-13T23:29:24.291238+0000","last_clean":"2024-09-13T23:29:24.291238+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:29:24.291238+0000","last_undegraded":"2024-09-13T23:29:24.291238+0000","last_fullsized":"2024-09-13T23:29:24.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.291152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:45.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.294481+0000","last_change":"2024-09-13T23:29:14.294522+0000","last_active":"2024-09-13T23:29:14.294481+0000","last_peered":"2024-09-13T23:29:14.294481+0000","last_clean":"2024-09-13T23:29:14.294481+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:29:14.294481+0000","last_undegraded":"2024-09-13T23:29:14.294481+0000","last_fullsized":"2024-09-13T23:29:14.294481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.294392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:06.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.588641+0000","last_change":"2024-09-13T23:29:12.588641+0000","last_active":"2024-09-13T23:29:12.588641+0000","last_peered":"2024-09-13T23:29:12.588641+0000","last_clean":"2024-09-13T23:29:12.588641+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:29:12.588641+0000","last_undegraded":"2024-09-13T23:29:12.588641+0000","last_fullsized":"2024-09-13T23:29:12.588641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.588515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.973454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.254160+0000","last_change":"2024-09-13T23:29:22.254201+0000","last_active":"2024-09-13T23:29:22.254160+0000","last_peered":"2024-09-13T23:29:22.254160+0000","last_clean":"2024-09-13T23:29:22.254160+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:29:22.254160+0000","last_undegraded":"2024-09-13T23:29:22.254160+0000","last_fullsized":"2024-09-13T23:29:22.254160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.254042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:04.901135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.179305+0000","last_change":"2024-09-13T23:29:31.179333+0000","last_active":"2024-09-13T23:29:31.179305+0000","last_peered":"2024-09-13T23:29:31.179305+0000","last_clean":"2024-09-13T23:29:31.179305+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:29:31.179305+0000","last_undegraded":"2024-09-13T23:29:31.179305+0000","last_fullsized":"2024-09-13T23:29:31.179305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.179217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:35.444208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.235215+0000","last_change":"2024-09-13T23:29:06.235215+0000","last_active":"2024-09-13T23:29:06.235215+0000","last_peered":"2024-09-13T23:29:06.235215+0000","last_clean":"2024-09-13T23:29:06.235215+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:29:06.235215+0000","last_undegraded":"2024-09-13T23:29:06.235215+0000","last_fullsized":"2024-09-13T23:29:06.235215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.235100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:34.242160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.619586+0000","last_change":"2024-09-13T23:29:13.619615+0000","last_active":"2024-09-13T23:29:13.619586+0000","last_peered":"2024-09-13T23:29:13.619586+0000","last_clean":"2024-09-13T23:29:13.619586+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:29:13.619586+0000","last_undegraded":"2024-09-13T23:29:13.619586+0000","last_fullsized":"2024-09-13T23:29:13.619586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.619476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:22.716408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.353102+0000","last_change":"2024-09-13T23:28:54.353102+0000","last_active":"2024-09-13T23:28:54.353102+0000","last_peered":"2024-09-13T23:28:54.353102+0000","last_clean":"2024-09-13T23:28:54.353102+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:54.353102+0000","last_undegraded":"2024-09-13T23:28:54.353102+0000","last_fullsized":"2024-09-13T23:28:54.353102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.352965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:28.479961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:49.079096+0000","last_change":"2024-09-13T23:29:49.079126+0000","last_active":"2024-09-13T23:29:49.079096+0000","last_peered":"2024-09-13T23:29:49.079096+0000","last_clean":"2024-09-13T23:29:49.079096+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:29:49.079096+0000","last_undegraded":"2024-09-13T23:29:49.079096+0000","last_fullsized":"2024-09-13T23:29:49.079096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:49.078989+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:49.078989+0000","last_clean_scrub_stamp":"2024-09-13T23:29:49.078989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:51.068576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.509539+0000","last_change":"2024-09-13T23:29:03.509539+0000","last_active":"2024-09-13T23:29:03.509539+0000","last_peered":"2024-09-13T23:29:03.509539+0000","last_clean":"2024-09-13T23:29:03.509539+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:29:03.509539+0000","last_undegraded":"2024-09-13T23:29:03.509539+0000","last_fullsized":"2024-09-13T23:29:03.509539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.509398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:45.386333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.928159+0000","last_change":"2024-09-13T23:29:06.928236+0000","last_active":"2024-09-13T23:29:06.928159+0000","last_peered":"2024-09-13T23:29:06.928159+0000","last_clean":"2024-09-13T23:29:06.928159+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:29:06.928159+0000","last_undegraded":"2024-09-13T23:29:06.928159+0000","last_fullsized":"2024-09-13T23:29:06.928159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.928056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.581026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.519547+0000","last_change":"2024-09-13T23:29:19.519547+0000","last_active":"2024-09-13T23:29:19.519547+0000","last_peered":"2024-09-13T23:29:19.519547+0000","last_clean":"2024-09-13T23:29:19.519547+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:29:19.519547+0000","last_undegraded":"2024-09-13T23:29:19.519547+0000","last_fullsized":"2024-09-13T23:29:19.519547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.519430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:37:02.172401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.396623+0000","last_change":"2024-09-13T23:29:08.396667+0000","last_active":"2024-09-13T23:29:08.396623+0000","last_peered":"2024-09-13T23:29:08.396623+0000","last_clean":"2024-09-13T23:29:08.396623+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:29:08.396623+0000","last_undegraded":"2024-09-13T23:29:08.396623+0000","last_fullsized":"2024-09-13T23:29:08.396623+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.396493+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:17.076369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.051518+0000","last_change":"2024-09-13T23:29:15.051540+0000","last_active":"2024-09-13T23:29:15.051518+0000","last_peered":"2024-09-13T23:29:15.051518+0000","last_clean":"2024-09-13T23:29:15.051518+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:29:15.051518+0000","last_undegraded":"2024-09-13T23:29:15.051518+0000","last_fullsized":"2024-09-13T23:29:15.051518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.051419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:59.097722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.166812+0000","last_change":"2024-09-13T23:29:08.166839+0000","last_active":"2024-09-13T23:29:08.166812+0000","last_peered":"2024-09-13T23:29:08.166812+0000","last_clean":"2024-09-13T23:29:08.166812+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:29:08.166812+0000","last_undegraded":"2024-09-13T23:29:08.166812+0000","last_fullsized":"2024-09-13T23:29:08.166812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.166727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:24.485148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.595148+0000","last_change":"2024-09-13T23:29:06.595179+0000","last_active":"2024-09-13T23:29:06.595148+0000","last_peered":"2024-09-13T23:29:06.595148+0000","last_clean":"2024-09-13T23:29:06.595148+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:29:06.595148+0000","last_undegraded":"2024-09-13T23:29:06.595148+0000","last_fullsized":"2024-09-13T23:29:06.595148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.595032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.144296+0000","last_change":"2024-09-13T23:29:09.144341+0000","last_active":"2024-09-13T23:29:09.144296+0000","last_peered":"2024-09-13T23:29:09.144296+0000","last_clean":"2024-09-13T23:29:09.144296+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:29:09.144296+0000","last_undegraded":"2024-09-13T23:29:09.144296+0000","last_fullsized":"2024-09-13T23:29:09.144296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.144187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:54:48.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:35.244399+0000","last_change":"2024-09-13T23:29:35.244424+0000","last_active":"2024-09-13T23:29:35.244399+0000","last_peered":"2024-09-13T23:29:35.244399+0000","last_clean":"2024-09-13T23:29:35.244399+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:29:35.244399+0000","last_undegraded":"2024-09-13T23:29:35.244399+0000","last_fullsized":"2024-09-13T23:29:35.244399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:35.244272+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:35.244272+0000","last_clean_scrub_stamp":"2024-09-13T23:29:35.244272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:45.037545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.890183+0000","last_change":"2024-09-13T23:29:07.890225+0000","last_active":"2024-09-13T23:29:07.890183+0000","last_peered":"2024-09-13T23:29:07.890183+0000","last_clean":"2024-09-13T23:29:07.890183+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:29:07.890183+0000","last_undegraded":"2024-09-13T23:29:07.890183+0000","last_fullsized":"2024-09-13T23:29:07.890183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.890094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.804774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.208876+0000","last_change":"2024-09-13T23:29:21.208916+0000","last_active":"2024-09-13T23:29:21.208876+0000","last_peered":"2024-09-13T23:29:21.208876+0000","last_clean":"2024-09-13T23:29:21.208876+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:29:21.208876+0000","last_undegraded":"2024-09-13T23:29:21.208876+0000","last_fullsized":"2024-09-13T23:29:21.208876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.208791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:18.571722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.639015+0000","last_change":"2024-09-13T23:28:56.639079+0000","last_active":"2024-09-13T23:28:56.639015+0000","last_peered":"2024-09-13T23:28:56.639015+0000","last_clean":"2024-09-13T23:28:56.639015+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:28:56.639015+0000","last_undegraded":"2024-09-13T23:28:56.639015+0000","last_fullsized":"2024-09-13T23:28:56.639015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.638914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:33.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.718552+0000","last_change":"2024-09-13T23:29:16.718580+0000","last_active":"2024-09-13T23:29:16.718552+0000","last_peered":"2024-09-13T23:29:16.718552+0000","last_clean":"2024-09-13T23:29:16.718552+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:29:16.718552+0000","last_undegraded":"2024-09-13T23:29:16.718552+0000","last_fullsized":"2024-09-13T23:29:16.718552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.718459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:51.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.213714+0000","last_change":"2024-09-13T23:29:07.213741+0000","last_active":"2024-09-13T23:29:07.213714+0000","last_peered":"2024-09-13T23:29:07.213714+0000","last_clean":"2024-09-13T23:29:07.213714+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:29:07.213714+0000","last_undegraded":"2024-09-13T23:29:07.213714+0000","last_fullsized":"2024-09-13T23:29:07.213714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.213605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:01.540063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.162764+0000","last_change":"2024-09-13T23:29:27.162764+0000","last_active":"2024-09-13T23:29:27.162764+0000","last_peered":"2024-09-13T23:29:27.162764+0000","last_clean":"2024-09-13T23:29:27.162764+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:29:27.162764+0000","last_undegraded":"2024-09-13T23:29:27.162764+0000","last_fullsized":"2024-09-13T23:29:27.162764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.162654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:25.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.195768+0000","last_change":"2024-09-13T23:29:30.195793+0000","last_active":"2024-09-13T23:29:30.195768+0000","last_peered":"2024-09-13T23:29:30.195768+0000","last_clean":"2024-09-13T23:29:30.195768+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:29:30.195768+0000","last_undegraded":"2024-09-13T23:29:30.195768+0000","last_fullsized":"2024-09-13T23:29:30.195768+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.195679+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:33.795978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.250487+0000","last_change":"2024-09-13T23:29:18.250515+0000","last_active":"2024-09-13T23:29:18.250487+0000","last_peered":"2024-09-13T23:29:18.250487+0000","last_clean":"2024-09-13T23:29:18.250487+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:29:18.250487+0000","last_undegraded":"2024-09-13T23:29:18.250487+0000","last_fullsized":"2024-09-13T23:29:18.250487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.250363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:36.745243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.195808+0000","last_change":"2024-09-13T23:29:33.195808+0000","last_active":"2024-09-13T23:29:33.195808+0000","last_peered":"2024-09-13T23:29:33.195808+0000","last_clean":"2024-09-13T23:29:33.195808+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:29:33.195808+0000","last_undegraded":"2024-09-13T23:29:33.195808+0000","last_fullsized":"2024-09-13T23:29:33.195808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.195648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:34.430333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.412219+0000","last_change":"2024-09-13T23:28:35.412268+0000","last_active":"2024-09-13T23:28:35.412219+0000","last_peered":"2024-09-13T23:28:35.412219+0000","last_clean":"2024-09-13T23:28:35.412219+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:28:35.412219+0000","last_undegraded":"2024-09-13T23:28:35.412219+0000","last_fullsized":"2024-09-13T23:28:35.412219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.412096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:03.433021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.403834+0000","last_change":"2024-09-13T23:28:53.403875+0000","last_active":"2024-09-13T23:28:53.403834+0000","last_peered":"2024-09-13T23:28:53.403834+0000","last_clean":"2024-09-13T23:28:53.403834+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:53.403834+0000","last_undegraded":"2024-09-13T23:28:53.403834+0000","last_fullsized":"2024-09-13T23:28:53.403834+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.403743+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:52.708366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.383764+0000","last_change":"2024-09-13T23:28:42.383806+0000","last_active":"2024-09-13T23:28:42.383764+0000","last_peered":"2024-09-13T23:28:42.383764+0000","last_clean":"2024-09-13T23:28:42.383764+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:28:42.383764+0000","last_undegraded":"2024-09-13T23:28:42.383764+0000","last_fullsized":"2024-09-13T23:28:42.383764+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.383654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:23.582962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.190460+0000","last_change":"2024-09-13T23:29:29.190517+0000","last_active":"2024-09-13T23:29:29.190460+0000","last_peered":"2024-09-13T23:29:29.190460+0000","last_clean":"2024-09-13T23:29:29.190460+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:29:29.190460+0000","last_undegraded":"2024-09-13T23:29:29.190460+0000","last_fullsized":"2024-09-13T23:29:29.190460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.190360+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:54.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'12","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.298202+0000","last_change":"2024-09-13T23:29:16.298230+0000","last_active":"2024-09-13T23:29:16.298202+0000","last_peered":"2024-09-13T23:29:16.298202+0000","last_clean":"2024-09-13T23:29:16.298202+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:29:16.298202+0000","last_undegraded":"2024-09-13T23:29:16.298202+0000","last_fullsized":"2024-09-13T23:29:16.298202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.298110+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:05.867340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.525462+0000","last_change":"2024-09-13T23:29:18.525462+0000","last_active":"2024-09-13T23:29:18.525462+0000","last_peered":"2024-09-13T23:29:18.525462+0000","last_clean":"2024-09-13T23:29:18.525462+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:29:18.525462+0000","last_undegraded":"2024-09-13T23:29:18.525462+0000","last_fullsized":"2024-09-13T23:29:18.525462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.525350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:40.941146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.285642+0000","last_change":"2024-09-13T23:29:33.285670+0000","last_active":"2024-09-13T23:29:33.285642+0000","last_peered":"2024-09-13T23:29:33.285642+0000","last_clean":"2024-09-13T23:29:33.285642+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:29:33.285642+0000","last_undegraded":"2024-09-13T23:29:33.285642+0000","last_fullsized":"2024-09-13T23:29:33.285642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.285554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.109619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.401547+0000","last_change":"2024-09-13T23:28:39.401603+0000","last_active":"2024-09-13T23:28:39.401547+0000","last_peered":"2024-09-13T23:28:39.401547+0000","last_clean":"2024-09-13T23:28:39.401547+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:28:39.401547+0000","last_undegraded":"2024-09-13T23:28:39.401547+0000","last_fullsized":"2024-09-13T23:28:39.401547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.401441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:23.948110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.453172+0000","last_change":"2024-09-13T23:28:34.453193+0000","last_active":"2024-09-13T23:28:34.453172+0000","last_peered":"2024-09-13T23:28:34.453172+0000","last_clean":"2024-09-13T23:28:34.453172+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:28:34.453172+0000","last_undegraded":"2024-09-13T23:28:34.453172+0000","last_fullsized":"2024-09-13T23:28:34.453172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.453082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:39.061568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.609004+0000","last_change":"2024-09-13T23:29:31.609031+0000","last_active":"2024-09-13T23:29:31.609004+0000","last_peered":"2024-09-13T23:29:31.609004+0000","last_clean":"2024-09-13T23:29:31.609004+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:29:31.609004+0000","last_undegraded":"2024-09-13T23:29:31.609004+0000","last_fullsized":"2024-09-13T23:29:31.609004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:31.608901+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:31.608901+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.608901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:07.619631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.254465+0000","last_change":"2024-09-13T23:29:20.254517+0000","last_active":"2024-09-13T23:29:20.254465+0000","last_peered":"2024-09-13T23:29:20.254465+0000","last_clean":"2024-09-13T23:29:20.254465+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:29:20.254465+0000","last_undegraded":"2024-09-13T23:29:20.254465+0000","last_fullsized":"2024-09-13T23:29:20.254465+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.254341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:55.274744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:42.138836+0000","last_change":"2024-09-13T23:29:42.138836+0000","last_active":"2024-09-13T23:29:42.138836+0000","last_peered":"2024-09-13T23:29:42.138836+0000","last_clean":"2024-09-13T23:29:42.138836+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:29:42.138836+0000","last_undegraded":"2024-09-13T23:29:42.138836+0000","last_fullsized":"2024-09-13T23:29:42.138836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:42.138666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:42.138666+0000","last_clean_scrub_stamp":"2024-09-13T23:29:42.138666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:45.200165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.916935+0000","last_change":"2024-09-13T23:28:50.917010+0000","last_active":"2024-09-13T23:28:50.916935+0000","last_peered":"2024-09-13T23:28:50.916935+0000","last_clean":"2024-09-13T23:28:50.916935+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:28:50.916935+0000","last_undegraded":"2024-09-13T23:28:50.916935+0000","last_fullsized":"2024-09-13T23:28:50.916935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.916803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:55.569318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.835923+0000","last_change":"2024-09-13T23:28:43.835968+0000","last_active":"2024-09-13T23:28:43.835923+0000","last_peered":"2024-09-13T23:28:43.835923+0000","last_clean":"2024-09-13T23:28:43.835923+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:28:43.835923+0000","last_undegraded":"2024-09-13T23:28:43.835923+0000","last_fullsized":"2024-09-13T23:28:43.835923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.835830+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.336311+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":393,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.332450+0000","last_change":"2024-09-13T23:28:58.332504+0000","last_active":"2024-09-13T23:28:58.332450+0000","last_peered":"2024-09-13T23:28:58.332450+0000","last_clean":"2024-09-13T23:28:58.332450+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:58.332450+0000","last_undegraded":"2024-09-13T23:28:58.332450+0000","last_fullsized":"2024-09-13T23:28:58.332450+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.332349+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:44.416231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.600162+0000","last_change":"2024-09-13T23:29:21.600189+0000","last_active":"2024-09-13T23:29:21.600162+0000","last_peered":"2024-09-13T23:29:21.600162+0000","last_clean":"2024-09-13T23:29:21.600162+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:29:21.600162+0000","last_undegraded":"2024-09-13T23:29:21.600162+0000","last_fullsized":"2024-09-13T23:29:21.600162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.600069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:19:33.000348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.847241+0000","last_change":"2024-09-13T23:28:59.847269+0000","last_active":"2024-09-13T23:28:59.847241+0000","last_peered":"2024-09-13T23:28:59.847241+0000","last_clean":"2024-09-13T23:28:59.847241+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:59.847241+0000","last_undegraded":"2024-09-13T23:28:59.847241+0000","last_fullsized":"2024-09-13T23:28:59.847241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.847154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:32.418333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.073943+0000","last_change":"2024-09-13T23:29:11.073943+0000","last_active":"2024-09-13T23:29:11.073943+0000","last_peered":"2024-09-13T23:29:11.073943+0000","last_clean":"2024-09-13T23:29:11.073943+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:29:11.073943+0000","last_undegraded":"2024-09-13T23:29:11.073943+0000","last_fullsized":"2024-09-13T23:29:11.073943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.073831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:30.480544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.432327+0000","last_change":"2024-09-13T23:28:42.432355+0000","last_active":"2024-09-13T23:28:42.432327+0000","last_peered":"2024-09-13T23:28:42.432327+0000","last_clean":"2024-09-13T23:28:42.432327+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:28:42.432327+0000","last_undegraded":"2024-09-13T23:28:42.432327+0000","last_fullsized":"2024-09-13T23:28:42.432327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.432240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.272484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.853868+0000","last_change":"2024-09-13T23:28:42.853928+0000","last_active":"2024-09-13T23:28:42.853868+0000","last_peered":"2024-09-13T23:28:42.853868+0000","last_clean":"2024-09-13T23:28:42.853868+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:42.853868+0000","last_undegraded":"2024-09-13T23:28:42.853868+0000","last_fullsized":"2024-09-13T23:28:42.853868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.853764+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:24.964571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.867464+0000","last_change":"2024-09-13T23:28:37.867494+0000","last_active":"2024-09-13T23:28:37.867464+0000","last_peered":"2024-09-13T23:28:37.867464+0000","last_clean":"2024-09-13T23:28:37.867464+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:37.867464+0000","last_undegraded":"2024-09-13T23:28:37.867464+0000","last_fullsized":"2024-09-13T23:28:37.867464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.867370+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:50.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.383237+0000","last_change":"2024-09-13T23:28:48.383237+0000","last_active":"2024-09-13T23:28:48.383237+0000","last_peered":"2024-09-13T23:28:48.383237+0000","last_clean":"2024-09-13T23:28:48.383237+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:48.383237+0000","last_undegraded":"2024-09-13T23:28:48.383237+0000","last_fullsized":"2024-09-13T23:28:48.383237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.383091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:30.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.539913+0000","last_change":"2024-09-13T23:29:00.539913+0000","last_active":"2024-09-13T23:29:00.539913+0000","last_peered":"2024-09-13T23:29:00.539913+0000","last_clean":"2024-09-13T23:29:00.539913+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:29:00.539913+0000","last_undegraded":"2024-09-13T23:29:00.539913+0000","last_fullsized":"2024-09-13T23:29:00.539913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.539784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:15.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.221472+0000","last_change":"2024-09-13T23:28:48.221472+0000","last_active":"2024-09-13T23:28:48.221472+0000","last_peered":"2024-09-13T23:28:48.221472+0000","last_clean":"2024-09-13T23:28:48.221472+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:28:48.221472+0000","last_undegraded":"2024-09-13T23:28:48.221472+0000","last_fullsized":"2024-09-13T23:28:48.221472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.221353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:59.646033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.789114+0000","last_change":"2024-09-13T23:28:38.789114+0000","last_active":"2024-09-13T23:28:38.789114+0000","last_peered":"2024-09-13T23:28:38.789114+0000","last_clean":"2024-09-13T23:28:38.789114+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:38.789114+0000","last_undegraded":"2024-09-13T23:28:38.789114+0000","last_fullsized":"2024-09-13T23:28:38.789114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.788930+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:52.119474+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.797133+0000","last_change":"2024-09-13T23:28:35.797133+0000","last_active":"2024-09-13T23:28:35.797133+0000","last_peered":"2024-09-13T23:28:35.797133+0000","last_clean":"2024-09-13T23:28:35.797133+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:28:35.797133+0000","last_undegraded":"2024-09-13T23:28:35.797133+0000","last_fullsized":"2024-09-13T23:28:35.797133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.797014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.615531+0000","last_change":"2024-09-13T23:29:23.615531+0000","last_active":"2024-09-13T23:29:23.615531+0000","last_peered":"2024-09-13T23:29:23.615531+0000","last_clean":"2024-09-13T23:29:23.615531+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:29:23.615531+0000","last_undegraded":"2024-09-13T23:29:23.615531+0000","last_fullsized":"2024-09-13T23:29:23.615531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.615415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:56.682635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.193218+0000","last_change":"2024-09-13T23:29:05.193218+0000","last_active":"2024-09-13T23:29:05.193218+0000","last_peered":"2024-09-13T23:29:05.193218+0000","last_clean":"2024-09-13T23:29:05.193218+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:29:05.193218+0000","last_undegraded":"2024-09-13T23:29:05.193218+0000","last_fullsized":"2024-09-13T23:29:05.193218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.193061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:54.252627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.516198+0000","last_change":"2024-09-13T23:29:17.516198+0000","last_active":"2024-09-13T23:29:17.516198+0000","last_peered":"2024-09-13T23:29:17.516198+0000","last_clean":"2024-09-13T23:29:17.516198+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:29:17.516198+0000","last_undegraded":"2024-09-13T23:29:17.516198+0000","last_fullsized":"2024-09-13T23:29:17.516198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.516070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:33.834491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.878026+0000","last_change":"2024-09-13T23:28:47.878026+0000","last_active":"2024-09-13T23:28:47.878026+0000","last_peered":"2024-09-13T23:28:47.878026+0000","last_clean":"2024-09-13T23:28:47.878026+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:28:47.878026+0000","last_undegraded":"2024-09-13T23:28:47.878026+0000","last_fullsized":"2024-09-13T23:28:47.878026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.877888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:24.096380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.395683+0000","last_change":"2024-09-13T23:28:41.395683+0000","last_active":"2024-09-13T23:28:41.395683+0000","last_peered":"2024-09-13T23:28:41.395683+0000","last_clean":"2024-09-13T23:28:41.395683+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:41.395683+0000","last_undegraded":"2024-09-13T23:28:41.395683+0000","last_fullsized":"2024-09-13T23:28:41.395683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.395529+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:16.720847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.869568+0000","last_change":"2024-09-13T23:28:49.869568+0000","last_active":"2024-09-13T23:28:49.869568+0000","last_peered":"2024-09-13T23:28:49.869568+0000","last_clean":"2024-09-13T23:28:49.869568+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:28:49.869568+0000","last_undegraded":"2024-09-13T23:28:49.869568+0000","last_fullsized":"2024-09-13T23:28:49.869568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.869451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.241159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.227072+0000","last_change":"2024-09-13T23:28:50.227072+0000","last_active":"2024-09-13T23:28:50.227072+0000","last_peered":"2024-09-13T23:28:50.227072+0000","last_clean":"2024-09-13T23:28:50.227072+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:28:50.227072+0000","last_undegraded":"2024-09-13T23:28:50.227072+0000","last_fullsized":"2024-09-13T23:28:50.227072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.226940+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.317457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.574304+0000","last_change":"2024-09-13T23:29:01.574304+0000","last_active":"2024-09-13T23:29:01.574304+0000","last_peered":"2024-09-13T23:29:01.574304+0000","last_clean":"2024-09-13T23:29:01.574304+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:29:01.574304+0000","last_undegraded":"2024-09-13T23:29:01.574304+0000","last_fullsized":"2024-09-13T23:29:01.574304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.574185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:53.945893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:41.161430+0000","last_change":"2024-09-13T23:29:41.161430+0000","last_active":"2024-09-13T23:29:41.161430+0000","last_peered":"2024-09-13T23:29:41.161430+0000","last_clean":"2024-09-13T23:29:41.161430+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:29:41.161430+0000","last_undegraded":"2024-09-13T23:29:41.161430+0000","last_fullsized":"2024-09-13T23:29:41.161430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:41.161274+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:41.161274+0000","last_clean_scrub_stamp":"2024-09-13T23:29:41.161274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:34.421641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.848076+0000","last_change":"2024-09-13T23:28:52.848076+0000","last_active":"2024-09-13T23:28:52.848076+0000","last_peered":"2024-09-13T23:28:52.848076+0000","last_clean":"2024-09-13T23:28:52.848076+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:28:52.848076+0000","last_undegraded":"2024-09-13T23:28:52.848076+0000","last_fullsized":"2024-09-13T23:28:52.848076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.847961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.924204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.373593+0000","last_change":"2024-09-13T23:29:02.373593+0000","last_active":"2024-09-13T23:29:02.373593+0000","last_peered":"2024-09-13T23:29:02.373593+0000","last_clean":"2024-09-13T23:29:02.373593+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:29:02.373593+0000","last_undegraded":"2024-09-13T23:29:02.373593+0000","last_fullsized":"2024-09-13T23:29:02.373593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.373443+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:09.196717+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":361,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.901638+0000","last_change":"2024-09-13T23:28:57.901638+0000","last_active":"2024-09-13T23:28:57.901638+0000","last_peered":"2024-09-13T23:28:57.901638+0000","last_clean":"2024-09-13T23:28:57.901638+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:57.901638+0000","last_undegraded":"2024-09-13T23:28:57.901638+0000","last_fullsized":"2024-09-13T23:28:57.901638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.901512+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:41.619080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.614182+0000","last_change":"2024-09-13T23:29:28.614182+0000","last_active":"2024-09-13T23:29:28.614182+0000","last_peered":"2024-09-13T23:29:28.614182+0000","last_clean":"2024-09-13T23:29:28.614182+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:29:28.614182+0000","last_undegraded":"2024-09-13T23:29:28.614182+0000","last_fullsized":"2024-09-13T23:29:28.614182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.614044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:14.521686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.672214+0000","last_change":"2024-09-13T23:28:55.672214+0000","last_active":"2024-09-13T23:28:55.672214+0000","last_peered":"2024-09-13T23:28:55.672214+0000","last_clean":"2024-09-13T23:28:55.672214+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:55.672214+0000","last_undegraded":"2024-09-13T23:28:55.672214+0000","last_fullsized":"2024-09-13T23:28:55.672214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.672076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:02.488271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.188812+0000","last_change":"2024-09-13T23:29:30.188812+0000","last_active":"2024-09-13T23:29:30.188812+0000","last_peered":"2024-09-13T23:29:30.188812+0000","last_clean":"2024-09-13T23:29:30.188812+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:29:30.188812+0000","last_undegraded":"2024-09-13T23:29:30.188812+0000","last_fullsized":"2024-09-13T23:29:30.188812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.188678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:01.676356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.872681+0000","last_change":"2024-09-13T23:28:51.872681+0000","last_active":"2024-09-13T23:28:51.872681+0000","last_peered":"2024-09-13T23:28:51.872681+0000","last_clean":"2024-09-13T23:28:51.872681+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:28:51.872681+0000","last_undegraded":"2024-09-13T23:28:51.872681+0000","last_fullsized":"2024-09-13T23:28:51.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.872543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:15.808273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.300292+0000","last_change":"2024-09-13T23:29:00.300292+0000","last_active":"2024-09-13T23:29:00.300292+0000","last_peered":"2024-09-13T23:29:00.300292+0000","last_clean":"2024-09-13T23:29:00.300292+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:29:00.300292+0000","last_undegraded":"2024-09-13T23:29:00.300292+0000","last_fullsized":"2024-09-13T23:29:00.300292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'66","last_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_deep_scrub":"33'66","last_deep_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.300157+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:45.866727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.841693+0000","last_change":"2024-09-13T23:28:34.841693+0000","last_active":"2024-09-13T23:28:34.841693+0000","last_peered":"2024-09-13T23:28:34.841693+0000","last_clean":"2024-09-13T23:28:34.841693+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:28:34.841693+0000","last_undegraded":"2024-09-13T23:28:34.841693+0000","last_fullsized":"2024-09-13T23:28:34.841693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.841569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:03.926916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'23","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.590842+0000","last_change":"2024-09-13T23:29:34.590842+0000","last_active":"2024-09-13T23:29:34.590842+0000","last_peered":"2024-09-13T23:29:34.590842+0000","last_clean":"2024-09-13T23:29:34.590842+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:29:34.590842+0000","last_undegraded":"2024-09-13T23:29:34.590842+0000","last_fullsized":"2024-09-13T23:29:34.590842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-09-13T23:29:34.590715+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-09-13T23:29:34.590715+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.590715+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:35.207539+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.232952+0000","last_change":"2024-09-13T23:28:57.232952+0000","last_active":"2024-09-13T23:28:57.232952+0000","last_peered":"2024-09-13T23:28:57.232952+0000","last_clean":"2024-09-13T23:28:57.232952+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:57.232952+0000","last_undegraded":"2024-09-13T23:28:57.232952+0000","last_fullsized":"2024-09-13T23:28:57.232952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.232786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:36.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.864615+0000","last_change":"2024-09-13T23:29:08.864615+0000","last_active":"2024-09-13T23:29:08.864615+0000","last_peered":"2024-09-13T23:29:08.864615+0000","last_clean":"2024-09-13T23:29:08.864615+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:29:08.864615+0000","last_undegraded":"2024-09-13T23:29:08.864615+0000","last_fullsized":"2024-09-13T23:29:08.864615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.864495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:40.831517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.688153+0000","last_change":"2024-09-13T23:28:50.688153+0000","last_active":"2024-09-13T23:28:50.688153+0000","last_peered":"2024-09-13T23:28:50.688153+0000","last_clean":"2024-09-13T23:28:50.688153+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:28:50.688153+0000","last_undegraded":"2024-09-13T23:28:50.688153+0000","last_fullsized":"2024-09-13T23:28:50.688153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.687998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:09.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.386721+0000","last_change":"2024-09-13T23:28:43.386721+0000","last_active":"2024-09-13T23:28:43.386721+0000","last_peered":"2024-09-13T23:28:43.386721+0000","last_clean":"2024-09-13T23:28:43.386721+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:43.386721+0000","last_undegraded":"2024-09-13T23:28:43.386721+0000","last_fullsized":"2024-09-13T23:28:43.386721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.386578+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.830372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.325076+0000","last_change":"2024-09-13T23:29:01.325076+0000","last_active":"2024-09-13T23:29:01.325076+0000","last_peered":"2024-09-13T23:29:01.325076+0000","last_clean":"2024-09-13T23:29:01.325076+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:29:01.325076+0000","last_undegraded":"2024-09-13T23:29:01.325076+0000","last_fullsized":"2024-09-13T23:29:01.325076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.324903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:21.454194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.252111+0000","last_change":"2024-09-13T23:29:21.252111+0000","last_active":"2024-09-13T23:29:21.252111+0000","last_peered":"2024-09-13T23:29:21.252111+0000","last_clean":"2024-09-13T23:29:21.252111+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:29:21.252111+0000","last_undegraded":"2024-09-13T23:29:21.252111+0000","last_fullsized":"2024-09-13T23:29:21.252111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.251980+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:04.952259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.447307+0000","last_change":"2024-09-13T23:28:52.447307+0000","last_active":"2024-09-13T23:28:52.447307+0000","last_peered":"2024-09-13T23:28:52.447307+0000","last_clean":"2024-09-13T23:28:52.447307+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:52.447307+0000","last_undegraded":"2024-09-13T23:28:52.447307+0000","last_fullsized":"2024-09-13T23:28:52.447307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.447192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:03.543667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.127947+0000","last_change":"2024-09-13T23:29:28.127947+0000","last_active":"2024-09-13T23:29:28.127947+0000","last_peered":"2024-09-13T23:29:28.127947+0000","last_clean":"2024-09-13T23:29:28.127947+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:29:28.127947+0000","last_undegraded":"2024-09-13T23:29:28.127947+0000","last_fullsized":"2024-09-13T23:29:28.127947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.127828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.066301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.844011+0000","last_change":"2024-09-13T23:28:48.844011+0000","last_active":"2024-09-13T23:28:48.844011+0000","last_peered":"2024-09-13T23:28:48.844011+0000","last_clean":"2024-09-13T23:28:48.844011+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:28:48.844011+0000","last_undegraded":"2024-09-13T23:28:48.844011+0000","last_fullsized":"2024-09-13T23:28:48.844011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.843846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:04.241715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.801707+0000","last_change":"2024-09-13T23:28:44.801707+0000","last_active":"2024-09-13T23:28:44.801707+0000","last_peered":"2024-09-13T23:28:44.801707+0000","last_clean":"2024-09-13T23:28:44.801707+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:44.801707+0000","last_undegraded":"2024-09-13T23:28:44.801707+0000","last_fullsized":"2024-09-13T23:28:44.801707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.801589+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:14.458499+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":444,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.752406+0000","last_change":"2024-09-13T23:28:33.752406+0000","last_active":"2024-09-13T23:28:33.752406+0000","last_peered":"2024-09-13T23:28:33.752406+0000","last_clean":"2024-09-13T23:28:33.752406+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:33.752406+0000","last_undegraded":"2024-09-13T23:28:33.752406+0000","last_fullsized":"2024-09-13T23:28:33.752406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.752282+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:30.865050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.848945+0000","last_change":"2024-09-13T23:29:01.848945+0000","last_active":"2024-09-13T23:29:01.848945+0000","last_peered":"2024-09-13T23:29:01.848945+0000","last_clean":"2024-09-13T23:29:01.848945+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:29:01.848945+0000","last_undegraded":"2024-09-13T23:29:01.848945+0000","last_fullsized":"2024-09-13T23:29:01.848945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.848809+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:59.151044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.562160+0000","last_change":"2024-09-13T23:29:09.562160+0000","last_active":"2024-09-13T23:29:09.562160+0000","last_peered":"2024-09-13T23:29:09.562160+0000","last_clean":"2024-09-13T23:29:09.562160+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:29:09.562160+0000","last_undegraded":"2024-09-13T23:29:09.562160+0000","last_fullsized":"2024-09-13T23:29:09.562160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.562025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:49.934234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:40.165232+0000","last_change":"2024-09-13T23:29:40.165273+0000","last_active":"2024-09-13T23:29:40.165232+0000","last_peered":"2024-09-13T23:29:40.165232+0000","last_clean":"2024-09-13T23:29:40.165232+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:29:40.165232+0000","last_undegraded":"2024-09-13T23:29:40.165232+0000","last_fullsized":"2024-09-13T23:29:40.165232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:40.165135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:40.165135+0000","last_clean_scrub_stamp":"2024-09-13T23:29:40.165135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:59.047989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.183590+0000","last_change":"2024-09-13T23:28:49.183590+0000","last_active":"2024-09-13T23:28:49.183590+0000","last_peered":"2024-09-13T23:28:49.183590+0000","last_clean":"2024-09-13T23:28:49.183590+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:49.183590+0000","last_undegraded":"2024-09-13T23:28:49.183590+0000","last_fullsized":"2024-09-13T23:28:49.183590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.183478+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:30.265049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.395583+0000","last_change":"2024-09-13T23:29:04.395583+0000","last_active":"2024-09-13T23:29:04.395583+0000","last_peered":"2024-09-13T23:29:04.395583+0000","last_clean":"2024-09-13T23:29:04.395583+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:29:04.395583+0000","last_undegraded":"2024-09-13T23:29:04.395583+0000","last_fullsized":"2024-09-13T23:29:04.395583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.395455+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:53.348397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":481,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425723+0000","last_change":"2024-09-13T23:28:36.425723+0000","last_active":"2024-09-13T23:28:36.425723+0000","last_peered":"2024-09-13T23:28:36.425723+0000","last_clean":"2024-09-13T23:28:36.425723+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:36.425723+0000","last_undegraded":"2024-09-13T23:28:36.425723+0000","last_fullsized":"2024-09-13T23:28:36.425723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.425562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.620126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.564601+0000","last_change":"2024-09-13T23:29:20.564601+0000","last_active":"2024-09-13T23:29:20.564601+0000","last_peered":"2024-09-13T23:29:20.564601+0000","last_clean":"2024-09-13T23:29:20.564601+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:29:20.564601+0000","last_undegraded":"2024-09-13T23:29:20.564601+0000","last_fullsized":"2024-09-13T23:29:20.564601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.564390+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.971103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.185521+0000","last_change":"2024-09-13T23:29:01.185521+0000","last_active":"2024-09-13T23:29:01.185521+0000","last_peered":"2024-09-13T23:29:01.185521+0000","last_clean":"2024-09-13T23:29:01.185521+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:29:01.185521+0000","last_undegraded":"2024-09-13T23:29:01.185521+0000","last_fullsized":"2024-09-13T23:29:01.185521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.185393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:49.860619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:39.181740+0000","last_change":"2024-09-13T23:29:39.181798+0000","last_active":"2024-09-13T23:29:39.181740+0000","last_peered":"2024-09-13T23:29:39.181740+0000","last_clean":"2024-09-13T23:29:39.181740+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:29:39.181740+0000","last_undegraded":"2024-09-13T23:29:39.181740+0000","last_fullsized":"2024-09-13T23:29:39.181740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:39.181620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:39.181620+0000","last_clean_scrub_stamp":"2024-09-13T23:29:39.181620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.019308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.394345+0000","last_change":"2024-09-13T23:28:38.394345+0000","last_active":"2024-09-13T23:28:38.394345+0000","last_peered":"2024-09-13T23:28:38.394345+0000","last_clean":"2024-09-13T23:28:38.394345+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:28:38.394345+0000","last_undegraded":"2024-09-13T23:28:38.394345+0000","last_fullsized":"2024-09-13T23:28:38.394345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.394212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:21.836246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.343852+0000","last_change":"2024-09-13T23:28:44.343852+0000","last_active":"2024-09-13T23:28:44.343852+0000","last_peered":"2024-09-13T23:28:44.343852+0000","last_clean":"2024-09-13T23:28:44.343852+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:44.343852+0000","last_undegraded":"2024-09-13T23:28:44.343852+0000","last_fullsized":"2024-09-13T23:28:44.343852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.343715+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.109483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.818982+0000","last_change":"2024-09-13T23:28:41.818982+0000","last_active":"2024-09-13T23:28:41.818982+0000","last_peered":"2024-09-13T23:28:41.818982+0000","last_clean":"2024-09-13T23:28:41.818982+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:28:41.818982+0000","last_undegraded":"2024-09-13T23:28:41.818982+0000","last_fullsized":"2024-09-13T23:28:41.818982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.818869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:39:47.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.308494+0000","last_change":"2024-09-13T23:28:46.308494+0000","last_active":"2024-09-13T23:28:46.308494+0000","last_peered":"2024-09-13T23:28:46.308494+0000","last_clean":"2024-09-13T23:28:46.308494+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:46.308494+0000","last_undegraded":"2024-09-13T23:28:46.308494+0000","last_fullsized":"2024-09-13T23:28:46.308494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.308315+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:05.222355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.609131+0000","last_change":"2024-09-13T23:29:26.609157+0000","last_active":"2024-09-13T23:29:26.609131+0000","last_peered":"2024-09-13T23:29:26.609131+0000","last_clean":"2024-09-13T23:29:26.609131+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:29:26.609131+0000","last_undegraded":"2024-09-13T23:29:26.609131+0000","last_fullsized":"2024-09-13T23:29:26.609131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.609024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:44.317023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.163503+0000","last_change":"2024-09-13T23:29:20.163541+0000","last_active":"2024-09-13T23:29:20.163503+0000","last_peered":"2024-09-13T23:29:20.163503+0000","last_clean":"2024-09-13T23:29:20.163503+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:29:20.163503+0000","last_undegraded":"2024-09-13T23:29:20.163503+0000","last_fullsized":"2024-09-13T23:29:20.163503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.163405+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:46.471149+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:46.090992+0000","last_change":"2024-09-13T23:29:46.091023+0000","last_active":"2024-09-13T23:29:46.090992+0000","last_peered":"2024-09-13T23:29:46.090992+0000","last_clean":"2024-09-13T23:29:46.090992+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:29:46.090992+0000","last_undegraded":"2024-09-13T23:29:46.090992+0000","last_fullsized":"2024-09-13T23:29:46.090992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:46.090900+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:46.090900+0000","last_clean_scrub_stamp":"2024-09-13T23:29:46.090900+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:13.244597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:36.198295+0000","last_change":"2024-09-13T23:29:36.198326+0000","last_active":"2024-09-13T23:29:36.198295+0000","last_peered":"2024-09-13T23:29:36.198295+0000","last_clean":"2024-09-13T23:29:36.198295+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:29:36.198295+0000","last_undegraded":"2024-09-13T23:29:36.198295+0000","last_fullsized":"2024-09-13T23:29:36.198295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:36.198192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:36.198192+0000","last_clean_scrub_stamp":"2024-09-13T23:29:36.198192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:51.372266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.221206+0000","last_change":"2024-09-13T23:28:53.221206+0000","last_active":"2024-09-13T23:28:53.221206+0000","last_peered":"2024-09-13T23:28:53.221206+0000","last_clean":"2024-09-13T23:28:53.221206+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:28:53.221206+0000","last_undegraded":"2024-09-13T23:28:53.221206+0000","last_fullsized":"2024-09-13T23:28:53.221206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.221045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:28.166667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'92","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.357739+0000","last_change":"2024-09-13T23:29:06.357739+0000","last_active":"2024-09-13T23:29:06.357739+0000","last_peered":"2024-09-13T23:29:06.357739+0000","last_clean":"2024-09-13T23:29:06.357739+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:29:06.357739+0000","last_undegraded":"2024-09-13T23:29:06.357739+0000","last_fullsized":"2024-09-13T23:29:06.357739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.357608+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:02.482328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.823673+0000","last_change":"2024-09-13T23:28:53.823673+0000","last_active":"2024-09-13T23:28:53.823673+0000","last_peered":"2024-09-13T23:28:53.823673+0000","last_clean":"2024-09-13T23:28:53.823673+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:28:53.823673+0000","last_undegraded":"2024-09-13T23:28:53.823673+0000","last_fullsized":"2024-09-13T23:28:53.823673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.823527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:30.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.737380+0000","last_change":"2024-09-13T23:28:49.737380+0000","last_active":"2024-09-13T23:28:49.737380+0000","last_peered":"2024-09-13T23:28:49.737380+0000","last_clean":"2024-09-13T23:28:49.737380+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:49.737380+0000","last_undegraded":"2024-09-13T23:28:49.737380+0000","last_fullsized":"2024-09-13T23:28:49.737380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.737262+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:19.374870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.227141+0000","last_change":"2024-09-13T23:29:19.227141+0000","last_active":"2024-09-13T23:29:19.227141+0000","last_peered":"2024-09-13T23:29:19.227141+0000","last_clean":"2024-09-13T23:29:19.227141+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:29:19.227141+0000","last_undegraded":"2024-09-13T23:29:19.227141+0000","last_fullsized":"2024-09-13T23:29:19.227141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.227009+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:09.980858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:43.091908+0000","last_change":"2024-09-13T23:29:43.091932+0000","last_active":"2024-09-13T23:29:43.091908+0000","last_peered":"2024-09-13T23:29:43.091908+0000","last_clean":"2024-09-13T23:29:43.091908+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:29:43.091908+0000","last_undegraded":"2024-09-13T23:29:43.091908+0000","last_fullsized":"2024-09-13T23:29:43.091908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:43.091818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:43.091818+0000","last_clean_scrub_stamp":"2024-09-13T23:29:43.091818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:33.568177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.548895+0000","last_change":"2024-09-13T23:29:22.548895+0000","last_active":"2024-09-13T23:29:22.548895+0000","last_peered":"2024-09-13T23:29:22.548895+0000","last_clean":"2024-09-13T23:29:22.548895+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:29:22.548895+0000","last_undegraded":"2024-09-13T23:29:22.548895+0000","last_fullsized":"2024-09-13T23:29:22.548895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.548710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:02.141054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.403471+0000","last_change":"2024-09-13T23:28:40.403471+0000","last_active":"2024-09-13T23:28:40.403471+0000","last_peered":"2024-09-13T23:28:40.403471+0000","last_clean":"2024-09-13T23:28:40.403471+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:28:40.403471+0000","last_undegraded":"2024-09-13T23:28:40.403471+0000","last_fullsized":"2024-09-13T23:28:40.403471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.922817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":516,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.424100+0000","last_change":"2024-09-13T23:28:37.424100+0000","last_active":"2024-09-13T23:28:37.424100+0000","last_peered":"2024-09-13T23:28:37.424100+0000","last_clean":"2024-09-13T23:28:37.424100+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:37.424100+0000","last_undegraded":"2024-09-13T23:28:37.424100+0000","last_fullsized":"2024-09-13T23:28:37.424100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'290","last_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_deep_scrub":"33'290","last_deep_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.423958+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:06.509304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.332791+0000","last_change":"2024-09-13T23:28:59.332791+0000","last_active":"2024-09-13T23:28:59.332791+0000","last_peered":"2024-09-13T23:28:59.332791+0000","last_clean":"2024-09-13T23:28:59.332791+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:28:59.332791+0000","last_undegraded":"2024-09-13T23:28:59.332791+0000","last_fullsized":"2024-09-13T23:28:59.332791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.332635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.559378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.257508+0000","last_change":"2024-09-13T23:28:54.257508+0000","last_active":"2024-09-13T23:28:54.257508+0000","last_peered":"2024-09-13T23:28:54.257508+0000","last_clean":"2024-09-13T23:28:54.257508+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:28:54.257508+0000","last_undegraded":"2024-09-13T23:28:54.257508+0000","last_fullsized":"2024-09-13T23:28:54.257508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.257339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:02.842442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.870912+0000","last_change":"2024-09-13T23:29:00.870912+0000","last_active":"2024-09-13T23:29:00.870912+0000","last_peered":"2024-09-13T23:29:00.870912+0000","last_clean":"2024-09-13T23:29:00.870912+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:29:00.870912+0000","last_undegraded":"2024-09-13T23:29:00.870912+0000","last_fullsized":"2024-09-13T23:29:00.870912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.870738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:34.532435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.571870+0000","last_change":"2024-09-13T23:29:11.571870+0000","last_active":"2024-09-13T23:29:11.571870+0000","last_peered":"2024-09-13T23:29:11.571870+0000","last_clean":"2024-09-13T23:29:11.571870+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:29:11.571870+0000","last_undegraded":"2024-09-13T23:29:11.571870+0000","last_fullsized":"2024-09-13T23:29:11.571870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.571739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:44.142918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.914793+0000","last_change":"2024-09-13T23:29:04.914793+0000","last_active":"2024-09-13T23:29:04.914793+0000","last_peered":"2024-09-13T23:29:04.914793+0000","last_clean":"2024-09-13T23:29:04.914793+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:29:04.914793+0000","last_undegraded":"2024-09-13T23:29:04.914793+0000","last_fullsized":"2024-09-13T23:29:04.914793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.914680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:41.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":233,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.702609+0000","last_change":"2024-09-13T23:28:51.702609+0000","last_active":"2024-09-13T23:28:51.702609+0000","last_peered":"2024-09-13T23:28:51.702609+0000","last_clean":"2024-09-13T23:28:51.702609+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:51.702609+0000","last_undegraded":"2024-09-13T23:28:51.702609+0000","last_fullsized":"2024-09-13T23:28:51.702609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.702483+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:52.157557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.806174+0000","last_change":"2024-09-13T23:28:39.806174+0000","last_active":"2024-09-13T23:28:39.806174+0000","last_peered":"2024-09-13T23:28:39.806174+0000","last_clean":"2024-09-13T23:28:39.806174+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:39.806174+0000","last_undegraded":"2024-09-13T23:28:39.806174+0000","last_fullsized":"2024-09-13T23:28:39.806174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.806026+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:51.713911+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.882546+0000","last_change":"2024-09-13T23:28:33.882546+0000","last_active":"2024-09-13T23:28:33.882546+0000","last_peered":"2024-09-13T23:28:33.882546+0000","last_clean":"2024-09-13T23:28:33.882546+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:28:33.882546+0000","last_undegraded":"2024-09-13T23:28:33.882546+0000","last_fullsized":"2024-09-13T23:28:33.882546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.882409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:51.076973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.334740+0000","last_change":"2024-09-13T23:29:13.334740+0000","last_active":"2024-09-13T23:29:13.334740+0000","last_peered":"2024-09-13T23:29:13.334740+0000","last_clean":"2024-09-13T23:29:13.334740+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:29:13.334740+0000","last_undegraded":"2024-09-13T23:29:13.334740+0000","last_fullsized":"2024-09-13T23:29:13.334740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.334630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:41.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.809935+0000","last_change":"2024-09-13T23:29:13.809935+0000","last_active":"2024-09-13T23:29:13.809935+0000","last_peered":"2024-09-13T23:29:13.809935+0000","last_clean":"2024-09-13T23:29:13.809935+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:29:13.809935+0000","last_undegraded":"2024-09-13T23:29:13.809935+0000","last_fullsized":"2024-09-13T23:29:13.809935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.809798+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:31.517797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:45.085055+0000","last_change":"2024-09-13T23:29:45.085106+0000","last_active":"2024-09-13T23:29:45.085055+0000","last_peered":"2024-09-13T23:29:45.085055+0000","last_clean":"2024-09-13T23:29:45.085055+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:29:45.085055+0000","last_undegraded":"2024-09-13T23:29:45.085055+0000","last_fullsized":"2024-09-13T23:29:45.085055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:45.084957+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:45.084957+0000","last_clean_scrub_stamp":"2024-09-13T23:29:45.084957+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:07.113680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.573654+0000","last_change":"2024-09-13T23:29:14.573654+0000","last_active":"2024-09-13T23:29:14.573654+0000","last_peered":"2024-09-13T23:29:14.573654+0000","last_clean":"2024-09-13T23:29:14.573654+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:29:14.573654+0000","last_undegraded":"2024-09-13T23:29:14.573654+0000","last_fullsized":"2024-09-13T23:29:14.573654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.573539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:03.633104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.851664+0000","last_change":"2024-09-13T23:28:55.851664+0000","last_active":"2024-09-13T23:28:55.851664+0000","last_peered":"2024-09-13T23:28:55.851664+0000","last_clean":"2024-09-13T23:28:55.851664+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:28:55.851664+0000","last_undegraded":"2024-09-13T23:28:55.851664+0000","last_fullsized":"2024-09-13T23:28:55.851664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.851536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.407551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.436815+0000","last_change":"2024-09-13T23:28:39.436815+0000","last_active":"2024-09-13T23:28:39.436815+0000","last_peered":"2024-09-13T23:28:39.436815+0000","last_clean":"2024-09-13T23:28:39.436815+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:39.436815+0000","last_undegraded":"2024-09-13T23:28:39.436815+0000","last_fullsized":"2024-09-13T23:28:39.436815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.436619+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.975861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.387757+0000","last_change":"2024-09-13T23:29:05.387757+0000","last_active":"2024-09-13T23:29:05.387757+0000","last_peered":"2024-09-13T23:29:05.387757+0000","last_clean":"2024-09-13T23:29:05.387757+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:29:05.387757+0000","last_undegraded":"2024-09-13T23:29:05.387757+0000","last_fullsized":"2024-09-13T23:29:05.387757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.387595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:27.332966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.209565+0000","last_change":"2024-09-13T23:29:02.209565+0000","last_active":"2024-09-13T23:29:02.209565+0000","last_peered":"2024-09-13T23:29:02.209565+0000","last_clean":"2024-09-13T23:29:02.209565+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:29:02.209565+0000","last_undegraded":"2024-09-13T23:29:02.209565+0000","last_fullsized":"2024-09-13T23:29:02.209565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.209446+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:20.762436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.243922+0000","last_change":"2024-09-13T23:29:03.243922+0000","last_active":"2024-09-13T23:29:03.243922+0000","last_peered":"2024-09-13T23:29:03.243922+0000","last_clean":"2024-09-13T23:29:03.243922+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:29:03.243922+0000","last_undegraded":"2024-09-13T23:29:03.243922+0000","last_fullsized":"2024-09-13T23:29:03.243922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.243808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:56.628747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.531080+0000","last_change":"2024-09-13T23:29:15.531080+0000","last_active":"2024-09-13T23:29:15.531080+0000","last_peered":"2024-09-13T23:29:15.531080+0000","last_clean":"2024-09-13T23:29:15.531080+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:29:15.531080+0000","last_undegraded":"2024-09-13T23:29:15.531080+0000","last_fullsized":"2024-09-13T23:29:15.531080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.530856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:05.204799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.643519+0000","last_change":"2024-09-13T23:29:20.643550+0000","last_active":"2024-09-13T23:29:20.643519+0000","last_peered":"2024-09-13T23:29:20.643519+0000","last_clean":"2024-09-13T23:29:20.643519+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:29:20.643519+0000","last_undegraded":"2024-09-13T23:29:20.643519+0000","last_fullsized":"2024-09-13T23:29:20.643519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.643435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:53.234522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.874110+0000","last_change":"2024-09-13T23:28:56.874110+0000","last_active":"2024-09-13T23:28:56.874110+0000","last_peered":"2024-09-13T23:28:56.874110+0000","last_clean":"2024-09-13T23:28:56.874110+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:56.874110+0000","last_undegraded":"2024-09-13T23:28:56.874110+0000","last_fullsized":"2024-09-13T23:28:56.874110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.873926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:08.273545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.871262+0000","last_change":"2024-09-13T23:28:39.871262+0000","last_active":"2024-09-13T23:28:39.871262+0000","last_peered":"2024-09-13T23:28:39.871262+0000","last_clean":"2024-09-13T23:28:39.871262+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:39.871262+0000","last_undegraded":"2024-09-13T23:28:39.871262+0000","last_fullsized":"2024-09-13T23:28:39.871262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.871135+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:40.326209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.710245+0000","last_change":"2024-09-13T23:28:34.710245+0000","last_active":"2024-09-13T23:28:34.710245+0000","last_peered":"2024-09-13T23:28:34.710245+0000","last_clean":"2024-09-13T23:28:34.710245+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:28:34.710245+0000","last_undegraded":"2024-09-13T23:28:34.710245+0000","last_fullsized":"2024-09-13T23:28:34.710245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.710073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:54.079159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.581925+0000","last_change":"2024-09-13T23:29:32.581999+0000","last_active":"2024-09-13T23:29:32.581925+0000","last_peered":"2024-09-13T23:29:32.581925+0000","last_clean":"2024-09-13T23:29:32.581925+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:29:32.581925+0000","last_undegraded":"2024-09-13T23:29:32.581925+0000","last_fullsized":"2024-09-13T23:29:32.581925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:29:32.581809+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:29:32.581809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.581809+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:01.348395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.241484+0000","last_change":"2024-09-13T23:29:32.241520+0000","last_active":"2024-09-13T23:29:32.241484+0000","last_peered":"2024-09-13T23:29:32.241484+0000","last_clean":"2024-09-13T23:29:32.241484+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:29:32.241484+0000","last_undegraded":"2024-09-13T23:29:32.241484+0000","last_fullsized":"2024-09-13T23:29:32.241484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.241399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:22.020934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.766210+0000","last_change":"2024-09-13T23:29:14.766210+0000","last_active":"2024-09-13T23:29:14.766210+0000","last_peered":"2024-09-13T23:29:14.766210+0000","last_clean":"2024-09-13T23:29:14.766210+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:29:14.766210+0000","last_undegraded":"2024-09-13T23:29:14.766210+0000","last_fullsized":"2024-09-13T23:29:14.766210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.766103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:57.073467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:44.093325+0000","last_change":"2024-09-13T23:29:44.093350+0000","last_active":"2024-09-13T23:29:44.093325+0000","last_peered":"2024-09-13T23:29:44.093325+0000","last_clean":"2024-09-13T23:29:44.093325+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:29:44.093325+0000","last_undegraded":"2024-09-13T23:29:44.093325+0000","last_fullsized":"2024-09-13T23:29:44.093325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:44.093199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:44.093199+0000","last_clean_scrub_stamp":"2024-09-13T23:29:44.093199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:55.641065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.414539+0000","last_change":"2024-09-13T23:28:43.414539+0000","last_active":"2024-09-13T23:28:43.414539+0000","last_peered":"2024-09-13T23:28:43.414539+0000","last_clean":"2024-09-13T23:28:43.414539+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:28:43.414539+0000","last_undegraded":"2024-09-13T23:28:43.414539+0000","last_fullsized":"2024-09-13T23:28:43.414539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.414417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:10.088043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.380370+0000","last_change":"2024-09-13T23:28:41.380370+0000","last_active":"2024-09-13T23:28:41.380370+0000","last_peered":"2024-09-13T23:28:41.380370+0000","last_clean":"2024-09-13T23:28:41.380370+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:28:41.380370+0000","last_undegraded":"2024-09-13T23:28:41.380370+0000","last_fullsized":"2024-09-13T23:28:41.380370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.380224+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:00.663439+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":382,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.460537+0000","last_change":"2024-09-13T23:28:33.460537+0000","last_active":"2024-09-13T23:28:33.460537+0000","last_peered":"2024-09-13T23:28:33.460537+0000","last_clean":"2024-09-13T23:28:33.460537+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:33.460537+0000","last_undegraded":"2024-09-13T23:28:33.460537+0000","last_fullsized":"2024-09-13T23:28:33.460537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.460417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:15.571224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.402665+0000","last_change":"2024-09-13T23:29:09.402665+0000","last_active":"2024-09-13T23:29:09.402665+0000","last_peered":"2024-09-13T23:29:09.402665+0000","last_clean":"2024-09-13T23:29:09.402665+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:29:09.402665+0000","last_undegraded":"2024-09-13T23:29:09.402665+0000","last_fullsized":"2024-09-13T23:29:09.402665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.402546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:24.217280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.425285+0000","last_change":"2024-09-13T23:28:50.425285+0000","last_active":"2024-09-13T23:28:50.425285+0000","last_peered":"2024-09-13T23:28:50.425285+0000","last_clean":"2024-09-13T23:28:50.425285+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:50.425285+0000","last_undegraded":"2024-09-13T23:28:50.425285+0000","last_fullsized":"2024-09-13T23:28:50.425285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.425164+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:33.299011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:50.062602+0000","last_change":"2024-09-13T23:29:50.062631+0000","last_active":"2024-09-13T23:29:50.062602+0000","last_peered":"2024-09-13T23:29:50.062602+0000","last_clean":"2024-09-13T23:29:50.062602+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:29:50.062602+0000","last_undegraded":"2024-09-13T23:29:50.062602+0000","last_fullsized":"2024-09-13T23:29:50.062602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:50.062492+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:50.062492+0000","last_clean_scrub_stamp":"2024-09-13T23:29:50.062492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:02.942468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.649065+0000","last_change":"2024-09-13T23:29:19.649065+0000","last_active":"2024-09-13T23:29:19.649065+0000","last_peered":"2024-09-13T23:29:19.649065+0000","last_clean":"2024-09-13T23:29:19.649065+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:29:19.649065+0000","last_undegraded":"2024-09-13T23:29:19.649065+0000","last_fullsized":"2024-09-13T23:29:19.649065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.648941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:56.406515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808592+0000","last_change":"2024-09-13T23:25:52.385166+0000","last_active":"2024-09-13T23:28:33.808592+0000","last_peered":"2024-09-13T23:28:33.808592+0000","last_clean":"2024-09-13T23:28:33.808592+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:28:33.808592+0000","last_undegraded":"2024-09-13T23:28:33.808592+0000","last_fullsized":"2024-09-13T23:28:33.808592+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.381242+0000","last_change":"2024-09-13T23:28:49.381242+0000","last_active":"2024-09-13T23:28:49.381242+0000","last_peered":"2024-09-13T23:28:49.381242+0000","last_clean":"2024-09-13T23:28:49.381242+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:28:49.381242+0000","last_undegraded":"2024-09-13T23:28:49.381242+0000","last_fullsized":"2024-09-13T23:28:49.381242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.381105+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:20.463802+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.879400+0000","last_change":"2024-09-13T23:28:38.879400+0000","last_active":"2024-09-13T23:28:38.879400+0000","last_peered":"2024-09-13T23:28:38.879400+0000","last_clean":"2024-09-13T23:28:38.879400+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:38.879400+0000","last_undegraded":"2024-09-13T23:28:38.879400+0000","last_fullsized":"2024-09-13T23:28:38.879400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.879232+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:58.162447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.197573+0000","last_change":"2024-09-13T23:29:31.197573+0000","last_active":"2024-09-13T23:29:31.197573+0000","last_peered":"2024-09-13T23:29:31.197573+0000","last_clean":"2024-09-13T23:29:31.197573+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:29:31.197573+0000","last_undegraded":"2024-09-13T23:29:31.197573+0000","last_fullsized":"2024-09-13T23:29:31.197573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.197417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:14.373909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.601069+0000","last_change":"2024-09-13T23:29:07.601069+0000","last_active":"2024-09-13T23:29:07.601069+0000","last_peered":"2024-09-13T23:29:07.601069+0000","last_clean":"2024-09-13T23:29:07.601069+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:29:07.601069+0000","last_undegraded":"2024-09-13T23:29:07.601069+0000","last_fullsized":"2024-09-13T23:29:07.601069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.600916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:00.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.266733+0000","last_change":"2024-09-13T23:29:24.266733+0000","last_active":"2024-09-13T23:29:24.266733+0000","last_peered":"2024-09-13T23:29:24.266733+0000","last_clean":"2024-09-13T23:29:24.266733+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:29:24.266733+0000","last_undegraded":"2024-09-13T23:29:24.266733+0000","last_fullsized":"2024-09-13T23:29:24.266733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.266619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:10.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:47.105618+0000","last_change":"2024-09-13T23:29:47.105653+0000","last_active":"2024-09-13T23:29:47.105618+0000","last_peered":"2024-09-13T23:29:47.105618+0000","last_clean":"2024-09-13T23:29:47.105618+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:29:47.105618+0000","last_undegraded":"2024-09-13T23:29:47.105618+0000","last_fullsized":"2024-09-13T23:29:47.105618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:47.105535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:47.105535+0000","last_clean_scrub_stamp":"2024-09-13T23:29:47.105535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:52.136676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.808585+0000","last_change":"2024-09-13T23:25:52.385401+0000","last_active":"2024-09-13T23:28:33.808585+0000","last_peered":"2024-09-13T23:28:33.808585+0000","last_clean":"2024-09-13T23:28:33.808585+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:28:33.808585+0000","last_undegraded":"2024-09-13T23:28:33.808585+0000","last_fullsized":"2024-09-13T23:28:33.808585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:16.268357+0000","last_clean_scrub_stamp":"2024-09-13T23:25:16.268357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.843531+0000","last_change":"2024-09-13T23:28:40.843531+0000","last_active":"2024-09-13T23:28:40.843531+0000","last_peered":"2024-09-13T23:28:40.843531+0000","last_clean":"2024-09-13T23:28:40.843531+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:40.843531+0000","last_undegraded":"2024-09-13T23:28:40.843531+0000","last_fullsized":"2024-09-13T23:28:40.843531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.843409+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:25.282723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.906383+0000","last_change":"2024-09-13T23:28:32.906383+0000","last_active":"2024-09-13T23:28:32.906383+0000","last_peered":"2024-09-13T23:28:32.906383+0000","last_clean":"2024-09-13T23:28:32.906383+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:28:32.906383+0000","last_undegraded":"2024-09-13T23:28:32.906383+0000","last_fullsized":"2024-09-13T23:28:32.906383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_clean_scrub_stamp":"2024-09-13T23:28:32.906287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:02.563197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.690642+0000","last_change":"2024-09-13T23:28:53.690642+0000","last_active":"2024-09-13T23:28:53.690642+0000","last_peered":"2024-09-13T23:28:53.690642+0000","last_clean":"2024-09-13T23:28:53.690642+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:28:53.690642+0000","last_undegraded":"2024-09-13T23:28:53.690642+0000","last_fullsized":"2024-09-13T23:28:53.690642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.690487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:50.456254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.602393+0000","last_change":"2024-09-13T23:29:22.602393+0000","last_active":"2024-09-13T23:29:22.602393+0000","last_peered":"2024-09-13T23:29:22.602393+0000","last_clean":"2024-09-13T23:29:22.602393+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:29:22.602393+0000","last_undegraded":"2024-09-13T23:29:22.602393+0000","last_fullsized":"2024-09-13T23:29:22.602393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.602254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:11.951905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.572393+0000","last_change":"2024-09-13T23:29:05.572440+0000","last_active":"2024-09-13T23:29:05.572393+0000","last_peered":"2024-09-13T23:29:05.572393+0000","last_clean":"2024-09-13T23:29:05.572393+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:29:05.572393+0000","last_undegraded":"2024-09-13T23:29:05.572393+0000","last_fullsized":"2024-09-13T23:29:05.572393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.572289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:29.963092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.184485+0000","last_change":"2024-09-13T23:29:34.184485+0000","last_active":"2024-09-13T23:29:34.184485+0000","last_peered":"2024-09-13T23:29:34.184485+0000","last_clean":"2024-09-13T23:29:34.184485+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:29:34.184485+0000","last_undegraded":"2024-09-13T23:29:34.184485+0000","last_fullsized":"2024-09-13T23:29:34.184485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:34.184356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:34.184356+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.184356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:19.682114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.206254+0000","last_change":"2024-09-13T23:28:51.206296+0000","last_active":"2024-09-13T23:28:51.206254+0000","last_peered":"2024-09-13T23:28:51.206254+0000","last_clean":"2024-09-13T23:28:51.206254+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:28:51.206254+0000","last_undegraded":"2024-09-13T23:28:51.206254+0000","last_fullsized":"2024-09-13T23:28:51.206254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.206161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:55.123436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'40","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.380671+0000","last_change":"2024-09-13T23:29:03.380714+0000","last_active":"2024-09-13T23:29:03.380671+0000","last_peered":"2024-09-13T23:29:03.380671+0000","last_clean":"2024-09-13T23:29:03.380671+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:29:03.380671+0000","last_undegraded":"2024-09-13T23:29:03.380671+0000","last_fullsized":"2024-09-13T23:29:03.380671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.380585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:23.091624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.323477+0000","last_change":"2024-09-13T23:28:55.323501+0000","last_active":"2024-09-13T23:28:55.323477+0000","last_peered":"2024-09-13T23:28:55.323477+0000","last_clean":"2024-09-13T23:28:55.323477+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:28:55.323477+0000","last_undegraded":"2024-09-13T23:28:55.323477+0000","last_fullsized":"2024-09-13T23:28:55.323477+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.323390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:04.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.588269+0000","last_change":"2024-09-13T23:29:33.588311+0000","last_active":"2024-09-13T23:29:33.588269+0000","last_peered":"2024-09-13T23:29:33.588269+0000","last_clean":"2024-09-13T23:29:33.588269+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:29:33.588269+0000","last_undegraded":"2024-09-13T23:29:33.588269+0000","last_fullsized":"2024-09-13T23:29:33.588269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:33.588179+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:33.588179+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.588179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.532728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'10","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.129075+0000","last_change":"2024-09-13T23:29:18.129114+0000","last_active":"2024-09-13T23:29:18.129075+0000","last_peered":"2024-09-13T23:29:18.129075+0000","last_clean":"2024-09-13T23:29:18.129075+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:29:18.129075+0000","last_undegraded":"2024-09-13T23:29:18.129075+0000","last_fullsized":"2024-09-13T23:29:18.129075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.128983+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:24.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.534732+0000","last_change":"2024-09-13T23:29:02.534760+0000","last_active":"2024-09-13T23:29:02.534732+0000","last_peered":"2024-09-13T23:29:02.534732+0000","last_clean":"2024-09-13T23:29:02.534732+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:29:02.534732+0000","last_undegraded":"2024-09-13T23:29:02.534732+0000","last_fullsized":"2024-09-13T23:29:02.534732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.534643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:37.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.419549+0000","last_change":"2024-09-13T23:28:44.419595+0000","last_active":"2024-09-13T23:28:44.419549+0000","last_peered":"2024-09-13T23:28:44.419549+0000","last_clean":"2024-09-13T23:28:44.419549+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:28:44.419549+0000","last_undegraded":"2024-09-13T23:28:44.419549+0000","last_fullsized":"2024-09-13T23:28:44.419549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.419451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:28.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.882244+0000","last_change":"2024-09-13T23:28:44.882276+0000","last_active":"2024-09-13T23:28:44.882244+0000","last_peered":"2024-09-13T23:28:44.882244+0000","last_clean":"2024-09-13T23:28:44.882244+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:44.882244+0000","last_undegraded":"2024-09-13T23:28:44.882244+0000","last_fullsized":"2024-09-13T23:28:44.882244+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.882155+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.157762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.770991+0000","last_change":"2024-09-13T23:28:45.771011+0000","last_active":"2024-09-13T23:28:45.770991+0000","last_peered":"2024-09-13T23:28:45.770991+0000","last_clean":"2024-09-13T23:28:45.770991+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:28:45.770991+0000","last_undegraded":"2024-09-13T23:28:45.770991+0000","last_fullsized":"2024-09-13T23:28:45.770991+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.770908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:02.965472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.620279+0000","last_change":"2024-09-13T23:29:29.620306+0000","last_active":"2024-09-13T23:29:29.620279+0000","last_peered":"2024-09-13T23:29:29.620279+0000","last_clean":"2024-09-13T23:29:29.620279+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:29:29.620279+0000","last_undegraded":"2024-09-13T23:29:29.620279+0000","last_fullsized":"2024-09-13T23:29:29.620279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:36:47.509114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.866124+0000","last_change":"2024-09-13T23:29:11.866151+0000","last_active":"2024-09-13T23:29:11.866124+0000","last_peered":"2024-09-13T23:29:11.866124+0000","last_clean":"2024-09-13T23:29:11.866124+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:29:11.866124+0000","last_undegraded":"2024-09-13T23:29:11.866124+0000","last_fullsized":"2024-09-13T23:29:11.866124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.866030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:36.997837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.602669+0000","last_change":"2024-09-13T23:29:10.602698+0000","last_active":"2024-09-13T23:29:10.602669+0000","last_peered":"2024-09-13T23:29:10.602669+0000","last_clean":"2024-09-13T23:29:10.602669+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:29:10.602669+0000","last_undegraded":"2024-09-13T23:29:10.602669+0000","last_fullsized":"2024-09-13T23:29:10.602669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.602581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:02.399450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.713164+0000","last_change":"2024-09-13T23:28:47.713189+0000","last_active":"2024-09-13T23:28:47.713164+0000","last_peered":"2024-09-13T23:28:47.713164+0000","last_clean":"2024-09-13T23:28:47.713164+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:28:47.713164+0000","last_undegraded":"2024-09-13T23:28:47.713164+0000","last_fullsized":"2024-09-13T23:28:47.713164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.713076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:36.167508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'48","reported_seq":120,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.861559+0000","last_change":"2024-09-13T23:28:43.861599+0000","last_active":"2024-09-13T23:28:43.861559+0000","last_peered":"2024-09-13T23:28:43.861559+0000","last_clean":"2024-09-13T23:28:43.861559+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:43.861559+0000","last_undegraded":"2024-09-13T23:28:43.861559+0000","last_fullsized":"2024-09-13T23:28:43.861559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.861453+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:50.677647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.470961+0000","last_change":"2024-09-13T23:28:35.470984+0000","last_active":"2024-09-13T23:28:35.470961+0000","last_peered":"2024-09-13T23:28:35.470961+0000","last_clean":"2024-09-13T23:28:35.470961+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:28:35.470961+0000","last_undegraded":"2024-09-13T23:28:35.470961+0000","last_fullsized":"2024-09-13T23:28:35.470961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.470871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:42.091197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:53.013686+0000","last_change":"2024-09-13T23:29:53.013711+0000","last_active":"2024-09-13T23:29:53.013686+0000","last_peered":"2024-09-13T23:29:53.013686+0000","last_clean":"2024-09-13T23:29:53.013686+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:29:53.013686+0000","last_undegraded":"2024-09-13T23:29:53.013686+0000","last_fullsized":"2024-09-13T23:29:53.013686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:53.013586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:53.013586+0000","last_clean_scrub_stamp":"2024-09-13T23:29:53.013586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:57.296130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.391868+0000","last_change":"2024-09-13T23:28:46.391900+0000","last_active":"2024-09-13T23:28:46.391868+0000","last_peered":"2024-09-13T23:28:46.391868+0000","last_clean":"2024-09-13T23:28:46.391868+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:46.391868+0000","last_undegraded":"2024-09-13T23:28:46.391868+0000","last_fullsized":"2024-09-13T23:28:46.391868+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.391777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:57.512441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.055925+0000","last_change":"2024-09-13T23:29:13.055977+0000","last_active":"2024-09-13T23:29:13.055925+0000","last_peered":"2024-09-13T23:29:13.055925+0000","last_clean":"2024-09-13T23:29:13.055925+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:29:13.055925+0000","last_undegraded":"2024-09-13T23:29:13.055925+0000","last_fullsized":"2024-09-13T23:29:13.055925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.055822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:46.390759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425037+0000","last_change":"2024-09-13T23:28:36.425088+0000","last_active":"2024-09-13T23:28:36.425037+0000","last_peered":"2024-09-13T23:28:36.425037+0000","last_clean":"2024-09-13T23:28:36.425037+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:28:36.425037+0000","last_undegraded":"2024-09-13T23:28:36.425037+0000","last_fullsized":"2024-09-13T23:28:36.425037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.424930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:03.124803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.764356+0000","last_change":"2024-09-13T23:28:46.764392+0000","last_active":"2024-09-13T23:28:46.764356+0000","last_peered":"2024-09-13T23:28:46.764356+0000","last_clean":"2024-09-13T23:28:46.764356+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:46.764356+0000","last_undegraded":"2024-09-13T23:28:46.764356+0000","last_fullsized":"2024-09-13T23:28:46.764356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.764271+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:15.849617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.707109+0000","last_change":"2024-09-13T23:28:36.707149+0000","last_active":"2024-09-13T23:28:36.707109+0000","last_peered":"2024-09-13T23:28:36.707109+0000","last_clean":"2024-09-13T23:28:36.707109+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:28:36.707109+0000","last_undegraded":"2024-09-13T23:28:36.707109+0000","last_fullsized":"2024-09-13T23:28:36.707109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.706974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.091638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.253579+0000","last_change":"2024-09-13T23:29:15.253579+0000","last_active":"2024-09-13T23:29:15.253579+0000","last_peered":"2024-09-13T23:29:15.253579+0000","last_clean":"2024-09-13T23:29:15.253579+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:29:15.253579+0000","last_undegraded":"2024-09-13T23:29:15.253579+0000","last_fullsized":"2024-09-13T23:29:15.253579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.253463+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:56.543757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:37.190080+0000","last_change":"2024-09-13T23:29:37.190105+0000","last_active":"2024-09-13T23:29:37.190080+0000","last_peered":"2024-09-13T23:29:37.190080+0000","last_clean":"2024-09-13T23:29:37.190080+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:29:37.190080+0000","last_undegraded":"2024-09-13T23:29:37.190080+0000","last_fullsized":"2024-09-13T23:29:37.190080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:37.189981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:37.189981+0000","last_clean_scrub_stamp":"2024-09-13T23:29:37.189981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:08.220487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.823047+0000","last_change":"2024-09-13T23:28:54.823047+0000","last_active":"2024-09-13T23:28:54.823047+0000","last_peered":"2024-09-13T23:28:54.823047+0000","last_clean":"2024-09-13T23:28:54.823047+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:28:54.823047+0000","last_undegraded":"2024-09-13T23:28:54.823047+0000","last_fullsized":"2024-09-13T23:28:54.823047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.822942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:27.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'65","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.838301+0000","last_change":"2024-09-13T23:28:46.838338+0000","last_active":"2024-09-13T23:28:46.838301+0000","last_peered":"2024-09-13T23:28:46.838301+0000","last_clean":"2024-09-13T23:28:46.838301+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:46.838301+0000","last_undegraded":"2024-09-13T23:28:46.838301+0000","last_fullsized":"2024-09-13T23:28:46.838301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'65","last_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_deep_scrub":"33'65","last_deep_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.838216+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.670165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.700661+0000","last_change":"2024-09-13T23:28:35.700684+0000","last_active":"2024-09-13T23:28:35.700661+0000","last_peered":"2024-09-13T23:28:35.700661+0000","last_clean":"2024-09-13T23:28:35.700661+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:28:35.700661+0000","last_undegraded":"2024-09-13T23:28:35.700661+0000","last_fullsized":"2024-09-13T23:28:35.700661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.700569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:06.066777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.634315+0000","last_change":"2024-09-13T23:29:30.634367+0000","last_active":"2024-09-13T23:29:30.634315+0000","last_peered":"2024-09-13T23:29:30.634315+0000","last_clean":"2024-09-13T23:29:30.634315+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:29:30.634315+0000","last_undegraded":"2024-09-13T23:29:30.634315+0000","last_fullsized":"2024-09-13T23:29:30.634315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.634191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:01.458256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.879160+0000","last_change":"2024-09-13T23:29:09.879160+0000","last_active":"2024-09-13T23:29:09.879160+0000","last_peered":"2024-09-13T23:29:09.879160+0000","last_clean":"2024-09-13T23:29:09.879160+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:29:09.879160+0000","last_undegraded":"2024-09-13T23:29:09.879160+0000","last_fullsized":"2024-09-13T23:29:09.879160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.879042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:02.841770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.251484+0000","last_change":"2024-09-13T23:29:27.251517+0000","last_active":"2024-09-13T23:29:27.251484+0000","last_peered":"2024-09-13T23:29:27.251484+0000","last_clean":"2024-09-13T23:29:27.251484+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:29:27.251484+0000","last_undegraded":"2024-09-13T23:29:27.251484+0000","last_fullsized":"2024-09-13T23:29:27.251484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.251359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:01:54.226319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.730040+0000","last_change":"2024-09-13T23:28:52.730040+0000","last_active":"2024-09-13T23:28:52.730040+0000","last_peered":"2024-09-13T23:28:52.730040+0000","last_clean":"2024-09-13T23:28:52.730040+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:28:52.730040+0000","last_undegraded":"2024-09-13T23:28:52.730040+0000","last_fullsized":"2024-09-13T23:28:52.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.729923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:09.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.432492+0000","last_change":"2024-09-13T23:28:34.432533+0000","last_active":"2024-09-13T23:28:34.432492+0000","last_peered":"2024-09-13T23:28:34.432492+0000","last_clean":"2024-09-13T23:28:34.432492+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:34.432492+0000","last_undegraded":"2024-09-13T23:28:34.432492+0000","last_fullsized":"2024-09-13T23:28:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.432394+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:14.169652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.418506+0000","last_change":"2024-09-13T23:28:38.418547+0000","last_active":"2024-09-13T23:28:38.418506+0000","last_peered":"2024-09-13T23:28:38.418506+0000","last_clean":"2024-09-13T23:28:38.418506+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:28:38.418506+0000","last_undegraded":"2024-09-13T23:28:38.418506+0000","last_fullsized":"2024-09-13T23:28:38.418506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.418363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:26.872796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:27:43.332242+0000","last_change":"2024-09-13T23:25:23.314774+0000","last_active":"2024-09-13T23:27:43.332242+0000","last_peered":"2024-09-13T23:27:43.332242+0000","last_clean":"2024-09-13T23:27:43.332242+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:27:43.332242+0000","last_undegraded":"2024-09-13T23:27:43.332242+0000","last_fullsized":"2024-09-13T23:27:43.332242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.399289+0000","last_change":"2024-09-13T23:28:51.399332+0000","last_active":"2024-09-13T23:28:51.399289+0000","last_peered":"2024-09-13T23:28:51.399289+0000","last_clean":"2024-09-13T23:28:51.399289+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:28:51.399289+0000","last_undegraded":"2024-09-13T23:28:51.399289+0000","last_fullsized":"2024-09-13T23:28:51.399289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.399178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:24.391607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.183241+0000","last_change":"2024-09-13T23:29:22.183283+0000","last_active":"2024-09-13T23:29:22.183241+0000","last_peered":"2024-09-13T23:29:22.183241+0000","last_clean":"2024-09-13T23:29:22.183241+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:29:22.183241+0000","last_undegraded":"2024-09-13T23:29:22.183241+0000","last_fullsized":"2024-09-13T23:29:22.183241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.183135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:55.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.671431+0000","last_change":"2024-09-13T23:28:54.671459+0000","last_active":"2024-09-13T23:28:54.671431+0000","last_peered":"2024-09-13T23:28:54.671431+0000","last_clean":"2024-09-13T23:28:54.671431+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:54.671431+0000","last_undegraded":"2024-09-13T23:28:54.671431+0000","last_fullsized":"2024-09-13T23:28:54.671431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.671339+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:38.895472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.872729+0000","last_change":"2024-09-13T23:28:42.872729+0000","last_active":"2024-09-13T23:28:42.872729+0000","last_peered":"2024-09-13T23:28:42.872729+0000","last_clean":"2024-09-13T23:28:42.872729+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:42.872729+0000","last_undegraded":"2024-09-13T23:28:42.872729+0000","last_fullsized":"2024-09-13T23:28:42.872729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.872602+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:27.096735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.838668+0000","last_change":"2024-09-13T23:28:36.838668+0000","last_active":"2024-09-13T23:28:36.838668+0000","last_peered":"2024-09-13T23:28:36.838668+0000","last_clean":"2024-09-13T23:28:36.838668+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:28:36.838668+0000","last_undegraded":"2024-09-13T23:28:36.838668+0000","last_fullsized":"2024-09-13T23:28:36.838668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.838543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:00.388168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.630335+0000","last_change":"2024-09-13T23:25:23.314783+0000","last_active":"2024-09-13T23:28:22.630335+0000","last_peered":"2024-09-13T23:28:22.630335+0000","last_clean":"2024-09-13T23:28:22.630335+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:28:22.630335+0000","last_undegraded":"2024-09-13T23:28:22.630335+0000","last_fullsized":"2024-09-13T23:28:22.630335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.646845+0000","last_change":"2024-09-13T23:29:27.646872+0000","last_active":"2024-09-13T23:29:27.646845+0000","last_peered":"2024-09-13T23:29:27.646845+0000","last_clean":"2024-09-13T23:29:27.646845+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:29:27.646845+0000","last_undegraded":"2024-09-13T23:29:27.646845+0000","last_fullsized":"2024-09-13T23:29:27.646845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.646739+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:10.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:35.188040+0000","last_change":"2024-09-13T23:29:35.188079+0000","last_active":"2024-09-13T23:29:35.188040+0000","last_peered":"2024-09-13T23:29:35.188040+0000","last_clean":"2024-09-13T23:29:35.188040+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:29:35.188040+0000","last_undegraded":"2024-09-13T23:29:35.188040+0000","last_fullsized":"2024-09-13T23:29:35.188040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:35.187934+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:35.187934+0000","last_clean_scrub_stamp":"2024-09-13T23:29:35.187934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:07.166736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.274118+0000","last_change":"2024-09-13T23:28:55.274173+0000","last_active":"2024-09-13T23:28:55.274118+0000","last_peered":"2024-09-13T23:28:55.274118+0000","last_clean":"2024-09-13T23:28:55.274118+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:28:55.274118+0000","last_undegraded":"2024-09-13T23:28:55.274118+0000","last_fullsized":"2024-09-13T23:28:55.274118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.273979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.097633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.392868+0000","last_change":"2024-09-13T23:28:37.392868+0000","last_active":"2024-09-13T23:28:37.392868+0000","last_peered":"2024-09-13T23:28:37.392868+0000","last_clean":"2024-09-13T23:28:37.392868+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:28:37.392868+0000","last_undegraded":"2024-09-13T23:28:37.392868+0000","last_fullsized":"2024-09-13T23:28:37.392868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.392753+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:27.511355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":379,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.736270+0000","last_change":"2024-09-13T23:28:37.736270+0000","last_active":"2024-09-13T23:28:37.736270+0000","last_peered":"2024-09-13T23:28:37.736270+0000","last_clean":"2024-09-13T23:28:37.736270+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:37.736270+0000","last_undegraded":"2024-09-13T23:28:37.736270+0000","last_fullsized":"2024-09-13T23:28:37.736270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.736151+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:12.004146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.286601+0000","last_change":"2024-09-13T23:29:17.286625+0000","last_active":"2024-09-13T23:29:17.286601+0000","last_peered":"2024-09-13T23:29:17.286601+0000","last_clean":"2024-09-13T23:29:17.286601+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:29:17.286601+0000","last_undegraded":"2024-09-13T23:29:17.286601+0000","last_fullsized":"2024-09-13T23:29:17.286601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.286508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:34.136659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.616003+0000","last_change":"2024-09-13T23:28:57.616072+0000","last_active":"2024-09-13T23:28:57.616003+0000","last_peered":"2024-09-13T23:28:57.616003+0000","last_clean":"2024-09-13T23:28:57.616003+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:57.616003+0000","last_undegraded":"2024-09-13T23:28:57.616003+0000","last_fullsized":"2024-09-13T23:28:57.616003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.615887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:32.451308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.162725+0000","last_change":"2024-09-13T23:29:19.162747+0000","last_active":"2024-09-13T23:29:19.162725+0000","last_peered":"2024-09-13T23:29:19.162725+0000","last_clean":"2024-09-13T23:29:19.162725+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:29:19.162725+0000","last_undegraded":"2024-09-13T23:29:19.162725+0000","last_fullsized":"2024-09-13T23:29:19.162725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.162640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.937244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.172867+0000","last_change":"2024-09-13T23:28:52.172891+0000","last_active":"2024-09-13T23:28:52.172867+0000","last_peered":"2024-09-13T23:28:52.172867+0000","last_clean":"2024-09-13T23:28:52.172867+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:28:52.172867+0000","last_undegraded":"2024-09-13T23:28:52.172867+0000","last_fullsized":"2024-09-13T23:28:52.172867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.172781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.571714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.428570+0000","last_change":"2024-09-13T23:28:40.428650+0000","last_active":"2024-09-13T23:28:40.428570+0000","last_peered":"2024-09-13T23:28:40.428570+0000","last_clean":"2024-09-13T23:28:40.428570+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:40.428570+0000","last_undegraded":"2024-09-13T23:28:40.428570+0000","last_fullsized":"2024-09-13T23:28:40.428570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.428479+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:10.066086+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.913346+0000","last_change":"2024-09-13T23:28:41.913370+0000","last_active":"2024-09-13T23:28:41.913346+0000","last_peered":"2024-09-13T23:28:41.913346+0000","last_clean":"2024-09-13T23:28:41.913346+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:28:41.913346+0000","last_undegraded":"2024-09-13T23:28:41.913346+0000","last_fullsized":"2024-09-13T23:28:41.913346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.913252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:38.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.193716+0000","last_change":"2024-09-13T23:28:58.193740+0000","last_active":"2024-09-13T23:28:58.193716+0000","last_peered":"2024-09-13T23:28:58.193716+0000","last_clean":"2024-09-13T23:28:58.193716+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:28:58.193716+0000","last_undegraded":"2024-09-13T23:28:58.193716+0000","last_fullsized":"2024-09-13T23:28:58.193716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.193629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:31.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.569758+0000","last_change":"2024-09-13T23:28:58.569782+0000","last_active":"2024-09-13T23:28:58.569758+0000","last_peered":"2024-09-13T23:28:58.569758+0000","last_clean":"2024-09-13T23:28:58.569758+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:28:58.569758+0000","last_undegraded":"2024-09-13T23:28:58.569758+0000","last_fullsized":"2024-09-13T23:28:58.569758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.569633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:33.401582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.207054+0000","last_change":"2024-09-13T23:29:26.207097+0000","last_active":"2024-09-13T23:29:26.207054+0000","last_peered":"2024-09-13T23:29:26.207054+0000","last_clean":"2024-09-13T23:29:26.207054+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:29:26.207054+0000","last_undegraded":"2024-09-13T23:29:26.207054+0000","last_fullsized":"2024-09-13T23:29:26.207054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.206939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:01.274448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.761946+0000","last_change":"2024-09-13T23:28:48.761973+0000","last_active":"2024-09-13T23:28:48.761946+0000","last_peered":"2024-09-13T23:28:48.761946+0000","last_clean":"2024-09-13T23:28:48.761946+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:28:48.761946+0000","last_undegraded":"2024-09-13T23:28:48.761946+0000","last_fullsized":"2024-09-13T23:28:48.761946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.761854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:33.308523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":91,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.868864+0000","last_change":"2024-09-13T23:28:40.868903+0000","last_active":"2024-09-13T23:28:40.868864+0000","last_peered":"2024-09-13T23:28:40.868864+0000","last_clean":"2024-09-13T23:28:40.868864+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:40.868864+0000","last_undegraded":"2024-09-13T23:28:40.868864+0000","last_fullsized":"2024-09-13T23:28:40.868864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.868753+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:57.312547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.366001+0000","last_change":"2024-09-13T23:28:57.366023+0000","last_active":"2024-09-13T23:28:57.366001+0000","last_peered":"2024-09-13T23:28:57.366001+0000","last_clean":"2024-09-13T23:28:57.366001+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:28:57.366001+0000","last_undegraded":"2024-09-13T23:28:57.366001+0000","last_fullsized":"2024-09-13T23:28:57.366001+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.365894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:37:00.729302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.246819+0000","last_change":"2024-09-13T23:29:25.246850+0000","last_active":"2024-09-13T23:29:25.246819+0000","last_peered":"2024-09-13T23:29:25.246819+0000","last_clean":"2024-09-13T23:29:25.246819+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:29:25.246819+0000","last_undegraded":"2024-09-13T23:29:25.246819+0000","last_fullsized":"2024-09-13T23:29:25.246819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.246730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:35.183768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.639235+0000","last_change":"2024-09-13T23:29:24.639260+0000","last_active":"2024-09-13T23:29:24.639235+0000","last_peered":"2024-09-13T23:29:24.639235+0000","last_clean":"2024-09-13T23:29:24.639235+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:29:24.639235+0000","last_undegraded":"2024-09-13T23:29:24.639235+0000","last_fullsized":"2024-09-13T23:29:24.639235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.639140+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:49.770946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.577686+0000","last_change":"2024-09-13T23:29:25.577713+0000","last_active":"2024-09-13T23:29:25.577686+0000","last_peered":"2024-09-13T23:29:25.577686+0000","last_clean":"2024-09-13T23:29:25.577686+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:29:25.577686+0000","last_undegraded":"2024-09-13T23:29:25.577686+0000","last_fullsized":"2024-09-13T23:29:25.577686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.577568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.172717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.259377+0000","last_change":"2024-09-13T23:28:47.259399+0000","last_active":"2024-09-13T23:28:47.259377+0000","last_peered":"2024-09-13T23:28:47.259377+0000","last_clean":"2024-09-13T23:28:47.259377+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:28:47.259377+0000","last_undegraded":"2024-09-13T23:28:47.259377+0000","last_fullsized":"2024-09-13T23:28:47.259377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.259291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.594250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.407054+0000","last_change":"2024-09-13T23:28:47.407089+0000","last_active":"2024-09-13T23:28:47.407054+0000","last_peered":"2024-09-13T23:28:47.407054+0000","last_clean":"2024-09-13T23:28:47.407054+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:47.407054+0000","last_undegraded":"2024-09-13T23:28:47.407054+0000","last_fullsized":"2024-09-13T23:28:47.407054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.406957+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:12.268807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.367378+0000","last_change":"2024-09-13T23:28:56.367406+0000","last_active":"2024-09-13T23:28:56.367378+0000","last_peered":"2024-09-13T23:28:56.367378+0000","last_clean":"2024-09-13T23:28:56.367378+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:28:56.367378+0000","last_undegraded":"2024-09-13T23:28:56.367378+0000","last_fullsized":"2024-09-13T23:28:56.367378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.367288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:36.192963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:51.995650+0000","last_change":"2024-09-13T23:29:51.995684+0000","last_active":"2024-09-13T23:29:51.995650+0000","last_peered":"2024-09-13T23:29:51.995650+0000","last_clean":"2024-09-13T23:29:51.995650+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:29:51.995650+0000","last_undegraded":"2024-09-13T23:29:51.995650+0000","last_fullsized":"2024-09-13T23:29:51.995650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:51.995552+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:51.995552+0000","last_clean_scrub_stamp":"2024-09-13T23:29:51.995552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:17.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.563381+0000","last_change":"2024-09-13T23:28:59.563436+0000","last_active":"2024-09-13T23:28:59.563381+0000","last_peered":"2024-09-13T23:28:59.563381+0000","last_clean":"2024-09-13T23:28:59.563381+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:59.563381+0000","last_undegraded":"2024-09-13T23:28:59.563381+0000","last_fullsized":"2024-09-13T23:28:59.563381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.563236+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:35.781729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.253112+0000","last_change":"2024-09-13T23:29:25.253137+0000","last_active":"2024-09-13T23:29:25.253112+0000","last_peered":"2024-09-13T23:29:25.253112+0000","last_clean":"2024-09-13T23:29:25.253112+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:29:25.253112+0000","last_undegraded":"2024-09-13T23:29:25.253112+0000","last_fullsized":"2024-09-13T23:29:25.253112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.252974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:32.325506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.345673+0000","last_change":"2024-09-13T23:28:45.345702+0000","last_active":"2024-09-13T23:28:45.345673+0000","last_peered":"2024-09-13T23:28:45.345673+0000","last_clean":"2024-09-13T23:28:45.345673+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:28:45.345673+0000","last_undegraded":"2024-09-13T23:28:45.345673+0000","last_fullsized":"2024-09-13T23:28:45.345673+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.345587+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.147860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.376916+0000","last_change":"2024-09-13T23:28:45.376963+0000","last_active":"2024-09-13T23:28:45.376916+0000","last_peered":"2024-09-13T23:28:45.376916+0000","last_clean":"2024-09-13T23:28:45.376916+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:45.376916+0000","last_undegraded":"2024-09-13T23:28:45.376916+0000","last_fullsized":"2024-09-13T23:28:45.376916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.376807+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:21.519688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.830708+0000","last_change":"2024-09-13T23:28:45.830736+0000","last_active":"2024-09-13T23:28:45.830708+0000","last_peered":"2024-09-13T23:28:45.830708+0000","last_clean":"2024-09-13T23:28:45.830708+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:28:45.830708+0000","last_undegraded":"2024-09-13T23:28:45.830708+0000","last_fullsized":"2024-09-13T23:28:45.830708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.830607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.666028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:22.705711+0000","last_change":"2024-09-13T23:25:23.314225+0000","last_active":"2024-09-13T23:28:22.705711+0000","last_peered":"2024-09-13T23:28:22.705711+0000","last_clean":"2024-09-13T23:28:22.705711+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:28:22.705711+0000","last_undegraded":"2024-09-13T23:28:22.705711+0000","last_fullsized":"2024-09-13T23:28:22.705711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:25:22.288579+0000","last_clean_scrub_stamp":"2024-09-13T23:25:22.288579+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.240948+0000","last_change":"2024-09-13T23:28:56.240948+0000","last_active":"2024-09-13T23:28:56.240948+0000","last_peered":"2024-09-13T23:28:56.240948+0000","last_clean":"2024-09-13T23:28:56.240948+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:56.240948+0000","last_undegraded":"2024-09-13T23:28:56.240948+0000","last_fullsized":"2024-09-13T23:28:56.240948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.240805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:20.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.557352+0000","last_change":"2024-09-13T23:29:16.557352+0000","last_active":"2024-09-13T23:29:16.557352+0000","last_peered":"2024-09-13T23:29:16.557352+0000","last_clean":"2024-09-13T23:29:16.557352+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:29:16.557352+0000","last_undegraded":"2024-09-13T23:29:16.557352+0000","last_fullsized":"2024-09-13T23:29:16.557352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.557180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:10.883638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.844145+0000","last_change":"2024-09-13T23:29:02.844145+0000","last_active":"2024-09-13T23:29:02.844145+0000","last_peered":"2024-09-13T23:29:02.844145+0000","last_clean":"2024-09-13T23:29:02.844145+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:29:02.844145+0000","last_undegraded":"2024-09-13T23:29:02.844145+0000","last_fullsized":"2024-09-13T23:29:02.844145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.844013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:02.339878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.834175+0000","last_change":"2024-09-13T23:29:10.834175+0000","last_active":"2024-09-13T23:29:10.834175+0000","last_peered":"2024-09-13T23:29:10.834175+0000","last_clean":"2024-09-13T23:29:10.834175+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:29:10.834175+0000","last_undegraded":"2024-09-13T23:29:10.834175+0000","last_fullsized":"2024-09-13T23:29:10.834175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.834057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:43.901277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.358637+0000","last_change":"2024-09-13T23:29:12.358637+0000","last_active":"2024-09-13T23:29:12.358637+0000","last_peered":"2024-09-13T23:29:12.358637+0000","last_clean":"2024-09-13T23:29:12.358637+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:29:12.358637+0000","last_undegraded":"2024-09-13T23:29:12.358637+0000","last_fullsized":"2024-09-13T23:29:12.358637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.358491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:40.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:38.225824+0000","last_change":"2024-09-13T23:29:38.225848+0000","last_active":"2024-09-13T23:29:38.225824+0000","last_peered":"2024-09-13T23:29:38.225824+0000","last_clean":"2024-09-13T23:29:38.225824+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:29:38.225824+0000","last_undegraded":"2024-09-13T23:29:38.225824+0000","last_fullsized":"2024-09-13T23:29:38.225824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:38.225704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:38.225704+0000","last_clean_scrub_stamp":"2024-09-13T23:29:38.225704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:30.774800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.704641+0000","last_change":"2024-09-13T23:29:17.704641+0000","last_active":"2024-09-13T23:29:17.704641+0000","last_peered":"2024-09-13T23:29:17.704641+0000","last_clean":"2024-09-13T23:29:17.704641+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:29:17.704641+0000","last_undegraded":"2024-09-13T23:29:17.704641+0000","last_fullsized":"2024-09-13T23:29:17.704641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.704520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:44.012264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.611316+0000","last_change":"2024-09-13T23:29:26.611343+0000","last_active":"2024-09-13T23:29:26.611316+0000","last_peered":"2024-09-13T23:29:26.611316+0000","last_clean":"2024-09-13T23:29:26.611316+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:29:26.611316+0000","last_undegraded":"2024-09-13T23:29:26.611316+0000","last_fullsized":"2024-09-13T23:29:26.611316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.611220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:02.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.891498+0000","last_change":"2024-09-13T23:29:03.891498+0000","last_active":"2024-09-13T23:29:03.891498+0000","last_peered":"2024-09-13T23:29:03.891498+0000","last_clean":"2024-09-13T23:29:03.891498+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:29:03.891498+0000","last_undegraded":"2024-09-13T23:29:03.891498+0000","last_fullsized":"2024-09-13T23:29:03.891498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.891377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:38.332864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.552331+0000","last_change":"2024-09-13T23:29:23.552331+0000","last_active":"2024-09-13T23:29:23.552331+0000","last_peered":"2024-09-13T23:29:23.552331+0000","last_clean":"2024-09-13T23:29:23.552331+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:29:23.552331+0000","last_undegraded":"2024-09-13T23:29:23.552331+0000","last_fullsized":"2024-09-13T23:29:23.552331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.552205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:53.424634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.276456+0000","last_change":"2024-09-13T23:29:34.276484+0000","last_active":"2024-09-13T23:29:34.276456+0000","last_peered":"2024-09-13T23:29:34.276456+0000","last_clean":"2024-09-13T23:29:34.276456+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:29:34.276456+0000","last_undegraded":"2024-09-13T23:29:34.276456+0000","last_fullsized":"2024-09-13T23:29:34.276456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:34.276320+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:34.276320+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.276320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:10.287050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.105327+0000","last_change":"2024-09-13T23:29:17.105327+0000","last_active":"2024-09-13T23:29:17.105327+0000","last_peered":"2024-09-13T23:29:17.105327+0000","last_clean":"2024-09-13T23:29:17.105327+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:29:17.105327+0000","last_undegraded":"2024-09-13T23:29:17.105327+0000","last_fullsized":"2024-09-13T23:29:17.105327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.105202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:24.212381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.880712+0000","last_change":"2024-09-13T23:28:58.880712+0000","last_active":"2024-09-13T23:28:58.880712+0000","last_peered":"2024-09-13T23:28:58.880712+0000","last_clean":"2024-09-13T23:28:58.880712+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:58.880712+0000","last_undegraded":"2024-09-13T23:28:58.880712+0000","last_fullsized":"2024-09-13T23:28:58.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.880594+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:50.677464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.632996+0000","last_change":"2024-09-13T23:29:25.632996+0000","last_active":"2024-09-13T23:29:25.632996+0000","last_peered":"2024-09-13T23:29:25.632996+0000","last_clean":"2024-09-13T23:29:25.632996+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:29:25.632996+0000","last_undegraded":"2024-09-13T23:29:25.632996+0000","last_fullsized":"2024-09-13T23:29:25.632996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.632887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:23.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.102517+0000","last_change":"2024-09-13T23:29:10.102517+0000","last_active":"2024-09-13T23:29:10.102517+0000","last_peered":"2024-09-13T23:29:10.102517+0000","last_clean":"2024-09-13T23:29:10.102517+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:29:10.102517+0000","last_undegraded":"2024-09-13T23:29:10.102517+0000","last_fullsized":"2024-09-13T23:29:10.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.102348+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:25:08.910893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.847610+0000","last_change":"2024-09-13T23:29:12.847610+0000","last_active":"2024-09-13T23:29:12.847610+0000","last_peered":"2024-09-13T23:29:12.847610+0000","last_clean":"2024-09-13T23:29:12.847610+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:29:12.847610+0000","last_undegraded":"2024-09-13T23:29:12.847610+0000","last_fullsized":"2024-09-13T23:29:12.847610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.847494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:56.893797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.067437+0000","last_change":"2024-09-13T23:29:16.067463+0000","last_active":"2024-09-13T23:29:16.067437+0000","last_peered":"2024-09-13T23:29:16.067437+0000","last_clean":"2024-09-13T23:29:16.067437+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:29:16.067437+0000","last_undegraded":"2024-09-13T23:29:16.067437+0000","last_fullsized":"2024-09-13T23:29:16.067437+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.067342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:01.072491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:48.097382+0000","last_change":"2024-09-13T23:29:48.097409+0000","last_active":"2024-09-13T23:29:48.097382+0000","last_peered":"2024-09-13T23:29:48.097382+0000","last_clean":"2024-09-13T23:29:48.097382+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:29:48.097382+0000","last_undegraded":"2024-09-13T23:29:48.097382+0000","last_fullsized":"2024-09-13T23:29:48.097382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:48.097284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:48.097284+0000","last_clean_scrub_stamp":"2024-09-13T23:29:48.097284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:09:25.107228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.398875+0000","last_change":"2024-09-13T23:29:10.398912+0000","last_active":"2024-09-13T23:29:10.398875+0000","last_peered":"2024-09-13T23:29:10.398875+0000","last_clean":"2024-09-13T23:29:10.398875+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:29:10.398875+0000","last_undegraded":"2024-09-13T23:29:10.398875+0000","last_fullsized":"2024-09-13T23:29:10.398875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.398784+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.393158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.596036+0000","last_change":"2024-09-13T23:29:21.596036+0000","last_active":"2024-09-13T23:29:21.596036+0000","last_peered":"2024-09-13T23:29:21.596036+0000","last_clean":"2024-09-13T23:29:21.596036+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:29:21.596036+0000","last_undegraded":"2024-09-13T23:29:21.596036+0000","last_fullsized":"2024-09-13T23:29:21.596036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.595907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:26.153996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.895957+0000","last_change":"2024-09-13T23:29:05.895957+0000","last_active":"2024-09-13T23:29:05.895957+0000","last_peered":"2024-09-13T23:29:05.895957+0000","last_clean":"2024-09-13T23:29:05.895957+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:29:05.895957+0000","last_undegraded":"2024-09-13T23:29:05.895957+0000","last_fullsized":"2024-09-13T23:29:05.895957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.895771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.311567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.223521+0000","last_change":"2024-09-13T23:29:26.223521+0000","last_active":"2024-09-13T23:29:26.223521+0000","last_peered":"2024-09-13T23:29:26.223521+0000","last_clean":"2024-09-13T23:29:26.223521+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:29:26.223521+0000","last_undegraded":"2024-09-13T23:29:26.223521+0000","last_fullsized":"2024-09-13T23:29:26.223521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.223409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:56.095839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.241797+0000","last_change":"2024-09-13T23:29:04.241797+0000","last_active":"2024-09-13T23:29:04.241797+0000","last_peered":"2024-09-13T23:29:04.241797+0000","last_clean":"2024-09-13T23:29:04.241797+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:29:04.241797+0000","last_undegraded":"2024-09-13T23:29:04.241797+0000","last_fullsized":"2024-09-13T23:29:04.241797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.241674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.223443+0000","last_change":"2024-09-13T23:29:23.223443+0000","last_active":"2024-09-13T23:29:23.223443+0000","last_peered":"2024-09-13T23:29:23.223443+0000","last_clean":"2024-09-13T23:29:23.223443+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:29:23.223443+0000","last_undegraded":"2024-09-13T23:29:23.223443+0000","last_fullsized":"2024-09-13T23:29:23.223443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.223288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:55.814375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.175652+0000","last_change":"2024-09-13T23:28:59.175652+0000","last_active":"2024-09-13T23:28:59.175652+0000","last_peered":"2024-09-13T23:28:59.175652+0000","last_clean":"2024-09-13T23:28:59.175652+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:28:59.175652+0000","last_undegraded":"2024-09-13T23:28:59.175652+0000","last_fullsized":"2024-09-13T23:28:59.175652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.175522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:16.558152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.153588+0000","last_change":"2024-09-13T23:29:29.153588+0000","last_active":"2024-09-13T23:29:29.153588+0000","last_peered":"2024-09-13T23:29:29.153588+0000","last_clean":"2024-09-13T23:29:29.153588+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:29:29.153588+0000","last_undegraded":"2024-09-13T23:29:29.153588+0000","last_fullsized":"2024-09-13T23:29:29.153588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.153466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:20.138130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.071500+0000","last_change":"2024-09-13T23:29:12.071500+0000","last_active":"2024-09-13T23:29:12.071500+0000","last_peered":"2024-09-13T23:29:12.071500+0000","last_clean":"2024-09-13T23:29:12.071500+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:29:12.071500+0000","last_undegraded":"2024-09-13T23:29:12.071500+0000","last_fullsized":"2024-09-13T23:29:12.071500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.071386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:05.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.225489+0000","last_change":"2024-09-13T23:29:32.225489+0000","last_active":"2024-09-13T23:29:32.225489+0000","last_peered":"2024-09-13T23:29:32.225489+0000","last_clean":"2024-09-13T23:29:32.225489+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:29:32.225489+0000","last_undegraded":"2024-09-13T23:29:32.225489+0000","last_fullsized":"2024-09-13T23:29:32.225489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.225283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:38.368651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.360863+0000","last_change":"2024-09-13T23:29:07.360863+0000","last_active":"2024-09-13T23:29:07.360863+0000","last_peered":"2024-09-13T23:29:07.360863+0000","last_clean":"2024-09-13T23:29:07.360863+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:29:07.360863+0000","last_undegraded":"2024-09-13T23:29:07.360863+0000","last_fullsized":"2024-09-13T23:29:07.360863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.360714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:38.924264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.579817+0000","last_change":"2024-09-13T23:29:08.579817+0000","last_active":"2024-09-13T23:29:08.579817+0000","last_peered":"2024-09-13T23:29:08.579817+0000","last_clean":"2024-09-13T23:29:08.579817+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:29:08.579817+0000","last_undegraded":"2024-09-13T23:29:08.579817+0000","last_fullsized":"2024-09-13T23:29:08.579817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.579696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:25.962325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'22","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.013647+0000","last_change":"2024-09-13T23:29:14.013647+0000","last_active":"2024-09-13T23:29:14.013647+0000","last_peered":"2024-09-13T23:29:14.013647+0000","last_clean":"2024-09-13T23:29:14.013647+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:29:14.013647+0000","last_undegraded":"2024-09-13T23:29:14.013647+0000","last_fullsized":"2024-09-13T23:29:14.013647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.013525+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:39.145331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.251384+0000","last_change":"2024-09-13T23:29:23.251384+0000","last_active":"2024-09-13T23:29:23.251384+0000","last_peered":"2024-09-13T23:29:23.251384+0000","last_clean":"2024-09-13T23:29:23.251384+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:29:23.251384+0000","last_undegraded":"2024-09-13T23:29:23.251384+0000","last_fullsized":"2024-09-13T23:29:23.251384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.251266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:20.867611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:51.034663+0000","last_change":"2024-09-13T23:29:51.034663+0000","last_active":"2024-09-13T23:29:51.034663+0000","last_peered":"2024-09-13T23:29:51.034663+0000","last_clean":"2024-09-13T23:29:51.034663+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:29:51.034663+0000","last_undegraded":"2024-09-13T23:29:51.034663+0000","last_fullsized":"2024-09-13T23:29:51.034663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:51.034549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:51.034549+0000","last_clean_scrub_stamp":"2024-09-13T23:29:51.034549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:34.583805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.722961+0000","last_change":"2024-09-13T23:29:15.722993+0000","last_active":"2024-09-13T23:29:15.722961+0000","last_peered":"2024-09-13T23:29:15.722961+0000","last_clean":"2024-09-13T23:29:15.722961+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:29:15.722961+0000","last_undegraded":"2024-09-13T23:29:15.722961+0000","last_fullsized":"2024-09-13T23:29:15.722961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.722865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:22.325909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.694251+0000","last_change":"2024-09-13T23:29:18.694276+0000","last_active":"2024-09-13T23:29:18.694251+0000","last_peered":"2024-09-13T23:29:18.694251+0000","last_clean":"2024-09-13T23:29:18.694251+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:29:18.694251+0000","last_undegraded":"2024-09-13T23:29:18.694251+0000","last_fullsized":"2024-09-13T23:29:18.694251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.694159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:03.264071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.185869+0000","last_change":"2024-09-13T23:29:00.185902+0000","last_active":"2024-09-13T23:29:00.185869+0000","last_peered":"2024-09-13T23:29:00.185869+0000","last_clean":"2024-09-13T23:29:00.185869+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:29:00.185869+0000","last_undegraded":"2024-09-13T23:29:00.185869+0000","last_fullsized":"2024-09-13T23:29:00.185869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.185781+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:40.557990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673022,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673024,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673023,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:29:55.619 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:55.620 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T23:25:16.268357+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=16, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:55.620 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:55.620 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:55.621 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T23:25:22.288579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=25, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=23, tm_min=28, tm_sec=31, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T23:29:55.621 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T23:30:15.622 DEBUG:teuthology.orchestra.run.smithi043:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T23:30:15.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.736+0000 7f6b079b0640 1 Processor -- start 2024-09-13T23:30:15.738 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.736+0000 7f6b079b0640 1 -- start start 2024-09-13T23:30:15.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b079b0640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6b0009a100 0x7f6b00133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:15.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b079b0640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0009d3b0 con 0x7f6b0009bd50 2024-09-13T23:30:15.739 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b079b0640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0009c840 con 0x7f6b0009a100 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b04f4b640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f6b0009a100 0x7f6b00133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b0574c640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f6b0009bd50 0x7f6b0009c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53656/0 (socket says 172.21.15.43:53656) 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b0574c640 1 -- 172.21.15.43:0/2775287550 learned_addr learned my addr 172.21.15.43:0/2775287550 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b04f4b640 1 -- 172.21.15.43:0/2775287550 >> v1:172.21.15.43:6789/0 conn(0x7f6b0009bd50 legacy=0x7f6b0009c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6b04f4b640 1 -- 172.21.15.43:0/2775287550 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b00098230 con 0x7f6b0009a100 2024-09-13T23:30:15.740 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.737+0000 7f6af7fff640 1 -- 172.21.15.43:0/2775287550 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595022831 0 0) 0x7f6afc001110 con 0x7f6b0009bd50 2024-09-13T23:30:15.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6b04f4b640 1 --2- 172.21.15.43:0/2775287550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00133da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009720 tx=0x7f6af002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8d961048bc4db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:15.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6af7fff640 1 -- 172.21.15.43:0/2775287550 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6af0037070 con 0x7f6b0009a100 2024-09-13T23:30:15.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6af7fff640 1 -- 172.21.15.43:0/2775287550 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af002ad90 con 0x7f6b0009a100 2024-09-13T23:30:15.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6af7fff640 1 -- 172.21.15.43:0/2775287550 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6af0032590 con 0x7f6b0009a100 2024-09-13T23:30:15.742 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6b079b0640 1 -- 172.21.15.43:0/2775287550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 msgr2=0x7f6b00133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6b079b0640 1 --2- 172.21.15.43:0/2775287550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00133da0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6af0009720 tx=0x7f6af002a110 comp rx=0 tx=0).stop 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6b079b0640 1 -- 172.21.15.43:0/2775287550 shutdown_connections 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.738+0000 7f6b079b0640 1 --2- 172.21.15.43:0/2775287550 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00133da0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.739+0000 7f6b079b0640 1 -- 172.21.15.43:0/2775287550 >> 172.21.15.43:0/2775287550 conn(0x7f6b0006d4a0 msgr2=0x7f6b0006d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.739+0000 7f6b079b0640 1 -- 172.21.15.43:0/2775287550 shutdown_connections 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.739+0000 7f6b079b0640 1 -- 172.21.15.43:0/2775287550 wait complete. 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.739+0000 7f6b079b0640 1 Processor -- start 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.739+0000 7f6b079b0640 1 -- start start 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b079b0640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b079b0640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f6b00134670 con 0x7f6b0009a100 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b0574c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:15.743 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b0574c640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50112/0 (socket says 172.21.15.43:50112) 2024-09-13T23:30:15.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b0574c640 1 -- 172.21.15.43:0/3963312426 learned_addr learned my addr 172.21.15.43:0/3963312426 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:30:15.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b0574c640 1 -- 172.21.15.43:0/3963312426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b00125fc0 con 0x7f6b0009a100 2024-09-13T23:30:15.744 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.740+0000 7f6b0574c640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c700 tx=0x7f6afc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:15.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.741+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc018070 con 0x7f6b0009a100 2024-09-13T23:30:15.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.741+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc0070d0 con 0x7f6b0009a100 2024-09-13T23:30:15.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.741+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b00096570 con 0x7f6b0009a100 2024-09-13T23:30:15.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.741+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6afc0073f0 con 0x7f6b0009a100 2024-09-13T23:30:15.745 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.741+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b00096f80 con 0x7f6b0009a100 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.742+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f6afc01b070 con 0x7f6b0009a100 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.742+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b00126360 con 0x7f6b0009a100 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.742+0000 7f6af5ffb640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 0x7f6ae403a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.742+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f6afc04af70 con 0x7f6b0009a100 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.742+0000 7f6b04f4b640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 0x7f6ae403a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:15.746 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.743+0000 7f6b04f4b640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 0x7f6ae403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6af0034000 tx=0x7f6af002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:15.749 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.747+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b00125fc0 con 0x7f6b0009a100 2024-09-13T23:30:15.919 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.917+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 --> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b0009d020 con 0x7f6ae40382a0 2024-09-13T23:30:15.934 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.932+0000 7f6af5ffb640 1 -- 172.21.15.43:0/3963312426 <== mgr.4098 v2:172.21.15.99:6824/1176945367 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665931 (secure 0 0 0) 0x7f6b0009d020 con 0x7f6ae40382a0 2024-09-13T23:30:15.941 INFO:teuthology.orchestra.run.smithi043.stdout: 2024-09-13T23:30:15.947 INFO:teuthology.orchestra.run.smithi043.stderr:dumped all 2024-09-13T23:30:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 msgr2=0x7f6ae403a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:15.949 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 0x7f6ae403a760 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6af0034000 tx=0x7f6af002e000 comp rx=0 tx=0).stop 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 msgr2=0x7f6b00132a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c700 tx=0x7f6afc00cbc0 comp rx=0 tx=0).stop 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 shutdown_connections 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f6ae40382a0 0x7f6ae403a760 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 --2- 172.21.15.43:0/3963312426 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f6b0009a100 0x7f6b00132a40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.936+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 >> 172.21.15.43:0/3963312426 conn(0x7f6b0006d4a0 msgr2=0x7f6b0008d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.937+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 shutdown_connections 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:15.937+0000 7f6b079b0640 1 -- 172.21.15.43:0/3963312426 wait complete. 2024-09-13T23:30:15.950 INFO:teuthology.orchestra.run.smithi043.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2024-09-13T23:30:15.389785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5077,"num_read_kb":4662,"num_write":2179,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4792,"ondisk_log_size":4792,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144224,"kb_used_data":2848,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343136,"statfs":{"total":386547056640,"available":386399371264,"internally_reserved":0,"allocated":2916352,"data_stored":1737440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004191"},"pg_stats":[{"pgid":"3.3f","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.528904+0000","last_change":"2024-09-13T23:29:04.528904+0000","last_active":"2024-09-13T23:29:04.528904+0000","last_peered":"2024-09-13T23:29:04.528904+0000","last_clean":"2024-09-13T23:29:04.528904+0000","last_became_active":"2024-09-13T23:25:13.286808+0000","last_became_peered":"2024-09-13T23:25:13.286808+0000","last_unstale":"2024-09-13T23:29:04.528904+0000","last_undegraded":"2024-09-13T23:29:04.528904+0000","last_fullsized":"2024-09-13T23:29:04.528904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:04.528789+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.528789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:50.352443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":22,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"33'2","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.226954+0000","last_change":"2024-09-13T23:29:28.227005+0000","last_active":"2024-09-13T23:29:28.226954+0000","last_peered":"2024-09-13T23:29:28.226954+0000","last_clean":"2024-09-13T23:29:28.226954+0000","last_became_active":"2024-09-13T23:25:15.292533+0000","last_became_peered":"2024-09-13T23:25:15.292533+0000","last_unstale":"2024-09-13T23:29:28.226954+0000","last_undegraded":"2024-09-13T23:29:28.226954+0000","last_fullsized":"2024-09-13T23:29:28.226954+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.226821+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.226821+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:46:06.285889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.590162+0000","last_change":"2024-09-13T23:29:24.590162+0000","last_active":"2024-09-13T23:29:24.590162+0000","last_peered":"2024-09-13T23:29:24.590162+0000","last_clean":"2024-09-13T23:29:24.590162+0000","last_became_active":"2024-09-13T23:25:13.279361+0000","last_became_peered":"2024-09-13T23:25:13.279361+0000","last_unstale":"2024-09-13T23:29:24.590162+0000","last_undegraded":"2024-09-13T23:29:24.590162+0000","last_fullsized":"2024-09-13T23:29:24.590162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:24.590043+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.590043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:05.937596+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.402553+0000","last_change":"2024-09-13T23:29:11.402579+0000","last_active":"2024-09-13T23:29:11.402553+0000","last_peered":"2024-09-13T23:29:11.402553+0000","last_clean":"2024-09-13T23:29:11.402553+0000","last_became_active":"2024-09-13T23:25:15.283256+0000","last_became_peered":"2024-09-13T23:25:15.283256+0000","last_unstale":"2024-09-13T23:29:11.402553+0000","last_undegraded":"2024-09-13T23:29:11.402553+0000","last_fullsized":"2024-09-13T23:29:11.402553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:11.402459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.402459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:44.051975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.291238+0000","last_change":"2024-09-13T23:29:24.291261+0000","last_active":"2024-09-13T23:29:24.291238+0000","last_peered":"2024-09-13T23:29:24.291238+0000","last_clean":"2024-09-13T23:29:24.291238+0000","last_became_active":"2024-09-13T23:25:13.291369+0000","last_became_peered":"2024-09-13T23:25:13.291369+0000","last_unstale":"2024-09-13T23:29:24.291238+0000","last_undegraded":"2024-09-13T23:29:24.291238+0000","last_fullsized":"2024-09-13T23:29:24.291238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:24.291152+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.291152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:02:45.809762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"33'4","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.294481+0000","last_change":"2024-09-13T23:29:14.294522+0000","last_active":"2024-09-13T23:29:14.294481+0000","last_peered":"2024-09-13T23:29:14.294481+0000","last_clean":"2024-09-13T23:29:14.294481+0000","last_became_active":"2024-09-13T23:25:15.282432+0000","last_became_peered":"2024-09-13T23:25:15.282432+0000","last_unstale":"2024-09-13T23:29:14.294481+0000","last_undegraded":"2024-09-13T23:29:14.294481+0000","last_fullsized":"2024-09-13T23:29:14.294481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:14.294392+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.294392+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:41:06.956364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.588641+0000","last_change":"2024-09-13T23:29:12.588641+0000","last_active":"2024-09-13T23:29:12.588641+0000","last_peered":"2024-09-13T23:29:12.588641+0000","last_clean":"2024-09-13T23:29:12.588641+0000","last_became_active":"2024-09-13T23:25:13.274741+0000","last_became_peered":"2024-09-13T23:25:13.274741+0000","last_unstale":"2024-09-13T23:29:12.588641+0000","last_undegraded":"2024-09-13T23:29:12.588641+0000","last_fullsized":"2024-09-13T23:29:12.588641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.588515+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.588515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:05.973454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"33'6","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.254160+0000","last_change":"2024-09-13T23:29:22.254201+0000","last_active":"2024-09-13T23:29:22.254160+0000","last_peered":"2024-09-13T23:29:22.254160+0000","last_clean":"2024-09-13T23:29:22.254160+0000","last_became_active":"2024-09-13T23:25:15.277287+0000","last_became_peered":"2024-09-13T23:25:15.277287+0000","last_unstale":"2024-09-13T23:29:22.254160+0000","last_undegraded":"2024-09-13T23:29:22.254160+0000","last_fullsized":"2024-09-13T23:29:22.254160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:22.254042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.254042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:04.901135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.179333+0000","last_change":"2024-09-13T23:29:31.179333+0000","last_active":"2024-09-13T23:29:31.179333+0000","last_peered":"2024-09-13T23:29:31.179333+0000","last_clean":"2024-09-13T23:29:31.179333+0000","last_became_active":"2024-09-13T23:25:13.282693+0000","last_became_peered":"2024-09-13T23:25:13.282693+0000","last_unstale":"2024-09-13T23:29:31.179333+0000","last_undegraded":"2024-09-13T23:29:31.179333+0000","last_fullsized":"2024-09-13T23:29:31.179333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:31.179217+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.179217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:35.444208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"33'4","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.235215+0000","last_change":"2024-09-13T23:29:06.235215+0000","last_active":"2024-09-13T23:29:06.235215+0000","last_peered":"2024-09-13T23:29:06.235215+0000","last_clean":"2024-09-13T23:29:06.235215+0000","last_became_active":"2024-09-13T23:25:15.285307+0000","last_became_peered":"2024-09-13T23:25:15.285307+0000","last_unstale":"2024-09-13T23:29:06.235215+0000","last_undegraded":"2024-09-13T23:29:06.235215+0000","last_fullsized":"2024-09-13T23:29:06.235215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:06.235100+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.235100+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:34.242160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.619615+0000","last_change":"2024-09-13T23:29:13.619615+0000","last_active":"2024-09-13T23:29:13.619615+0000","last_peered":"2024-09-13T23:29:13.619615+0000","last_clean":"2024-09-13T23:29:13.619615+0000","last_became_active":"2024-09-13T23:25:13.274691+0000","last_became_peered":"2024-09-13T23:25:13.274691+0000","last_unstale":"2024-09-13T23:29:13.619615+0000","last_undegraded":"2024-09-13T23:29:13.619615+0000","last_fullsized":"2024-09-13T23:29:13.619615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.619476+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.619476+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:22.716408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.353102+0000","last_change":"2024-09-13T23:28:54.353102+0000","last_active":"2024-09-13T23:28:54.353102+0000","last_peered":"2024-09-13T23:28:54.353102+0000","last_clean":"2024-09-13T23:28:54.353102+0000","last_became_active":"2024-09-13T23:25:15.289106+0000","last_became_peered":"2024-09-13T23:25:15.289106+0000","last_unstale":"2024-09-13T23:28:54.353102+0000","last_undegraded":"2024-09-13T23:28:54.353102+0000","last_fullsized":"2024-09-13T23:28:54.353102+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:54.352965+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.352965+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:28.479961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:49.079126+0000","last_change":"2024-09-13T23:29:49.079126+0000","last_active":"2024-09-13T23:29:49.079126+0000","last_peered":"2024-09-13T23:29:49.079126+0000","last_clean":"2024-09-13T23:29:49.079126+0000","last_became_active":"2024-09-13T23:25:13.278685+0000","last_became_peered":"2024-09-13T23:25:13.278685+0000","last_unstale":"2024-09-13T23:29:49.079126+0000","last_undegraded":"2024-09-13T23:29:49.079126+0000","last_fullsized":"2024-09-13T23:29:49.079126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:49.078989+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:49.078989+0000","last_clean_scrub_stamp":"2024-09-13T23:29:49.078989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:51.068576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"33'2","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.509539+0000","last_change":"2024-09-13T23:29:03.509539+0000","last_active":"2024-09-13T23:29:03.509539+0000","last_peered":"2024-09-13T23:29:03.509539+0000","last_clean":"2024-09-13T23:29:03.509539+0000","last_became_active":"2024-09-13T23:25:15.287726+0000","last_became_peered":"2024-09-13T23:25:15.287726+0000","last_unstale":"2024-09-13T23:29:03.509539+0000","last_undegraded":"2024-09-13T23:29:03.509539+0000","last_fullsized":"2024-09-13T23:29:03.509539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:03.509398+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.509398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:01:45.386333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.928159+0000","last_change":"2024-09-13T23:29:06.928236+0000","last_active":"2024-09-13T23:29:06.928159+0000","last_peered":"2024-09-13T23:29:06.928159+0000","last_clean":"2024-09-13T23:29:06.928159+0000","last_became_active":"2024-09-13T23:25:13.285024+0000","last_became_peered":"2024-09-13T23:25:13.285024+0000","last_unstale":"2024-09-13T23:29:06.928159+0000","last_undegraded":"2024-09-13T23:29:06.928159+0000","last_fullsized":"2024-09-13T23:29:06.928159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:06.928056+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.928056+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.581026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"33'10","reported_seq":79,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.519547+0000","last_change":"2024-09-13T23:29:19.519547+0000","last_active":"2024-09-13T23:29:19.519547+0000","last_peered":"2024-09-13T23:29:19.519547+0000","last_clean":"2024-09-13T23:29:19.519547+0000","last_became_active":"2024-09-13T23:25:15.291156+0000","last_became_peered":"2024-09-13T23:25:15.291156+0000","last_unstale":"2024-09-13T23:29:19.519547+0000","last_undegraded":"2024-09-13T23:29:19.519547+0000","last_fullsized":"2024-09-13T23:29:19.519547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:19.519430+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.519430+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:37:02.172401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"33'20","reported_seq":87,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.396667+0000","last_change":"2024-09-13T23:29:08.396667+0000","last_active":"2024-09-13T23:29:08.396667+0000","last_peered":"2024-09-13T23:29:08.396667+0000","last_clean":"2024-09-13T23:29:08.396667+0000","last_became_active":"2024-09-13T23:25:15.285867+0000","last_became_peered":"2024-09-13T23:25:15.285867+0000","last_unstale":"2024-09-13T23:29:08.396667+0000","last_undegraded":"2024-09-13T23:29:08.396667+0000","last_fullsized":"2024-09-13T23:29:08.396667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:29:08.396493+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.396493+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:17.076369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":66,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.051540+0000","last_change":"2024-09-13T23:29:15.051540+0000","last_active":"2024-09-13T23:29:15.051540+0000","last_peered":"2024-09-13T23:29:15.051540+0000","last_clean":"2024-09-13T23:29:15.051540+0000","last_became_active":"2024-09-13T23:25:13.286801+0000","last_became_peered":"2024-09-13T23:25:13.286801+0000","last_unstale":"2024-09-13T23:29:15.051540+0000","last_undegraded":"2024-09-13T23:29:15.051540+0000","last_fullsized":"2024-09-13T23:29:15.051540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.051419+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.051419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:59.097722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"33'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.166839+0000","last_change":"2024-09-13T23:29:08.166839+0000","last_active":"2024-09-13T23:29:08.166839+0000","last_peered":"2024-09-13T23:29:08.166839+0000","last_clean":"2024-09-13T23:29:08.166839+0000","last_became_active":"2024-09-13T23:25:15.287233+0000","last_became_peered":"2024-09-13T23:25:15.287233+0000","last_unstale":"2024-09-13T23:29:08.166839+0000","last_undegraded":"2024-09-13T23:29:08.166839+0000","last_fullsized":"2024-09-13T23:29:08.166839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.166727+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.166727+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:24.485148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.595179+0000","last_change":"2024-09-13T23:29:06.595179+0000","last_active":"2024-09-13T23:29:06.595179+0000","last_peered":"2024-09-13T23:29:06.595179+0000","last_clean":"2024-09-13T23:29:06.595179+0000","last_became_active":"2024-09-13T23:25:13.285871+0000","last_became_peered":"2024-09-13T23:25:13.285871+0000","last_unstale":"2024-09-13T23:29:06.595179+0000","last_undegraded":"2024-09-13T23:29:06.595179+0000","last_fullsized":"2024-09-13T23:29:06.595179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:06.595032+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.595032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"33'14","reported_seq":74,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.144341+0000","last_change":"2024-09-13T23:29:09.144341+0000","last_active":"2024-09-13T23:29:09.144341+0000","last_peered":"2024-09-13T23:29:09.144341+0000","last_clean":"2024-09-13T23:29:09.144341+0000","last_became_active":"2024-09-13T23:25:15.284022+0000","last_became_peered":"2024-09-13T23:25:15.284022+0000","last_unstale":"2024-09-13T23:29:09.144341+0000","last_undegraded":"2024-09-13T23:29:09.144341+0000","last_fullsized":"2024-09-13T23:29:09.144341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:09.144187+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.144187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:54:48.538850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"33'4","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:35.244424+0000","last_change":"2024-09-13T23:29:35.244424+0000","last_active":"2024-09-13T23:29:35.244424+0000","last_peered":"2024-09-13T23:29:35.244424+0000","last_clean":"2024-09-13T23:29:35.244424+0000","last_became_active":"2024-09-13T23:25:52.381922+0000","last_became_peered":"2024-09-13T23:25:52.381922+0000","last_unstale":"2024-09-13T23:29:35.244424+0000","last_undegraded":"2024-09-13T23:29:35.244424+0000","last_fullsized":"2024-09-13T23:29:35.244424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:35.244272+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:35.244272+0000","last_clean_scrub_stamp":"2024-09-13T23:29:35.244272+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:45.037545+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.890225+0000","last_change":"2024-09-13T23:29:07.890225+0000","last_active":"2024-09-13T23:29:07.890225+0000","last_peered":"2024-09-13T23:29:07.890225+0000","last_clean":"2024-09-13T23:29:07.890225+0000","last_became_active":"2024-09-13T23:25:15.278590+0000","last_became_peered":"2024-09-13T23:25:15.278590+0000","last_unstale":"2024-09-13T23:29:07.890225+0000","last_undegraded":"2024-09-13T23:29:07.890225+0000","last_fullsized":"2024-09-13T23:29:07.890225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:07.890094+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.890094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:26.804774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.208916+0000","last_change":"2024-09-13T23:29:21.208916+0000","last_active":"2024-09-13T23:29:21.208916+0000","last_peered":"2024-09-13T23:29:21.208916+0000","last_clean":"2024-09-13T23:29:21.208916+0000","last_became_active":"2024-09-13T23:25:13.276188+0000","last_became_peered":"2024-09-13T23:25:13.276188+0000","last_unstale":"2024-09-13T23:29:21.208916+0000","last_undegraded":"2024-09-13T23:29:21.208916+0000","last_fullsized":"2024-09-13T23:29:21.208916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:21.208791+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.208791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:30:18.571722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.639079+0000","last_change":"2024-09-13T23:28:56.639079+0000","last_active":"2024-09-13T23:28:56.639079+0000","last_peered":"2024-09-13T23:28:56.639079+0000","last_clean":"2024-09-13T23:28:56.639079+0000","last_became_active":"2024-09-13T23:25:15.280299+0000","last_became_peered":"2024-09-13T23:25:15.280299+0000","last_unstale":"2024-09-13T23:28:56.639079+0000","last_undegraded":"2024-09-13T23:28:56.639079+0000","last_fullsized":"2024-09-13T23:28:56.639079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.638914+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.638914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:33.914521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.718580+0000","last_change":"2024-09-13T23:29:16.718580+0000","last_active":"2024-09-13T23:29:16.718580+0000","last_peered":"2024-09-13T23:29:16.718580+0000","last_clean":"2024-09-13T23:29:16.718580+0000","last_became_active":"2024-09-13T23:25:13.280417+0000","last_became_peered":"2024-09-13T23:25:13.280417+0000","last_unstale":"2024-09-13T23:29:16.718580+0000","last_undegraded":"2024-09-13T23:29:16.718580+0000","last_fullsized":"2024-09-13T23:29:16.718580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.718459+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.718459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:51.493063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"33'8","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.213741+0000","last_change":"2024-09-13T23:29:07.213741+0000","last_active":"2024-09-13T23:29:07.213741+0000","last_peered":"2024-09-13T23:29:07.213741+0000","last_clean":"2024-09-13T23:29:07.213741+0000","last_became_active":"2024-09-13T23:25:15.284335+0000","last_became_peered":"2024-09-13T23:25:15.284335+0000","last_unstale":"2024-09-13T23:29:07.213741+0000","last_undegraded":"2024-09-13T23:29:07.213741+0000","last_fullsized":"2024-09-13T23:29:07.213741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:07.213605+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.213605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:01.540063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.162764+0000","last_change":"2024-09-13T23:29:27.162764+0000","last_active":"2024-09-13T23:29:27.162764+0000","last_peered":"2024-09-13T23:29:27.162764+0000","last_clean":"2024-09-13T23:29:27.162764+0000","last_became_active":"2024-09-13T23:25:13.281666+0000","last_became_peered":"2024-09-13T23:25:13.281666+0000","last_unstale":"2024-09-13T23:29:27.162764+0000","last_undegraded":"2024-09-13T23:29:27.162764+0000","last_fullsized":"2024-09-13T23:29:27.162764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:27.162654+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.162654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:55:25.591007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"33'36","reported_seq":110,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.195793+0000","last_change":"2024-09-13T23:29:30.195793+0000","last_active":"2024-09-13T23:29:30.195793+0000","last_peered":"2024-09-13T23:29:30.195793+0000","last_clean":"2024-09-13T23:29:30.195793+0000","last_became_active":"2024-09-13T23:25:23.315889+0000","last_became_peered":"2024-09-13T23:25:23.315889+0000","last_unstale":"2024-09-13T23:29:30.195793+0000","last_undegraded":"2024-09-13T23:29:30.195793+0000","last_fullsized":"2024-09-13T23:29:30.195793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:29:30.195679+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.195679+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:05:33.795978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"33'8","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.250515+0000","last_change":"2024-09-13T23:29:18.250515+0000","last_active":"2024-09-13T23:29:18.250515+0000","last_peered":"2024-09-13T23:29:18.250515+0000","last_clean":"2024-09-13T23:29:18.250515+0000","last_became_active":"2024-09-13T23:25:15.278021+0000","last_became_peered":"2024-09-13T23:25:15.278021+0000","last_unstale":"2024-09-13T23:29:18.250515+0000","last_undegraded":"2024-09-13T23:29:18.250515+0000","last_fullsized":"2024-09-13T23:29:18.250515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:18.250363+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.250363+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:36.745243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.195808+0000","last_change":"2024-09-13T23:29:33.195808+0000","last_active":"2024-09-13T23:29:33.195808+0000","last_peered":"2024-09-13T23:29:33.195808+0000","last_clean":"2024-09-13T23:29:33.195808+0000","last_became_active":"2024-09-13T23:25:13.282742+0000","last_became_peered":"2024-09-13T23:25:13.282742+0000","last_unstale":"2024-09-13T23:29:33.195808+0000","last_undegraded":"2024-09-13T23:29:33.195808+0000","last_fullsized":"2024-09-13T23:29:33.195808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.195648+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.195648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:34.430333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.412268+0000","last_change":"2024-09-13T23:28:35.412268+0000","last_active":"2024-09-13T23:28:35.412268+0000","last_peered":"2024-09-13T23:28:35.412268+0000","last_clean":"2024-09-13T23:28:35.412268+0000","last_became_active":"2024-09-13T23:25:17.288938+0000","last_became_peered":"2024-09-13T23:25:17.288938+0000","last_unstale":"2024-09-13T23:28:35.412268+0000","last_undegraded":"2024-09-13T23:28:35.412268+0000","last_fullsized":"2024-09-13T23:28:35.412268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.412096+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.412096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:03.433021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.403875+0000","last_change":"2024-09-13T23:28:53.403875+0000","last_active":"2024-09-13T23:28:53.403875+0000","last_peered":"2024-09-13T23:28:53.403875+0000","last_clean":"2024-09-13T23:28:53.403875+0000","last_became_active":"2024-09-13T23:25:19.296581+0000","last_became_peered":"2024-09-13T23:25:19.296581+0000","last_unstale":"2024-09-13T23:28:53.403875+0000","last_undegraded":"2024-09-13T23:28:53.403875+0000","last_fullsized":"2024-09-13T23:28:53.403875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:53.403743+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.403743+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:46:52.708366+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.383806+0000","last_change":"2024-09-13T23:28:42.383806+0000","last_active":"2024-09-13T23:28:42.383806+0000","last_peered":"2024-09-13T23:28:42.383806+0000","last_clean":"2024-09-13T23:28:42.383806+0000","last_became_active":"2024-09-13T23:25:21.305822+0000","last_became_peered":"2024-09-13T23:25:21.305822+0000","last_unstale":"2024-09-13T23:28:42.383806+0000","last_undegraded":"2024-09-13T23:28:42.383806+0000","last_fullsized":"2024-09-13T23:28:42.383806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.383654+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.383654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:23.582962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.190517+0000","last_change":"2024-09-13T23:29:29.190517+0000","last_active":"2024-09-13T23:29:29.190517+0000","last_peered":"2024-09-13T23:29:29.190517+0000","last_clean":"2024-09-13T23:29:29.190517+0000","last_became_active":"2024-09-13T23:25:23.315819+0000","last_became_peered":"2024-09-13T23:25:23.315819+0000","last_unstale":"2024-09-13T23:29:29.190517+0000","last_undegraded":"2024-09-13T23:29:29.190517+0000","last_fullsized":"2024-09-13T23:29:29.190517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:29:29.190360+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.190360+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:54.584195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"33'12","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.298230+0000","last_change":"2024-09-13T23:29:16.298230+0000","last_active":"2024-09-13T23:29:16.298230+0000","last_peered":"2024-09-13T23:29:16.298230+0000","last_clean":"2024-09-13T23:29:16.298230+0000","last_became_active":"2024-09-13T23:25:15.278593+0000","last_became_peered":"2024-09-13T23:25:15.278593+0000","last_unstale":"2024-09-13T23:29:16.298230+0000","last_undegraded":"2024-09-13T23:29:16.298230+0000","last_fullsized":"2024-09-13T23:29:16.298230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:16.298110+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.298110+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:05.867340+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.525462+0000","last_change":"2024-09-13T23:29:18.525462+0000","last_active":"2024-09-13T23:29:18.525462+0000","last_peered":"2024-09-13T23:29:18.525462+0000","last_clean":"2024-09-13T23:29:18.525462+0000","last_became_active":"2024-09-13T23:25:13.285237+0000","last_became_peered":"2024-09-13T23:25:13.285237+0000","last_unstale":"2024-09-13T23:29:18.525462+0000","last_undegraded":"2024-09-13T23:29:18.525462+0000","last_fullsized":"2024-09-13T23:29:18.525462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:18.525350+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.525350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:40.941146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.285642+0000","last_change":"2024-09-13T23:29:33.285670+0000","last_active":"2024-09-13T23:29:33.285642+0000","last_peered":"2024-09-13T23:29:33.285642+0000","last_clean":"2024-09-13T23:29:33.285642+0000","last_became_active":"2024-09-13T23:25:52.381218+0000","last_became_peered":"2024-09-13T23:25:52.381218+0000","last_unstale":"2024-09-13T23:29:33.285642+0000","last_undegraded":"2024-09-13T23:29:33.285642+0000","last_fullsized":"2024-09-13T23:29:33.285642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:33.285554+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.285554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:04.109619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"33'9","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.401603+0000","last_change":"2024-09-13T23:28:39.401603+0000","last_active":"2024-09-13T23:28:39.401603+0000","last_peered":"2024-09-13T23:28:39.401603+0000","last_clean":"2024-09-13T23:28:39.401603+0000","last_became_active":"2024-09-13T23:25:19.296154+0000","last_became_peered":"2024-09-13T23:25:19.296154+0000","last_unstale":"2024-09-13T23:28:39.401603+0000","last_undegraded":"2024-09-13T23:28:39.401603+0000","last_fullsized":"2024-09-13T23:28:39.401603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:39.401441+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.401441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:23.948110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.453193+0000","last_change":"2024-09-13T23:28:34.453193+0000","last_active":"2024-09-13T23:28:34.453193+0000","last_peered":"2024-09-13T23:28:34.453193+0000","last_clean":"2024-09-13T23:28:34.453193+0000","last_became_active":"2024-09-13T23:25:21.301079+0000","last_became_peered":"2024-09-13T23:25:21.301079+0000","last_unstale":"2024-09-13T23:28:34.453193+0000","last_undegraded":"2024-09-13T23:28:34.453193+0000","last_fullsized":"2024-09-13T23:28:34.453193+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.453082+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.453082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:57:39.061568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.609004+0000","last_change":"2024-09-13T23:29:31.609031+0000","last_active":"2024-09-13T23:29:31.609004+0000","last_peered":"2024-09-13T23:29:31.609004+0000","last_clean":"2024-09-13T23:29:31.609004+0000","last_became_active":"2024-09-13T23:25:23.305625+0000","last_became_peered":"2024-09-13T23:25:23.305625+0000","last_unstale":"2024-09-13T23:29:31.609004+0000","last_undegraded":"2024-09-13T23:29:31.609004+0000","last_fullsized":"2024-09-13T23:29:31.609004+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:31.608901+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:31.608901+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.608901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:07.619631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"33'14","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.254517+0000","last_change":"2024-09-13T23:29:20.254517+0000","last_active":"2024-09-13T23:29:20.254517+0000","last_peered":"2024-09-13T23:29:20.254517+0000","last_clean":"2024-09-13T23:29:20.254517+0000","last_became_active":"2024-09-13T23:25:15.278562+0000","last_became_peered":"2024-09-13T23:25:15.278562+0000","last_unstale":"2024-09-13T23:29:20.254517+0000","last_undegraded":"2024-09-13T23:29:20.254517+0000","last_fullsized":"2024-09-13T23:29:20.254517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:20.254341+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.254341+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:55.274744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":40,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:42.138836+0000","last_change":"2024-09-13T23:29:42.138836+0000","last_active":"2024-09-13T23:29:42.138836+0000","last_peered":"2024-09-13T23:29:42.138836+0000","last_clean":"2024-09-13T23:29:42.138836+0000","last_became_active":"2024-09-13T23:25:13.279123+0000","last_became_peered":"2024-09-13T23:25:13.279123+0000","last_unstale":"2024-09-13T23:29:42.138836+0000","last_undegraded":"2024-09-13T23:29:42.138836+0000","last_fullsized":"2024-09-13T23:29:42.138836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:42.138666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:42.138666+0000","last_clean_scrub_stamp":"2024-09-13T23:29:42.138666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:45.200165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.917010+0000","last_change":"2024-09-13T23:28:50.917010+0000","last_active":"2024-09-13T23:28:50.917010+0000","last_peered":"2024-09-13T23:28:50.917010+0000","last_clean":"2024-09-13T23:28:50.917010+0000","last_became_active":"2024-09-13T23:25:17.286578+0000","last_became_peered":"2024-09-13T23:25:17.286578+0000","last_unstale":"2024-09-13T23:28:50.917010+0000","last_undegraded":"2024-09-13T23:28:50.917010+0000","last_fullsized":"2024-09-13T23:28:50.917010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.916803+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.916803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:55.569318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"33'15","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.835968+0000","last_change":"2024-09-13T23:28:43.835968+0000","last_active":"2024-09-13T23:28:43.835968+0000","last_peered":"2024-09-13T23:28:43.835968+0000","last_clean":"2024-09-13T23:28:43.835968+0000","last_became_active":"2024-09-13T23:25:19.289542+0000","last_became_peered":"2024-09-13T23:25:19.289542+0000","last_unstale":"2024-09-13T23:28:43.835968+0000","last_undegraded":"2024-09-13T23:28:43.835968+0000","last_fullsized":"2024-09-13T23:28:43.835968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'15","last_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_deep_scrub":"33'15","last_deep_scrub_stamp":"2024-09-13T23:28:43.835830+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.835830+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:52.336311+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'285","reported_seq":394,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.332504+0000","last_change":"2024-09-13T23:28:58.332504+0000","last_active":"2024-09-13T23:28:58.332504+0000","last_peered":"2024-09-13T23:28:58.332504+0000","last_clean":"2024-09-13T23:28:58.332504+0000","last_became_active":"2024-09-13T23:25:21.303833+0000","last_became_peered":"2024-09-13T23:25:21.303833+0000","last_unstale":"2024-09-13T23:28:58.332504+0000","last_undegraded":"2024-09-13T23:28:58.332504+0000","last_fullsized":"2024-09-13T23:28:58.332504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:58.332349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.332349+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:12:44.416231+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"33'2","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.600162+0000","last_change":"2024-09-13T23:29:21.600189+0000","last_active":"2024-09-13T23:29:21.600162+0000","last_peered":"2024-09-13T23:29:21.600162+0000","last_clean":"2024-09-13T23:29:21.600162+0000","last_became_active":"2024-09-13T23:25:23.308720+0000","last_became_peered":"2024-09-13T23:25:23.308720+0000","last_unstale":"2024-09-13T23:29:21.600162+0000","last_undegraded":"2024-09-13T23:29:21.600162+0000","last_fullsized":"2024-09-13T23:29:21.600162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:21.600069+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.600069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:19:33.000348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"33'10","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.847269+0000","last_change":"2024-09-13T23:28:59.847269+0000","last_active":"2024-09-13T23:28:59.847269+0000","last_peered":"2024-09-13T23:28:59.847269+0000","last_clean":"2024-09-13T23:28:59.847269+0000","last_became_active":"2024-09-13T23:25:15.285000+0000","last_became_peered":"2024-09-13T23:25:15.285000+0000","last_unstale":"2024-09-13T23:28:59.847269+0000","last_undegraded":"2024-09-13T23:28:59.847269+0000","last_fullsized":"2024-09-13T23:28:59.847269+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.847154+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.847154+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:32.418333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.073943+0000","last_change":"2024-09-13T23:29:11.073943+0000","last_active":"2024-09-13T23:29:11.073943+0000","last_peered":"2024-09-13T23:29:11.073943+0000","last_clean":"2024-09-13T23:29:11.073943+0000","last_became_active":"2024-09-13T23:25:13.288616+0000","last_became_peered":"2024-09-13T23:25:13.288616+0000","last_unstale":"2024-09-13T23:29:11.073943+0000","last_undegraded":"2024-09-13T23:29:11.073943+0000","last_fullsized":"2024-09-13T23:29:11.073943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.073831+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.073831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:30.480544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.432355+0000","last_change":"2024-09-13T23:28:42.432355+0000","last_active":"2024-09-13T23:28:42.432355+0000","last_peered":"2024-09-13T23:28:42.432355+0000","last_clean":"2024-09-13T23:28:42.432355+0000","last_became_active":"2024-09-13T23:25:17.286860+0000","last_became_peered":"2024-09-13T23:25:17.286860+0000","last_unstale":"2024-09-13T23:28:42.432355+0000","last_undegraded":"2024-09-13T23:28:42.432355+0000","last_fullsized":"2024-09-13T23:28:42.432355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:42.432240+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.432240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.272484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.853928+0000","last_change":"2024-09-13T23:28:42.853928+0000","last_active":"2024-09-13T23:28:42.853928+0000","last_peered":"2024-09-13T23:28:42.853928+0000","last_clean":"2024-09-13T23:28:42.853928+0000","last_became_active":"2024-09-13T23:25:19.290910+0000","last_became_peered":"2024-09-13T23:25:19.290910+0000","last_unstale":"2024-09-13T23:28:42.853928+0000","last_undegraded":"2024-09-13T23:28:42.853928+0000","last_fullsized":"2024-09-13T23:28:42.853928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:42.853764+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.853764+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:24.964571+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"33'285","reported_seq":454,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.867494+0000","last_change":"2024-09-13T23:28:37.867494+0000","last_active":"2024-09-13T23:28:37.867494+0000","last_peered":"2024-09-13T23:28:37.867494+0000","last_clean":"2024-09-13T23:28:37.867494+0000","last_became_active":"2024-09-13T23:25:21.302872+0000","last_became_peered":"2024-09-13T23:25:21.302872+0000","last_unstale":"2024-09-13T23:28:37.867494+0000","last_undegraded":"2024-09-13T23:28:37.867494+0000","last_fullsized":"2024-09-13T23:28:37.867494+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.867370+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.867370+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:50.148177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"33'18","reported_seq":85,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.383237+0000","last_change":"2024-09-13T23:28:48.383237+0000","last_active":"2024-09-13T23:28:48.383237+0000","last_peered":"2024-09-13T23:28:48.383237+0000","last_clean":"2024-09-13T23:28:48.383237+0000","last_became_active":"2024-09-13T23:25:15.290786+0000","last_became_peered":"2024-09-13T23:25:15.290786+0000","last_unstale":"2024-09-13T23:28:48.383237+0000","last_undegraded":"2024-09-13T23:28:48.383237+0000","last_fullsized":"2024-09-13T23:28:48.383237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:28:48.383091+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.383091+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:30.549975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.539913+0000","last_change":"2024-09-13T23:29:00.539913+0000","last_active":"2024-09-13T23:29:00.539913+0000","last_peered":"2024-09-13T23:29:00.539913+0000","last_clean":"2024-09-13T23:29:00.539913+0000","last_became_active":"2024-09-13T23:25:13.289583+0000","last_became_peered":"2024-09-13T23:25:13.289583+0000","last_unstale":"2024-09-13T23:29:00.539913+0000","last_undegraded":"2024-09-13T23:29:00.539913+0000","last_fullsized":"2024-09-13T23:29:00.539913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:00.539784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.539784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:15.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.221472+0000","last_change":"2024-09-13T23:28:48.221472+0000","last_active":"2024-09-13T23:28:48.221472+0000","last_peered":"2024-09-13T23:28:48.221472+0000","last_clean":"2024-09-13T23:28:48.221472+0000","last_became_active":"2024-09-13T23:25:17.288825+0000","last_became_peered":"2024-09-13T23:25:17.288825+0000","last_unstale":"2024-09-13T23:28:48.221472+0000","last_undegraded":"2024-09-13T23:28:48.221472+0000","last_fullsized":"2024-09-13T23:28:48.221472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.221353+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.221353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:59.646033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"33'51","reported_seq":112,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.789114+0000","last_change":"2024-09-13T23:28:38.789114+0000","last_active":"2024-09-13T23:28:38.789114+0000","last_peered":"2024-09-13T23:28:38.789114+0000","last_clean":"2024-09-13T23:28:38.789114+0000","last_became_active":"2024-09-13T23:25:19.297672+0000","last_became_peered":"2024-09-13T23:25:19.297672+0000","last_unstale":"2024-09-13T23:28:38.789114+0000","last_undegraded":"2024-09-13T23:28:38.789114+0000","last_fullsized":"2024-09-13T23:28:38.789114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'51","last_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_deep_scrub":"33'51","last_deep_scrub_stamp":"2024-09-13T23:28:38.788930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.788930+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:43:52.119474+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.797133+0000","last_change":"2024-09-13T23:28:35.797133+0000","last_active":"2024-09-13T23:28:35.797133+0000","last_peered":"2024-09-13T23:28:35.797133+0000","last_clean":"2024-09-13T23:28:35.797133+0000","last_became_active":"2024-09-13T23:25:21.300903+0000","last_became_peered":"2024-09-13T23:25:21.300903+0000","last_unstale":"2024-09-13T23:28:35.797133+0000","last_undegraded":"2024-09-13T23:28:35.797133+0000","last_fullsized":"2024-09-13T23:28:35.797133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.797014+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.797014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:49.977474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.615531+0000","last_change":"2024-09-13T23:29:23.615531+0000","last_active":"2024-09-13T23:29:23.615531+0000","last_peered":"2024-09-13T23:29:23.615531+0000","last_clean":"2024-09-13T23:29:23.615531+0000","last_became_active":"2024-09-13T23:25:23.314465+0000","last_became_peered":"2024-09-13T23:25:23.314465+0000","last_unstale":"2024-09-13T23:29:23.615531+0000","last_undegraded":"2024-09-13T23:29:23.615531+0000","last_fullsized":"2024-09-13T23:29:23.615531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:23.615415+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.615415+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:56.682635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.193218+0000","last_change":"2024-09-13T23:29:05.193218+0000","last_active":"2024-09-13T23:29:05.193218+0000","last_peered":"2024-09-13T23:29:05.193218+0000","last_clean":"2024-09-13T23:29:05.193218+0000","last_became_active":"2024-09-13T23:25:15.284699+0000","last_became_peered":"2024-09-13T23:25:15.284699+0000","last_unstale":"2024-09-13T23:29:05.193218+0000","last_undegraded":"2024-09-13T23:29:05.193218+0000","last_fullsized":"2024-09-13T23:29:05.193218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:05.193061+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.193061+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:49:54.252627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.516198+0000","last_change":"2024-09-13T23:29:17.516198+0000","last_active":"2024-09-13T23:29:17.516198+0000","last_peered":"2024-09-13T23:29:17.516198+0000","last_clean":"2024-09-13T23:29:17.516198+0000","last_became_active":"2024-09-13T23:25:13.281876+0000","last_became_peered":"2024-09-13T23:25:13.281876+0000","last_unstale":"2024-09-13T23:29:17.516198+0000","last_undegraded":"2024-09-13T23:29:17.516198+0000","last_fullsized":"2024-09-13T23:29:17.516198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.516070+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.516070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:53:33.834491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.878026+0000","last_change":"2024-09-13T23:28:47.878026+0000","last_active":"2024-09-13T23:28:47.878026+0000","last_peered":"2024-09-13T23:28:47.878026+0000","last_clean":"2024-09-13T23:28:47.878026+0000","last_became_active":"2024-09-13T23:25:17.290977+0000","last_became_peered":"2024-09-13T23:25:17.290977+0000","last_unstale":"2024-09-13T23:28:47.878026+0000","last_undegraded":"2024-09-13T23:28:47.878026+0000","last_fullsized":"2024-09-13T23:28:47.878026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.877888+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.877888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:24.096380+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.395683+0000","last_change":"2024-09-13T23:28:41.395683+0000","last_active":"2024-09-13T23:28:41.395683+0000","last_peered":"2024-09-13T23:28:41.395683+0000","last_clean":"2024-09-13T23:28:41.395683+0000","last_became_active":"2024-09-13T23:25:19.294068+0000","last_became_peered":"2024-09-13T23:25:19.294068+0000","last_unstale":"2024-09-13T23:28:41.395683+0000","last_undegraded":"2024-09-13T23:28:41.395683+0000","last_fullsized":"2024-09-13T23:28:41.395683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:41.395529+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.395529+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:36:16.720847+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.869568+0000","last_change":"2024-09-13T23:28:49.869568+0000","last_active":"2024-09-13T23:28:49.869568+0000","last_peered":"2024-09-13T23:28:49.869568+0000","last_clean":"2024-09-13T23:28:49.869568+0000","last_became_active":"2024-09-13T23:25:21.307990+0000","last_became_peered":"2024-09-13T23:25:21.307990+0000","last_unstale":"2024-09-13T23:28:49.869568+0000","last_undegraded":"2024-09-13T23:28:49.869568+0000","last_fullsized":"2024-09-13T23:28:49.869568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:49.869451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.869451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:42.241159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.227072+0000","last_change":"2024-09-13T23:28:50.227072+0000","last_active":"2024-09-13T23:28:50.227072+0000","last_peered":"2024-09-13T23:28:50.227072+0000","last_clean":"2024-09-13T23:28:50.227072+0000","last_became_active":"2024-09-13T23:25:23.304810+0000","last_became_peered":"2024-09-13T23:25:23.304810+0000","last_unstale":"2024-09-13T23:28:50.227072+0000","last_undegraded":"2024-09-13T23:28:50.227072+0000","last_fullsized":"2024-09-13T23:28:50.227072+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:50.226940+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.226940+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:51.317457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"33'2","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.574304+0000","last_change":"2024-09-13T23:29:01.574304+0000","last_active":"2024-09-13T23:29:01.574304+0000","last_peered":"2024-09-13T23:29:01.574304+0000","last_clean":"2024-09-13T23:29:01.574304+0000","last_became_active":"2024-09-13T23:25:15.286765+0000","last_became_peered":"2024-09-13T23:25:15.286765+0000","last_unstale":"2024-09-13T23:29:01.574304+0000","last_undegraded":"2024-09-13T23:29:01.574304+0000","last_fullsized":"2024-09-13T23:29:01.574304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:01.574185+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.574185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:53.945893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:41.161430+0000","last_change":"2024-09-13T23:29:41.161430+0000","last_active":"2024-09-13T23:29:41.161430+0000","last_peered":"2024-09-13T23:29:41.161430+0000","last_clean":"2024-09-13T23:29:41.161430+0000","last_became_active":"2024-09-13T23:25:13.284646+0000","last_became_peered":"2024-09-13T23:25:13.284646+0000","last_unstale":"2024-09-13T23:29:41.161430+0000","last_undegraded":"2024-09-13T23:29:41.161430+0000","last_fullsized":"2024-09-13T23:29:41.161430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:41.161274+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:41.161274+0000","last_clean_scrub_stamp":"2024-09-13T23:29:41.161274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:34.421641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.848076+0000","last_change":"2024-09-13T23:28:52.848076+0000","last_active":"2024-09-13T23:28:52.848076+0000","last_peered":"2024-09-13T23:28:52.848076+0000","last_clean":"2024-09-13T23:28:52.848076+0000","last_became_active":"2024-09-13T23:25:17.285643+0000","last_became_peered":"2024-09-13T23:25:17.285643+0000","last_unstale":"2024-09-13T23:28:52.848076+0000","last_undegraded":"2024-09-13T23:28:52.848076+0000","last_fullsized":"2024-09-13T23:28:52.848076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.847961+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.847961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.924204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"33'47","reported_seq":106,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.373593+0000","last_change":"2024-09-13T23:29:02.373593+0000","last_active":"2024-09-13T23:29:02.373593+0000","last_peered":"2024-09-13T23:29:02.373593+0000","last_clean":"2024-09-13T23:29:02.373593+0000","last_became_active":"2024-09-13T23:25:19.299362+0000","last_became_peered":"2024-09-13T23:25:19.299362+0000","last_unstale":"2024-09-13T23:29:02.373593+0000","last_undegraded":"2024-09-13T23:29:02.373593+0000","last_fullsized":"2024-09-13T23:29:02.373593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'47","last_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_deep_scrub":"33'47","last_deep_scrub_stamp":"2024-09-13T23:29:02.373443+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.373443+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:28:09.196717+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"33'285","reported_seq":361,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.901638+0000","last_change":"2024-09-13T23:28:57.901638+0000","last_active":"2024-09-13T23:28:57.901638+0000","last_peered":"2024-09-13T23:28:57.901638+0000","last_clean":"2024-09-13T23:28:57.901638+0000","last_became_active":"2024-09-13T23:25:21.308507+0000","last_became_peered":"2024-09-13T23:25:21.308507+0000","last_unstale":"2024-09-13T23:28:57.901638+0000","last_undegraded":"2024-09-13T23:28:57.901638+0000","last_fullsized":"2024-09-13T23:28:57.901638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:57.901512+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.901512+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:41.619080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"31'2","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.614182+0000","last_change":"2024-09-13T23:29:28.614182+0000","last_active":"2024-09-13T23:29:28.614182+0000","last_peered":"2024-09-13T23:29:28.614182+0000","last_clean":"2024-09-13T23:29:28.614182+0000","last_became_active":"2024-09-13T23:25:23.305451+0000","last_became_peered":"2024-09-13T23:25:23.305451+0000","last_unstale":"2024-09-13T23:29:28.614182+0000","last_undegraded":"2024-09-13T23:29:28.614182+0000","last_fullsized":"2024-09-13T23:29:28.614182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:28.614044+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.614044+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:14.521686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.672214+0000","last_change":"2024-09-13T23:28:55.672214+0000","last_active":"2024-09-13T23:28:55.672214+0000","last_peered":"2024-09-13T23:28:55.672214+0000","last_clean":"2024-09-13T23:28:55.672214+0000","last_became_active":"2024-09-13T23:25:15.282970+0000","last_became_peered":"2024-09-13T23:25:15.282970+0000","last_unstale":"2024-09-13T23:28:55.672214+0000","last_undegraded":"2024-09-13T23:28:55.672214+0000","last_fullsized":"2024-09-13T23:28:55.672214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:55.672076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.672076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:08:02.488271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.188812+0000","last_change":"2024-09-13T23:29:30.188812+0000","last_active":"2024-09-13T23:29:30.188812+0000","last_peered":"2024-09-13T23:29:30.188812+0000","last_clean":"2024-09-13T23:29:30.188812+0000","last_became_active":"2024-09-13T23:25:13.280837+0000","last_became_peered":"2024-09-13T23:25:13.280837+0000","last_unstale":"2024-09-13T23:29:30.188812+0000","last_undegraded":"2024-09-13T23:29:30.188812+0000","last_fullsized":"2024-09-13T23:29:30.188812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:30.188678+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.188678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:01.676356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.872681+0000","last_change":"2024-09-13T23:28:51.872681+0000","last_active":"2024-09-13T23:28:51.872681+0000","last_peered":"2024-09-13T23:28:51.872681+0000","last_clean":"2024-09-13T23:28:51.872681+0000","last_became_active":"2024-09-13T23:25:17.286355+0000","last_became_peered":"2024-09-13T23:25:17.286355+0000","last_unstale":"2024-09-13T23:28:51.872681+0000","last_undegraded":"2024-09-13T23:28:51.872681+0000","last_fullsized":"2024-09-13T23:28:51.872681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.872543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.872543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:22:15.808273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"33'66","reported_seq":140,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.300292+0000","last_change":"2024-09-13T23:29:00.300292+0000","last_active":"2024-09-13T23:29:00.300292+0000","last_peered":"2024-09-13T23:29:00.300292+0000","last_clean":"2024-09-13T23:29:00.300292+0000","last_became_active":"2024-09-13T23:25:19.299275+0000","last_became_peered":"2024-09-13T23:25:19.299275+0000","last_unstale":"2024-09-13T23:29:00.300292+0000","last_undegraded":"2024-09-13T23:29:00.300292+0000","last_fullsized":"2024-09-13T23:29:00.300292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'66","last_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_deep_scrub":"33'66","last_deep_scrub_stamp":"2024-09-13T23:29:00.300157+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.300157+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:42:45.866727+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.841693+0000","last_change":"2024-09-13T23:28:34.841693+0000","last_active":"2024-09-13T23:28:34.841693+0000","last_peered":"2024-09-13T23:28:34.841693+0000","last_clean":"2024-09-13T23:28:34.841693+0000","last_became_active":"2024-09-13T23:25:21.301264+0000","last_became_peered":"2024-09-13T23:25:21.301264+0000","last_unstale":"2024-09-13T23:28:34.841693+0000","last_undegraded":"2024-09-13T23:28:34.841693+0000","last_fullsized":"2024-09-13T23:28:34.841693+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.841569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.841569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:03.926916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"33'23","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.590842+0000","last_change":"2024-09-13T23:29:34.590842+0000","last_active":"2024-09-13T23:29:34.590842+0000","last_peered":"2024-09-13T23:29:34.590842+0000","last_clean":"2024-09-13T23:29:34.590842+0000","last_became_active":"2024-09-13T23:25:23.311185+0000","last_became_peered":"2024-09-13T23:25:23.311185+0000","last_unstale":"2024-09-13T23:29:34.590842+0000","last_undegraded":"2024-09-13T23:29:34.590842+0000","last_fullsized":"2024-09-13T23:29:34.590842+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'23","last_scrub_stamp":"2024-09-13T23:29:34.590715+0000","last_deep_scrub":"33'23","last_deep_scrub_stamp":"2024-09-13T23:29:34.590715+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.590715+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:16:35.207539+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"33'8","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.232952+0000","last_change":"2024-09-13T23:28:57.232952+0000","last_active":"2024-09-13T23:28:57.232952+0000","last_peered":"2024-09-13T23:28:57.232952+0000","last_clean":"2024-09-13T23:28:57.232952+0000","last_became_active":"2024-09-13T23:25:15.296466+0000","last_became_peered":"2024-09-13T23:25:15.296466+0000","last_unstale":"2024-09-13T23:28:57.232952+0000","last_undegraded":"2024-09-13T23:28:57.232952+0000","last_fullsized":"2024-09-13T23:28:57.232952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:57.232786+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.232786+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:36.752822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.864615+0000","last_change":"2024-09-13T23:29:08.864615+0000","last_active":"2024-09-13T23:29:08.864615+0000","last_peered":"2024-09-13T23:29:08.864615+0000","last_clean":"2024-09-13T23:29:08.864615+0000","last_became_active":"2024-09-13T23:25:13.283609+0000","last_became_peered":"2024-09-13T23:25:13.283609+0000","last_unstale":"2024-09-13T23:29:08.864615+0000","last_undegraded":"2024-09-13T23:29:08.864615+0000","last_fullsized":"2024-09-13T23:29:08.864615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:08.864495+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.864495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:40.831517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.688153+0000","last_change":"2024-09-13T23:28:50.688153+0000","last_active":"2024-09-13T23:28:50.688153+0000","last_peered":"2024-09-13T23:28:50.688153+0000","last_clean":"2024-09-13T23:28:50.688153+0000","last_became_active":"2024-09-13T23:25:17.284979+0000","last_became_peered":"2024-09-13T23:25:17.284979+0000","last_unstale":"2024-09-13T23:28:50.688153+0000","last_undegraded":"2024-09-13T23:28:50.688153+0000","last_fullsized":"2024-09-13T23:28:50.688153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:50.687998+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.687998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:09.971212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.386721+0000","last_change":"2024-09-13T23:28:43.386721+0000","last_active":"2024-09-13T23:28:43.386721+0000","last_peered":"2024-09-13T23:28:43.386721+0000","last_clean":"2024-09-13T23:28:43.386721+0000","last_became_active":"2024-09-13T23:25:19.292630+0000","last_became_peered":"2024-09-13T23:25:19.292630+0000","last_unstale":"2024-09-13T23:28:43.386721+0000","last_undegraded":"2024-09-13T23:28:43.386721+0000","last_fullsized":"2024-09-13T23:28:43.386721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:43.386578+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.386578+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:59.830372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.325076+0000","last_change":"2024-09-13T23:29:01.325076+0000","last_active":"2024-09-13T23:29:01.325076+0000","last_peered":"2024-09-13T23:29:01.325076+0000","last_clean":"2024-09-13T23:29:01.325076+0000","last_became_active":"2024-09-13T23:25:21.307590+0000","last_became_peered":"2024-09-13T23:25:21.307590+0000","last_unstale":"2024-09-13T23:29:01.325076+0000","last_undegraded":"2024-09-13T23:29:01.325076+0000","last_fullsized":"2024-09-13T23:29:01.325076+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:01.324903+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.324903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:21.454194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.252111+0000","last_change":"2024-09-13T23:29:21.252111+0000","last_active":"2024-09-13T23:29:21.252111+0000","last_peered":"2024-09-13T23:29:21.252111+0000","last_clean":"2024-09-13T23:29:21.252111+0000","last_became_active":"2024-09-13T23:25:23.311395+0000","last_became_peered":"2024-09-13T23:25:23.311395+0000","last_unstale":"2024-09-13T23:29:21.252111+0000","last_undegraded":"2024-09-13T23:29:21.252111+0000","last_fullsized":"2024-09-13T23:29:21.252111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:21.251980+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.251980+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:04.952259+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"33'4","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.447307+0000","last_change":"2024-09-13T23:28:52.447307+0000","last_active":"2024-09-13T23:28:52.447307+0000","last_peered":"2024-09-13T23:28:52.447307+0000","last_clean":"2024-09-13T23:28:52.447307+0000","last_became_active":"2024-09-13T23:25:15.289389+0000","last_became_peered":"2024-09-13T23:25:15.289389+0000","last_unstale":"2024-09-13T23:28:52.447307+0000","last_undegraded":"2024-09-13T23:28:52.447307+0000","last_fullsized":"2024-09-13T23:28:52.447307+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:52.447192+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.447192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:10:03.543667+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:28.127947+0000","last_change":"2024-09-13T23:29:28.127947+0000","last_active":"2024-09-13T23:29:28.127947+0000","last_peered":"2024-09-13T23:29:28.127947+0000","last_clean":"2024-09-13T23:29:28.127947+0000","last_became_active":"2024-09-13T23:25:13.281317+0000","last_became_peered":"2024-09-13T23:25:13.281317+0000","last_unstale":"2024-09-13T23:29:28.127947+0000","last_undegraded":"2024-09-13T23:29:28.127947+0000","last_fullsized":"2024-09-13T23:29:28.127947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:28.127828+0000","last_clean_scrub_stamp":"2024-09-13T23:29:28.127828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:16.066301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.844011+0000","last_change":"2024-09-13T23:28:48.844011+0000","last_active":"2024-09-13T23:28:48.844011+0000","last_peered":"2024-09-13T23:28:48.844011+0000","last_clean":"2024-09-13T23:28:48.844011+0000","last_became_active":"2024-09-13T23:25:17.286912+0000","last_became_peered":"2024-09-13T23:25:17.286912+0000","last_unstale":"2024-09-13T23:28:48.844011+0000","last_undegraded":"2024-09-13T23:28:48.844011+0000","last_fullsized":"2024-09-13T23:28:48.844011+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.843846+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.843846+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:24:04.241715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"33'46","reported_seq":105,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.801707+0000","last_change":"2024-09-13T23:28:44.801707+0000","last_active":"2024-09-13T23:28:44.801707+0000","last_peered":"2024-09-13T23:28:44.801707+0000","last_clean":"2024-09-13T23:28:44.801707+0000","last_became_active":"2024-09-13T23:25:19.288780+0000","last_became_peered":"2024-09-13T23:25:19.288780+0000","last_unstale":"2024-09-13T23:28:44.801707+0000","last_undegraded":"2024-09-13T23:28:44.801707+0000","last_fullsized":"2024-09-13T23:28:44.801707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'46","last_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_deep_scrub":"33'46","last_deep_scrub_stamp":"2024-09-13T23:28:44.801589+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.801589+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:14.458499+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'285","reported_seq":444,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.752406+0000","last_change":"2024-09-13T23:28:33.752406+0000","last_active":"2024-09-13T23:28:33.752406+0000","last_peered":"2024-09-13T23:28:33.752406+0000","last_clean":"2024-09-13T23:28:33.752406+0000","last_became_active":"2024-09-13T23:25:21.302094+0000","last_became_peered":"2024-09-13T23:25:21.302094+0000","last_unstale":"2024-09-13T23:28:33.752406+0000","last_undegraded":"2024-09-13T23:28:33.752406+0000","last_fullsized":"2024-09-13T23:28:33.752406+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.752282+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.752282+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:30.865050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"33'13","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.848945+0000","last_change":"2024-09-13T23:29:01.848945+0000","last_active":"2024-09-13T23:29:01.848945+0000","last_peered":"2024-09-13T23:29:01.848945+0000","last_clean":"2024-09-13T23:29:01.848945+0000","last_became_active":"2024-09-13T23:25:23.302437+0000","last_became_peered":"2024-09-13T23:25:23.302437+0000","last_unstale":"2024-09-13T23:29:01.848945+0000","last_undegraded":"2024-09-13T23:29:01.848945+0000","last_fullsized":"2024-09-13T23:29:01.848945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T23:29:01.848809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.848809+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:59.151044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"33'4","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.562160+0000","last_change":"2024-09-13T23:29:09.562160+0000","last_active":"2024-09-13T23:29:09.562160+0000","last_peered":"2024-09-13T23:29:09.562160+0000","last_clean":"2024-09-13T23:29:09.562160+0000","last_became_active":"2024-09-13T23:25:15.290685+0000","last_became_peered":"2024-09-13T23:25:15.290685+0000","last_unstale":"2024-09-13T23:29:09.562160+0000","last_undegraded":"2024-09-13T23:29:09.562160+0000","last_fullsized":"2024-09-13T23:29:09.562160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:09.562025+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.562025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:49.934234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:40.165232+0000","last_change":"2024-09-13T23:29:40.165273+0000","last_active":"2024-09-13T23:29:40.165232+0000","last_peered":"2024-09-13T23:29:40.165232+0000","last_clean":"2024-09-13T23:29:40.165232+0000","last_became_active":"2024-09-13T23:25:13.279640+0000","last_became_peered":"2024-09-13T23:25:13.279640+0000","last_unstale":"2024-09-13T23:29:40.165232+0000","last_undegraded":"2024-09-13T23:29:40.165232+0000","last_fullsized":"2024-09-13T23:29:40.165232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:40.165135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:40.165135+0000","last_clean_scrub_stamp":"2024-09-13T23:29:40.165135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:59.047989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'5","reported_seq":429,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.183590+0000","last_change":"2024-09-13T23:28:49.183590+0000","last_active":"2024-09-13T23:28:49.183590+0000","last_peered":"2024-09-13T23:28:49.183590+0000","last_clean":"2024-09-13T23:28:49.183590+0000","last_became_active":"2024-09-13T23:25:17.288310+0000","last_became_peered":"2024-09-13T23:25:17.288310+0000","last_unstale":"2024-09-13T23:28:49.183590+0000","last_undegraded":"2024-09-13T23:28:49.183590+0000","last_fullsized":"2024-09-13T23:28:49.183590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:49.183478+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.183478+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:43:30.265049+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.395583+0000","last_change":"2024-09-13T23:29:04.395583+0000","last_active":"2024-09-13T23:29:04.395583+0000","last_peered":"2024-09-13T23:29:04.395583+0000","last_clean":"2024-09-13T23:29:04.395583+0000","last_became_active":"2024-09-13T23:25:19.297932+0000","last_became_peered":"2024-09-13T23:25:19.297932+0000","last_unstale":"2024-09-13T23:29:04.395583+0000","last_undegraded":"2024-09-13T23:29:04.395583+0000","last_fullsized":"2024-09-13T23:29:04.395583+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:04.395455+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.395455+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:53.348397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'285","reported_seq":481,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425723+0000","last_change":"2024-09-13T23:28:36.425723+0000","last_active":"2024-09-13T23:28:36.425723+0000","last_peered":"2024-09-13T23:28:36.425723+0000","last_clean":"2024-09-13T23:28:36.425723+0000","last_became_active":"2024-09-13T23:25:21.299212+0000","last_became_peered":"2024-09-13T23:25:21.299212+0000","last_unstale":"2024-09-13T23:28:36.425723+0000","last_undegraded":"2024-09-13T23:28:36.425723+0000","last_fullsized":"2024-09-13T23:28:36.425723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:36.425562+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.425562+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:53.620126+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.564601+0000","last_change":"2024-09-13T23:29:20.564601+0000","last_active":"2024-09-13T23:29:20.564601+0000","last_peered":"2024-09-13T23:29:20.564601+0000","last_clean":"2024-09-13T23:29:20.564601+0000","last_became_active":"2024-09-13T23:25:23.305488+0000","last_became_peered":"2024-09-13T23:25:23.305488+0000","last_unstale":"2024-09-13T23:29:20.564601+0000","last_undegraded":"2024-09-13T23:29:20.564601+0000","last_fullsized":"2024-09-13T23:29:20.564601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T23:29:20.564390+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.564390+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:39.971103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"33'4","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:01.185521+0000","last_change":"2024-09-13T23:29:01.185521+0000","last_active":"2024-09-13T23:29:01.185521+0000","last_peered":"2024-09-13T23:29:01.185521+0000","last_clean":"2024-09-13T23:29:01.185521+0000","last_became_active":"2024-09-13T23:25:15.295003+0000","last_became_peered":"2024-09-13T23:25:15.295003+0000","last_unstale":"2024-09-13T23:29:01.185521+0000","last_undegraded":"2024-09-13T23:29:01.185521+0000","last_fullsized":"2024-09-13T23:29:01.185521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:01.185393+0000","last_clean_scrub_stamp":"2024-09-13T23:29:01.185393+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:49.860619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:39.181740+0000","last_change":"2024-09-13T23:29:39.181798+0000","last_active":"2024-09-13T23:29:39.181740+0000","last_peered":"2024-09-13T23:29:39.181740+0000","last_clean":"2024-09-13T23:29:39.181740+0000","last_became_active":"2024-09-13T23:25:13.283852+0000","last_became_peered":"2024-09-13T23:25:13.283852+0000","last_unstale":"2024-09-13T23:29:39.181740+0000","last_undegraded":"2024-09-13T23:29:39.181740+0000","last_fullsized":"2024-09-13T23:29:39.181740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:39.181620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:39.181620+0000","last_clean_scrub_stamp":"2024-09-13T23:29:39.181620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.019308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.394345+0000","last_change":"2024-09-13T23:28:38.394345+0000","last_active":"2024-09-13T23:28:38.394345+0000","last_peered":"2024-09-13T23:28:38.394345+0000","last_clean":"2024-09-13T23:28:38.394345+0000","last_became_active":"2024-09-13T23:25:17.287542+0000","last_became_peered":"2024-09-13T23:25:17.287542+0000","last_unstale":"2024-09-13T23:28:38.394345+0000","last_undegraded":"2024-09-13T23:28:38.394345+0000","last_fullsized":"2024-09-13T23:28:38.394345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.394212+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.394212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:06:21.836246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"33'49","reported_seq":109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.343852+0000","last_change":"2024-09-13T23:28:44.343852+0000","last_active":"2024-09-13T23:28:44.343852+0000","last_peered":"2024-09-13T23:28:44.343852+0000","last_clean":"2024-09-13T23:28:44.343852+0000","last_became_active":"2024-09-13T23:25:19.291843+0000","last_became_peered":"2024-09-13T23:25:19.291843+0000","last_unstale":"2024-09-13T23:28:44.343852+0000","last_undegraded":"2024-09-13T23:28:44.343852+0000","last_fullsized":"2024-09-13T23:28:44.343852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'49","last_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_deep_scrub":"33'49","last_deep_scrub_stamp":"2024-09-13T23:28:44.343715+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.343715+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:41.109483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.818982+0000","last_change":"2024-09-13T23:28:41.818982+0000","last_active":"2024-09-13T23:28:41.818982+0000","last_peered":"2024-09-13T23:28:41.818982+0000","last_clean":"2024-09-13T23:28:41.818982+0000","last_became_active":"2024-09-13T23:25:21.307173+0000","last_became_peered":"2024-09-13T23:25:21.307173+0000","last_unstale":"2024-09-13T23:28:41.818982+0000","last_undegraded":"2024-09-13T23:28:41.818982+0000","last_fullsized":"2024-09-13T23:28:41.818982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.818869+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.818869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:39:47.767366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.308494+0000","last_change":"2024-09-13T23:28:46.308494+0000","last_active":"2024-09-13T23:28:46.308494+0000","last_peered":"2024-09-13T23:28:46.308494+0000","last_clean":"2024-09-13T23:28:46.308494+0000","last_became_active":"2024-09-13T23:25:23.303293+0000","last_became_peered":"2024-09-13T23:25:23.303293+0000","last_unstale":"2024-09-13T23:28:46.308494+0000","last_undegraded":"2024-09-13T23:28:46.308494+0000","last_fullsized":"2024-09-13T23:28:46.308494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:28:46.308315+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.308315+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:05.222355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.609157+0000","last_change":"2024-09-13T23:29:26.609157+0000","last_active":"2024-09-13T23:29:26.609157+0000","last_peered":"2024-09-13T23:29:26.609157+0000","last_clean":"2024-09-13T23:29:26.609157+0000","last_became_active":"2024-09-13T23:25:52.382891+0000","last_became_peered":"2024-09-13T23:25:52.382891+0000","last_unstale":"2024-09-13T23:29:26.609157+0000","last_undegraded":"2024-09-13T23:29:26.609157+0000","last_fullsized":"2024-09-13T23:29:26.609157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:26.609024+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.609024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:44.317023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":212,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.163503+0000","last_change":"2024-09-13T23:29:20.163541+0000","last_active":"2024-09-13T23:29:20.163503+0000","last_peered":"2024-09-13T23:29:20.163503+0000","last_clean":"2024-09-13T23:29:20.163503+0000","last_became_active":"2024-09-13T23:25:01.120733+0000","last_became_peered":"2024-09-13T23:25:01.120733+0000","last_unstale":"2024-09-13T23:29:20.163503+0000","last_undegraded":"2024-09-13T23:29:20.163503+0000","last_fullsized":"2024-09-13T23:29:20.163503+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T23:29:20.163405+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.163405+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:46.471149+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:46.090992+0000","last_change":"2024-09-13T23:29:46.091023+0000","last_active":"2024-09-13T23:29:46.090992+0000","last_peered":"2024-09-13T23:29:46.090992+0000","last_clean":"2024-09-13T23:29:46.090992+0000","last_became_active":"2024-09-13T23:25:04.407736+0000","last_became_peered":"2024-09-13T23:25:04.407736+0000","last_unstale":"2024-09-13T23:29:46.090992+0000","last_undegraded":"2024-09-13T23:29:46.090992+0000","last_fullsized":"2024-09-13T23:29:46.090992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:46.090900+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:46.090900+0000","last_clean_scrub_stamp":"2024-09-13T23:29:46.090900+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:13.244597+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0014480490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:36.198295+0000","last_change":"2024-09-13T23:29:36.198326+0000","last_active":"2024-09-13T23:29:36.198295+0000","last_peered":"2024-09-13T23:29:36.198295+0000","last_clean":"2024-09-13T23:29:36.198295+0000","last_became_active":"2024-09-13T23:25:13.280708+0000","last_became_peered":"2024-09-13T23:25:13.280708+0000","last_unstale":"2024-09-13T23:29:36.198295+0000","last_undegraded":"2024-09-13T23:29:36.198295+0000","last_fullsized":"2024-09-13T23:29:36.198295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:36.198192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:36.198192+0000","last_clean_scrub_stamp":"2024-09-13T23:29:36.198192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:03:51.372266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.221206+0000","last_change":"2024-09-13T23:28:53.221206+0000","last_active":"2024-09-13T23:28:53.221206+0000","last_peered":"2024-09-13T23:28:53.221206+0000","last_clean":"2024-09-13T23:28:53.221206+0000","last_became_active":"2024-09-13T23:25:17.285810+0000","last_became_peered":"2024-09-13T23:25:17.285810+0000","last_unstale":"2024-09-13T23:28:53.221206+0000","last_undegraded":"2024-09-13T23:28:53.221206+0000","last_fullsized":"2024-09-13T23:28:53.221206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.221045+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.221045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:28.166667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"33'92","reported_seq":183,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:06.357739+0000","last_change":"2024-09-13T23:29:06.357739+0000","last_active":"2024-09-13T23:29:06.357739+0000","last_peered":"2024-09-13T23:29:06.357739+0000","last_clean":"2024-09-13T23:29:06.357739+0000","last_became_active":"2024-09-13T23:25:19.297766+0000","last_became_peered":"2024-09-13T23:25:19.297766+0000","last_unstale":"2024-09-13T23:29:06.357739+0000","last_undegraded":"2024-09-13T23:29:06.357739+0000","last_fullsized":"2024-09-13T23:29:06.357739+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'92","last_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_deep_scrub":"33'92","last_deep_scrub_stamp":"2024-09-13T23:29:06.357608+0000","last_clean_scrub_stamp":"2024-09-13T23:29:06.357608+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:02.482328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.823673+0000","last_change":"2024-09-13T23:28:53.823673+0000","last_active":"2024-09-13T23:28:53.823673+0000","last_peered":"2024-09-13T23:28:53.823673+0000","last_clean":"2024-09-13T23:28:53.823673+0000","last_became_active":"2024-09-13T23:25:21.308342+0000","last_became_peered":"2024-09-13T23:25:21.308342+0000","last_unstale":"2024-09-13T23:28:53.823673+0000","last_undegraded":"2024-09-13T23:28:53.823673+0000","last_fullsized":"2024-09-13T23:28:53.823673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.823527+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.823527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:30.216256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"33'83","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.737380+0000","last_change":"2024-09-13T23:28:49.737380+0000","last_active":"2024-09-13T23:28:49.737380+0000","last_peered":"2024-09-13T23:28:49.737380+0000","last_clean":"2024-09-13T23:28:49.737380+0000","last_became_active":"2024-09-13T23:25:23.304093+0000","last_became_peered":"2024-09-13T23:25:23.304093+0000","last_unstale":"2024-09-13T23:28:49.737380+0000","last_undegraded":"2024-09-13T23:28:49.737380+0000","last_fullsized":"2024-09-13T23:28:49.737380+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'83","last_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_deep_scrub":"33'83","last_deep_scrub_stamp":"2024-09-13T23:28:49.737262+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.737262+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:19.374870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.227141+0000","last_change":"2024-09-13T23:29:19.227141+0000","last_active":"2024-09-13T23:29:19.227141+0000","last_peered":"2024-09-13T23:29:19.227141+0000","last_clean":"2024-09-13T23:29:19.227141+0000","last_became_active":"2024-09-13T23:25:15.278392+0000","last_became_peered":"2024-09-13T23:25:15.278392+0000","last_unstale":"2024-09-13T23:29:19.227141+0000","last_undegraded":"2024-09-13T23:29:19.227141+0000","last_fullsized":"2024-09-13T23:29:19.227141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:19.227009+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.227009+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:09.980858+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:43.091908+0000","last_change":"2024-09-13T23:29:43.091932+0000","last_active":"2024-09-13T23:29:43.091908+0000","last_peered":"2024-09-13T23:29:43.091908+0000","last_clean":"2024-09-13T23:29:43.091908+0000","last_became_active":"2024-09-13T23:25:04.405705+0000","last_became_peered":"2024-09-13T23:25:04.405705+0000","last_unstale":"2024-09-13T23:29:43.091908+0000","last_undegraded":"2024-09-13T23:29:43.091908+0000","last_fullsized":"2024-09-13T23:29:43.091908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:43.091818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:43.091818+0000","last_clean_scrub_stamp":"2024-09-13T23:29:43.091818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:33.568177+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041757099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.548895+0000","last_change":"2024-09-13T23:29:22.548895+0000","last_active":"2024-09-13T23:29:22.548895+0000","last_peered":"2024-09-13T23:29:22.548895+0000","last_clean":"2024-09-13T23:29:22.548895+0000","last_became_active":"2024-09-13T23:25:13.277559+0000","last_became_peered":"2024-09-13T23:25:13.277559+0000","last_unstale":"2024-09-13T23:29:22.548895+0000","last_undegraded":"2024-09-13T23:29:22.548895+0000","last_fullsized":"2024-09-13T23:29:22.548895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.548710+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.548710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:02.141054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.403471+0000","last_change":"2024-09-13T23:28:40.403471+0000","last_active":"2024-09-13T23:28:40.403471+0000","last_peered":"2024-09-13T23:28:40.403471+0000","last_clean":"2024-09-13T23:28:40.403471+0000","last_became_active":"2024-09-13T23:25:17.287594+0000","last_became_peered":"2024-09-13T23:25:17.287594+0000","last_unstale":"2024-09-13T23:28:40.403471+0000","last_undegraded":"2024-09-13T23:28:40.403471+0000","last_fullsized":"2024-09-13T23:28:40.403471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:40.403349+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.403349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:01.922817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"33'290","reported_seq":516,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.424100+0000","last_change":"2024-09-13T23:28:37.424100+0000","last_active":"2024-09-13T23:28:37.424100+0000","last_peered":"2024-09-13T23:28:37.424100+0000","last_clean":"2024-09-13T23:28:37.424100+0000","last_became_active":"2024-09-13T23:25:19.298899+0000","last_became_peered":"2024-09-13T23:25:19.298899+0000","last_unstale":"2024-09-13T23:28:37.424100+0000","last_undegraded":"2024-09-13T23:28:37.424100+0000","last_fullsized":"2024-09-13T23:28:37.424100+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'290","last_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_deep_scrub":"33'290","last_deep_scrub_stamp":"2024-09-13T23:28:37.423958+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.423958+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:06.509304+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.332791+0000","last_change":"2024-09-13T23:28:59.332791+0000","last_active":"2024-09-13T23:28:59.332791+0000","last_peered":"2024-09-13T23:28:59.332791+0000","last_clean":"2024-09-13T23:28:59.332791+0000","last_became_active":"2024-09-13T23:25:21.302278+0000","last_became_peered":"2024-09-13T23:25:21.302278+0000","last_unstale":"2024-09-13T23:28:59.332791+0000","last_undegraded":"2024-09-13T23:28:59.332791+0000","last_fullsized":"2024-09-13T23:28:59.332791+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.332635+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.332635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.559378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.257508+0000","last_change":"2024-09-13T23:28:54.257508+0000","last_active":"2024-09-13T23:28:54.257508+0000","last_peered":"2024-09-13T23:28:54.257508+0000","last_clean":"2024-09-13T23:28:54.257508+0000","last_became_active":"2024-09-13T23:25:23.307919+0000","last_became_peered":"2024-09-13T23:25:23.307919+0000","last_unstale":"2024-09-13T23:28:54.257508+0000","last_undegraded":"2024-09-13T23:28:54.257508+0000","last_fullsized":"2024-09-13T23:28:54.257508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:54.257339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.257339+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:29:02.842442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"33'8","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.870912+0000","last_change":"2024-09-13T23:29:00.870912+0000","last_active":"2024-09-13T23:29:00.870912+0000","last_peered":"2024-09-13T23:29:00.870912+0000","last_clean":"2024-09-13T23:29:00.870912+0000","last_became_active":"2024-09-13T23:25:15.284399+0000","last_became_peered":"2024-09-13T23:25:15.284399+0000","last_unstale":"2024-09-13T23:29:00.870912+0000","last_undegraded":"2024-09-13T23:29:00.870912+0000","last_fullsized":"2024-09-13T23:29:00.870912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:00.870738+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.870738+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:34.532435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.571870+0000","last_change":"2024-09-13T23:29:11.571870+0000","last_active":"2024-09-13T23:29:11.571870+0000","last_peered":"2024-09-13T23:29:11.571870+0000","last_clean":"2024-09-13T23:29:11.571870+0000","last_became_active":"2024-09-13T23:25:04.406949+0000","last_became_peered":"2024-09-13T23:25:04.406949+0000","last_unstale":"2024-09-13T23:29:11.571870+0000","last_undegraded":"2024-09-13T23:29:11.571870+0000","last_fullsized":"2024-09-13T23:29:11.571870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:11.571739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.571739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:19:44.142918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000379031,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'4","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.914793+0000","last_change":"2024-09-13T23:29:04.914793+0000","last_active":"2024-09-13T23:29:04.914793+0000","last_peered":"2024-09-13T23:29:04.914793+0000","last_clean":"2024-09-13T23:29:04.914793+0000","last_became_active":"2024-09-13T23:25:13.287586+0000","last_became_peered":"2024-09-13T23:25:13.287586+0000","last_unstale":"2024-09-13T23:29:04.914793+0000","last_undegraded":"2024-09-13T23:29:04.914793+0000","last_fullsized":"2024-09-13T23:29:04.914793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.914680+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.914680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:41.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"33'4","reported_seq":233,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.702609+0000","last_change":"2024-09-13T23:28:51.702609+0000","last_active":"2024-09-13T23:28:51.702609+0000","last_peered":"2024-09-13T23:28:51.702609+0000","last_clean":"2024-09-13T23:28:51.702609+0000","last_became_active":"2024-09-13T23:25:17.282155+0000","last_became_peered":"2024-09-13T23:25:17.282155+0000","last_unstale":"2024-09-13T23:28:51.702609+0000","last_undegraded":"2024-09-13T23:28:51.702609+0000","last_fullsized":"2024-09-13T23:28:51.702609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.702483+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.702483+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:52.157557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"33'24","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.806174+0000","last_change":"2024-09-13T23:28:39.806174+0000","last_active":"2024-09-13T23:28:39.806174+0000","last_peered":"2024-09-13T23:28:39.806174+0000","last_clean":"2024-09-13T23:28:39.806174+0000","last_became_active":"2024-09-13T23:25:19.293100+0000","last_became_peered":"2024-09-13T23:25:19.293100+0000","last_unstale":"2024-09-13T23:28:39.806174+0000","last_undegraded":"2024-09-13T23:28:39.806174+0000","last_fullsized":"2024-09-13T23:28:39.806174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T23:28:39.806026+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.806026+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:12:51.713911+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.882546+0000","last_change":"2024-09-13T23:28:33.882546+0000","last_active":"2024-09-13T23:28:33.882546+0000","last_peered":"2024-09-13T23:28:33.882546+0000","last_clean":"2024-09-13T23:28:33.882546+0000","last_became_active":"2024-09-13T23:25:21.302088+0000","last_became_peered":"2024-09-13T23:25:21.302088+0000","last_unstale":"2024-09-13T23:28:33.882546+0000","last_undegraded":"2024-09-13T23:28:33.882546+0000","last_fullsized":"2024-09-13T23:28:33.882546+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:33.882409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.882409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:51.076973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.334740+0000","last_change":"2024-09-13T23:29:13.334740+0000","last_active":"2024-09-13T23:29:13.334740+0000","last_peered":"2024-09-13T23:29:13.334740+0000","last_clean":"2024-09-13T23:29:13.334740+0000","last_became_active":"2024-09-13T23:25:23.311464+0000","last_became_peered":"2024-09-13T23:25:23.311464+0000","last_unstale":"2024-09-13T23:29:13.334740+0000","last_undegraded":"2024-09-13T23:29:13.334740+0000","last_fullsized":"2024-09-13T23:29:13.334740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.334630+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.334630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:20:41.331396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.809935+0000","last_change":"2024-09-13T23:29:13.809935+0000","last_active":"2024-09-13T23:29:13.809935+0000","last_peered":"2024-09-13T23:29:13.809935+0000","last_clean":"2024-09-13T23:29:13.809935+0000","last_became_active":"2024-09-13T23:25:15.283865+0000","last_became_peered":"2024-09-13T23:25:15.283865+0000","last_unstale":"2024-09-13T23:29:13.809935+0000","last_undegraded":"2024-09-13T23:29:13.809935+0000","last_fullsized":"2024-09-13T23:29:13.809935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:13.809798+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.809798+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:47:31.517797+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:45.085055+0000","last_change":"2024-09-13T23:29:45.085106+0000","last_active":"2024-09-13T23:29:45.085055+0000","last_peered":"2024-09-13T23:29:45.085055+0000","last_clean":"2024-09-13T23:29:45.085055+0000","last_became_active":"2024-09-13T23:25:04.407207+0000","last_became_peered":"2024-09-13T23:25:04.407207+0000","last_unstale":"2024-09-13T23:29:45.085055+0000","last_undegraded":"2024-09-13T23:29:45.085055+0000","last_fullsized":"2024-09-13T23:29:45.085055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:45.084957+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:45.084957+0000","last_clean_scrub_stamp":"2024-09-13T23:29:45.084957+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:07.113680+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001119585,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.573654+0000","last_change":"2024-09-13T23:29:14.573654+0000","last_active":"2024-09-13T23:29:14.573654+0000","last_peered":"2024-09-13T23:29:14.573654+0000","last_clean":"2024-09-13T23:29:14.573654+0000","last_became_active":"2024-09-13T23:25:13.275169+0000","last_became_peered":"2024-09-13T23:25:13.275169+0000","last_unstale":"2024-09-13T23:29:14.573654+0000","last_undegraded":"2024-09-13T23:29:14.573654+0000","last_fullsized":"2024-09-13T23:29:14.573654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:14.573539+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.573539+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:50:03.633104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":30,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.851664+0000","last_change":"2024-09-13T23:28:55.851664+0000","last_active":"2024-09-13T23:28:55.851664+0000","last_peered":"2024-09-13T23:28:55.851664+0000","last_clean":"2024-09-13T23:28:55.851664+0000","last_became_active":"2024-09-13T23:25:17.285170+0000","last_became_peered":"2024-09-13T23:25:17.285170+0000","last_unstale":"2024-09-13T23:28:55.851664+0000","last_undegraded":"2024-09-13T23:28:55.851664+0000","last_fullsized":"2024-09-13T23:28:55.851664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.851536+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.851536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:29.407551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"33'20","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.436815+0000","last_change":"2024-09-13T23:28:39.436815+0000","last_active":"2024-09-13T23:28:39.436815+0000","last_peered":"2024-09-13T23:28:39.436815+0000","last_clean":"2024-09-13T23:28:39.436815+0000","last_became_active":"2024-09-13T23:25:19.293916+0000","last_became_peered":"2024-09-13T23:25:19.293916+0000","last_unstale":"2024-09-13T23:28:39.436815+0000","last_undegraded":"2024-09-13T23:28:39.436815+0000","last_fullsized":"2024-09-13T23:28:39.436815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T23:28:39.436619+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.436619+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:23.975861+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.387757+0000","last_change":"2024-09-13T23:29:05.387757+0000","last_active":"2024-09-13T23:29:05.387757+0000","last_peered":"2024-09-13T23:29:05.387757+0000","last_clean":"2024-09-13T23:29:05.387757+0000","last_became_active":"2024-09-13T23:25:21.307694+0000","last_became_peered":"2024-09-13T23:25:21.307694+0000","last_unstale":"2024-09-13T23:29:05.387757+0000","last_undegraded":"2024-09-13T23:29:05.387757+0000","last_fullsized":"2024-09-13T23:29:05.387757+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.387595+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.387595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:27.332966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.209565+0000","last_change":"2024-09-13T23:29:02.209565+0000","last_active":"2024-09-13T23:29:02.209565+0000","last_peered":"2024-09-13T23:29:02.209565+0000","last_clean":"2024-09-13T23:29:02.209565+0000","last_became_active":"2024-09-13T23:25:23.314145+0000","last_became_peered":"2024-09-13T23:25:23.314145+0000","last_unstale":"2024-09-13T23:29:02.209565+0000","last_undegraded":"2024-09-13T23:29:02.209565+0000","last_fullsized":"2024-09-13T23:29:02.209565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.209446+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.209446+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:20.762436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.243922+0000","last_change":"2024-09-13T23:29:03.243922+0000","last_active":"2024-09-13T23:29:03.243922+0000","last_peered":"2024-09-13T23:29:03.243922+0000","last_clean":"2024-09-13T23:29:03.243922+0000","last_became_active":"2024-09-13T23:25:15.294807+0000","last_became_peered":"2024-09-13T23:25:15.294807+0000","last_unstale":"2024-09-13T23:29:03.243922+0000","last_undegraded":"2024-09-13T23:29:03.243922+0000","last_fullsized":"2024-09-13T23:29:03.243922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:03.243808+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.243808+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:56.628747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.531080+0000","last_change":"2024-09-13T23:29:15.531080+0000","last_active":"2024-09-13T23:29:15.531080+0000","last_peered":"2024-09-13T23:29:15.531080+0000","last_clean":"2024-09-13T23:29:15.531080+0000","last_became_active":"2024-09-13T23:25:13.275192+0000","last_became_peered":"2024-09-13T23:25:13.275192+0000","last_unstale":"2024-09-13T23:29:15.531080+0000","last_undegraded":"2024-09-13T23:29:15.531080+0000","last_fullsized":"2024-09-13T23:29:15.531080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:15.530856+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.530856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:21:05.204799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:20.643519+0000","last_change":"2024-09-13T23:29:20.643550+0000","last_active":"2024-09-13T23:29:20.643519+0000","last_peered":"2024-09-13T23:29:20.643519+0000","last_clean":"2024-09-13T23:29:20.643519+0000","last_became_active":"2024-09-13T23:25:04.407473+0000","last_became_peered":"2024-09-13T23:25:04.407473+0000","last_unstale":"2024-09-13T23:29:20.643519+0000","last_undegraded":"2024-09-13T23:29:20.643519+0000","last_fullsized":"2024-09-13T23:29:20.643519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:20.643435+0000","last_clean_scrub_stamp":"2024-09-13T23:29:20.643435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:53.234522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059406400000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"33'2","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.874110+0000","last_change":"2024-09-13T23:28:56.874110+0000","last_active":"2024-09-13T23:28:56.874110+0000","last_peered":"2024-09-13T23:28:56.874110+0000","last_clean":"2024-09-13T23:28:56.874110+0000","last_became_active":"2024-09-13T23:25:17.285021+0000","last_became_peered":"2024-09-13T23:25:17.285021+0000","last_unstale":"2024-09-13T23:28:56.874110+0000","last_undegraded":"2024-09-13T23:28:56.874110+0000","last_fullsized":"2024-09-13T23:28:56.874110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:28:56.873926+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.873926+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:08.273545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"33'75","reported_seq":152,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:39.871262+0000","last_change":"2024-09-13T23:28:39.871262+0000","last_active":"2024-09-13T23:28:39.871262+0000","last_peered":"2024-09-13T23:28:39.871262+0000","last_clean":"2024-09-13T23:28:39.871262+0000","last_became_active":"2024-09-13T23:25:19.298167+0000","last_became_peered":"2024-09-13T23:25:19.298167+0000","last_unstale":"2024-09-13T23:28:39.871262+0000","last_undegraded":"2024-09-13T23:28:39.871262+0000","last_fullsized":"2024-09-13T23:28:39.871262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'75","last_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_deep_scrub":"33'75","last_deep_scrub_stamp":"2024-09-13T23:28:39.871135+0000","last_clean_scrub_stamp":"2024-09-13T23:28:39.871135+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:25:40.326209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":77,"num_read_kb":83,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.710245+0000","last_change":"2024-09-13T23:28:34.710245+0000","last_active":"2024-09-13T23:28:34.710245+0000","last_peered":"2024-09-13T23:28:34.710245+0000","last_clean":"2024-09-13T23:28:34.710245+0000","last_became_active":"2024-09-13T23:25:21.301340+0000","last_became_peered":"2024-09-13T23:25:21.301340+0000","last_unstale":"2024-09-13T23:28:34.710245+0000","last_undegraded":"2024-09-13T23:28:34.710245+0000","last_fullsized":"2024-09-13T23:28:34.710245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:34.710073+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.710073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:56:54.079159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"33'9","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.581999+0000","last_change":"2024-09-13T23:29:32.581999+0000","last_active":"2024-09-13T23:29:32.581999+0000","last_peered":"2024-09-13T23:29:32.581999+0000","last_clean":"2024-09-13T23:29:32.581999+0000","last_became_active":"2024-09-13T23:25:23.307873+0000","last_became_peered":"2024-09-13T23:25:23.307873+0000","last_unstale":"2024-09-13T23:29:32.581999+0000","last_undegraded":"2024-09-13T23:29:32.581999+0000","last_fullsized":"2024-09-13T23:29:32.581999+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:29:32.581809+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:29:32.581809+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.581809+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:05:01.348395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"33'4","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.241484+0000","last_change":"2024-09-13T23:29:32.241520+0000","last_active":"2024-09-13T23:29:32.241484+0000","last_peered":"2024-09-13T23:29:32.241484+0000","last_clean":"2024-09-13T23:29:32.241484+0000","last_became_active":"2024-09-13T23:25:52.380733+0000","last_became_peered":"2024-09-13T23:25:52.380733+0000","last_unstale":"2024-09-13T23:29:32.241484+0000","last_undegraded":"2024-09-13T23:29:32.241484+0000","last_fullsized":"2024-09-13T23:29:32.241484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:32.241399+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.241399+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:22.020934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.766210+0000","last_change":"2024-09-13T23:29:14.766210+0000","last_active":"2024-09-13T23:29:14.766210+0000","last_peered":"2024-09-13T23:29:14.766210+0000","last_clean":"2024-09-13T23:29:14.766210+0000","last_became_active":"2024-09-13T23:25:13.280089+0000","last_became_peered":"2024-09-13T23:25:13.280089+0000","last_unstale":"2024-09-13T23:29:14.766210+0000","last_undegraded":"2024-09-13T23:29:14.766210+0000","last_fullsized":"2024-09-13T23:29:14.766210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:14.766103+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.766103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:57.073467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:44.093325+0000","last_change":"2024-09-13T23:29:44.093350+0000","last_active":"2024-09-13T23:29:44.093325+0000","last_peered":"2024-09-13T23:29:44.093325+0000","last_clean":"2024-09-13T23:29:44.093325+0000","last_became_active":"2024-09-13T23:25:04.407027+0000","last_became_peered":"2024-09-13T23:25:04.407027+0000","last_unstale":"2024-09-13T23:29:44.093325+0000","last_undegraded":"2024-09-13T23:29:44.093325+0000","last_fullsized":"2024-09-13T23:29:44.093325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:44.093199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:44.093199+0000","last_clean_scrub_stamp":"2024-09-13T23:29:44.093199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:44:55.641065+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00041499700000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.414539+0000","last_change":"2024-09-13T23:28:43.414539+0000","last_active":"2024-09-13T23:28:43.414539+0000","last_peered":"2024-09-13T23:28:43.414539+0000","last_clean":"2024-09-13T23:28:43.414539+0000","last_became_active":"2024-09-13T23:25:17.286766+0000","last_became_peered":"2024-09-13T23:25:17.286766+0000","last_unstale":"2024-09-13T23:28:43.414539+0000","last_undegraded":"2024-09-13T23:28:43.414539+0000","last_fullsized":"2024-09-13T23:28:43.414539+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:43.414417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.414417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:10.088043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"33'21","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.380370+0000","last_change":"2024-09-13T23:28:41.380370+0000","last_active":"2024-09-13T23:28:41.380370+0000","last_peered":"2024-09-13T23:28:41.380370+0000","last_clean":"2024-09-13T23:28:41.380370+0000","last_became_active":"2024-09-13T23:25:19.294079+0000","last_became_peered":"2024-09-13T23:25:19.294079+0000","last_unstale":"2024-09-13T23:28:41.380370+0000","last_undegraded":"2024-09-13T23:28:41.380370+0000","last_fullsized":"2024-09-13T23:28:41.380370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'21","last_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_deep_scrub":"33'21","last_deep_scrub_stamp":"2024-09-13T23:28:41.380224+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.380224+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:00.663439+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'285","reported_seq":382,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:33.460537+0000","last_change":"2024-09-13T23:28:33.460537+0000","last_active":"2024-09-13T23:28:33.460537+0000","last_peered":"2024-09-13T23:28:33.460537+0000","last_clean":"2024-09-13T23:28:33.460537+0000","last_became_active":"2024-09-13T23:25:21.300462+0000","last_became_peered":"2024-09-13T23:25:21.300462+0000","last_unstale":"2024-09-13T23:28:33.460537+0000","last_undegraded":"2024-09-13T23:28:33.460537+0000","last_fullsized":"2024-09-13T23:28:33.460537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:33.460417+0000","last_clean_scrub_stamp":"2024-09-13T23:28:33.460417+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:15.571224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.402665+0000","last_change":"2024-09-13T23:29:09.402665+0000","last_active":"2024-09-13T23:29:09.402665+0000","last_peered":"2024-09-13T23:29:09.402665+0000","last_clean":"2024-09-13T23:29:09.402665+0000","last_became_active":"2024-09-13T23:25:23.310930+0000","last_became_peered":"2024-09-13T23:25:23.310930+0000","last_unstale":"2024-09-13T23:29:09.402665+0000","last_undegraded":"2024-09-13T23:29:09.402665+0000","last_fullsized":"2024-09-13T23:29:09.402665+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:09.402546+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.402546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:31:24.217280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"33'9","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:50.425285+0000","last_change":"2024-09-13T23:28:50.425285+0000","last_active":"2024-09-13T23:28:50.425285+0000","last_peered":"2024-09-13T23:28:50.425285+0000","last_clean":"2024-09-13T23:28:50.425285+0000","last_became_active":"2024-09-13T23:25:15.290425+0000","last_became_peered":"2024-09-13T23:25:15.290425+0000","last_unstale":"2024-09-13T23:28:50.425285+0000","last_undegraded":"2024-09-13T23:28:50.425285+0000","last_fullsized":"2024-09-13T23:28:50.425285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T23:28:50.425164+0000","last_clean_scrub_stamp":"2024-09-13T23:28:50.425164+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:45:33.299011+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:50.062602+0000","last_change":"2024-09-13T23:29:50.062631+0000","last_active":"2024-09-13T23:29:50.062602+0000","last_peered":"2024-09-13T23:29:50.062602+0000","last_clean":"2024-09-13T23:29:50.062602+0000","last_became_active":"2024-09-13T23:25:13.278788+0000","last_became_peered":"2024-09-13T23:25:13.278788+0000","last_unstale":"2024-09-13T23:29:50.062602+0000","last_undegraded":"2024-09-13T23:29:50.062602+0000","last_fullsized":"2024-09-13T23:29:50.062602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:50.062492+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:50.062492+0000","last_clean_scrub_stamp":"2024-09-13T23:29:50.062492+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:02.942468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.649065+0000","last_change":"2024-09-13T23:29:19.649065+0000","last_active":"2024-09-13T23:29:19.649065+0000","last_peered":"2024-09-13T23:29:19.649065+0000","last_clean":"2024-09-13T23:29:19.649065+0000","last_became_active":"2024-09-13T23:25:04.407258+0000","last_became_peered":"2024-09-13T23:25:04.407258+0000","last_unstale":"2024-09-13T23:29:19.649065+0000","last_undegraded":"2024-09-13T23:29:19.649065+0000","last_fullsized":"2024-09-13T23:29:19.649065+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.648941+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.648941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:56.406515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00061058200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:56.897654+0000","last_change":"2024-09-13T23:29:56.897679+0000","last_active":"2024-09-13T23:29:56.897654+0000","last_peered":"2024-09-13T23:29:56.897654+0000","last_clean":"2024-09-13T23:29:56.897654+0000","last_became_active":"2024-09-13T23:25:52.384835+0000","last_became_peered":"2024-09-13T23:25:52.384835+0000","last_unstale":"2024-09-13T23:29:56.897654+0000","last_undegraded":"2024-09-13T23:29:56.897654+0000","last_fullsized":"2024-09-13T23:29:56.897654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:56.897553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:56.897553+0000","last_clean_scrub_stamp":"2024-09-13T23:29:56.897553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:00.867056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:49.381242+0000","last_change":"2024-09-13T23:28:49.381242+0000","last_active":"2024-09-13T23:28:49.381242+0000","last_peered":"2024-09-13T23:28:49.381242+0000","last_clean":"2024-09-13T23:28:49.381242+0000","last_became_active":"2024-09-13T23:25:19.295364+0000","last_became_peered":"2024-09-13T23:25:19.295364+0000","last_unstale":"2024-09-13T23:28:49.381242+0000","last_undegraded":"2024-09-13T23:28:49.381242+0000","last_fullsized":"2024-09-13T23:28:49.381242+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:49.381105+0000","last_clean_scrub_stamp":"2024-09-13T23:28:49.381105+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:20.463802+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"33'285","reported_seq":412,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.879400+0000","last_change":"2024-09-13T23:28:38.879400+0000","last_active":"2024-09-13T23:28:38.879400+0000","last_peered":"2024-09-13T23:28:38.879400+0000","last_clean":"2024-09-13T23:28:38.879400+0000","last_became_active":"2024-09-13T23:25:21.300362+0000","last_became_peered":"2024-09-13T23:25:21.300362+0000","last_unstale":"2024-09-13T23:28:38.879400+0000","last_undegraded":"2024-09-13T23:28:38.879400+0000","last_fullsized":"2024-09-13T23:28:38.879400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:38.879232+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.879232+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:58.162447+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"33'5","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:31.197573+0000","last_change":"2024-09-13T23:29:31.197573+0000","last_active":"2024-09-13T23:29:31.197573+0000","last_peered":"2024-09-13T23:29:31.197573+0000","last_clean":"2024-09-13T23:29:31.197573+0000","last_became_active":"2024-09-13T23:25:23.315810+0000","last_became_peered":"2024-09-13T23:25:23.315810+0000","last_unstale":"2024-09-13T23:29:31.197573+0000","last_undegraded":"2024-09-13T23:29:31.197573+0000","last_fullsized":"2024-09-13T23:29:31.197573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:31.197417+0000","last_clean_scrub_stamp":"2024-09-13T23:29:31.197417+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:59:14.373909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":15,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.601069+0000","last_change":"2024-09-13T23:29:07.601069+0000","last_active":"2024-09-13T23:29:07.601069+0000","last_peered":"2024-09-13T23:29:07.601069+0000","last_clean":"2024-09-13T23:29:07.601069+0000","last_became_active":"2024-09-13T23:25:15.289540+0000","last_became_peered":"2024-09-13T23:25:15.289540+0000","last_unstale":"2024-09-13T23:29:07.601069+0000","last_undegraded":"2024-09-13T23:29:07.601069+0000","last_fullsized":"2024-09-13T23:29:07.601069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:07.600916+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.600916+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:18:00.086515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.266733+0000","last_change":"2024-09-13T23:29:24.266733+0000","last_active":"2024-09-13T23:29:24.266733+0000","last_peered":"2024-09-13T23:29:24.266733+0000","last_clean":"2024-09-13T23:29:24.266733+0000","last_became_active":"2024-09-13T23:25:13.278046+0000","last_became_peered":"2024-09-13T23:25:13.278046+0000","last_unstale":"2024-09-13T23:29:24.266733+0000","last_undegraded":"2024-09-13T23:29:24.266733+0000","last_fullsized":"2024-09-13T23:29:24.266733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:24.266619+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.266619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:10.896215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:47.105618+0000","last_change":"2024-09-13T23:29:47.105653+0000","last_active":"2024-09-13T23:29:47.105618+0000","last_peered":"2024-09-13T23:29:47.105618+0000","last_clean":"2024-09-13T23:29:47.105618+0000","last_became_active":"2024-09-13T23:25:04.744778+0000","last_became_peered":"2024-09-13T23:25:04.744778+0000","last_unstale":"2024-09-13T23:29:47.105618+0000","last_undegraded":"2024-09-13T23:29:47.105618+0000","last_fullsized":"2024-09-13T23:29:47.105618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:47.105535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:47.105535+0000","last_clean_scrub_stamp":"2024-09-13T23:29:47.105535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:52.136676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001195453,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:57.935462+0000","last_change":"2024-09-13T23:29:57.935505+0000","last_active":"2024-09-13T23:29:57.935462+0000","last_peered":"2024-09-13T23:29:57.935462+0000","last_clean":"2024-09-13T23:29:57.935462+0000","last_became_active":"2024-09-13T23:25:52.384985+0000","last_became_peered":"2024-09-13T23:25:52.384985+0000","last_unstale":"2024-09-13T23:29:57.935462+0000","last_undegraded":"2024-09-13T23:29:57.935462+0000","last_fullsized":"2024-09-13T23:29:57.935462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:57.935350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:57.935350+0000","last_clean_scrub_stamp":"2024-09-13T23:29:57.935350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:19.093951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"33'97","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.843531+0000","last_change":"2024-09-13T23:28:40.843531+0000","last_active":"2024-09-13T23:28:40.843531+0000","last_peered":"2024-09-13T23:28:40.843531+0000","last_clean":"2024-09-13T23:28:40.843531+0000","last_became_active":"2024-09-13T23:25:19.289578+0000","last_became_peered":"2024-09-13T23:25:19.289578+0000","last_unstale":"2024-09-13T23:28:40.843531+0000","last_undegraded":"2024-09-13T23:28:40.843531+0000","last_fullsized":"2024-09-13T23:28:40.843531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'97","last_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_deep_scrub":"33'97","last_deep_scrub_stamp":"2024-09-13T23:28:40.843409+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.843409+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:25.282723+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:32.906383+0000","last_change":"2024-09-13T23:28:32.906383+0000","last_active":"2024-09-13T23:28:32.906383+0000","last_peered":"2024-09-13T23:28:32.906383+0000","last_clean":"2024-09-13T23:28:32.906383+0000","last_became_active":"2024-09-13T23:25:21.301359+0000","last_became_peered":"2024-09-13T23:25:21.301359+0000","last_unstale":"2024-09-13T23:28:32.906383+0000","last_undegraded":"2024-09-13T23:28:32.906383+0000","last_fullsized":"2024-09-13T23:28:32.906383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:32.906287+0000","last_clean_scrub_stamp":"2024-09-13T23:28:32.906287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:02.563197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:53.690642+0000","last_change":"2024-09-13T23:28:53.690642+0000","last_active":"2024-09-13T23:28:53.690642+0000","last_peered":"2024-09-13T23:28:53.690642+0000","last_clean":"2024-09-13T23:28:53.690642+0000","last_became_active":"2024-09-13T23:25:23.305285+0000","last_became_peered":"2024-09-13T23:25:23.305285+0000","last_unstale":"2024-09-13T23:28:53.690642+0000","last_undegraded":"2024-09-13T23:28:53.690642+0000","last_fullsized":"2024-09-13T23:28:53.690642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:53.690487+0000","last_clean_scrub_stamp":"2024-09-13T23:28:53.690487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:50.456254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.602393+0000","last_change":"2024-09-13T23:29:22.602393+0000","last_active":"2024-09-13T23:29:22.602393+0000","last_peered":"2024-09-13T23:29:22.602393+0000","last_clean":"2024-09-13T23:29:22.602393+0000","last_became_active":"2024-09-13T23:25:23.311233+0000","last_became_peered":"2024-09-13T23:25:23.311233+0000","last_unstale":"2024-09-13T23:29:22.602393+0000","last_undegraded":"2024-09-13T23:29:22.602393+0000","last_fullsized":"2024-09-13T23:29:22.602393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:22.602254+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.602254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:43:11.951905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"33'14","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.572440+0000","last_change":"2024-09-13T23:29:05.572440+0000","last_active":"2024-09-13T23:29:05.572440+0000","last_peered":"2024-09-13T23:29:05.572440+0000","last_clean":"2024-09-13T23:29:05.572440+0000","last_became_active":"2024-09-13T23:25:15.289319+0000","last_became_peered":"2024-09-13T23:25:15.289319+0000","last_unstale":"2024-09-13T23:29:05.572440+0000","last_undegraded":"2024-09-13T23:29:05.572440+0000","last_fullsized":"2024-09-13T23:29:05.572440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:05.572289+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.572289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:29.963092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.184485+0000","last_change":"2024-09-13T23:29:34.184485+0000","last_active":"2024-09-13T23:29:34.184485+0000","last_peered":"2024-09-13T23:29:34.184485+0000","last_clean":"2024-09-13T23:29:34.184485+0000","last_became_active":"2024-09-13T23:25:13.280532+0000","last_became_peered":"2024-09-13T23:25:13.280532+0000","last_unstale":"2024-09-13T23:29:34.184485+0000","last_undegraded":"2024-09-13T23:29:34.184485+0000","last_fullsized":"2024-09-13T23:29:34.184485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:34.184356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:34.184356+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.184356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:19.682114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.206296+0000","last_change":"2024-09-13T23:28:51.206296+0000","last_active":"2024-09-13T23:28:51.206296+0000","last_peered":"2024-09-13T23:28:51.206296+0000","last_clean":"2024-09-13T23:28:51.206296+0000","last_became_active":"2024-09-13T23:25:17.285396+0000","last_became_peered":"2024-09-13T23:25:17.285396+0000","last_unstale":"2024-09-13T23:28:51.206296+0000","last_undegraded":"2024-09-13T23:28:51.206296+0000","last_fullsized":"2024-09-13T23:28:51.206296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:51.206161+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.206161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:55.123436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"33'40","reported_seq":97,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.380714+0000","last_change":"2024-09-13T23:29:03.380714+0000","last_active":"2024-09-13T23:29:03.380714+0000","last_peered":"2024-09-13T23:29:03.380714+0000","last_clean":"2024-09-13T23:29:03.380714+0000","last_became_active":"2024-09-13T23:25:19.297611+0000","last_became_peered":"2024-09-13T23:25:19.297611+0000","last_unstale":"2024-09-13T23:29:03.380714+0000","last_undegraded":"2024-09-13T23:29:03.380714+0000","last_fullsized":"2024-09-13T23:29:03.380714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T23:29:03.380585+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.380585+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:49:23.091624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.323501+0000","last_change":"2024-09-13T23:28:55.323501+0000","last_active":"2024-09-13T23:28:55.323501+0000","last_peered":"2024-09-13T23:28:55.323501+0000","last_clean":"2024-09-13T23:28:55.323501+0000","last_became_active":"2024-09-13T23:25:21.306097+0000","last_became_peered":"2024-09-13T23:25:21.306097+0000","last_unstale":"2024-09-13T23:28:55.323501+0000","last_undegraded":"2024-09-13T23:28:55.323501+0000","last_fullsized":"2024-09-13T23:28:55.323501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.323390+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.323390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:10:04.775704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:33.588269+0000","last_change":"2024-09-13T23:29:33.588311+0000","last_active":"2024-09-13T23:29:33.588269+0000","last_peered":"2024-09-13T23:29:33.588269+0000","last_clean":"2024-09-13T23:29:33.588269+0000","last_became_active":"2024-09-13T23:25:23.311096+0000","last_became_peered":"2024-09-13T23:25:23.311096+0000","last_unstale":"2024-09-13T23:29:33.588269+0000","last_undegraded":"2024-09-13T23:29:33.588269+0000","last_fullsized":"2024-09-13T23:29:33.588269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:33.588179+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:33.588179+0000","last_clean_scrub_stamp":"2024-09-13T23:29:33.588179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:38.532728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"33'10","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.129114+0000","last_change":"2024-09-13T23:29:18.129114+0000","last_active":"2024-09-13T23:29:18.129114+0000","last_peered":"2024-09-13T23:29:18.129114+0000","last_clean":"2024-09-13T23:29:18.129114+0000","last_became_active":"2024-09-13T23:25:15.291015+0000","last_became_peered":"2024-09-13T23:25:15.291015+0000","last_unstale":"2024-09-13T23:29:18.129114+0000","last_undegraded":"2024-09-13T23:29:18.129114+0000","last_fullsized":"2024-09-13T23:29:18.129114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:29:18.128983+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.128983+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:08:24.896547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.534760+0000","last_change":"2024-09-13T23:29:02.534760+0000","last_active":"2024-09-13T23:29:02.534760+0000","last_peered":"2024-09-13T23:29:02.534760+0000","last_clean":"2024-09-13T23:29:02.534760+0000","last_became_active":"2024-09-13T23:25:13.287529+0000","last_became_peered":"2024-09-13T23:25:13.287529+0000","last_unstale":"2024-09-13T23:29:02.534760+0000","last_undegraded":"2024-09-13T23:29:02.534760+0000","last_fullsized":"2024-09-13T23:29:02.534760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:02.534643+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.534643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:18:37.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.419595+0000","last_change":"2024-09-13T23:28:44.419595+0000","last_active":"2024-09-13T23:28:44.419595+0000","last_peered":"2024-09-13T23:28:44.419595+0000","last_clean":"2024-09-13T23:28:44.419595+0000","last_became_active":"2024-09-13T23:25:17.286753+0000","last_became_peered":"2024-09-13T23:25:17.286753+0000","last_unstale":"2024-09-13T23:28:44.419595+0000","last_undegraded":"2024-09-13T23:28:44.419595+0000","last_fullsized":"2024-09-13T23:28:44.419595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:44.419451+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.419451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:28.949382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:44.882276+0000","last_change":"2024-09-13T23:28:44.882276+0000","last_active":"2024-09-13T23:28:44.882276+0000","last_peered":"2024-09-13T23:28:44.882276+0000","last_clean":"2024-09-13T23:28:44.882276+0000","last_became_active":"2024-09-13T23:25:19.290238+0000","last_became_peered":"2024-09-13T23:25:19.290238+0000","last_unstale":"2024-09-13T23:28:44.882276+0000","last_undegraded":"2024-09-13T23:28:44.882276+0000","last_fullsized":"2024-09-13T23:28:44.882276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:44.882155+0000","last_clean_scrub_stamp":"2024-09-13T23:28:44.882155+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:22.157762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.771011+0000","last_change":"2024-09-13T23:28:45.771011+0000","last_active":"2024-09-13T23:28:45.771011+0000","last_peered":"2024-09-13T23:28:45.771011+0000","last_clean":"2024-09-13T23:28:45.771011+0000","last_became_active":"2024-09-13T23:25:21.308432+0000","last_became_peered":"2024-09-13T23:25:21.308432+0000","last_unstale":"2024-09-13T23:28:45.771011+0000","last_undegraded":"2024-09-13T23:28:45.771011+0000","last_fullsized":"2024-09-13T23:28:45.771011+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.770908+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.770908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:02.965472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"33'8","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.620279+0000","last_change":"2024-09-13T23:29:29.620306+0000","last_active":"2024-09-13T23:29:29.620279+0000","last_peered":"2024-09-13T23:29:29.620279+0000","last_clean":"2024-09-13T23:29:29.620279+0000","last_became_active":"2024-09-13T23:25:23.305396+0000","last_became_peered":"2024-09-13T23:25:23.305396+0000","last_unstale":"2024-09-13T23:29:29.620279+0000","last_undegraded":"2024-09-13T23:29:29.620279+0000","last_fullsized":"2024-09-13T23:29:29.620279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:29.620164+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.620164+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:36:47.509114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"33'6","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:11.866151+0000","last_change":"2024-09-13T23:29:11.866151+0000","last_active":"2024-09-13T23:29:11.866151+0000","last_peered":"2024-09-13T23:29:11.866151+0000","last_clean":"2024-09-13T23:29:11.866151+0000","last_became_active":"2024-09-13T23:25:15.282781+0000","last_became_peered":"2024-09-13T23:25:15.282781+0000","last_unstale":"2024-09-13T23:29:11.866151+0000","last_undegraded":"2024-09-13T23:29:11.866151+0000","last_fullsized":"2024-09-13T23:29:11.866151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:11.866030+0000","last_clean_scrub_stamp":"2024-09-13T23:29:11.866030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:36.997837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.602698+0000","last_change":"2024-09-13T23:29:10.602698+0000","last_active":"2024-09-13T23:29:10.602698+0000","last_peered":"2024-09-13T23:29:10.602698+0000","last_clean":"2024-09-13T23:29:10.602698+0000","last_became_active":"2024-09-13T23:25:13.285073+0000","last_became_peered":"2024-09-13T23:25:13.285073+0000","last_unstale":"2024-09-13T23:29:10.602698+0000","last_undegraded":"2024-09-13T23:29:10.602698+0000","last_fullsized":"2024-09-13T23:29:10.602698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:10.602581+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.602581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:02.399450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.713189+0000","last_change":"2024-09-13T23:28:47.713189+0000","last_active":"2024-09-13T23:28:47.713189+0000","last_peered":"2024-09-13T23:28:47.713189+0000","last_clean":"2024-09-13T23:28:47.713189+0000","last_became_active":"2024-09-13T23:25:17.286580+0000","last_became_peered":"2024-09-13T23:25:17.286580+0000","last_unstale":"2024-09-13T23:28:47.713189+0000","last_undegraded":"2024-09-13T23:28:47.713189+0000","last_fullsized":"2024-09-13T23:28:47.713189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.713076+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.713076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:36.167508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"33'48","reported_seq":121,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:43.861599+0000","last_change":"2024-09-13T23:28:43.861599+0000","last_active":"2024-09-13T23:28:43.861599+0000","last_peered":"2024-09-13T23:28:43.861599+0000","last_clean":"2024-09-13T23:28:43.861599+0000","last_became_active":"2024-09-13T23:25:19.292953+0000","last_became_peered":"2024-09-13T23:25:19.292953+0000","last_unstale":"2024-09-13T23:28:43.861599+0000","last_undegraded":"2024-09-13T23:28:43.861599+0000","last_fullsized":"2024-09-13T23:28:43.861599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'48","last_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_deep_scrub":"33'48","last_deep_scrub_stamp":"2024-09-13T23:28:43.861453+0000","last_clean_scrub_stamp":"2024-09-13T23:28:43.861453+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:07:50.677647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.470984+0000","last_change":"2024-09-13T23:28:35.470984+0000","last_active":"2024-09-13T23:28:35.470984+0000","last_peered":"2024-09-13T23:28:35.470984+0000","last_clean":"2024-09-13T23:28:35.470984+0000","last_became_active":"2024-09-13T23:25:21.299459+0000","last_became_peered":"2024-09-13T23:25:21.299459+0000","last_unstale":"2024-09-13T23:28:35.470984+0000","last_undegraded":"2024-09-13T23:28:35.470984+0000","last_fullsized":"2024-09-13T23:28:35.470984+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.470871+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.470871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:42.091197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:53.013686+0000","last_change":"2024-09-13T23:29:53.013711+0000","last_active":"2024-09-13T23:29:53.013686+0000","last_peered":"2024-09-13T23:29:53.013686+0000","last_clean":"2024-09-13T23:29:53.013686+0000","last_became_active":"2024-09-13T23:25:23.313095+0000","last_became_peered":"2024-09-13T23:25:23.313095+0000","last_unstale":"2024-09-13T23:29:53.013686+0000","last_undegraded":"2024-09-13T23:29:53.013686+0000","last_fullsized":"2024-09-13T23:29:53.013686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:53.013586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:53.013586+0000","last_clean_scrub_stamp":"2024-09-13T23:29:53.013586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:14:57.296130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.391900+0000","last_change":"2024-09-13T23:28:46.391900+0000","last_active":"2024-09-13T23:28:46.391900+0000","last_peered":"2024-09-13T23:28:46.391900+0000","last_clean":"2024-09-13T23:28:46.391900+0000","last_became_active":"2024-09-13T23:25:15.291469+0000","last_became_peered":"2024-09-13T23:25:15.291469+0000","last_unstale":"2024-09-13T23:28:46.391900+0000","last_undegraded":"2024-09-13T23:28:46.391900+0000","last_fullsized":"2024-09-13T23:28:46.391900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:28:46.391777+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.391777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:57.512441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:13.055977+0000","last_change":"2024-09-13T23:29:13.055977+0000","last_active":"2024-09-13T23:29:13.055977+0000","last_peered":"2024-09-13T23:29:13.055977+0000","last_clean":"2024-09-13T23:29:13.055977+0000","last_became_active":"2024-09-13T23:25:13.285298+0000","last_became_peered":"2024-09-13T23:25:13.285298+0000","last_unstale":"2024-09-13T23:29:13.055977+0000","last_undegraded":"2024-09-13T23:29:13.055977+0000","last_fullsized":"2024-09-13T23:29:13.055977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:13.055822+0000","last_clean_scrub_stamp":"2024-09-13T23:29:13.055822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:46.390759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.425088+0000","last_change":"2024-09-13T23:28:36.425088+0000","last_active":"2024-09-13T23:28:36.425088+0000","last_peered":"2024-09-13T23:28:36.425088+0000","last_clean":"2024-09-13T23:28:36.425088+0000","last_became_active":"2024-09-13T23:25:17.287856+0000","last_became_peered":"2024-09-13T23:25:17.287856+0000","last_unstale":"2024-09-13T23:28:36.425088+0000","last_undegraded":"2024-09-13T23:28:36.425088+0000","last_fullsized":"2024-09-13T23:28:36.425088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.424930+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.424930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:03.124803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.764392+0000","last_change":"2024-09-13T23:28:46.764392+0000","last_active":"2024-09-13T23:28:46.764392+0000","last_peered":"2024-09-13T23:28:46.764392+0000","last_clean":"2024-09-13T23:28:46.764392+0000","last_became_active":"2024-09-13T23:25:19.288611+0000","last_became_peered":"2024-09-13T23:25:19.288611+0000","last_unstale":"2024-09-13T23:28:46.764392+0000","last_undegraded":"2024-09-13T23:28:46.764392+0000","last_fullsized":"2024-09-13T23:28:46.764392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:46.764271+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.764271+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:56:15.849617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.707149+0000","last_change":"2024-09-13T23:28:36.707149+0000","last_active":"2024-09-13T23:28:36.707149+0000","last_peered":"2024-09-13T23:28:36.707149+0000","last_clean":"2024-09-13T23:28:36.707149+0000","last_became_active":"2024-09-13T23:25:21.298419+0000","last_became_peered":"2024-09-13T23:25:21.298419+0000","last_unstale":"2024-09-13T23:28:36.707149+0000","last_undegraded":"2024-09-13T23:28:36.707149+0000","last_fullsized":"2024-09-13T23:28:36.707149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.706974+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.706974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:59.091638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.253579+0000","last_change":"2024-09-13T23:29:15.253579+0000","last_active":"2024-09-13T23:29:15.253579+0000","last_peered":"2024-09-13T23:29:15.253579+0000","last_clean":"2024-09-13T23:29:15.253579+0000","last_became_active":"2024-09-13T23:25:15.281426+0000","last_became_peered":"2024-09-13T23:25:15.281426+0000","last_unstale":"2024-09-13T23:29:15.253579+0000","last_undegraded":"2024-09-13T23:29:15.253579+0000","last_fullsized":"2024-09-13T23:29:15.253579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:15.253463+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.253463+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:56.543757+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:37.190105+0000","last_change":"2024-09-13T23:29:37.190105+0000","last_active":"2024-09-13T23:29:37.190105+0000","last_peered":"2024-09-13T23:29:37.190105+0000","last_clean":"2024-09-13T23:29:37.190105+0000","last_became_active":"2024-09-13T23:25:13.283704+0000","last_became_peered":"2024-09-13T23:25:13.283704+0000","last_unstale":"2024-09-13T23:29:37.190105+0000","last_undegraded":"2024-09-13T23:29:37.190105+0000","last_fullsized":"2024-09-13T23:29:37.190105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:37.189981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:37.189981+0000","last_clean_scrub_stamp":"2024-09-13T23:29:37.189981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:08.220487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.823047+0000","last_change":"2024-09-13T23:28:54.823047+0000","last_active":"2024-09-13T23:28:54.823047+0000","last_peered":"2024-09-13T23:28:54.823047+0000","last_clean":"2024-09-13T23:28:54.823047+0000","last_became_active":"2024-09-13T23:25:17.285164+0000","last_became_peered":"2024-09-13T23:25:17.285164+0000","last_unstale":"2024-09-13T23:28:54.823047+0000","last_undegraded":"2024-09-13T23:28:54.823047+0000","last_fullsized":"2024-09-13T23:28:54.823047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:54.822942+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.822942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:27.981439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"33'65","reported_seq":138,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:46.838301+0000","last_change":"2024-09-13T23:28:46.838338+0000","last_active":"2024-09-13T23:28:46.838301+0000","last_peered":"2024-09-13T23:28:46.838301+0000","last_clean":"2024-09-13T23:28:46.838301+0000","last_became_active":"2024-09-13T23:25:19.289685+0000","last_became_peered":"2024-09-13T23:25:19.289685+0000","last_unstale":"2024-09-13T23:28:46.838301+0000","last_undegraded":"2024-09-13T23:28:46.838301+0000","last_fullsized":"2024-09-13T23:28:46.838301+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'65","last_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_deep_scrub":"33'65","last_deep_scrub_stamp":"2024-09-13T23:28:46.838216+0000","last_clean_scrub_stamp":"2024-09-13T23:28:46.838216+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:21.670165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:35.700661+0000","last_change":"2024-09-13T23:28:35.700684+0000","last_active":"2024-09-13T23:28:35.700661+0000","last_peered":"2024-09-13T23:28:35.700661+0000","last_clean":"2024-09-13T23:28:35.700661+0000","last_became_active":"2024-09-13T23:25:21.300088+0000","last_became_peered":"2024-09-13T23:25:21.300088+0000","last_unstale":"2024-09-13T23:28:35.700661+0000","last_undegraded":"2024-09-13T23:28:35.700661+0000","last_fullsized":"2024-09-13T23:28:35.700661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:35.700569+0000","last_clean_scrub_stamp":"2024-09-13T23:28:35.700569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:06.066777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"33'16","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:30.634367+0000","last_change":"2024-09-13T23:29:30.634367+0000","last_active":"2024-09-13T23:29:30.634367+0000","last_peered":"2024-09-13T23:29:30.634367+0000","last_clean":"2024-09-13T23:29:30.634367+0000","last_became_active":"2024-09-13T23:25:23.305878+0000","last_became_peered":"2024-09-13T23:25:23.305878+0000","last_unstale":"2024-09-13T23:29:30.634367+0000","last_undegraded":"2024-09-13T23:29:30.634367+0000","last_fullsized":"2024-09-13T23:29:30.634367+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:29:30.634191+0000","last_clean_scrub_stamp":"2024-09-13T23:29:30.634191+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:01.458256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"33'6","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:09.879160+0000","last_change":"2024-09-13T23:29:09.879160+0000","last_active":"2024-09-13T23:29:09.879160+0000","last_peered":"2024-09-13T23:29:09.879160+0000","last_clean":"2024-09-13T23:29:09.879160+0000","last_became_active":"2024-09-13T23:25:15.281523+0000","last_became_peered":"2024-09-13T23:25:15.281523+0000","last_unstale":"2024-09-13T23:29:09.879160+0000","last_undegraded":"2024-09-13T23:29:09.879160+0000","last_fullsized":"2024-09-13T23:29:09.879160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:09.879042+0000","last_clean_scrub_stamp":"2024-09-13T23:29:09.879042+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:02.841770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.251517+0000","last_change":"2024-09-13T23:29:27.251517+0000","last_active":"2024-09-13T23:29:27.251517+0000","last_peered":"2024-09-13T23:29:27.251517+0000","last_clean":"2024-09-13T23:29:27.251517+0000","last_became_active":"2024-09-13T23:25:13.284141+0000","last_became_peered":"2024-09-13T23:25:13.284141+0000","last_unstale":"2024-09-13T23:29:27.251517+0000","last_undegraded":"2024-09-13T23:29:27.251517+0000","last_fullsized":"2024-09-13T23:29:27.251517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:27.251359+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.251359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:01:54.226319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.730040+0000","last_change":"2024-09-13T23:28:52.730040+0000","last_active":"2024-09-13T23:28:52.730040+0000","last_peered":"2024-09-13T23:28:52.730040+0000","last_clean":"2024-09-13T23:28:52.730040+0000","last_became_active":"2024-09-13T23:25:17.282415+0000","last_became_peered":"2024-09-13T23:25:17.282415+0000","last_unstale":"2024-09-13T23:28:52.730040+0000","last_undegraded":"2024-09-13T23:28:52.730040+0000","last_fullsized":"2024-09-13T23:28:52.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.729923+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.729923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:09.173717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"33'45","reported_seq":103,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:34.432492+0000","last_change":"2024-09-13T23:28:34.432533+0000","last_active":"2024-09-13T23:28:34.432492+0000","last_peered":"2024-09-13T23:28:34.432492+0000","last_clean":"2024-09-13T23:28:34.432492+0000","last_became_active":"2024-09-13T23:25:19.289921+0000","last_became_peered":"2024-09-13T23:25:19.289921+0000","last_unstale":"2024-09-13T23:28:34.432492+0000","last_undegraded":"2024-09-13T23:28:34.432492+0000","last_fullsized":"2024-09-13T23:28:34.432492+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:34.432394+0000","last_clean_scrub_stamp":"2024-09-13T23:28:34.432394+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:13:14.169652+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:38.418506+0000","last_change":"2024-09-13T23:28:38.418547+0000","last_active":"2024-09-13T23:28:38.418506+0000","last_peered":"2024-09-13T23:28:38.418506+0000","last_clean":"2024-09-13T23:28:38.418506+0000","last_became_active":"2024-09-13T23:25:21.305191+0000","last_became_peered":"2024-09-13T23:25:21.305191+0000","last_unstale":"2024-09-13T23:28:38.418506+0000","last_undegraded":"2024-09-13T23:28:38.418506+0000","last_fullsized":"2024-09-13T23:28:38.418506+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:38.418363+0000","last_clean_scrub_stamp":"2024-09-13T23:28:38.418363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:24:26.872796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:54.957946+0000","last_change":"2024-09-13T23:29:54.957946+0000","last_active":"2024-09-13T23:29:54.957946+0000","last_peered":"2024-09-13T23:29:54.957946+0000","last_clean":"2024-09-13T23:29:54.957946+0000","last_became_active":"2024-09-13T23:25:23.314274+0000","last_became_peered":"2024-09-13T23:25:23.314274+0000","last_unstale":"2024-09-13T23:29:54.957946+0000","last_undegraded":"2024-09-13T23:29:54.957946+0000","last_fullsized":"2024-09-13T23:29:54.957946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:54.957794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:54.957794+0000","last_clean_scrub_stamp":"2024-09-13T23:29:54.957794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:30:38.409101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:51.399289+0000","last_change":"2024-09-13T23:28:51.399332+0000","last_active":"2024-09-13T23:28:51.399289+0000","last_peered":"2024-09-13T23:28:51.399289+0000","last_clean":"2024-09-13T23:28:51.399289+0000","last_became_active":"2024-09-13T23:25:15.289939+0000","last_became_peered":"2024-09-13T23:25:15.289939+0000","last_unstale":"2024-09-13T23:28:51.399289+0000","last_undegraded":"2024-09-13T23:28:51.399289+0000","last_fullsized":"2024-09-13T23:28:51.399289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:51.399178+0000","last_clean_scrub_stamp":"2024-09-13T23:28:51.399178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:24.391607+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:22.183283+0000","last_change":"2024-09-13T23:29:22.183283+0000","last_active":"2024-09-13T23:29:22.183283+0000","last_peered":"2024-09-13T23:29:22.183283+0000","last_clean":"2024-09-13T23:29:22.183283+0000","last_became_active":"2024-09-13T23:25:13.277365+0000","last_became_peered":"2024-09-13T23:25:13.277365+0000","last_unstale":"2024-09-13T23:29:22.183283+0000","last_undegraded":"2024-09-13T23:29:22.183283+0000","last_fullsized":"2024-09-13T23:29:22.183283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:22.183135+0000","last_clean_scrub_stamp":"2024-09-13T23:29:22.183135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:08:55.965697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"33'5","reported_seq":238,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:54.671431+0000","last_change":"2024-09-13T23:28:54.671459+0000","last_active":"2024-09-13T23:28:54.671431+0000","last_peered":"2024-09-13T23:28:54.671431+0000","last_clean":"2024-09-13T23:28:54.671431+0000","last_became_active":"2024-09-13T23:25:17.281957+0000","last_became_peered":"2024-09-13T23:25:17.281957+0000","last_unstale":"2024-09-13T23:28:54.671431+0000","last_undegraded":"2024-09-13T23:28:54.671431+0000","last_fullsized":"2024-09-13T23:28:54.671431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:28:54.671339+0000","last_clean_scrub_stamp":"2024-09-13T23:28:54.671339+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:38.895472+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:42.872729+0000","last_change":"2024-09-13T23:28:42.872729+0000","last_active":"2024-09-13T23:28:42.872729+0000","last_peered":"2024-09-13T23:28:42.872729+0000","last_clean":"2024-09-13T23:28:42.872729+0000","last_became_active":"2024-09-13T23:25:19.294701+0000","last_became_peered":"2024-09-13T23:25:19.294701+0000","last_unstale":"2024-09-13T23:28:42.872729+0000","last_undegraded":"2024-09-13T23:28:42.872729+0000","last_fullsized":"2024-09-13T23:28:42.872729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:42.872602+0000","last_clean_scrub_stamp":"2024-09-13T23:28:42.872602+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:27.096735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:36.838668+0000","last_change":"2024-09-13T23:28:36.838668+0000","last_active":"2024-09-13T23:28:36.838668+0000","last_peered":"2024-09-13T23:28:36.838668+0000","last_clean":"2024-09-13T23:28:36.838668+0000","last_became_active":"2024-09-13T23:25:21.301074+0000","last_became_peered":"2024-09-13T23:25:21.301074+0000","last_unstale":"2024-09-13T23:28:36.838668+0000","last_undegraded":"2024-09-13T23:28:36.838668+0000","last_fullsized":"2024-09-13T23:28:36.838668+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:36.838543+0000","last_clean_scrub_stamp":"2024-09-13T23:28:36.838543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:00.388168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:55.944180+0000","last_change":"2024-09-13T23:29:55.944180+0000","last_active":"2024-09-13T23:29:55.944180+0000","last_peered":"2024-09-13T23:29:55.944180+0000","last_clean":"2024-09-13T23:29:55.944180+0000","last_became_active":"2024-09-13T23:25:23.314350+0000","last_became_peered":"2024-09-13T23:25:23.314350+0000","last_unstale":"2024-09-13T23:29:55.944180+0000","last_undegraded":"2024-09-13T23:29:55.944180+0000","last_fullsized":"2024-09-13T23:29:55.944180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T23:29:55.944045+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T23:29:55.944045+0000","last_clean_scrub_stamp":"2024-09-13T23:29:55.944045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:31:29.871711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"33'12","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:27.646845+0000","last_change":"2024-09-13T23:29:27.646872+0000","last_active":"2024-09-13T23:29:27.646845+0000","last_peered":"2024-09-13T23:29:27.646845+0000","last_clean":"2024-09-13T23:29:27.646845+0000","last_became_active":"2024-09-13T23:25:15.284346+0000","last_became_peered":"2024-09-13T23:25:15.284346+0000","last_unstale":"2024-09-13T23:29:27.646845+0000","last_undegraded":"2024-09-13T23:29:27.646845+0000","last_fullsized":"2024-09-13T23:29:27.646845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:27.646739+0000","last_clean_scrub_stamp":"2024-09-13T23:29:27.646739+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:10.748574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:35.188079+0000","last_change":"2024-09-13T23:29:35.188079+0000","last_active":"2024-09-13T23:29:35.188079+0000","last_peered":"2024-09-13T23:29:35.188079+0000","last_clean":"2024-09-13T23:29:35.188079+0000","last_became_active":"2024-09-13T23:25:13.283007+0000","last_became_peered":"2024-09-13T23:25:13.283007+0000","last_unstale":"2024-09-13T23:29:35.188079+0000","last_undegraded":"2024-09-13T23:29:35.188079+0000","last_fullsized":"2024-09-13T23:29:35.188079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:35.187934+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:35.187934+0000","last_clean_scrub_stamp":"2024-09-13T23:29:35.187934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:07.166736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:55.274118+0000","last_change":"2024-09-13T23:28:55.274173+0000","last_active":"2024-09-13T23:28:55.274118+0000","last_peered":"2024-09-13T23:28:55.274118+0000","last_clean":"2024-09-13T23:28:55.274118+0000","last_became_active":"2024-09-13T23:25:17.285265+0000","last_became_peered":"2024-09-13T23:25:17.285265+0000","last_unstale":"2024-09-13T23:28:55.274118+0000","last_undegraded":"2024-09-13T23:28:55.274118+0000","last_fullsized":"2024-09-13T23:28:55.274118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:55.273979+0000","last_clean_scrub_stamp":"2024-09-13T23:28:55.273979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:41.097633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"33'16","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.392868+0000","last_change":"2024-09-13T23:28:37.392868+0000","last_active":"2024-09-13T23:28:37.392868+0000","last_peered":"2024-09-13T23:28:37.392868+0000","last_clean":"2024-09-13T23:28:37.392868+0000","last_became_active":"2024-09-13T23:25:19.293897+0000","last_became_peered":"2024-09-13T23:25:19.293897+0000","last_unstale":"2024-09-13T23:28:37.392868+0000","last_undegraded":"2024-09-13T23:28:37.392868+0000","last_fullsized":"2024-09-13T23:28:37.392868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'16","last_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_deep_scrub":"33'16","last_deep_scrub_stamp":"2024-09-13T23:28:37.392753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.392753+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:27.511355+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"33'285","reported_seq":379,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:37.736270+0000","last_change":"2024-09-13T23:28:37.736270+0000","last_active":"2024-09-13T23:28:37.736270+0000","last_peered":"2024-09-13T23:28:37.736270+0000","last_clean":"2024-09-13T23:28:37.736270+0000","last_became_active":"2024-09-13T23:25:21.304584+0000","last_became_peered":"2024-09-13T23:25:21.304584+0000","last_unstale":"2024-09-13T23:28:37.736270+0000","last_undegraded":"2024-09-13T23:28:37.736270+0000","last_fullsized":"2024-09-13T23:28:37.736270+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'285","last_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_deep_scrub":"33'285","last_deep_scrub_stamp":"2024-09-13T23:28:37.736151+0000","last_clean_scrub_stamp":"2024-09-13T23:28:37.736151+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:12.004146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.286625+0000","last_change":"2024-09-13T23:29:17.286625+0000","last_active":"2024-09-13T23:29:17.286625+0000","last_peered":"2024-09-13T23:29:17.286625+0000","last_clean":"2024-09-13T23:29:17.286625+0000","last_became_active":"2024-09-13T23:25:23.311808+0000","last_became_peered":"2024-09-13T23:25:23.311808+0000","last_unstale":"2024-09-13T23:29:17.286625+0000","last_undegraded":"2024-09-13T23:29:17.286625+0000","last_fullsized":"2024-09-13T23:29:17.286625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:17.286508+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.286508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:34.136659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.616003+0000","last_change":"2024-09-13T23:28:57.616072+0000","last_active":"2024-09-13T23:28:57.616003+0000","last_peered":"2024-09-13T23:28:57.616003+0000","last_clean":"2024-09-13T23:28:57.616003+0000","last_became_active":"2024-09-13T23:25:15.284181+0000","last_became_peered":"2024-09-13T23:25:15.284181+0000","last_unstale":"2024-09-13T23:28:57.616003+0000","last_undegraded":"2024-09-13T23:28:57.616003+0000","last_fullsized":"2024-09-13T23:28:57.616003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:28:57.615887+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.615887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:32.451308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:19.162747+0000","last_change":"2024-09-13T23:29:19.162747+0000","last_active":"2024-09-13T23:29:19.162747+0000","last_peered":"2024-09-13T23:29:19.162747+0000","last_clean":"2024-09-13T23:29:19.162747+0000","last_became_active":"2024-09-13T23:25:13.284120+0000","last_became_peered":"2024-09-13T23:25:13.284120+0000","last_unstale":"2024-09-13T23:29:19.162747+0000","last_undegraded":"2024-09-13T23:29:19.162747+0000","last_fullsized":"2024-09-13T23:29:19.162747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:19.162640+0000","last_clean_scrub_stamp":"2024-09-13T23:29:19.162640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:53.937244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:52.172867+0000","last_change":"2024-09-13T23:28:52.172891+0000","last_active":"2024-09-13T23:28:52.172867+0000","last_peered":"2024-09-13T23:28:52.172867+0000","last_clean":"2024-09-13T23:28:52.172867+0000","last_became_active":"2024-09-13T23:25:17.285399+0000","last_became_peered":"2024-09-13T23:25:17.285399+0000","last_unstale":"2024-09-13T23:28:52.172867+0000","last_undegraded":"2024-09-13T23:28:52.172867+0000","last_fullsized":"2024-09-13T23:28:52.172867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:52.172781+0000","last_clean_scrub_stamp":"2024-09-13T23:28:52.172781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:42.571714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"33'45","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.428650+0000","last_change":"2024-09-13T23:28:40.428650+0000","last_active":"2024-09-13T23:28:40.428650+0000","last_peered":"2024-09-13T23:28:40.428650+0000","last_clean":"2024-09-13T23:28:40.428650+0000","last_became_active":"2024-09-13T23:25:19.296108+0000","last_became_peered":"2024-09-13T23:25:19.296108+0000","last_unstale":"2024-09-13T23:28:40.428650+0000","last_undegraded":"2024-09-13T23:28:40.428650+0000","last_fullsized":"2024-09-13T23:28:40.428650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'45","last_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_deep_scrub":"33'45","last_deep_scrub_stamp":"2024-09-13T23:28:40.428479+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.428479+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:10.066086+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:41.913370+0000","last_change":"2024-09-13T23:28:41.913370+0000","last_active":"2024-09-13T23:28:41.913370+0000","last_peered":"2024-09-13T23:28:41.913370+0000","last_clean":"2024-09-13T23:28:41.913370+0000","last_became_active":"2024-09-13T23:25:21.307102+0000","last_became_peered":"2024-09-13T23:25:21.307102+0000","last_unstale":"2024-09-13T23:28:41.913370+0000","last_undegraded":"2024-09-13T23:28:41.913370+0000","last_fullsized":"2024-09-13T23:28:41.913370+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:41.913252+0000","last_clean_scrub_stamp":"2024-09-13T23:28:41.913252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:38.679020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.193740+0000","last_change":"2024-09-13T23:28:58.193740+0000","last_active":"2024-09-13T23:28:58.193740+0000","last_peered":"2024-09-13T23:28:58.193740+0000","last_clean":"2024-09-13T23:28:58.193740+0000","last_became_active":"2024-09-13T23:25:23.309141+0000","last_became_peered":"2024-09-13T23:25:23.309141+0000","last_unstale":"2024-09-13T23:28:58.193740+0000","last_undegraded":"2024-09-13T23:28:58.193740+0000","last_fullsized":"2024-09-13T23:28:58.193740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:58.193629+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.193629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:23:31.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"31'6","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.569758+0000","last_change":"2024-09-13T23:28:58.569782+0000","last_active":"2024-09-13T23:28:58.569758+0000","last_peered":"2024-09-13T23:28:58.569758+0000","last_clean":"2024-09-13T23:28:58.569758+0000","last_became_active":"2024-09-13T23:25:15.279401+0000","last_became_peered":"2024-09-13T23:25:15.279401+0000","last_unstale":"2024-09-13T23:28:58.569758+0000","last_undegraded":"2024-09-13T23:28:58.569758+0000","last_fullsized":"2024-09-13T23:28:58.569758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'6","last_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_deep_scrub":"31'6","last_deep_scrub_stamp":"2024-09-13T23:28:58.569633+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.569633+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:33.401582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.207097+0000","last_change":"2024-09-13T23:29:26.207097+0000","last_active":"2024-09-13T23:29:26.207097+0000","last_peered":"2024-09-13T23:29:26.207097+0000","last_clean":"2024-09-13T23:29:26.207097+0000","last_became_active":"2024-09-13T23:25:13.291411+0000","last_became_peered":"2024-09-13T23:25:13.291411+0000","last_unstale":"2024-09-13T23:29:26.207097+0000","last_undegraded":"2024-09-13T23:29:26.207097+0000","last_fullsized":"2024-09-13T23:29:26.207097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:26.206939+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.206939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:01.274448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:48.761946+0000","last_change":"2024-09-13T23:28:48.761973+0000","last_active":"2024-09-13T23:28:48.761946+0000","last_peered":"2024-09-13T23:28:48.761946+0000","last_clean":"2024-09-13T23:28:48.761946+0000","last_became_active":"2024-09-13T23:25:17.284998+0000","last_became_peered":"2024-09-13T23:25:17.284998+0000","last_unstale":"2024-09-13T23:28:48.761946+0000","last_undegraded":"2024-09-13T23:28:48.761946+0000","last_fullsized":"2024-09-13T23:28:48.761946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:48.761854+0000","last_clean_scrub_stamp":"2024-09-13T23:28:48.761854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:33.308523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"33'36","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:40.868903+0000","last_change":"2024-09-13T23:28:40.868903+0000","last_active":"2024-09-13T23:28:40.868903+0000","last_peered":"2024-09-13T23:28:40.868903+0000","last_clean":"2024-09-13T23:28:40.868903+0000","last_became_active":"2024-09-13T23:25:19.298078+0000","last_became_peered":"2024-09-13T23:25:19.298078+0000","last_unstale":"2024-09-13T23:28:40.868903+0000","last_undegraded":"2024-09-13T23:28:40.868903+0000","last_fullsized":"2024-09-13T23:28:40.868903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'36","last_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_deep_scrub":"33'36","last_deep_scrub_stamp":"2024-09-13T23:28:40.868753+0000","last_clean_scrub_stamp":"2024-09-13T23:28:40.868753+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:57.312547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:57.366023+0000","last_change":"2024-09-13T23:28:57.366023+0000","last_active":"2024-09-13T23:28:57.366023+0000","last_peered":"2024-09-13T23:28:57.366023+0000","last_clean":"2024-09-13T23:28:57.366023+0000","last_became_active":"2024-09-13T23:25:21.306637+0000","last_became_peered":"2024-09-13T23:25:21.306637+0000","last_unstale":"2024-09-13T23:28:57.366023+0000","last_undegraded":"2024-09-13T23:28:57.366023+0000","last_fullsized":"2024-09-13T23:28:57.366023+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:57.365894+0000","last_clean_scrub_stamp":"2024-09-13T23:28:57.365894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:37:00.729302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.246850+0000","last_change":"2024-09-13T23:29:25.246850+0000","last_active":"2024-09-13T23:29:25.246850+0000","last_peered":"2024-09-13T23:29:25.246850+0000","last_clean":"2024-09-13T23:29:25.246850+0000","last_became_active":"2024-09-13T23:25:23.312826+0000","last_became_peered":"2024-09-13T23:25:23.312826+0000","last_unstale":"2024-09-13T23:29:25.246850+0000","last_undegraded":"2024-09-13T23:29:25.246850+0000","last_fullsized":"2024-09-13T23:29:25.246850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:25.246730+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.246730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:48:35.183768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:24.639235+0000","last_change":"2024-09-13T23:29:24.639260+0000","last_active":"2024-09-13T23:29:24.639235+0000","last_peered":"2024-09-13T23:29:24.639235+0000","last_clean":"2024-09-13T23:29:24.639235+0000","last_became_active":"2024-09-13T23:25:52.375683+0000","last_became_peered":"2024-09-13T23:25:52.375683+0000","last_unstale":"2024-09-13T23:29:24.639235+0000","last_undegraded":"2024-09-13T23:29:24.639235+0000","last_fullsized":"2024-09-13T23:29:24.639235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:24.639140+0000","last_clean_scrub_stamp":"2024-09-13T23:29:24.639140+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:49.770946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.577686+0000","last_change":"2024-09-13T23:29:25.577713+0000","last_active":"2024-09-13T23:29:25.577686+0000","last_peered":"2024-09-13T23:29:25.577686+0000","last_clean":"2024-09-13T23:29:25.577686+0000","last_became_active":"2024-09-13T23:25:13.280222+0000","last_became_peered":"2024-09-13T23:25:13.280222+0000","last_unstale":"2024-09-13T23:29:25.577686+0000","last_undegraded":"2024-09-13T23:29:25.577686+0000","last_fullsized":"2024-09-13T23:29:25.577686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:25.577568+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.577568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:44.172717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.259399+0000","last_change":"2024-09-13T23:28:47.259399+0000","last_active":"2024-09-13T23:28:47.259399+0000","last_peered":"2024-09-13T23:28:47.259399+0000","last_clean":"2024-09-13T23:28:47.259399+0000","last_became_active":"2024-09-13T23:25:17.288997+0000","last_became_peered":"2024-09-13T23:25:17.288997+0000","last_unstale":"2024-09-13T23:28:47.259399+0000","last_undegraded":"2024-09-13T23:28:47.259399+0000","last_fullsized":"2024-09-13T23:28:47.259399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:47.259291+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.259291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:44:13.594250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"33'30","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:47.407054+0000","last_change":"2024-09-13T23:28:47.407089+0000","last_active":"2024-09-13T23:28:47.407054+0000","last_peered":"2024-09-13T23:28:47.407054+0000","last_clean":"2024-09-13T23:28:47.407054+0000","last_became_active":"2024-09-13T23:25:19.290368+0000","last_became_peered":"2024-09-13T23:25:19.290368+0000","last_unstale":"2024-09-13T23:28:47.407054+0000","last_undegraded":"2024-09-13T23:28:47.407054+0000","last_fullsized":"2024-09-13T23:28:47.407054+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'30","last_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_deep_scrub":"33'30","last_deep_scrub_stamp":"2024-09-13T23:28:47.406957+0000","last_clean_scrub_stamp":"2024-09-13T23:28:47.406957+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:01:12.268807+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.367378+0000","last_change":"2024-09-13T23:28:56.367406+0000","last_active":"2024-09-13T23:28:56.367378+0000","last_peered":"2024-09-13T23:28:56.367378+0000","last_clean":"2024-09-13T23:28:56.367378+0000","last_became_active":"2024-09-13T23:25:21.304743+0000","last_became_peered":"2024-09-13T23:25:21.304743+0000","last_unstale":"2024-09-13T23:28:56.367378+0000","last_undegraded":"2024-09-13T23:28:56.367378+0000","last_fullsized":"2024-09-13T23:28:56.367378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:56.367288+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.367288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:36.192963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:51.995684+0000","last_change":"2024-09-13T23:29:51.995684+0000","last_active":"2024-09-13T23:29:51.995684+0000","last_peered":"2024-09-13T23:29:51.995684+0000","last_clean":"2024-09-13T23:29:51.995684+0000","last_became_active":"2024-09-13T23:25:23.312918+0000","last_became_peered":"2024-09-13T23:25:23.312918+0000","last_unstale":"2024-09-13T23:29:51.995684+0000","last_undegraded":"2024-09-13T23:29:51.995684+0000","last_fullsized":"2024-09-13T23:29:51.995684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:51.995552+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:51.995552+0000","last_clean_scrub_stamp":"2024-09-13T23:29:51.995552+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:17.262312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"33'10","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.563436+0000","last_change":"2024-09-13T23:28:59.563436+0000","last_active":"2024-09-13T23:28:59.563436+0000","last_peered":"2024-09-13T23:28:59.563436+0000","last_clean":"2024-09-13T23:28:59.563436+0000","last_became_active":"2024-09-13T23:25:15.286587+0000","last_became_peered":"2024-09-13T23:25:15.286587+0000","last_unstale":"2024-09-13T23:28:59.563436+0000","last_undegraded":"2024-09-13T23:28:59.563436+0000","last_fullsized":"2024-09-13T23:28:59.563436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:59.563236+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.563236+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:35.781729+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.253112+0000","last_change":"2024-09-13T23:29:25.253137+0000","last_active":"2024-09-13T23:29:25.253112+0000","last_peered":"2024-09-13T23:29:25.253112+0000","last_clean":"2024-09-13T23:29:25.253112+0000","last_became_active":"2024-09-13T23:25:13.278199+0000","last_became_peered":"2024-09-13T23:25:13.278199+0000","last_unstale":"2024-09-13T23:29:25.253112+0000","last_undegraded":"2024-09-13T23:29:25.253112+0000","last_fullsized":"2024-09-13T23:29:25.253112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.252974+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.252974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:32.325506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"33'3","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.345702+0000","last_change":"2024-09-13T23:28:45.345702+0000","last_active":"2024-09-13T23:28:45.345702+0000","last_peered":"2024-09-13T23:28:45.345702+0000","last_clean":"2024-09-13T23:28:45.345702+0000","last_became_active":"2024-09-13T23:25:17.289909+0000","last_became_peered":"2024-09-13T23:25:17.289909+0000","last_unstale":"2024-09-13T23:28:45.345702+0000","last_undegraded":"2024-09-13T23:28:45.345702+0000","last_fullsized":"2024-09-13T23:28:45.345702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:28:45.345587+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.345587+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.147860+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"33'39","reported_seq":96,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.376916+0000","last_change":"2024-09-13T23:28:45.376963+0000","last_active":"2024-09-13T23:28:45.376916+0000","last_peered":"2024-09-13T23:28:45.376916+0000","last_clean":"2024-09-13T23:28:45.376916+0000","last_became_active":"2024-09-13T23:25:19.290228+0000","last_became_peered":"2024-09-13T23:25:19.290228+0000","last_unstale":"2024-09-13T23:28:45.376916+0000","last_undegraded":"2024-09-13T23:28:45.376916+0000","last_fullsized":"2024-09-13T23:28:45.376916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'39","last_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_deep_scrub":"33'39","last_deep_scrub_stamp":"2024-09-13T23:28:45.376807+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.376807+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:21.519688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:45.830708+0000","last_change":"2024-09-13T23:28:45.830736+0000","last_active":"2024-09-13T23:28:45.830708+0000","last_peered":"2024-09-13T23:28:45.830708+0000","last_clean":"2024-09-13T23:28:45.830708+0000","last_became_active":"2024-09-13T23:25:21.307074+0000","last_became_peered":"2024-09-13T23:25:21.307074+0000","last_unstale":"2024-09-13T23:28:45.830708+0000","last_undegraded":"2024-09-13T23:28:45.830708+0000","last_fullsized":"2024-09-13T23:28:45.830708+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:45.830607+0000","last_clean_scrub_stamp":"2024-09-13T23:28:45.830607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:20.666028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"33'8","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:53.968419+0000","last_change":"2024-09-13T23:29:53.968419+0000","last_active":"2024-09-13T23:29:53.968419+0000","last_peered":"2024-09-13T23:29:53.968419+0000","last_clean":"2024-09-13T23:29:53.968419+0000","last_became_active":"2024-09-13T23:25:23.313942+0000","last_became_peered":"2024-09-13T23:25:23.313942+0000","last_unstale":"2024-09-13T23:29:53.968419+0000","last_undegraded":"2024-09-13T23:29:53.968419+0000","last_fullsized":"2024-09-13T23:29:53.968419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:53.968295+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:53.968295+0000","last_clean_scrub_stamp":"2024-09-13T23:29:53.968295+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:55:16.605205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"33'12","reported_seq":76,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:56.240948+0000","last_change":"2024-09-13T23:28:56.240948+0000","last_active":"2024-09-13T23:28:56.240948+0000","last_peered":"2024-09-13T23:28:56.240948+0000","last_clean":"2024-09-13T23:28:56.240948+0000","last_became_active":"2024-09-13T23:25:15.296686+0000","last_became_peered":"2024-09-13T23:25:15.296686+0000","last_unstale":"2024-09-13T23:28:56.240948+0000","last_undegraded":"2024-09-13T23:28:56.240948+0000","last_fullsized":"2024-09-13T23:28:56.240948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:28:56.240805+0000","last_clean_scrub_stamp":"2024-09-13T23:28:56.240805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:20.631609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"33'6","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.557352+0000","last_change":"2024-09-13T23:29:16.557352+0000","last_active":"2024-09-13T23:29:16.557352+0000","last_peered":"2024-09-13T23:29:16.557352+0000","last_clean":"2024-09-13T23:29:16.557352+0000","last_became_active":"2024-09-13T23:25:13.278839+0000","last_became_peered":"2024-09-13T23:25:13.278839+0000","last_unstale":"2024-09-13T23:29:16.557352+0000","last_undegraded":"2024-09-13T23:29:16.557352+0000","last_fullsized":"2024-09-13T23:29:16.557352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:16.557180+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.557180+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:10.883638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:02.844145+0000","last_change":"2024-09-13T23:29:02.844145+0000","last_active":"2024-09-13T23:29:02.844145+0000","last_peered":"2024-09-13T23:29:02.844145+0000","last_clean":"2024-09-13T23:29:02.844145+0000","last_became_active":"2024-09-13T23:25:15.284387+0000","last_became_peered":"2024-09-13T23:25:15.284387+0000","last_unstale":"2024-09-13T23:29:02.844145+0000","last_undegraded":"2024-09-13T23:29:02.844145+0000","last_fullsized":"2024-09-13T23:29:02.844145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:02.844013+0000","last_clean_scrub_stamp":"2024-09-13T23:29:02.844013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:02.339878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.834175+0000","last_change":"2024-09-13T23:29:10.834175+0000","last_active":"2024-09-13T23:29:10.834175+0000","last_peered":"2024-09-13T23:29:10.834175+0000","last_clean":"2024-09-13T23:29:10.834175+0000","last_became_active":"2024-09-13T23:25:13.281509+0000","last_became_peered":"2024-09-13T23:25:13.281509+0000","last_unstale":"2024-09-13T23:29:10.834175+0000","last_undegraded":"2024-09-13T23:29:10.834175+0000","last_fullsized":"2024-09-13T23:29:10.834175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:10.834057+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.834057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:21:43.901277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"33'14","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.358637+0000","last_change":"2024-09-13T23:29:12.358637+0000","last_active":"2024-09-13T23:29:12.358637+0000","last_peered":"2024-09-13T23:29:12.358637+0000","last_clean":"2024-09-13T23:29:12.358637+0000","last_became_active":"2024-09-13T23:25:15.279732+0000","last_became_peered":"2024-09-13T23:25:15.279732+0000","last_unstale":"2024-09-13T23:29:12.358637+0000","last_undegraded":"2024-09-13T23:29:12.358637+0000","last_fullsized":"2024-09-13T23:29:12.358637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T23:29:12.358491+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.358491+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:16:40.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:38.225824+0000","last_change":"2024-09-13T23:29:38.225848+0000","last_active":"2024-09-13T23:29:38.225824+0000","last_peered":"2024-09-13T23:29:38.225824+0000","last_clean":"2024-09-13T23:29:38.225824+0000","last_became_active":"2024-09-13T23:25:13.280020+0000","last_became_peered":"2024-09-13T23:25:13.280020+0000","last_unstale":"2024-09-13T23:29:38.225824+0000","last_undegraded":"2024-09-13T23:29:38.225824+0000","last_fullsized":"2024-09-13T23:29:38.225824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:38.225704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:38.225704+0000","last_clean_scrub_stamp":"2024-09-13T23:29:38.225704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:30.774800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"33'18","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.704641+0000","last_change":"2024-09-13T23:29:17.704641+0000","last_active":"2024-09-13T23:29:17.704641+0000","last_peered":"2024-09-13T23:29:17.704641+0000","last_clean":"2024-09-13T23:29:17.704641+0000","last_became_active":"2024-09-13T23:25:15.283825+0000","last_became_peered":"2024-09-13T23:25:15.283825+0000","last_unstale":"2024-09-13T23:29:17.704641+0000","last_undegraded":"2024-09-13T23:29:17.704641+0000","last_fullsized":"2024-09-13T23:29:17.704641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T23:29:17.704520+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.704520+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:44.012264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"31'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.611316+0000","last_change":"2024-09-13T23:29:26.611343+0000","last_active":"2024-09-13T23:29:26.611316+0000","last_peered":"2024-09-13T23:29:26.611316+0000","last_clean":"2024-09-13T23:29:26.611316+0000","last_became_active":"2024-09-13T23:25:13.280344+0000","last_became_peered":"2024-09-13T23:25:13.280344+0000","last_unstale":"2024-09-13T23:29:26.611316+0000","last_undegraded":"2024-09-13T23:29:26.611316+0000","last_fullsized":"2024-09-13T23:29:26.611316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.611220+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.611220+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:02.680534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"33'8","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:03.891498+0000","last_change":"2024-09-13T23:29:03.891498+0000","last_active":"2024-09-13T23:29:03.891498+0000","last_peered":"2024-09-13T23:29:03.891498+0000","last_clean":"2024-09-13T23:29:03.891498+0000","last_became_active":"2024-09-13T23:25:15.278495+0000","last_became_peered":"2024-09-13T23:25:15.278495+0000","last_unstale":"2024-09-13T23:29:03.891498+0000","last_undegraded":"2024-09-13T23:29:03.891498+0000","last_fullsized":"2024-09-13T23:29:03.891498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:03.891377+0000","last_clean_scrub_stamp":"2024-09-13T23:29:03.891377+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:38.332864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.552331+0000","last_change":"2024-09-13T23:29:23.552331+0000","last_active":"2024-09-13T23:29:23.552331+0000","last_peered":"2024-09-13T23:29:23.552331+0000","last_clean":"2024-09-13T23:29:23.552331+0000","last_became_active":"2024-09-13T23:25:13.279329+0000","last_became_peered":"2024-09-13T23:25:13.279329+0000","last_unstale":"2024-09-13T23:29:23.552331+0000","last_undegraded":"2024-09-13T23:29:23.552331+0000","last_fullsized":"2024-09-13T23:29:23.552331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.552205+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.552205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:53.424634+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"33'8","reported_seq":80,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:34.276456+0000","last_change":"2024-09-13T23:29:34.276484+0000","last_active":"2024-09-13T23:29:34.276456+0000","last_peered":"2024-09-13T23:29:34.276456+0000","last_clean":"2024-09-13T23:29:34.276456+0000","last_became_active":"2024-09-13T23:25:52.381981+0000","last_became_peered":"2024-09-13T23:25:52.381981+0000","last_unstale":"2024-09-13T23:29:34.276456+0000","last_undegraded":"2024-09-13T23:29:34.276456+0000","last_fullsized":"2024-09-13T23:29:34.276456+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T23:29:34.276320+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T23:29:34.276320+0000","last_clean_scrub_stamp":"2024-09-13T23:29:34.276320+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:54:10.287050+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:17.105327+0000","last_change":"2024-09-13T23:29:17.105327+0000","last_active":"2024-09-13T23:29:17.105327+0000","last_peered":"2024-09-13T23:29:17.105327+0000","last_clean":"2024-09-13T23:29:17.105327+0000","last_became_active":"2024-09-13T23:25:13.285391+0000","last_became_peered":"2024-09-13T23:25:13.285391+0000","last_unstale":"2024-09-13T23:29:17.105327+0000","last_undegraded":"2024-09-13T23:29:17.105327+0000","last_fullsized":"2024-09-13T23:29:17.105327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:17.105202+0000","last_clean_scrub_stamp":"2024-09-13T23:29:17.105202+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:12:24.212381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"33'10","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:58.880712+0000","last_change":"2024-09-13T23:28:58.880712+0000","last_active":"2024-09-13T23:28:58.880712+0000","last_peered":"2024-09-13T23:28:58.880712+0000","last_clean":"2024-09-13T23:28:58.880712+0000","last_became_active":"2024-09-13T23:25:15.286134+0000","last_became_peered":"2024-09-13T23:25:15.286134+0000","last_unstale":"2024-09-13T23:28:58.880712+0000","last_undegraded":"2024-09-13T23:28:58.880712+0000","last_fullsized":"2024-09-13T23:28:58.880712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T23:28:58.880594+0000","last_clean_scrub_stamp":"2024-09-13T23:28:58.880594+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:50.677464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:25.632996+0000","last_change":"2024-09-13T23:29:25.632996+0000","last_active":"2024-09-13T23:29:25.632996+0000","last_peered":"2024-09-13T23:29:25.632996+0000","last_clean":"2024-09-13T23:29:25.632996+0000","last_became_active":"2024-09-13T23:25:52.381579+0000","last_became_peered":"2024-09-13T23:25:52.381579+0000","last_unstale":"2024-09-13T23:29:25.632996+0000","last_undegraded":"2024-09-13T23:29:25.632996+0000","last_fullsized":"2024-09-13T23:29:25.632996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:25.632887+0000","last_clean_scrub_stamp":"2024-09-13T23:29:25.632887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:23.643133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"33'12","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.102517+0000","last_change":"2024-09-13T23:29:10.102517+0000","last_active":"2024-09-13T23:29:10.102517+0000","last_peered":"2024-09-13T23:29:10.102517+0000","last_clean":"2024-09-13T23:29:10.102517+0000","last_became_active":"2024-09-13T23:25:15.283779+0000","last_became_peered":"2024-09-13T23:25:15.283779+0000","last_unstale":"2024-09-13T23:29:10.102517+0000","last_undegraded":"2024-09-13T23:29:10.102517+0000","last_fullsized":"2024-09-13T23:29:10.102517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T23:29:10.102348+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.102348+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:25:08.910893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.847610+0000","last_change":"2024-09-13T23:29:12.847610+0000","last_active":"2024-09-13T23:29:12.847610+0000","last_peered":"2024-09-13T23:29:12.847610+0000","last_clean":"2024-09-13T23:29:12.847610+0000","last_became_active":"2024-09-13T23:25:13.280714+0000","last_became_peered":"2024-09-13T23:25:13.280714+0000","last_unstale":"2024-09-13T23:29:12.847610+0000","last_undegraded":"2024-09-13T23:29:12.847610+0000","last_fullsized":"2024-09-13T23:29:12.847610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:12.847494+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.847494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T09:21:56.893797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"31'2","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:16.067463+0000","last_change":"2024-09-13T23:29:16.067463+0000","last_active":"2024-09-13T23:29:16.067463+0000","last_peered":"2024-09-13T23:29:16.067463+0000","last_clean":"2024-09-13T23:29:16.067463+0000","last_became_active":"2024-09-13T23:25:15.289746+0000","last_became_peered":"2024-09-13T23:25:15.289746+0000","last_unstale":"2024-09-13T23:29:16.067463+0000","last_undegraded":"2024-09-13T23:29:16.067463+0000","last_fullsized":"2024-09-13T23:29:16.067463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"31'2","last_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_deep_scrub":"31'2","last_deep_scrub_stamp":"2024-09-13T23:29:16.067342+0000","last_clean_scrub_stamp":"2024-09-13T23:29:16.067342+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:11:01.072491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:48.097382+0000","last_change":"2024-09-13T23:29:48.097409+0000","last_active":"2024-09-13T23:29:48.097382+0000","last_peered":"2024-09-13T23:29:48.097382+0000","last_clean":"2024-09-13T23:29:48.097382+0000","last_became_active":"2024-09-13T23:25:13.276302+0000","last_became_peered":"2024-09-13T23:25:13.276302+0000","last_unstale":"2024-09-13T23:29:48.097382+0000","last_undegraded":"2024-09-13T23:29:48.097382+0000","last_fullsized":"2024-09-13T23:29:48.097382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:48.097284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:48.097284+0000","last_clean_scrub_stamp":"2024-09-13T23:29:48.097284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:09:25.107228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"33'22","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:10.398912+0000","last_change":"2024-09-13T23:29:10.398912+0000","last_active":"2024-09-13T23:29:10.398912+0000","last_peered":"2024-09-13T23:29:10.398912+0000","last_clean":"2024-09-13T23:29:10.398912+0000","last_became_active":"2024-09-13T23:25:15.284729+0000","last_became_peered":"2024-09-13T23:25:15.284729+0000","last_unstale":"2024-09-13T23:29:10.398912+0000","last_undegraded":"2024-09-13T23:29:10.398912+0000","last_fullsized":"2024-09-13T23:29:10.398912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:10.398784+0000","last_clean_scrub_stamp":"2024-09-13T23:29:10.398784+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:16.393158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"33'3","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:21.596036+0000","last_change":"2024-09-13T23:29:21.596036+0000","last_active":"2024-09-13T23:29:21.596036+0000","last_peered":"2024-09-13T23:29:21.596036+0000","last_clean":"2024-09-13T23:29:21.596036+0000","last_became_active":"2024-09-13T23:25:13.277490+0000","last_became_peered":"2024-09-13T23:25:13.277490+0000","last_unstale":"2024-09-13T23:29:21.596036+0000","last_undegraded":"2024-09-13T23:29:21.596036+0000","last_fullsized":"2024-09-13T23:29:21.596036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T23:29:21.595907+0000","last_clean_scrub_stamp":"2024-09-13T23:29:21.595907+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:26.153996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:05.895957+0000","last_change":"2024-09-13T23:29:05.895957+0000","last_active":"2024-09-13T23:29:05.895957+0000","last_peered":"2024-09-13T23:29:05.895957+0000","last_clean":"2024-09-13T23:29:05.895957+0000","last_became_active":"2024-09-13T23:25:15.278519+0000","last_became_peered":"2024-09-13T23:25:15.278519+0000","last_unstale":"2024-09-13T23:29:05.895957+0000","last_undegraded":"2024-09-13T23:29:05.895957+0000","last_fullsized":"2024-09-13T23:29:05.895957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:05.895771+0000","last_clean_scrub_stamp":"2024-09-13T23:29:05.895771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:28.311567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:26.223521+0000","last_change":"2024-09-13T23:29:26.223521+0000","last_active":"2024-09-13T23:29:26.223521+0000","last_peered":"2024-09-13T23:29:26.223521+0000","last_clean":"2024-09-13T23:29:26.223521+0000","last_became_active":"2024-09-13T23:25:13.280238+0000","last_became_peered":"2024-09-13T23:25:13.280238+0000","last_unstale":"2024-09-13T23:29:26.223521+0000","last_undegraded":"2024-09-13T23:29:26.223521+0000","last_fullsized":"2024-09-13T23:29:26.223521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:26.223409+0000","last_clean_scrub_stamp":"2024-09-13T23:29:26.223409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:56.095839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"33'4","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:04.241797+0000","last_change":"2024-09-13T23:29:04.241797+0000","last_active":"2024-09-13T23:29:04.241797+0000","last_peered":"2024-09-13T23:29:04.241797+0000","last_clean":"2024-09-13T23:29:04.241797+0000","last_became_active":"2024-09-13T23:25:15.284910+0000","last_became_peered":"2024-09-13T23:25:15.284910+0000","last_unstale":"2024-09-13T23:29:04.241797+0000","last_undegraded":"2024-09-13T23:29:04.241797+0000","last_fullsized":"2024-09-13T23:29:04.241797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:04.241674+0000","last_clean_scrub_stamp":"2024-09-13T23:29:04.241674+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:13.338606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"33'2","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.223443+0000","last_change":"2024-09-13T23:29:23.223443+0000","last_active":"2024-09-13T23:29:23.223443+0000","last_peered":"2024-09-13T23:29:23.223443+0000","last_clean":"2024-09-13T23:29:23.223443+0000","last_became_active":"2024-09-13T23:25:13.277853+0000","last_became_peered":"2024-09-13T23:25:13.277853+0000","last_unstale":"2024-09-13T23:29:23.223443+0000","last_undegraded":"2024-09-13T23:29:23.223443+0000","last_fullsized":"2024-09-13T23:29:23.223443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:23.223288+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.223288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T07:04:55.814375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:28:59.175652+0000","last_change":"2024-09-13T23:28:59.175652+0000","last_active":"2024-09-13T23:28:59.175652+0000","last_peered":"2024-09-13T23:28:59.175652+0000","last_clean":"2024-09-13T23:28:59.175652+0000","last_became_active":"2024-09-13T23:25:15.295353+0000","last_became_peered":"2024-09-13T23:25:15.295353+0000","last_unstale":"2024-09-13T23:28:59.175652+0000","last_undegraded":"2024-09-13T23:28:59.175652+0000","last_fullsized":"2024-09-13T23:28:59.175652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:28:59.175522+0000","last_clean_scrub_stamp":"2024-09-13T23:28:59.175522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:16.558152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"33'4","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:29.153588+0000","last_change":"2024-09-13T23:29:29.153588+0000","last_active":"2024-09-13T23:29:29.153588+0000","last_peered":"2024-09-13T23:29:29.153588+0000","last_clean":"2024-09-13T23:29:29.153588+0000","last_became_active":"2024-09-13T23:25:13.282666+0000","last_became_peered":"2024-09-13T23:25:13.282666+0000","last_unstale":"2024-09-13T23:29:29.153588+0000","last_undegraded":"2024-09-13T23:29:29.153588+0000","last_fullsized":"2024-09-13T23:29:29.153588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T23:29:29.153466+0000","last_clean_scrub_stamp":"2024-09-13T23:29:29.153466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:20.138130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:12.071500+0000","last_change":"2024-09-13T23:29:12.071500+0000","last_active":"2024-09-13T23:29:12.071500+0000","last_peered":"2024-09-13T23:29:12.071500+0000","last_clean":"2024-09-13T23:29:12.071500+0000","last_became_active":"2024-09-13T23:25:15.287688+0000","last_became_peered":"2024-09-13T23:25:15.287688+0000","last_unstale":"2024-09-13T23:29:12.071500+0000","last_undegraded":"2024-09-13T23:29:12.071500+0000","last_fullsized":"2024-09-13T23:29:12.071500+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:12.071386+0000","last_clean_scrub_stamp":"2024-09-13T23:29:12.071386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:05.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:32.225489+0000","last_change":"2024-09-13T23:29:32.225489+0000","last_active":"2024-09-13T23:29:32.225489+0000","last_peered":"2024-09-13T23:29:32.225489+0000","last_clean":"2024-09-13T23:29:32.225489+0000","last_became_active":"2024-09-13T23:25:13.281014+0000","last_became_peered":"2024-09-13T23:25:13.281014+0000","last_unstale":"2024-09-13T23:29:32.225489+0000","last_undegraded":"2024-09-13T23:29:32.225489+0000","last_fullsized":"2024-09-13T23:29:32.225489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:32.225283+0000","last_clean_scrub_stamp":"2024-09-13T23:29:32.225283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:38.368651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"33'6","reported_seq":58,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:07.360863+0000","last_change":"2024-09-13T23:29:07.360863+0000","last_active":"2024-09-13T23:29:07.360863+0000","last_peered":"2024-09-13T23:29:07.360863+0000","last_clean":"2024-09-13T23:29:07.360863+0000","last_became_active":"2024-09-13T23:25:15.289118+0000","last_became_peered":"2024-09-13T23:25:15.289118+0000","last_unstale":"2024-09-13T23:29:07.360863+0000","last_undegraded":"2024-09-13T23:29:07.360863+0000","last_fullsized":"2024-09-13T23:29:07.360863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:07.360714+0000","last_clean_scrub_stamp":"2024-09-13T23:29:07.360714+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:38.924264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:08.579817+0000","last_change":"2024-09-13T23:29:08.579817+0000","last_active":"2024-09-13T23:29:08.579817+0000","last_peered":"2024-09-13T23:29:08.579817+0000","last_clean":"2024-09-13T23:29:08.579817+0000","last_became_active":"2024-09-13T23:25:13.285749+0000","last_became_peered":"2024-09-13T23:25:13.285749+0000","last_unstale":"2024-09-13T23:29:08.579817+0000","last_undegraded":"2024-09-13T23:29:08.579817+0000","last_fullsized":"2024-09-13T23:29:08.579817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:08.579696+0000","last_clean_scrub_stamp":"2024-09-13T23:29:08.579696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:25.962325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"33'22","reported_seq":89,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:14.013647+0000","last_change":"2024-09-13T23:29:14.013647+0000","last_active":"2024-09-13T23:29:14.013647+0000","last_peered":"2024-09-13T23:29:14.013647+0000","last_clean":"2024-09-13T23:29:14.013647+0000","last_became_active":"2024-09-13T23:25:15.286821+0000","last_became_peered":"2024-09-13T23:25:15.286821+0000","last_unstale":"2024-09-13T23:29:14.013647+0000","last_undegraded":"2024-09-13T23:29:14.013647+0000","last_fullsized":"2024-09-13T23:29:14.013647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'22","last_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_deep_scrub":"33'22","last_deep_scrub_stamp":"2024-09-13T23:29:14.013525+0000","last_clean_scrub_stamp":"2024-09-13T23:29:14.013525+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T08:51:39.145331+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:23.251384+0000","last_change":"2024-09-13T23:29:23.251384+0000","last_active":"2024-09-13T23:29:23.251384+0000","last_peered":"2024-09-13T23:29:23.251384+0000","last_clean":"2024-09-13T23:29:23.251384+0000","last_became_active":"2024-09-13T23:25:13.291518+0000","last_became_peered":"2024-09-13T23:25:13.291518+0000","last_unstale":"2024-09-13T23:29:23.251384+0000","last_undegraded":"2024-09-13T23:29:23.251384+0000","last_fullsized":"2024-09-13T23:29:23.251384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:23.251266+0000","last_clean_scrub_stamp":"2024-09-13T23:29:23.251266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:20.867611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:51.034663+0000","last_change":"2024-09-13T23:29:51.034663+0000","last_active":"2024-09-13T23:29:51.034663+0000","last_peered":"2024-09-13T23:29:51.034663+0000","last_clean":"2024-09-13T23:29:51.034663+0000","last_became_active":"2024-09-13T23:25:13.290154+0000","last_became_peered":"2024-09-13T23:25:13.290154+0000","last_unstale":"2024-09-13T23:29:51.034663+0000","last_undegraded":"2024-09-13T23:29:51.034663+0000","last_fullsized":"2024-09-13T23:29:51.034663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T23:29:51.034549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T23:29:51.034549+0000","last_clean_scrub_stamp":"2024-09-13T23:29:51.034549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:34.583805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"33'2","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:15.722993+0000","last_change":"2024-09-13T23:29:15.722993+0000","last_active":"2024-09-13T23:29:15.722993+0000","last_peered":"2024-09-13T23:29:15.722993+0000","last_clean":"2024-09-13T23:29:15.722993+0000","last_became_active":"2024-09-13T23:25:15.284415+0000","last_became_peered":"2024-09-13T23:25:15.284415+0000","last_unstale":"2024-09-13T23:29:15.722993+0000","last_undegraded":"2024-09-13T23:29:15.722993+0000","last_fullsized":"2024-09-13T23:29:15.722993+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:15.722865+0000","last_clean_scrub_stamp":"2024-09-13T23:29:15.722865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:22.325909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"33'2","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:18.694276+0000","last_change":"2024-09-13T23:29:18.694276+0000","last_active":"2024-09-13T23:29:18.694276+0000","last_peered":"2024-09-13T23:29:18.694276+0000","last_clean":"2024-09-13T23:29:18.694276+0000","last_became_active":"2024-09-13T23:25:13.280181+0000","last_became_peered":"2024-09-13T23:25:13.280181+0000","last_unstale":"2024-09-13T23:29:18.694276+0000","last_undegraded":"2024-09-13T23:29:18.694276+0000","last_fullsized":"2024-09-13T23:29:18.694276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2024-09-13T23:29:18.694159+0000","last_clean_scrub_stamp":"2024-09-13T23:29:18.694159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:03.264071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"33'6","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T23:29:00.185902+0000","last_change":"2024-09-13T23:29:00.185902+0000","last_active":"2024-09-13T23:29:00.185902+0000","last_peered":"2024-09-13T23:29:00.185902+0000","last_clean":"2024-09-13T23:29:00.185902+0000","last_became_active":"2024-09-13T23:25:15.295385+0000","last_became_peered":"2024-09-13T23:25:15.295385+0000","last_unstale":"2024-09-13T23:29:00.185902+0000","last_undegraded":"2024-09-13T23:29:00.185902+0000","last_fullsized":"2024-09-13T23:29:00.185902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T23:29:00.185781+0000","last_clean_scrub_stamp":"2024-09-13T23:29:00.185781+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:13:40.557990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1597,"num_read_kb":1487,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194307,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673026,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39956,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331884,"statfs":{"total":96636764160,"available":96595849216,"internally_reserved":0,"allocated":462848,"data_stored":139565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673028,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":999424,"data_stored":729485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673027,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":1011712,"data_stored":727987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31616,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340224,"statfs":{"total":96636764160,"available":96604389376,"internally_reserved":0,"allocated":442368,"data_stored":140403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T23:30:15.965 DEBUG:teuthology.orchestra.run.smithi043:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f181aded640 1 Processor -- start 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f181aded640 1 -- start start 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f181aded640 1 --2- >> v2:172.21.15.43:3300/0 conn(0x7f181406e090 0x7f1814133f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f181aded640 1 -- --> v1:172.21.15.43:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181406bd50 con 0x7f181412ed90 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f181aded640 1 -- --> v2:172.21.15.43:3300/0 -- mon_getmap magic: 0 -- 0x7f181406eab0 con 0x7f181406e090 2024-09-13T23:30:16.093 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f1818b89640 1 --1- >> v1:172.21.15.43:6789/0 conn(0x7f181412ed90 0x7f181412f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.43:6789/0 says I am v1:172.21.15.43:53666/0 (socket says 172.21.15.43:53666) 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f1818b89640 1 -- 172.21.15.43:0/3493081662 learned_addr learned my addr 172.21.15.43:0/3493081662 (peer_addr_for_me v1:172.21.15.43:0/0) 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.090+0000 7f180bfff640 1 --2- 172.21.15.43:0/3493081662 >> v2:172.21.15.43:3300/0 conn(0x7f181406e090 0x7f1814133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.091+0000 7f180b7fe640 1 -- 172.21.15.43:0/3493081662 <== mon.0 v1:172.21.15.43:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082906103 0 0) 0x7f181406bd50 con 0x7f181412ed90 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.091+0000 7f180b7fe640 1 -- 172.21.15.43:0/3493081662 --> v1:172.21.15.43:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003520 con 0x7f181412ed90 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.091+0000 7f180bfff640 1 -- 172.21.15.43:0/3493081662 >> v1:172.21.15.43:6789/0 conn(0x7f181412ed90 legacy=0x7f181412f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:16.094 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.091+0000 7f180bfff640 1 -- 172.21.15.43:0/3493081662 --> v2:172.21.15.43:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181409c640 con 0x7f181406e090 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.091+0000 7f180bfff640 1 --2- 172.21.15.43:0/3493081662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f1814133f70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1804009720 tx=0x7f180402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6aa35b886e5cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f180b7fe640 1 -- 172.21.15.43:0/3493081662 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804037070 con 0x7f181406e090 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f180b7fe640 1 -- 172.21.15.43:0/3493081662 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f180402ad90 con 0x7f181406e090 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f180b7fe640 1 -- 172.21.15.43:0/3493081662 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1804032590 con 0x7f181406e090 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 -- 172.21.15.43:0/3493081662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 msgr2=0x7f1814133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 --2- 172.21.15.43:0/3493081662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f1814133f70 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f1804009720 tx=0x7f180402a110 comp rx=0 tx=0).stop 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 -- 172.21.15.43:0/3493081662 shutdown_connections 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 --2- 172.21.15.43:0/3493081662 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f1814133f70 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 -- 172.21.15.43:0/3493081662 >> 172.21.15.43:0/3493081662 conn(0x7f181409a890 msgr2=0x7f181409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 -- 172.21.15.43:0/3493081662 shutdown_connections 2024-09-13T23:30:16.097 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.092+0000 7f181aded640 1 -- 172.21.15.43:0/3493081662 wait complete. 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.093+0000 7f181aded640 1 Processor -- start 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.093+0000 7f181aded640 1 -- start start 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f181aded640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f181aded640 1 -- --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_getmap magic: 0 -- 0x7f18141344b0 con 0x7f181406e090 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f1818b89640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f1818b89640 1 --2- >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.43:3300/0 says I am v2:172.21.15.43:50130/0 (socket says 172.21.15.43:50130) 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f1818b89640 1 -- 172.21.15.43:0/1340522817 learned_addr learned my addr 172.21.15.43:0/1340522817 (peer_addr_for_me v2:172.21.15.43:0/0) 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f1818b89640 1 -- 172.21.15.43:0/1340522817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1814093fa0 con 0x7f181406e090 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f1818b89640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f181000c480 tx=0x7f181000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810017070 con 0x7f181406e090 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1810005c10 con 0x7f181406e090 2024-09-13T23:30:16.098 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1810007070 con 0x7f181406e090 2024-09-13T23:30:16.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.094+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1814094770 con 0x7f181406e090 2024-09-13T23:30:16.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.095+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181412e050 con 0x7f181406e090 2024-09-13T23:30:16.099 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.095+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 4 ==== mgrmap(e 5) ==== 45737+0+0 (secure 0 0 0) 0x7f181001a070 con 0x7f181406e090 2024-09-13T23:30:16.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.095+0000 7f18097fa640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 0x7f180003a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T23:30:16.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.095+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5967+0+0 (secure 0 0 0) 0x7f181004af30 con 0x7f181406e090 2024-09-13T23:30:16.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.096+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1814094f10 con 0x7f181406e090 2024-09-13T23:30:16.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.096+0000 7f180bfff640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 0x7f180003a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T23:30:16.100 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.096+0000 7f180bfff640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 0x7f180003a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1804034000 tx=0x7f180402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T23:30:16.102 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.100+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f181001a760 con 0x7f181406e090 2024-09-13T23:30:16.278 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.276+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 --> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1814093b00 con 0x7f181406e090 2024-09-13T23:30:16.280 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.278+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f181001a9c0 con 0x7f181406e090 2024-09-13T23:30:16.281 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.279+0000 7f18097fa640 1 -- 172.21.15.43:0/1340522817 <== mon.0 v2:172.21.15.43:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f181001b730 con 0x7f181406e090 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 msgr2=0x7f180003a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 0x7f180003a760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1804034000 tx=0x7f180402e000 comp rx=0 tx=0).stop 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 msgr2=0x7f181412db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f181000c480 tx=0x7f181000c940 comp rx=0 tx=0).stop 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 shutdown_connections 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.99:6824/1176945367,v1:172.21.15.99:6825/1176945367] conn(0x7f18000382a0 0x7f180003a760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 --2- 172.21.15.43:0/1340522817 >> [v2:172.21.15.43:3300/0,v1:172.21.15.43:6789/0] conn(0x7f181406e090 0x7f181412db10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.280+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 >> 172.21.15.43:0/1340522817 conn(0x7f181409a890 msgr2=0x7f181412ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T23:30:16.283 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.281+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 shutdown_connections 2024-09-13T23:30:16.284 INFO:teuthology.orchestra.run.smithi043.stderr:2024-09-13T23:30:16.281+0000 7f181aded640 1 -- 172.21.15.43:0/1340522817 wait complete. 2024-09-13T23:30:16.294 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T23:30:16.294 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T23:30:16.294 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T23:30:16.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.337 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T23:30:16.337 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T23:30:16.337 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.370 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T23:30:16.370 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T23:30:16.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.446 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T23:30:16.446 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T23:30:16.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.515 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T23:30:16.637 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T23:30:16.638 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T23:30:16.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.669 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T23:30:16.669 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T23:30:16.669 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T23:30:16.669 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T23:30:16.681 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T23:30:16.681 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T23:30:16.682 DEBUG:teuthology.orchestra.run.smithi043:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T23:30:16.753 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi043.front.sepia.ceph.com 2024-09-13T23:30:16.753 DEBUG:teuthology.orchestra.run.smithi043:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T23:30:16.938 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:30:16.938 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T23:30:17.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:30:17.211 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T23:30:17.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:30:17.285 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T23:30:17.342 INFO:tasks.ceph:Archiving mon data... 2024-09-13T23:30:17.343 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/data/mon.a.tgz 2024-09-13T23:30:17.343 DEBUG:teuthology.orchestra.run.smithi043:> mktemp 2024-09-13T23:30:17.363 INFO:teuthology.orchestra.run.smithi043.stdout:/tmp/tmp.Gsvw5aWQBK 2024-09-13T23:30:17.363 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Gsvw5aWQBK 2024-09-13T23:30:17.509 DEBUG:teuthology.orchestra.run.smithi043:> sudo chmod 0666 /tmp/tmp.Gsvw5aWQBK 2024-09-13T23:30:17.596 DEBUG:teuthology.orchestra.remote:smithi043:/tmp/tmp.Gsvw5aWQBK is 269KB 2024-09-13T23:30:17.691 DEBUG:teuthology.orchestra.run.smithi043:> rm -fr /tmp/tmp.Gsvw5aWQBK 2024-09-13T23:30:17.708 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T23:30:17.708 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T23:30:17.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T23:30:17.829 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T23:30:17.847 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T23:30:17.847 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T23:30:17.849 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi043/crash 2024-09-13T23:30:17.849 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T23:30:17.895 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi099/crash 2024-09-13T23:30:17.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T23:30:17.947 INFO:tasks.ceph:Compressing logs... 2024-09-13T23:30:17.947 DEBUG:teuthology.orchestra.run.smithi043:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:30:17.950 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31143.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30846.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31143.log: /var/log/ceph/ceph-client.admin.30846.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31143.log.gz 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29383.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30846.log.gz 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32145.log 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-09-13T23:30:18.004 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.29383.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27543.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.29383.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30442.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.tmp-client.admin.27543.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32145.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.27543.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29265.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30417.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.29265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30787.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30442.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.29265.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31375.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30417.log.gz 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31807.log 2024-09-13T23:30:18.005 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30787.log.gz 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31375.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31375.log.gz 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30679.log 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31807.log.gz 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr: 88.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T23:30:18.006 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31193.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30679.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30535.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30493.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30493.log: gzip -5 --verbose -- 86.2% /var/log/ceph/ceph-client.admin.31513.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30535.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30493.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32017.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31429.log 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31513.log.gz 2024-09-13T23:30:18.007 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30678.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31429.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32017.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31975.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31429.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32186.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30678.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31291.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32186.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31975.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32186.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31849.log 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31291.log.gz 2024-09-13T23:30:18.008 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30677.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31849.log.gz 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30304.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30677.log.gz 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31933.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30304.log: /var/log/ceph/ceph-client.admin.31014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30304.log.gz 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31123.log 2024-09-13T23:30:18.009 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.31933.log.gz -5 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr: --verbose -- /var/log/ceph/ceph.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31891.log: /var/log/ceph/ceph-client.admin.31123.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31123.log.gz 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30577.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31191.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29425.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31555.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30577.log.gz 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31191.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30847.log 2024-09-13T23:30:18.010 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31191.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:gzip/var/log/ceph/ceph-client.admin.29425.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30845.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30676.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.29425.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30845.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30847.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30361.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30845.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31013.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30676.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.30361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31597.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30361.log.gz 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31639.log 2024-09-13T23:30:18.011 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31013.log: /var/log/ceph/ceph-client.admin.31597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31013.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31597.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30955.log 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31639.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31015.log 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31471.log: /var/log/ceph/ceph-client.admin.30955.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32059.log 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30955.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.31015.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31015.log.gz 2024-09-13T23:30:18.012 INFO:teuthology.orchestra.run.smithi043.stderr:/var/log/ceph/ceph-client.admin.32059.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32059.log.gz 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31351.log 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92236.log 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80771.log 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31351.log: /var/log/ceph/ceph-client.0.92236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82586.log 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31351.log.gz 2024-09-13T23:30:18.053 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.80771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46891.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.82586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68066.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.46891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81981.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92236.log.gz 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.68066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81376.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80771.log.gz 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.81981.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.82586.log.gz 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96523.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.81376.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46891.log.gz 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35818.log 2024-09-13T23:30:18.054 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40841.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.96523.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68066.log.gz 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37822.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.35818.log.gz 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48706.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.40841.log: /var/log/ceph/ceph-client.0.37822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75931.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.48706.log: gzip -5 --verbose -- 91.6% -- replaced with /var/log/ceph/ceph-client.0.81376.log.gz 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.0.62621.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.75931.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81981.log.gz 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.40841.log.gz 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.62621.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T23:30:18.055 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37822.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48706.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-osd.1.log: --verbose -- /var/log/ceph/ceph-client.0.92841.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54756.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75931.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.96523.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.92841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94656.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62621.log.gz 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.54756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85006.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62016.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.94656.log: /var/log/ceph/ceph-client.0.85006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42051.log 2024-09-13T23:30:18.056 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.62016.log: gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.92841.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.0.53546.log 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85006.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.42051.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54756.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57781.log 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.53546.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.94656.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67461.log 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.57781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45076.log 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.62016.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.67461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46286.log 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42051.log.gz 2024-09-13T23:30:18.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.45076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94051.log 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53546.log.gz 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.46286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89816.log 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57781.log.gz 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45681.log 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.94051.log: 90.9% -- replaced with /var/log/ceph/ceph-client.0.67461.log.gz 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.89816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69881.log 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2%/var/log/ceph/ceph-client.0.45681.log: -- replaced with /var/log/ceph/ceph-client.0.45076.log.gz 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77141.log 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46286.log.gz 2024-09-13T23:30:18.058 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.69881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60806.log 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.77141.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94051.log.gz 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86204.log 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89816.log.gz 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.60806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58991.log 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45681.log.gz 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.86204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86803.log 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.58991.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77141.log.gz 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.86204.log.gz 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73511.log 2024-09-13T23:30:18.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.86803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57176.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.69881.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.60806.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.73511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72906.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.86803.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58991.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.57176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65646.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.72906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37217.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.65646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61411.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37217.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58386.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.73511.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.61411.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66856.log 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.57176.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.0.72906.log.gz 2024-09-13T23:30:18.060 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.58386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63226.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.66856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87402.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.65646.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.63226.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71091.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.37217.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61411.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.87402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51126.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.58386.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.71091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66251.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.87402.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.66856.log.gz 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.0.51126.log: -5 --verbose -- /var/log/ceph/ceph-client.0.39637.log 2024-09-13T23:30:18.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.66251.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63226.log.gz 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31391.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90421.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.39637.log: /var/log/ceph/ceph-client.admin.31391.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68671.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.71091.log.gz 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr: 84.6% 90.4% -- replaced with /var/log/ceph/ceph-client.0.39637.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31391.log.gz 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.90421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51126.log.gz 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.68671.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.66251.log.gz 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55966.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35698.log 2024-09-13T23:30:18.062 INFO:teuthology.orchestra.run.smithi099.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.55966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64436.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90421.log.gz 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.64436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65041.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38427.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.0.65041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83191.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% 92.6% -- replaced with /var/log/ceph/ceph-client.0.68671.log.gz 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.55966.log.gz/var/log/ceph/ceph-client.0.38427.log: 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36612.log 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5/var/log/ceph/ceph-client.0.83191.log: --verbose -- 91.1% -- replaced with /var/log/ceph/ceph-client.0.64436.log.gz 2024-09-13T23:30:18.063 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.0.40236.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.36612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44471.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.40236.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95866.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.65041.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.38427.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83191.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.44471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74721.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.95866.log: gzip 91.9% -- replaced with /var/log/ceph/ceph-client.0.36612.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.63831.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.74721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89211.log 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.40236.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.63831.log: gzip -5 91.0% -- replaced with /var/log/ceph/ceph-client.0.95866.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.44471.log.gz 2024-09-13T23:30:18.064 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.0.48101.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.89211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75326.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.48101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95261.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% 91.3% -- replaced with /var/log/ceph/ceph-client.0.63831.log.gz 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.74721.log.gz 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.75326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79561.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.95261.log: gzip -5 91.1% -- replaced with /var/log/ceph/ceph-client.0.89211.log.gz 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.79561.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48101.log.gz 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60201.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75326.log.gz 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49311.log 2024-09-13T23:30:18.065 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95261.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.0.60201.log: -5 --verbose -- /var/log/ceph/ceph-client.0.84401.log 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.49311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91026.log 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.84401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31431.log 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.79561.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.91026.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49311.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.60201.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35738.log 91.3% -- replaced with /var/log/ceph/ceph-client.0.84401.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50521.log 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.31431.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51731.log 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.35738.log.gz 2024-09-13T23:30:18.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.50521.log: gzip -5 --verbose 91.2% -- /var/log/ceph/ceph-client.0.78956.log -- replaced with /var/log/ceph/ceph-client.0.91026.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.51731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41446.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.78956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43866.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.41446.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72301.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.50521.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.51731.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.43866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91631.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78956.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.0.72301.log: -5 --verbose -- /var/log/ceph/ceph-client.0.49916.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.91631.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80166.log 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.41446.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.49916.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43866.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.91631.log.gz 2024-09-13T23:30:18.067 INFO:teuthology.orchestra.run.smithi099.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.72301.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.49916.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55361.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.80166.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88606.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.55361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71696.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.88606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54151.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80166.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.71696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88001.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55361.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.54151.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88606.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70486.log 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.88001.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71696.log.gz 2024-09-13T23:30:18.068 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83796.log 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54151.log.gz 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.70486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77746.log 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.88001.log.gz 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.83796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85605.log 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.77746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59596.log 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3%/var/log/ceph/ceph-client.0.85605.log: -- replaced with /var/log/ceph/ceph-client.0.70486.log.gz 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77746.log.gz 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85605.log.gz 2024-09-13T23:30:18.069 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78351.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr: 91.5%/var/log/ceph/ceph-client.0.59596.log: -- replaced with /var/log/ceph/ceph-client.0.83796.log.gz 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.78351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74116.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42656.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.74116.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.59596.log.gz 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78351.log.gz 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52336.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.42656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31471.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.52336.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74116.log.gz 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76536.log 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.42656.log.gz 2024-09-13T23:30:18.070 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39032.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.52336.log.gz 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31471.log: /var/log/ceph/ceph-client.0.76536.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31471.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.52941.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.39032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43261.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.52941.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76536.log.gz 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47496.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.43261.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39032.log.gz 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93446.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.52941.log.gz 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.47496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69276.log 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.43261.log.gz 2024-09-13T23:30:18.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.93446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56571.log 2024-09-13T23:30:18.072 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.69276.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47496.log.gz 2024-09-13T23:30:18.072 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.56571.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93446.log.gz 2024-09-13T23:30:18.072 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56571.log.gz 2024-09-13T23:30:18.072 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69276.log.gz 2024-09-13T23:30:18.072 INFO:teuthology.orchestra.run.smithi099.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T23:30:18.073 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T23:30:18.164 INFO:teuthology.orchestra.run.smithi043.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T23:30:18.827 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T23:30:18.905 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T23:30:18.905 INFO:teuthology.orchestra.run.smithi043.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T23:30:18.907 INFO:teuthology.orchestra.run.smithi043.stderr: 2024-09-13T23:30:18.907 INFO:teuthology.orchestra.run.smithi043.stderr:real 0m0.945s 2024-09-13T23:30:18.907 INFO:teuthology.orchestra.run.smithi043.stderr:user 0m1.115s 2024-09-13T23:30:18.908 INFO:teuthology.orchestra.run.smithi043.stderr:sys 0m0.071s 2024-09-13T23:30:18.964 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T23:30:18.966 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-13T23:30:18.966 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m1.000s 2024-09-13T23:30:18.966 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m2.863s 2024-09-13T23:30:18.966 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.183s 2024-09-13T23:30:18.966 INFO:tasks.ceph:Archiving logs... 2024-09-13T23:30:18.966 DEBUG:teuthology.misc:Transferring archived files from smithi043:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi043/log 2024-09-13T23:30:18.967 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:30:19.198 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi099/log 2024-09-13T23:30:19.199 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T23:30:19.732 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T23:30:19.742 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T23:30:19.742 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:30:19.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T23:30:19.836 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T23:30:19.845 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T23:30:19.845 DEBUG:teuthology.orchestra.run.smithi043:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:30:19.848 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T23:30:19.863 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:30:19.863 INFO:teuthology.orchestra.run.smithi043.stderr:bash: line 1: ntpq: command not found 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +69us[ +96us] +/- 49ms 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -85us[ -85us] +/- 75ms 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +58us[ +85us] +/- 81ms 2024-09-13T23:30:19.868 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:=============================================================================== 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +58us[ +67us] +/- 49ms 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 38 -87us[ -87us] +/- 75ms 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +53us[ +63us] +/- 81ms 2024-09-13T23:30:19.869 INFO:teuthology.orchestra.run.smithi043.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T23:30:19.870 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T23:30:19.879 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T23:30:19.879 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T23:30:19.918 DEBUG:teuthology.orchestra.run.smithi043:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:30:19.989 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T23:30:20.049 DEBUG:teuthology.orchestra.run.smithi043:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:30:20.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:30:20.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T23:30:20.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:30:20.107 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T23:30:20.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T23:30:20.142 INFO:teuthology.task.internal:Duration was 727.003987 seconds 2024-09-13T23:30:20.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T23:30:20.176 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T23:30:20.177 DEBUG:teuthology.orchestra.run.smithi043:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:30:20.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T23:30:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:30:20.222 INFO:teuthology.orchestra.run.smithi043.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T23:30:20.417 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T23:30:20.418 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi043.front.sepia.ceph.com 2024-09-13T23:30:20.418 DEBUG:teuthology.orchestra.run.smithi043:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:30:20.441 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-13T23:30:20.441 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T23:30:20.462 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T23:30:20.463 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:30:20.483 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T23:30:20.528 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T23:30:20.529 DEBUG:teuthology.orchestra.run.smithi043:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:30:20.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T23:30:20.666 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T23:30:20.676 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T23:30:20.676 DEBUG:teuthology.orchestra.run.smithi043:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:30:20.701 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T23:30:20.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T23:30:20.735 DEBUG:teuthology.orchestra.run.smithi043:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:30:20.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:30:20.766 INFO:teuthology.orchestra.run.smithi043.stdout:kernel.core_pattern = core 2024-09-13T23:30:20.789 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-13T23:30:20.808 DEBUG:teuthology.orchestra.run.smithi043:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:30:20.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:30:20.863 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T23:30:20.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T23:30:20.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T23:30:20.888 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T23:30:20.889 DEBUG:teuthology.misc:Transferring archived files from smithi043:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi043 2024-09-13T23:30:20.889 DEBUG:teuthology.orchestra.run.smithi043:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:30:20.939 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_21:40:02-rgw-squid-distro-default-smithi/7904423/remote/smithi099 2024-09-13T23:30:20.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T23:30:20.972 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T23:30:20.972 DEBUG:teuthology.orchestra.run.smithi043:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:30:20.976 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T23:30:21.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T23:30:21.033 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T23:30:21.033 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T23:30:21.065 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T23:30:21.065 DEBUG:teuthology.orchestra.run.smithi043:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:30:21.067 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T23:30:21.081 INFO:teuthology.orchestra.run.smithi043.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:30 /home/ubuntu/cephtest 2024-09-13T23:30:21.082 INFO:teuthology.orchestra.run.smithi099.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 23:30 /home/ubuntu/cephtest 2024-09-13T23:30:21.083 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T23:30:21.093 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T23:30:21.165 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{centos_latest}} duration: 727.0039865970612 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-13T23:30:21.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T23:30:21.257 INFO:teuthology.run:pass